2024-09-20T18:45:19.475 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T18:45:19.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T18:45:19.596 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735 branch: wip-guits-main-2024-09-20-1028 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7912735' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-20-1028 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-20-1028 sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9945 sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-20-1028 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIM3WeGEmzeXfHXLtwCYNizlOzIIzLVB+7DvtaQRw3RXmlQE8fyrvD10wAnz+IBxZoqwYflQUpz82nGWeaVcls= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKLr1Vz2WTi7JIz+31IidqPygqJGsDlWJD1faptxPN7oPFcF7D8yJkn996mZzd2l2UNDFmdHLgjUEv8nNWRcPk= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_12:24:58 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-20T18:45:19.597 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa; will attempt to use it 2024-09-20T18:45:19.597 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks 2024-09-20T18:45:19.597 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T18:45:19.599 INFO:teuthology.task.internal:Checking packages... 2024-09-20T18:45:19.618 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '88deadb8082f4a33832e228ccefc59cedba158a5' 2024-09-20T18:45:19.618 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:45:19.618 INFO:teuthology.packaging:ref: None 2024-09-20T18:45:19.618 INFO:teuthology.packaging:tag: None 2024-09-20T18:45:19.618 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-20-1028 2024-09-20T18:45:19.618 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:45:19.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-20-1028 2024-09-20T18:45:19.760 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5099.g88deadb8 2024-09-20T18:45:19.761 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T18:45:19.767 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T18:45:19.767 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T18:45:19.803 INFO:teuthology.task.internal:Saving configuration 2024-09-20T18:45:19.821 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T18:45:19.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T18:45:19.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 18:39:21.554075', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIM3WeGEmzeXfHXLtwCYNizlOzIIzLVB+7DvtaQRw3RXmlQE8fyrvD10wAnz+IBxZoqwYflQUpz82nGWeaVcls='} 2024-09-20T18:45:19.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 18:39:21.555522', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKLr1Vz2WTi7JIz+31IidqPygqJGsDlWJD1faptxPN7oPFcF7D8yJkn996mZzd2l2UNDFmdHLgjUEv8nNWRcPk='} 2024-09-20T18:45:19.889 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T18:45:19.895 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-20T18:45:19.895 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-20T18:45:19.895 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T18:45:19.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e075b0280>, signals=[15]) 2024-09-20T18:45:19.964 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T18:45:19.970 INFO:teuthology.task.internal:Opening connections... 2024-09-20T18:45:19.970 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T18:45:19.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:45:20.065 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-20T18:45:20.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:45:20.141 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T18:45:20.150 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-09-20T18:45:20.169 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-09-20T18:45:20.169 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-09-20T18:45:20.227 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-09-20T18:45:20.227 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T18:45:20.228 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T18:45:20.229 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-09-20T18:45:20.278 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-20T18:45:20.297 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-20T18:45:20.297 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-20T18:45:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T18:45:20.355 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T18:45:20.355 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-20T18:45:20.375 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T18:45:20.384 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T18:45:20.389 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T18:45:20.389 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-09-20T18:45:20.391 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-20T18:45:20.411 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T18:45:20.416 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T18:45:20.416 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-09-20T18:45:20.450 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-20T18:45:20.551 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T18:45:20.608 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T18:45:20.622 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T18:45:20.622 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T18:45:20.622 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T18:45:20.623 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T18:45:20.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:45:20.640 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-20T18:45:20.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:45:20.641 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-20T18:45:20.699 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-20T18:45:20.699 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-20T18:45:20.699 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-20T18:45:20.701 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-503.el9.x86_64 2024-09-20T18:45:20.701 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.14.0-503.el9.x86_64 2024-09-20T18:45:20.701 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2024-09-20T18:45:23.290 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.3 MB 00:00 2024-09-20T18:45:23.985 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.3 MB 00:01 2024-09-20T18:45:30.840 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 20 MB 00:06 2024-09-20T18:45:32.802 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-20T18:45:36.416 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-20T18:45:38.303 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-20T18:45:39.829 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-20T18:45:40.924 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-20T18:45:42.963 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 3.6 kB/s | 19 kB 00:05 2024-09-20T18:45:44.282 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-20T18:45:46.514 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-20T18:45:48.421 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T18:45:48.421 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T18:45:48.499 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:45:48.510 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:45:48.510 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:45:48.511 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:45:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-20T18:45:48.512 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:45:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-20T18:45:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-20T18:45:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:45:48.766 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 272 kB/s | 36 kB 00:00 2024-09-20T18:45:49.716 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-09-20T18:45:49.912 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-20T18:45:50.092 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Sep 2024 06:45:49 PM UTC. 2024-09-20T18:45:51.516 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-20T18:45:51.894 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T18:45:51.894 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T18:45:51.981 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T18:45:51.987 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout:Install 4 Packages 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 79 M 2024-09-20T18:45:51.988 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 126 M 2024-09-20T18:45:51.989 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:45:52.255 INFO:teuthology.orchestra.run.smithi027.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 290 kB/s | 36 kB 00:00 2024-09-20T18:45:52.274 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-20T18:45:52.275 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:45:52.275 INFO:teuthology.orchestra.run.smithi098.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-20T18:45:52.958 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:45:53.303 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:45:53.303 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:45:53.364 INFO:teuthology.orchestra.run.smithi027.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-20T18:45:53.639 INFO:teuthology.orchestra.run.smithi027.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-20T18:45:54.090 INFO:teuthology.orchestra.run.smithi027.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-09-20T18:45:54.090 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:45:54.090 INFO:teuthology.orchestra.run.smithi027.stdout:Total 37 MB/s | 79 MB 00:02 2024-09-20T18:45:54.274 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:45:54.274 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:45:54.802 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:45:55.214 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:45:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:45:56.216 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:45:56.216 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:45:56.707 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:45:57.400 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:45:57.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:45:58.797 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:45:59.470 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:45:59.609 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:46:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:46:00.372 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:02.493 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:46:02.619 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:05.290 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:07.840 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:07.886 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:10.115 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:13.122 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:48.366 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:48.404 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:48.785 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:48.785 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:46:48.785 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:46:48.785 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:46:49.634 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:46:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T18:46:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T18:46:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T18:46:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:46:49.635 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:46:50.005 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:46:50.087 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:50.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:46:50.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T18:46:50.088 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T18:46:50.088 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T18:46:50.088 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-20T18:46:50.088 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T18:46:50.088 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:46:50.146 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:50.146 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:46:50.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-20T18:46:50.188 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-20T18:46:50.188 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-20T18:46:50.189 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:46:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T18:46:50.191 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T18:46:50.191 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-508.el9.x86_64 2024-09-20T18:46:50.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T18:46:50.753 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-20T18:46:52.043 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T18:46:52.071 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-20T18:46:52.074 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-20T18:46:52.109 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.WFndAerSG1 2024-09-20T18:46:52.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WFndAerSG1 2024-09-20T18:46:52.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.WFndAerSG1 2024-09-20T18:46:52.327 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.WFndAerSG1 is 6KB 2024-09-20T18:46:52.346 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.WFndAerSG1 2024-09-20T18:46:52.361 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T18:46:52.424 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T18:46:52.424 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T18:46:52.424 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T18:46:52.424 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T18:46:52.426 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T18:46:52.577 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-20T18:46:53.197 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:53.239 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:53.595 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:53.595 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:46:53.595 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:46:53.596 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:46:54.484 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:46:54.485 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:46:54.873 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:46:54.952 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:54.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:46:54.953 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T18:46:54.953 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T18:46:54.953 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T18:46:54.953 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-20T18:46:54.953 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T18:46:54.953 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:46:55.014 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:46:55.014 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:46:55.014 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -qi grub2-tools 2024-09-20T18:46:55.046 INFO:teuthology.orchestra.run.smithi027.stdout:Name : grub2-tools 2024-09-20T18:46:55.046 INFO:teuthology.orchestra.run.smithi027.stdout:Epoch : 1 2024-09-20T18:46:55.046 INFO:teuthology.orchestra.run.smithi027.stdout:Version : 2.06 2024-09-20T18:46:55.046 INFO:teuthology.orchestra.run.smithi027.stdout:Release : 82.el9 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: x86_64 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Group : Unspecified 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Size : 8274670 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:License : GPLv3+ 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Packager : builder@centos.org 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Vendor : CentOS 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T18:46:55.047 INFO:teuthology.orchestra.run.smithi027.stdout:Summary : Support tools for GRUB. 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:Description : 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:hardware devices. 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:46:55.048 INFO:teuthology.orchestra.run.smithi027.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T18:46:55.049 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T18:46:55.049 INFO:teuthology.task.kernel:Updating grub on smithi027 to boot 5.14.0-508.el9.x86_64 2024-09-20T18:46:55.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T18:46:55.755 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-09-20T18:46:57.076 INFO:teuthology.orchestra.run.smithi027.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T18:46:57.113 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-09-20T18:46:57.115 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-09-20T18:46:57.131 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.yqH4ZOgEH2 2024-09-20T18:46:57.131 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yqH4ZOgEH2 2024-09-20T18:46:57.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.yqH4ZOgEH2 2024-09-20T18:46:57.343 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.yqH4ZOgEH2 is 6KB 2024-09-20T18:46:57.391 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.yqH4ZOgEH2 2024-09-20T18:46:57.406 DEBUG:teuthology.orchestra.run.smithi027:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T18:46:57.469 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T18:46:57.469 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T18:46:57.469 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T18:46:57.469 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T18:46:57.471 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T18:46:57.621 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2024-09-20T18:47:22.603 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-20T18:47:22.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:47:22.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:47:27.630 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-20T18:47:27.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:47:27.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:47:41.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-20T18:47:46.159 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-20T18:47:50.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:47:50.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:47:53.103 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-20T18:47:55.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:47:55.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:47:58.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-20T18:48:05.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:48:05.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:48:10.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:48:10.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:48:13.295 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-20T18:48:28.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:48:28.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:48:31.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-20T18:48:37.010 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-20T18:48:37.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:48:37.427 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-20T18:48:37.427 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-20T18:48:37.442 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-508.el9.x86_64 2024-09-20T18:48:37.442 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T18:48:37.443 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T18:48:37.443 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T18:48:38.444 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-20T18:48:38.444 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T18:48:38.528 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-20T18:48:38.569 DEBUG:teuthology.parallel:result is None 2024-09-20T18:48:49.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:48:49.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:49:07.823 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-20T18:49:28.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:49:28.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:49:29.219 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-20T18:49:29.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:49:29.570 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-20T18:49:29.570 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-20T18:49:29.587 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-508.el9.x86_64 2024-09-20T18:49:29.587 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T18:49:29.587 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T18:49:29.587 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T18:49:30.588 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-20T18:49:30.589 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T18:49:30.656 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2024-09-20T18:49:30.677 DEBUG:teuthology.parallel:result is None 2024-09-20T18:49:30.677 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T18:49:30.686 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T18:49:30.686 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T18:49:30.689 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T18:49:30.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T18:49:30.725 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T18:49:30.803 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T18:49:30.803 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T18:49:30.806 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T18:49:30.838 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T18:49:30.861 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T18:49:30.861 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T18:49:30.877 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T18:49:30.910 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:49:30.915 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:49:30.922 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:49:30.926 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:49:30.928 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T18:49:30.938 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T18:49:30.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T18:49:30.966 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T18:49:30.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T18:49:31.009 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T18:49:31.009 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T18:49:31.038 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T18:49:31.054 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:49:31.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:49:31.191 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:49:31.273 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:49:31.317 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:49:31.317 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T18:49:31.384 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:49:31.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:49:31.481 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:49:31.565 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:49:31.609 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:49:31.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T18:49:31.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-09-20T18:49:31.678 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-20T18:49:31.729 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T18:49:31.762 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T18:49:32.275 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T18:49:32.283 INFO:teuthology.task.internal:Starting timer... 2024-09-20T18:49:32.283 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T18:49:32.343 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T18:49:32.382 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-20T18:49:32.383 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2024-09-20T18:49:32.432 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2024-09-20T18:49:32.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-20T18:49:32.497 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-20T18:49:32.499 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T18:49:32.499 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2024-09-20T18:49:32.524 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2024-09-20T18:49:32.525 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-20T18:49:32.575 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-20T18:49:32.576 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2024-09-20T18:49:32.576 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T18:49:32.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:49:32.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T18:49:32.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:49:32.636 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T18:49:32.636 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2024-09-20T18:49:32.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-20T18:49:32.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T18:49:32.728 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-20T18:49:32.731 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-20T18:49:32.843 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T18:49:32.853 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T18:49:32.854 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T18:53:19.052 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-09-20T18:53:19.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:53:19.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:53:19.134 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-20T18:53:19.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-20T18:53:19.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:53:19.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:53:19.294 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-20T18:53:19.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-20T18:53:19.374 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T18:53:19.385 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T18:53:19.385 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T18:53:19.385 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T18:53:19.388 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T18:53:19.388 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T18:53:19.417 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T18:53:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T18:53:19.442 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T18:53:19.458 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T18:53:19.458 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2024-09-20T18:53:19.470 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2024-09-20T18:53:19.481 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-20T18:53:19.485 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T18:53:19.492 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-20T18:53:19.500 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T18:53:19.506 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T18:53:19.520 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T18:53:19.566 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-20T18:53:19.569 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T18:53:19.569 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-20T18:53:19.570 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.570 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.570 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.570 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.578 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:53:19.582 INFO:teuthology.run_tasks:Running task install... 2024-09-20T18:53:19.591 DEBUG:teuthology.task.install:project ceph 2024-09-20T18:53:19.591 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'}} 2024-09-20T18:53:19.591 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'} 2024-09-20T18:53:19.591 INFO:teuthology.task.install:Using flavor: default 2024-09-20T18:53:19.597 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-20T18:53:19.597 INFO:teuthology.task.install:extra packages: [] 2024-09-20T18:53:19.597 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'tag': None, 'wait_for_package': False} 2024-09-20T18:53:19.598 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:53:19.598 INFO:teuthology.packaging:ref: None 2024-09-20T18:53:19.598 INFO:teuthology.packaging:tag: None 2024-09-20T18:53:19.598 INFO:teuthology.packaging:branch: squid 2024-09-20T18:53:19.598 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:53:19.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:53:19.599 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'tag': None, 'wait_for_package': False} 2024-09-20T18:53:19.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:53:19.600 INFO:teuthology.packaging:ref: None 2024-09-20T18:53:19.600 INFO:teuthology.packaging:tag: None 2024-09-20T18:53:19.600 INFO:teuthology.packaging:branch: squid 2024-09-20T18:53:19.600 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:53:19.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:53:19.814 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/ 2024-09-20T18:53:19.814 INFO:teuthology.task.install.rpm:Package version is 19.1.1-369.ged8ee0f2 2024-09-20T18:53:19.839 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/ 2024-09-20T18:53:19.839 INFO:teuthology.task.install.rpm:Package version is 19.1.1-369.ged8ee0f2 2024-09-20T18:53:19.931 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-20T18:53:19.931 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:53:19.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-20T18:53:19.952 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-20T18:53:19.952 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:53:19.952 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-20T18:53:19.958 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-20T18:53:19.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:53:19.958 INFO:teuthology.packaging:ref: None 2024-09-20T18:53:19.958 INFO:teuthology.packaging:tag: None 2024-09-20T18:53:19.958 INFO:teuthology.packaging:branch: squid 2024-09-20T18:53:19.958 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:53:19.958 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-20T18:53:19.980 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-20T18:53:19.980 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:53:19.980 INFO:teuthology.packaging:ref: None 2024-09-20T18:53:19.980 INFO:teuthology.packaging:tag: None 2024-09-20T18:53:19.980 INFO:teuthology.packaging:branch: squid 2024-09-20T18:53:19.980 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:53:19.981 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-20T18:53:20.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-20T18:53:20.048 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-20T18:53:20.099 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-20T18:53:20.125 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-20T18:53:20.163 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-20T18:53:20.165 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-20T18:53:20.189 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2024-09-20T18:53:20.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2024-09-20T18:53:20.407 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-20T18:53:20.430 INFO:teuthology.orchestra.run.smithi027.stdout:45 files removed 2024-09-20T18:53:20.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2024-09-20T18:53:20.458 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw 2024-09-20T18:53:20.992 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-20T18:53:21.031 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-20T18:53:21.284 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-20T18:53:21.307 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-20T18:53:21.559 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-20T18:53:21.574 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-20T18:53:22.041 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-20T18:53:22.627 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.3 MB 00:01 2024-09-20T18:53:24.353 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-20T18:53:24.709 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-20T18:53:28.854 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-20T18:53:30.385 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-20T18:53:30.673 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-20T18:53:31.502 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-20T18:53:32.171 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-20T18:53:32.974 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-20T18:53:36.932 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-20T18:53:38.621 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-20T18:53:39.184 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 11 M 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.4 M 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.2 M 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:53:39.191 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.4 M 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 21 M 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 25 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 751 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-20T18:53:39.192 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 506 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.3 M 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 45 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 136 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 162 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 320 k 2024-09-20T18:53:39.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 301 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 99 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout:Install 30 Packages 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2024-09-20T18:53:39.194 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:53:39.195 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 60 M 2024-09-20T18:53:39.195 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:53:39.984 INFO:teuthology.orchestra.run.smithi098.stdout:(1/32): ceph-base-19.1.1-369.ged8ee0f2.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-20T18:53:40.059 INFO:teuthology.orchestra.run.smithi098.stdout:(2/32): ceph-selinux-19.1.1-369.ged8ee0f2.el9.x 336 kB/s | 25 kB 00:00 2024-09-20T18:53:40.159 INFO:teuthology.orchestra.run.smithi098.stdout:(3/32): libcephfs2-19.1.1-369.ged8ee0f2.el9.x86 7.4 MB/s | 751 kB 00:00 2024-09-20T18:53:40.268 INFO:teuthology.orchestra.run.smithi098.stdout:(4/32): libradosstriper1-19.1.1-369.ged8ee0f2.e 4.6 MB/s | 506 kB 00:00 2024-09-20T18:53:40.410 INFO:teuthology.orchestra.run.smithi098.stdout:(5/32): ceph-radosgw-19.1.1-369.ged8ee0f2.el9.x 11 MB/s | 11 MB 00:00 2024-09-20T18:53:40.619 INFO:teuthology.orchestra.run.smithi098.stdout:(6/32): ceph-common-19.1.1-369.ged8ee0f2.el9.x8 18 MB/s | 21 MB 00:01 2024-09-20T18:53:40.644 INFO:teuthology.orchestra.run.smithi098.stdout:(7/32): python3-ceph-argparse-19.1.1-369.ged8ee 193 kB/s | 45 kB 00:00 2024-09-20T18:53:40.678 INFO:teuthology.orchestra.run.smithi098.stdout:(8/32): python3-ceph-common-19.1.1-369.ged8ee0f 2.3 MB/s | 136 kB 00:00 2024-09-20T18:53:40.703 INFO:teuthology.orchestra.run.smithi098.stdout:(9/32): python3-cephfs-19.1.1-369.ged8ee0f2.el9 2.7 MB/s | 162 kB 00:00 2024-09-20T18:53:40.728 INFO:teuthology.orchestra.run.smithi098.stdout:(10/32): python3-rados-19.1.1-369.ged8ee0f2.el9 6.2 MB/s | 320 kB 00:00 2024-09-20T18:53:40.753 INFO:teuthology.orchestra.run.smithi098.stdout:(11/32): python3-rbd-19.1.1-369.ged8ee0f2.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-20T18:53:40.779 INFO:teuthology.orchestra.run.smithi098.stdout:(12/32): python3-rgw-19.1.1-369.ged8ee0f2.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-20T18:53:40.854 INFO:teuthology.orchestra.run.smithi098.stdout:(13/32): librgw2-19.1.1-369.ged8ee0f2.el9.x86_6 9.1 MB/s | 5.3 MB 00:00 2024-09-20T18:53:40.951 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 11 M 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.4 M 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.2 M 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:53:40.971 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.4 M 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 21 M 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 25 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 751 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 506 k 2024-09-20T18:53:40.972 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.3 M 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 45 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 136 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 162 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 320 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 301 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 99 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-20T18:53:40.973 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:Installing weak dependencies: 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:Install 30 Packages 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 2 Packages 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:53:40.974 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 60 M 2024-09-20T18:53:40.975 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:53:41.446 INFO:teuthology.orchestra.run.smithi098.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-20T18:53:41.471 INFO:teuthology.orchestra.run.smithi098.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 149 kB/s | 107 kB 00:00 2024-09-20T18:53:41.538 INFO:teuthology.orchestra.run.smithi098.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2024-09-20T18:53:41.856 INFO:teuthology.orchestra.run.smithi027.stdout:(1/32): ceph-base-19.1.1-369.ged8ee0f2.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-20T18:53:41.915 INFO:teuthology.orchestra.run.smithi027.stdout:(2/32): ceph-selinux-19.1.1-369.ged8ee0f2.el9.x 432 kB/s | 25 kB 00:00 2024-09-20T18:53:42.007 INFO:teuthology.orchestra.run.smithi027.stdout:(3/32): libcephfs2-19.1.1-369.ged8ee0f2.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-20T18:53:42.099 INFO:teuthology.orchestra.run.smithi027.stdout:(4/32): libradosstriper1-19.1.1-369.ged8ee0f2.e 5.4 MB/s | 506 kB 00:00 2024-09-20T18:53:42.122 INFO:teuthology.orchestra.run.smithi098.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 72 kB/s | 42 kB 00:00 2024-09-20T18:53:42.264 INFO:teuthology.orchestra.run.smithi098.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-20T18:53:42.356 INFO:teuthology.orchestra.run.smithi098.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 730 kB/s | 662 kB 00:00 2024-09-20T18:53:42.432 INFO:teuthology.orchestra.run.smithi027.stdout:(5/32): ceph-radosgw-19.1.1-369.ged8ee0f2.el9.x 9.9 MB/s | 11 MB 00:01 2024-09-20T18:53:42.632 INFO:teuthology.orchestra.run.smithi027.stdout:(6/32): ceph-common-19.1.1-369.ged8ee0f2.el9.x8 17 MB/s | 21 MB 00:01 2024-09-20T18:53:42.658 INFO:teuthology.orchestra.run.smithi027.stdout:(7/32): python3-ceph-argparse-19.1.1-369.ged8ee 200 kB/s | 45 kB 00:00 2024-09-20T18:53:42.683 INFO:teuthology.orchestra.run.smithi027.stdout:(8/32): python3-ceph-common-19.1.1-369.ged8ee0f 2.7 MB/s | 136 kB 00:00 2024-09-20T18:53:42.708 INFO:teuthology.orchestra.run.smithi027.stdout:(9/32): python3-cephfs-19.1.1-369.ged8ee0f2.el9 3.2 MB/s | 162 kB 00:00 2024-09-20T18:53:42.733 INFO:teuthology.orchestra.run.smithi027.stdout:(10/32): python3-rados-19.1.1-369.ged8ee0f2.el9 6.3 MB/s | 320 kB 00:00 2024-09-20T18:53:42.759 INFO:teuthology.orchestra.run.smithi027.stdout:(11/32): python3-rbd-19.1.1-369.ged8ee0f2.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-20T18:53:42.834 INFO:teuthology.orchestra.run.smithi027.stdout:(12/32): librgw2-19.1.1-369.ged8ee0f2.el9.x86_6 7.3 MB/s | 5.3 MB 00:00 2024-09-20T18:53:42.848 INFO:teuthology.orchestra.run.smithi098.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 61 kB/s | 36 kB 00:00 2024-09-20T18:53:42.860 INFO:teuthology.orchestra.run.smithi027.stdout:(13/32): python3-rgw-19.1.1-369.ged8ee0f2.el9.x 791 kB/s | 99 kB 00:00 2024-09-20T18:53:42.898 INFO:teuthology.orchestra.run.smithi098.stdout:(21/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.1 MB/s | 308 kB 00:00 2024-09-20T18:53:42.932 INFO:teuthology.orchestra.run.smithi098.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 83 kB/s | 47 kB 00:00 2024-09-20T18:53:42.958 INFO:teuthology.orchestra.run.smithi098.stdout:(23/32): qatlib-24.02.0-1.el9.x86_64.rpm 265 kB/s | 221 kB 00:00 2024-09-20T18:53:43.007 INFO:teuthology.orchestra.run.smithi098.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 352 kB/s | 26 kB 00:00 2024-09-20T18:53:43.032 INFO:teuthology.orchestra.run.smithi098.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-09-20T18:53:43.051 INFO:teuthology.orchestra.run.smithi027.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 236 kB/s | 45 kB 00:00 2024-09-20T18:53:43.066 INFO:teuthology.orchestra.run.smithi098.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-20T18:53:43.086 INFO:teuthology.orchestra.run.smithi027.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-20T18:53:43.108 INFO:teuthology.orchestra.run.smithi098.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-20T18:53:43.142 INFO:teuthology.orchestra.run.smithi098.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-20T18:53:43.202 INFO:teuthology.orchestra.run.smithi027.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-20T18:53:43.208 INFO:teuthology.orchestra.run.smithi098.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-20T18:53:43.259 INFO:teuthology.orchestra.run.smithi098.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-20T18:53:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 508 kB/s | 42 kB 00:00 2024-09-20T18:53:43.402 INFO:teuthology.orchestra.run.smithi027.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 921 kB/s | 292 kB 00:00 2024-09-20T18:53:43.417 INFO:teuthology.orchestra.run.smithi098.stdout:(31/32): librados2-19.1.1-369.ged8ee0f2.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-20T18:53:43.478 INFO:teuthology.orchestra.run.smithi027.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 479 kB/s | 36 kB 00:00 2024-09-20T18:53:43.503 INFO:teuthology.orchestra.run.smithi027.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-09-20T18:53:43.534 INFO:teuthology.orchestra.run.smithi098.stdout:(32/32): librbd1-19.1.1-369.ged8ee0f2.el9.x86_6 9.7 MB/s | 3.2 MB 00:00 2024-09-20T18:53:43.536 INFO:teuthology.orchestra.run.smithi027.stdout:(21/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-20T18:53:43.541 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:53:43.541 INFO:teuthology.orchestra.run.smithi098.stdout:Total 14 MB/s | 60 MB 00:04 2024-09-20T18:53:43.562 INFO:teuthology.orchestra.run.smithi027.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-20T18:53:43.629 INFO:teuthology.orchestra.run.smithi027.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-20T18:53:43.651 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:53:43.654 INFO:teuthology.orchestra.run.smithi027.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-20T18:53:43.679 INFO:teuthology.orchestra.run.smithi027.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-20T18:53:43.687 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:53:43.687 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:53:43.704 INFO:teuthology.orchestra.run.smithi027.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-20T18:53:43.738 INFO:teuthology.orchestra.run.smithi027.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-20T18:53:43.797 INFO:teuthology.orchestra.run.smithi027.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-20T18:53:43.839 INFO:teuthology.orchestra.run.smithi027.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-20T18:53:43.922 INFO:teuthology.orchestra.run.smithi027.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-20T18:53:44.114 INFO:teuthology.orchestra.run.smithi027.stdout:(31/32): librados2-19.1.1-369.ged8ee0f2.el9.x86 11 MB/s | 3.4 MB 00:00 2024-09-20T18:53:44.181 INFO:teuthology.orchestra.run.smithi027.stdout:(32/32): librbd1-19.1.1-369.ged8ee0f2.el9.x86_6 9.2 MB/s | 3.2 MB 00:00 2024-09-20T18:53:44.186 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:53:44.187 INFO:teuthology.orchestra.run.smithi027.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-20T18:53:44.294 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:53:44.335 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:53:44.335 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:53:44.377 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:53:44.377 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:53:45.042 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:53:45.043 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:53:45.854 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:53:45.935 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-20T18:53:45.965 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-20T18:53:45.990 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-20T18:53:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:53:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:53:46.206 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:53:46.260 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:53:46.569 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:53:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-20T18:53:46.654 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-20T18:53:46.687 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-20T18:53:46.712 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-20T18:53:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:53:46.734 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:53:46.756 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:53:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:53:46.899 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 8/34 2024-09-20T18:53:46.930 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:53:46.944 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:53:46.983 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:53:47.007 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:53:47.044 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-20T18:53:47.096 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 11/34 2024-09-20T18:53:47.166 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:53:47.187 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:53:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:53:47.286 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-20T18:53:47.386 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-20T18:53:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-20T18:53:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-20T18:53:47.446 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:53:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-20T18:53:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-20T18:53:47.553 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-20T18:53:47.589 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-20T18:53:47.647 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 8/34 2024-09-20T18:53:47.673 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:53:47.728 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:53:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-20T18:53:47.801 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 11/34 2024-09-20T18:53:47.880 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:53:47.900 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-20T18:53:47.909 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:53:47.957 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:53:47.991 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-20T18:53:47.994 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:53:48.090 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:53:48.103 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-20T18:53:48.126 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 23/34 2024-09-20T18:53:48.133 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-20T18:53:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-20T18:53:48.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-20T18:53:48.232 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-20T18:53:48.261 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-20T18:53:48.294 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-20T18:53:48.621 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-20T18:53:48.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-20T18:53:48.664 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:53:48.680 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:53:48.751 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:53:48.765 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:53:48.795 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 23/34 2024-09-20T18:53:48.829 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 27/34 2024-09-20T18:53:48.839 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-20T18:53:48.857 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 28/34 2024-09-20T18:53:49.348 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-20T18:53:49.376 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:53:49.451 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:53:49.528 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 27/34 2024-09-20T18:53:49.562 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 28/34 2024-09-20T18:53:51.188 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:51.237 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:51.822 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:51.866 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:53:51.974 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:51.983 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:53:51.983 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-20T18:53:51.983 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-20T18:53:51.983 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:53:52.024 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:52.026 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:53:52.620 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:53:52.661 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:53:52.760 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:53:52.761 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-20T18:53:52.761 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-20T18:53:52.761 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:53:52.795 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-20T18:54:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:54:03.006 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:54:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-20T18:54:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:54:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:54:03.007 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:03.008 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:54:03.068 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:54:03.068 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /root 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2024-09-20T18:54:03.069 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:03.100 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:54:03.100 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:04.088 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:54:04.115 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:54:04.115 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:04.115 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-20T18:54:04.115 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:54:04.116 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:54:04.116 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:04.117 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:54:04.216 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:54:04.216 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:04.315 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/34 2024-09-20T18:54:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/34 2024-09-20T18:54:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/34 2024-09-20T18:54:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/34 2024-09-20T18:54:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 6/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 8/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 9/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 10/34 2024-09-20T18:54:04.317 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 11/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-20T18:54:04.318 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-20T18:54:04.319 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-20T18:54:04.320 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-20T18:54:04.321 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:54:04.321 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-20T18:54:04.321 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/34 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.297 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.298 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:05.299 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:05.300 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:05.414 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 6/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 8/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 9/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 10/34 2024-09-20T18:54:05.415 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 11/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-20T18:54:05.416 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-20T18:54:05.417 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/34 2024-09-20T18:54:05.617 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2024-09-20T18:54:06.196 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:30 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.283 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-20T18:54:06.284 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-20T18:54:06.285 INFO:teuthology.orchestra.run.smithi027.stdout: re2-1:20211101-20.el9.x86_64 2024-09-20T18:54:06.286 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-20T18:54:06.286 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:06.286 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:06.335 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 49 M 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 163 k 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:06.336 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 49 M 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 209 M 2024-09-20T18:54:06.337 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:06.606 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): libcephsqlite-19.1.1-369.ged8ee0f2.el9.x 735 kB/s | 163 kB 00:00 2024-09-20T18:54:06.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-test 2024-09-20T18:54:06.631 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-20T18:54:06.748 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 448 kB/s | 64 kB 00:00 2024-09-20T18:54:07.224 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:07.370 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:07.370 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:07.370 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 49 M 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 163 k 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout:Install 4 Packages 2024-09-20T18:54:07.371 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:07.372 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 49 M 2024-09-20T18:54:07.372 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 209 M 2024-09-20T18:54:07.372 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:07.847 INFO:teuthology.orchestra.run.smithi027.stdout:(1/4): libcephsqlite-19.1.1-369.ged8ee0f2.el9.x 750 kB/s | 163 kB 00:00 2024-09-20T18:54:07.940 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): ceph-test-19.1.1-369.ged8ee0f2.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-20T18:54:07.942 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:07.942 INFO:teuthology.orchestra.run.smithi098.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-20T18:54:07.970 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:07.990 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:07.990 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:08.381 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:08.381 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:08.464 INFO:teuthology.orchestra.run.smithi027.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-20T18:54:08.489 INFO:teuthology.orchestra.run.smithi027.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 353 kB/s | 304 kB 00:00 2024-09-20T18:54:08.914 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:08.987 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-20T18:54:09.039 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-20T18:54:09.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:54:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:(4/4): ceph-test-19.1.1-369.ged8ee0f2.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-20T18:54:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:Total 28 MB/s | 49 MB 00:01 2024-09-20T18:54:09.162 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:09.185 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:09.185 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:09.592 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:09.592 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:10.144 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:10.227 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-20T18:54:10.281 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-20T18:54:10.308 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:54:13.676 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:54:13.766 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:54:15.205 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:54:15.292 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:54:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:54:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/4 2024-09-20T18:54:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/4 2024-09-20T18:54:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:16.527 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:16.789 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2024-09-20T18:54:17.394 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:41 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:17.537 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:17.539 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:17.539 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:17.539 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 6.5 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 2.4 M 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 1.5 M 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 249 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 4.7 M 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 17 M 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-20T18:54:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-20T18:54:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-20T18:54:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout:Install 37 Packages 2024-09-20T18:54:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:17.544 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 30 M 2024-09-20T18:54:17.544 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 108 M 2024-09-20T18:54:17.544 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:54:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/4 2024-09-20T18:54:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/4 2024-09-20T18:54:17.662 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-20T18:54:17.997 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-20T18:54:17.997 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:17.997 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:17.997 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:17.998 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:17.998 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-20T18:54:17.998 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-20T18:54:17.998 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:17.998 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:18.096 INFO:teuthology.orchestra.run.smithi098.stdout:(1/37): ceph-19.1.1-369.ged8ee0f2.el9.x86_64.rp 48 kB/s | 6.5 kB 00:00 2024-09-20T18:54:18.263 INFO:teuthology.orchestra.run.smithi098.stdout:(2/37): ceph-mgr-19.1.1-369.ged8ee0f2.el9.x86_6 5.0 MB/s | 1.5 MB 00:00 2024-09-20T18:54:18.308 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph 2024-09-20T18:54:18.321 INFO:teuthology.orchestra.run.smithi098.stdout:(3/37): ceph-mds-19.1.1-369.ged8ee0f2.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-20T18:54:18.414 INFO:teuthology.orchestra.run.smithi098.stdout:(4/37): ceph-mgr-modules-core-19.1.1-369.ged8ee 2.7 MB/s | 249 kB 00:00 2024-09-20T18:54:18.506 INFO:teuthology.orchestra.run.smithi098.stdout:(5/37): ceph-mon-19.1.1-369.ged8ee0f2.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-20T18:54:18.589 INFO:teuthology.orchestra.run.smithi098.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-20T18:54:18.631 INFO:teuthology.orchestra.run.smithi098.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-20T18:54:18.673 INFO:teuthology.orchestra.run.smithi098.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-20T18:54:18.849 INFO:teuthology.orchestra.run.smithi098.stdout:(9/37): ceph-osd-19.1.1-369.ged8ee0f2.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-20T18:54:18.874 INFO:teuthology.orchestra.run.smithi098.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-20T18:54:18.907 INFO:teuthology.orchestra.run.smithi098.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-09-20T18:54:18.929 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:40 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:18.991 INFO:teuthology.orchestra.run.smithi098.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-20T18:54:19.074 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:19.076 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:19.076 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:19.076 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 6.5 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 2.4 M 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 1.5 M 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 249 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 4.7 M 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 17 M 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-20T18:54:19.077 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-20T18:54:19.078 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-20T18:54:19.079 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:Install 37 Packages 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 30 M 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 108 M 2024-09-20T18:54:19.080 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:19.550 INFO:teuthology.orchestra.run.smithi098.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 62 kB/s | 35 kB 00:00 2024-09-20T18:54:19.640 INFO:teuthology.orchestra.run.smithi027.stdout:(1/37): ceph-19.1.1-369.ged8ee0f2.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2024-09-20T18:54:19.642 INFO:teuthology.orchestra.run.smithi098.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 245 kB/s | 188 kB 00:00 2024-09-20T18:54:19.684 INFO:teuthology.orchestra.run.smithi098.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 222 kB/s | 172 kB 00:00 2024-09-20T18:54:19.790 INFO:teuthology.orchestra.run.smithi027.stdout:(2/37): ceph-mgr-19.1.1-369.ged8ee0f2.el9.x86_6 5.4 MB/s | 1.5 MB 00:00 2024-09-20T18:54:19.857 INFO:teuthology.orchestra.run.smithi027.stdout:(3/37): ceph-mds-19.1.1-369.ged8ee0f2.el9.x86_6 6.8 MB/s | 2.4 MB 00:00 2024-09-20T18:54:19.949 INFO:teuthology.orchestra.run.smithi027.stdout:(4/37): ceph-mgr-modules-core-19.1.1-369.ged8ee 2.7 MB/s | 249 kB 00:00 2024-09-20T18:54:20.016 INFO:teuthology.orchestra.run.smithi027.stdout:(5/37): ceph-mon-19.1.1-369.ged8ee0f2.el9.x86_6 13 MB/s | 4.7 MB 00:00 2024-09-20T18:54:20.191 INFO:teuthology.orchestra.run.smithi027.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-20T18:54:20.259 INFO:teuthology.orchestra.run.smithi098.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-20T18:54:20.285 INFO:teuthology.orchestra.run.smithi098.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 105 kB/s | 77 kB 00:00 2024-09-20T18:54:20.310 INFO:teuthology.orchestra.run.smithi098.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 76 kB/s | 51 kB 00:00 2024-09-20T18:54:20.352 INFO:teuthology.orchestra.run.smithi098.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-20T18:54:20.367 INFO:teuthology.orchestra.run.smithi027.stdout:(7/37): ceph-osd-19.1.1-369.ged8ee0f2.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-20T18:54:20.377 INFO:teuthology.orchestra.run.smithi098.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.3 MB/s | 172 kB 00:00 2024-09-20T18:54:20.400 INFO:teuthology.orchestra.run.smithi027.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 510 kB/s | 106 kB 00:00 2024-09-20T18:54:20.402 INFO:teuthology.orchestra.run.smithi098.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi098.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-20T18:54:20.453 INFO:teuthology.orchestra.run.smithi098.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-20T18:54:20.459 INFO:teuthology.orchestra.run.smithi027.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-20T18:54:20.478 INFO:teuthology.orchestra.run.smithi098.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-20T18:54:20.492 INFO:teuthology.orchestra.run.smithi027.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-20T18:54:20.503 INFO:teuthology.orchestra.run.smithi098.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi027.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-20T18:54:20.528 INFO:teuthology.orchestra.run.smithi098.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-20T18:54:20.543 INFO:teuthology.orchestra.run.smithi027.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 768 kB/s | 135 kB 00:00 2024-09-20T18:54:20.562 INFO:teuthology.orchestra.run.smithi098.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-09-20T18:54:20.587 INFO:teuthology.orchestra.run.smithi098.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 901 kB/s | 46 kB 00:00 2024-09-20T18:54:20.613 INFO:teuthology.orchestra.run.smithi098.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-20T18:54:20.638 INFO:teuthology.orchestra.run.smithi098.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 683 kB/s | 16 kB 00:00 2024-09-20T18:54:20.663 INFO:teuthology.orchestra.run.smithi098.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-20T18:54:20.688 INFO:teuthology.orchestra.run.smithi098.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-20T18:54:20.714 INFO:teuthology.orchestra.run.smithi098.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-20T18:54:20.739 INFO:teuthology.orchestra.run.smithi098.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-20T18:54:20.764 INFO:teuthology.orchestra.run.smithi098.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-20T18:54:20.798 INFO:teuthology.orchestra.run.smithi098.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-20T18:54:20.827 INFO:teuthology.orchestra.run.smithi027.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 123 kB/s | 35 kB 00:00 2024-09-20T18:54:20.856 INFO:teuthology.orchestra.run.smithi098.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-09-20T18:54:20.861 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:20.861 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.1 MB/s | 30 MB 00:03 2024-09-20T18:54:20.977 INFO:teuthology.orchestra.run.smithi027.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 375 kB/s | 172 kB 00:00 2024-09-20T18:54:21.012 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:21.052 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:21.052 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:21.069 INFO:teuthology.orchestra.run.smithi027.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 327 kB/s | 188 kB 00:00 2024-09-20T18:54:21.089 INFO:teuthology.orchestra.run.smithi027.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 454 kB/s | 51 kB 00:00 2024-09-20T18:54:21.114 INFO:teuthology.orchestra.run.smithi027.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 268 kB/s | 77 kB 00:00 2024-09-20T18:54:21.156 INFO:teuthology.orchestra.run.smithi027.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-20T18:54:21.173 INFO:teuthology.orchestra.run.smithi027.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 400 kB/s | 42 kB 00:00 2024-09-20T18:54:21.191 INFO:teuthology.orchestra.run.smithi027.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-09-20T18:54:21.232 INFO:teuthology.orchestra.run.smithi027.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-20T18:54:21.249 INFO:teuthology.orchestra.run.smithi027.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-20T18:54:21.283 INFO:teuthology.orchestra.run.smithi027.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 222 kB/s | 11 kB 00:00 2024-09-20T18:54:21.308 INFO:teuthology.orchestra.run.smithi027.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.0 MB/s | 23 kB 00:00 2024-09-20T18:54:21.334 INFO:teuthology.orchestra.run.smithi027.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-09-20T18:54:21.359 INFO:teuthology.orchestra.run.smithi027.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-20T18:54:21.384 INFO:teuthology.orchestra.run.smithi027.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-20T18:54:21.409 INFO:teuthology.orchestra.run.smithi027.stdout:(28/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 729 kB/s | 172 kB 00:00 2024-09-20T18:54:21.435 INFO:teuthology.orchestra.run.smithi027.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-09-20T18:54:21.460 INFO:teuthology.orchestra.run.smithi027.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-20T18:54:21.485 INFO:teuthology.orchestra.run.smithi027.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-20T18:54:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-20T18:54:21.532 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:21.532 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:21.536 INFO:teuthology.orchestra.run.smithi027.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-20T18:54:21.561 INFO:teuthology.orchestra.run.smithi027.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-20T18:54:21.594 INFO:teuthology.orchestra.run.smithi027.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-20T18:54:21.620 INFO:teuthology.orchestra.run.smithi027.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 341 kB/s | 20 kB 00:00 2024-09-20T18:54:21.645 INFO:teuthology.orchestra.run.smithi027.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-20T18:54:21.649 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:21.649 INFO:teuthology.orchestra.run.smithi027.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-20T18:54:21.807 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:21.852 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:21.852 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:22.323 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:22.324 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:22.915 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:22.993 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-20T18:54:23.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-20T18:54:23.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-20T18:54:23.127 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-20T18:54:23.170 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-20T18:54:23.206 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-20T18:54:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-20T18:54:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-20T18:54:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-20T18:54:23.465 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-20T18:54:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-20T18:54:23.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-20T18:54:23.576 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-20T18:54:23.634 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-20T18:54:23.669 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-20T18:54:23.703 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-20T18:54:23.720 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:23.752 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-20T18:54:23.781 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-20T18:54:23.784 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-20T18:54:23.814 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-20T18:54:23.851 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-20T18:54:23.857 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-20T18:54:23.927 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-20T18:54:23.975 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-20T18:54:23.997 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-20T18:54:24.008 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-20T18:54:24.092 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-20T18:54:24.129 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-20T18:54:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-20T18:54:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-20T18:54:24.214 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-20T18:54:24.241 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-20T18:54:24.261 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-20T18:54:24.297 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-20T18:54:24.304 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-20T18:54:24.333 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-20T18:54:24.368 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-20T18:54:24.404 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-20T18:54:24.443 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-20T18:54:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-20T18:54:24.485 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-20T18:54:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-20T18:54:24.529 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-20T18:54:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-20T18:54:24.607 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-20T18:54:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-20T18:54:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-20T18:54:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-20T18:54:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-20T18:54:24.862 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-20T18:54:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-20T18:54:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-20T18:54:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-20T18:54:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 32/37 2024-09-20T18:54:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-20T18:54:25.056 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:54:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-20T18:54:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-20T18:54:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-20T18:54:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-20T18:54:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-20T18:54:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-20T18:54:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-20T18:54:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-20T18:54:25.959 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 32/37 2024-09-20T18:54:25.989 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:54:26.018 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:54:26.559 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:54:26.559 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:26.560 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-20T18:54:26.560 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:54:26.560 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:54:26.560 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:27.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:54:27.031 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:27.258 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:54:27.282 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:54:27.549 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:54:27.577 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:54:27.578 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:27.578 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-20T18:54:27.578 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:54:27.578 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:54:27.578 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:28.058 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:54:28.083 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:28.317 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:54:28.342 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:28.408 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 6/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-20T18:54:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-20T18:54:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-20T18:54:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-20T18:54:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-20T18:54:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-20T18:54:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-20T18:54:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-20T18:54:30.226 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 6/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-20T18:54:30.227 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-20T18:54:30.228 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-20T18:54:30.229 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-20T18:54:30.379 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-20T18:54:30.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:30.379 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:30.379 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:30.380 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-20T18:54:30.381 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-20T18:54:30.382 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-20T18:54:30.383 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:30.384 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:30.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:31.198 INFO:teuthology.orchestra.run.smithi027.stdout: lua-5.4.4-4.el9.x86_64 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-20T18:54:31.199 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply-3.11-14.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-20T18:54:31.200 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-20T18:54:31.201 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:31.201 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:31.355 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:54:31.484 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:31.485 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:54:31.485 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:31.533 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-base 2024-09-20T18:54:31.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2024-09-20T18:54:32.126 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:56 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:32.142 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:32.235 INFO:teuthology.orchestra.run.smithi027.stdout:Package ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:54:32.257 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:32.258 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:32.258 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:32.258 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 765 k 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 765 k 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 771 k 2024-09-20T18:54:32.259 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:32.281 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:32.282 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:54:32.282 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:32.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install cephadm 2024-09-20T18:54:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-19.1.1-369.ged8ee0f2.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-20T18:54:32.517 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-20T18:54:32.518 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:32.523 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:32.523 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:32.529 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:32.529 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:32.608 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:32.950 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:33.049 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:33.087 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:33.087 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 765 k 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:54:33.088 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:33.089 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 765 k 2024-09-20T18:54:33.089 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 771 k 2024-09-20T18:54:33.089 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:33.360 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm-19.1.1-369.ged8ee0f2.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-20T18:54:33.361 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:33.361 INFO:teuthology.orchestra.run.smithi027.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-20T18:54:33.361 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:33.366 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:33.366 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:33.372 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:33.372 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:33.445 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:33.469 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:33.705 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:33.706 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:33.909 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:33.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2024-09-20T18:54:34.007 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:34.356 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:34.515 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:58 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:34.587 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:54:34.587 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:34.588 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:34.588 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:34.588 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:34.588 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:34.649 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:34.649 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:34.649 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-20T18:54:34.649 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 145 k 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:54:34.650 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:34.651 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 145 k 2024-09-20T18:54:34.651 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 436 k 2024-09-20T18:54:34.651 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:34.811 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-immutable-object-cache 2024-09-20T18:54:34.840 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-19.1.1-369.ged8ee0f 765 kB/s | 145 kB 00:00 2024-09-20T18:54:34.841 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:34.841 INFO:teuthology.orchestra.run.smithi098.stdout:Total 759 kB/s | 145 kB 00:00 2024-09-20T18:54:34.841 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:34.849 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:34.849 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:34.908 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:34.908 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:35.059 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:35.150 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:35.175 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:35.175 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:35.175 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-20T18:54:35.175 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:35.421 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:35.559 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:35.559 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 145 k 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:54:35.560 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 145 k 2024-09-20T18:54:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 436 k 2024-09-20T18:54:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:35.765 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-immutable-object-cache-19.1.1-369.ged8ee0f 710 kB/s | 145 kB 00:00 2024-09-20T18:54:35.766 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:35.766 INFO:teuthology.orchestra.run.smithi027.stdout:Total 705 kB/s | 145 kB 00:00 2024-09-20T18:54:35.766 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:35.775 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:35.775 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:35.835 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:35.836 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:35.992 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:36.058 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:36.081 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:36.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:36.082 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:36.082 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:36.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:36.082 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:36.084 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:36.084 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:54:36.084 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-20T18:54:36.085 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:36.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2024-09-20T18:54:36.924 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:36.995 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:37.012 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:54:37.054 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:37.055 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:54:37.055 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:37.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2024-09-20T18:54:37.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr 2024-09-20T18:54:37.679 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:01 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:37.809 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:37.810 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 3.6 M 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 32 k 2024-09-20T18:54:37.811 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 16 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-20T18:54:37.812 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:37.813 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 8.7 M 2024-09-20T18:54:37.813 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 105 M 2024-09-20T18:54:37.813 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:37.827 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:59 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:37.920 INFO:teuthology.orchestra.run.smithi027.stdout:Package ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:54:37.965 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:37.966 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:54:37.966 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:38.045 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-dashboard 2024-09-20T18:54:38.537 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): ceph-grafana-dashboards-19.1.1-369.ged8 201 kB/s | 32 kB 00:00 2024-09-20T18:54:38.563 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): ceph-prometheus-alerts-19.1.1-369.ged8e 90 kB/s | 16 kB 00:00 2024-09-20T18:54:38.645 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:38.783 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:38.784 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:38.784 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:38.784 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 3.6 M 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 32 k 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 16 k 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-20T18:54:38.785 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout:Install 12 Packages 2024-09-20T18:54:38.786 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:38.787 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 8.7 M 2024-09-20T18:54:38.787 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 105 M 2024-09-20T18:54:38.787 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:38.788 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): ceph-mgr-dashboard-19.1.1-369.ged8ee0f2 8.7 MB/s | 3.6 MB 00:00 2024-09-20T18:54:39.077 INFO:teuthology.orchestra.run.smithi027.stdout:(1/12): ceph-grafana-dashboards-19.1.1-369.ged8 200 kB/s | 32 kB 00:00 2024-09-20T18:54:39.103 INFO:teuthology.orchestra.run.smithi027.stdout:(2/12): ceph-prometheus-alerts-19.1.1-369.ged8e 89 kB/s | 16 kB 00:00 2024-09-20T18:54:39.196 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 425 kB/s | 269 kB 00:00 2024-09-20T18:54:39.219 INFO:teuthology.orchestra.run.smithi027.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-20T18:54:39.247 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-20T18:54:39.272 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-20T18:54:39.295 INFO:teuthology.orchestra.run.smithi027.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-20T18:54:39.347 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-20T18:54:39.353 INFO:teuthology.orchestra.run.smithi027.stdout:(5/12): ceph-mgr-dashboard-19.1.1-369.ged8ee0f2 8.2 MB/s | 3.6 MB 00:00 2024-09-20T18:54:39.372 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-20T18:54:39.398 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-20T18:54:39.403 INFO:teuthology.orchestra.run.smithi027.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-09-20T18:54:39.429 INFO:teuthology.orchestra.run.smithi027.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-09-20T18:54:39.431 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-20T18:54:39.463 INFO:teuthology.orchestra.run.smithi027.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-20T18:54:39.488 INFO:teuthology.orchestra.run.smithi027.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-20T18:54:39.530 INFO:teuthology.orchestra.run.smithi027.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-20T18:54:39.548 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-20T18:54:39.588 INFO:teuthology.orchestra.run.smithi027.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-20T18:54:39.790 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 862 kB/s | 863 kB 00:01 2024-09-20T18:54:39.795 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:39.795 INFO:teuthology.orchestra.run.smithi098.stdout:Total 4.4 MB/s | 8.7 MB 00:01 2024-09-20T18:54:39.847 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:39.866 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:39.866 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:40.068 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:40.068 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:40.139 INFO:teuthology.orchestra.run.smithi027.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 940 kB/s | 863 kB 00:00 2024-09-20T18:54:40.143 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:40.143 INFO:teuthology.orchestra.run.smithi027.stdout:Total 6.4 MB/s | 8.7 MB 00:01 2024-09-20T18:54:40.198 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:40.218 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:40.218 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:40.442 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:40.442 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:40.590 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:40.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-20T18:54:40.701 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-20T18:54:40.748 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-20T18:54:40.778 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-20T18:54:40.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-20T18:54:40.983 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:41.014 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-20T18:54:41.065 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-20T18:54:41.100 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-20T18:54:41.147 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-20T18:54:41.176 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-20T18:54:41.230 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-20T18:54:41.288 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-20T18:54:41.300 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-20T18:54:41.337 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:54:41.368 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 10/12 2024-09-20T18:54:41.426 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-20T18:54:41.517 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-20T18:54:41.574 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-20T18:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:54:41.642 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 10/12 2024-09-20T18:54:42.427 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 11/12 2024-09-20T18:54:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:54:42.762 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 11/12 2024-09-20T18:54:42.801 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 1/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 2/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 3/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-20T18:54:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-20T18:54:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-20T18:54:44.058 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-20T18:54:44.059 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-20T18:54:44.059 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:44.059 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:44.180 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 1/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 2/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 3/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-20T18:54:44.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-20T18:54:44.305 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-20T18:54:44.502 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-20T18:54:44.502 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-20T18:54:44.503 INFO:teuthology.orchestra.run.smithi027.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-20T18:54:44.504 INFO:teuthology.orchestra.run.smithi027.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-20T18:54:44.504 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-20T18:54:44.504 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-20T18:54:44.504 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:44.504 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:44.743 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-20T18:54:44.882 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:08 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 7.4 M 2024-09-20T18:54:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-20T18:54:45.017 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-20T18:54:45.018 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 38 M 2024-09-20T18:54:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 212 M 2024-09-20T18:54:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:45.351 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:07 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:45.489 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:45.490 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-20T18:54:45.490 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:45.490 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 7.4 M 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-20T18:54:45.491 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout:Install 12 Packages 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 38 M 2024-09-20T18:54:45.492 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 212 M 2024-09-20T18:54:45.493 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:45.573 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-20T18:54:45.715 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-20T18:54:45.741 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 196 kB/s | 33 kB 00:00 2024-09-20T18:54:45.883 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-36 16 MB/s | 7.4 MB 00:00 2024-09-20T18:54:45.896 INFO:teuthology.orchestra.run.smithi027.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-20T18:54:45.908 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 109 kB/s | 18 kB 00:00 2024-09-20T18:54:45.947 INFO:teuthology.orchestra.run.smithi027.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-20T18:54:45.997 INFO:teuthology.orchestra.run.smithi027.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-20T18:54:46.058 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 220 kB/s | 38 kB 00:00 2024-09-20T18:54:46.080 INFO:teuthology.orchestra.run.smithi027.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 218 kB/s | 18 kB 00:00 2024-09-20T18:54:46.172 INFO:teuthology.orchestra.run.smithi027.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 420 kB/s | 38 kB 00:00 2024-09-20T18:54:46.192 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.3 MB/s | 3.0 MB 00:00 2024-09-20T18:54:46.242 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-20T18:54:46.264 INFO:teuthology.orchestra.run.smithi027.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-36 15 MB/s | 7.4 MB 00:00 2024-09-20T18:54:46.331 INFO:teuthology.orchestra.run.smithi027.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.8 MB/s | 3.0 MB 00:00 2024-09-20T18:54:46.342 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 11 MB/s | 4.9 MB 00:00 2024-09-20T18:54:46.401 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.5 MB/s | 250 kB 00:00 2024-09-20T18:54:46.468 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-20T18:54:46.515 INFO:teuthology.orchestra.run.smithi027.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-20T18:54:46.540 INFO:teuthology.orchestra.run.smithi027.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 888 kB/s | 245 kB 00:00 2024-09-20T18:54:46.640 INFO:teuthology.orchestra.run.smithi027.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-20T18:54:46.666 INFO:teuthology.orchestra.run.smithi027.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.6 MB/s | 250 kB 00:00 2024-09-20T18:54:46.785 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-20T18:54:46.786 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:46.786 INFO:teuthology.orchestra.run.smithi098.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-20T18:54:47.141 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:47.168 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:47.168 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:47.183 INFO:teuthology.orchestra.run.smithi027.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-20T18:54:47.183 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:47.184 INFO:teuthology.orchestra.run.smithi027.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-20T18:54:47.553 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:47.580 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:47.580 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:47.596 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:47.597 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:48.030 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:48.031 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:48.375 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:48.443 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-20T18:54:48.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:54:48.594 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:54:48.626 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-20T18:54:48.809 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-20T18:54:48.820 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:48.841 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-20T18:54:48.890 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-20T18:54:48.931 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:54:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-20T18:54:49.036 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:54:49.074 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-20T18:54:49.265 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-20T18:54:49.306 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-20T18:54:49.385 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-20T18:54:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-20T18:54:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-20T18:54:50.075 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-20T18:54:50.191 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-20T18:54:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:54:51.523 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:54:51.985 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-20T18:54:52.017 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:54:52.602 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-20T18:54:52.630 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:54:54.732 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 1/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:54:54.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-20T18:54:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-20T18:54:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:55.215 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:54:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:55.216 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:54:55.303 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 1/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:54:55.304 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-20T18:54:55.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2024-09-20T18:54:55.746 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-20T18:54:55.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:55.746 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:54:55.746 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-20T18:54:55.747 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-20T18:54:55.748 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-20T18:54:55.748 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-20T18:54:55.748 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:55.748 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:54:56.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-rook 2024-09-20T18:54:56.188 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:20 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:54:56.320 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:54:56.321 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 49 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-20T18:54:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2024-09-20T18:54:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:54:56.324 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.2 M 2024-09-20T18:54:56.324 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 26 M 2024-09-20T18:54:56.324 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:54:56.719 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:18 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:54:56.858 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 49 k 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-20T18:54:56.859 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:54:56.860 INFO:teuthology.orchestra.run.smithi027.stdout:Install 13 Packages 2024-09-20T18:54:56.861 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:54:56.861 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 2.2 M 2024-09-20T18:54:56.861 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 26 M 2024-09-20T18:54:56.861 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:54:56.862 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 211 kB/s | 26 kB 00:00 2024-09-20T18:54:56.878 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 139 kB/s | 19 kB 00:00 2024-09-20T18:54:56.895 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): ceph-mgr-rook-19.1.1-369.ged8ee0f2.el9. 318 kB/s | 49 kB 00:00 2024-09-20T18:54:57.029 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-20T18:54:57.054 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-09-20T18:54:57.088 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-20T18:54:57.122 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-20T18:54:57.146 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-20T18:54:57.172 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 171 kB/s | 14 kB 00:00 2024-09-20T18:54:57.198 INFO:teuthology.orchestra.run.smithi027.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 251 kB/s | 19 kB 00:00 2024-09-20T18:54:57.206 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-20T18:54:57.223 INFO:teuthology.orchestra.run.smithi027.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 252 kB/s | 26 kB 00:00 2024-09-20T18:54:57.231 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-20T18:54:57.256 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-20T18:54:57.290 INFO:teuthology.orchestra.run.smithi027.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-20T18:54:57.298 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-20T18:54:57.300 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:57.301 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-20T18:54:57.315 INFO:teuthology.orchestra.run.smithi027.stdout:(4/13): ceph-mgr-rook-19.1.1-369.ged8ee0f2.el9. 254 kB/s | 49 kB 00:00 2024-09-20T18:54:57.341 INFO:teuthology.orchestra.run.smithi027.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-20T18:54:57.364 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:54:57.379 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:54:57.379 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:54:57.383 INFO:teuthology.orchestra.run.smithi027.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.9 MB/s | 279 kB 00:00 2024-09-20T18:54:57.408 INFO:teuthology.orchestra.run.smithi027.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 801 kB/s | 54 kB 00:00 2024-09-20T18:54:57.441 INFO:teuthology.orchestra.run.smithi027.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-20T18:54:57.471 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:54:57.471 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:54:57.475 INFO:teuthology.orchestra.run.smithi027.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 157 kB/s | 14 kB 00:00 2024-09-20T18:54:57.500 INFO:teuthology.orchestra.run.smithi027.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-20T18:54:57.526 INFO:teuthology.orchestra.run.smithi027.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-20T18:54:57.551 INFO:teuthology.orchestra.run.smithi027.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-20T18:54:57.584 INFO:teuthology.orchestra.run.smithi027.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-20T18:54:57.587 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:54:57.587 INFO:teuthology.orchestra.run.smithi027.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-20T18:54:57.655 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:54:57.670 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:54:57.671 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:54:57.770 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:54:57.771 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:54:57.988 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:54:58.162 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-20T18:54:58.224 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-20T18:54:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-20T18:54:58.314 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:54:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-20T18:54:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-20T18:54:58.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-20T18:54:58.492 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-20T18:54:58.555 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-20T18:54:58.587 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-20T18:54:58.611 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-20T18:54:58.646 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-20T18:54:58.647 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-20T18:54:58.687 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-20T18:54:58.800 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-20T18:54:58.906 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-20T18:54:58.974 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-20T18:54:59.362 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-20T18:54:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-20T18:54:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-20T18:54:59.498 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-20T18:54:59.520 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:54:59.747 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-20T18:54:59.786 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-20T18:54:59.819 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-20T18:54:59.869 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-20T18:54:59.897 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:55:00.292 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:55:00.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 1/13 2024-09-20T18:55:00.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-20T18:55:00.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-20T18:55:00.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-20T18:55:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-20T18:55:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:00.638 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:00.639 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 1/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-20T18:55:00.715 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-20T18:55:00.716 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-20T18:55:00.716 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-20T18:55:00.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2024-09-20T18:55:01.059 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-20T18:55:01.059 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-20T18:55:01.060 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-20T18:55:01.061 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-20T18:55:01.061 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:01.061 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:01.320 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-cephadm 2024-09-20T18:55:01.464 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:25 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:01.596 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 146 k 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-20T18:55:01.597 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2024-09-20T18:55:01.598 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:01.599 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 7.0 M 2024-09-20T18:55:01.599 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 33 M 2024-09-20T18:55:01.599 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:01.931 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:23 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:02.068 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:02.069 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:02.069 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:55:02.069 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 146 k 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout:Install 6 Packages 2024-09-20T18:55:02.070 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:02.071 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 7.0 M 2024-09-20T18:55:02.071 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 33 M 2024-09-20T18:55:02.071 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:02.309 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): ceph-mgr-cephadm-19.1.1-369.ged8ee0f2.el 637 kB/s | 146 kB 00:00 2024-09-20T18:55:02.368 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-20T18:55:02.393 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-20T18:55:02.419 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-20T18:55:02.469 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 638 kB/s | 248 kB 00:00 2024-09-20T18:55:02.553 INFO:teuthology.orchestra.run.smithi027.stdout:(1/6): ceph-mgr-cephadm-19.1.1-369.ged8ee0f2.el 700 kB/s | 146 kB 00:00 2024-09-20T18:55:02.603 INFO:teuthology.orchestra.run.smithi027.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-20T18:55:02.628 INFO:teuthology.orchestra.run.smithi027.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-20T18:55:02.645 INFO:teuthology.orchestra.run.smithi027.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 4.4 MB/s | 74 kB 00:00 2024-09-20T18:55:02.878 INFO:teuthology.orchestra.run.smithi027.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 464 kB/s | 248 kB 00:00 2024-09-20T18:55:04.204 INFO:teuthology.orchestra.run.smithi027.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-20T18:55:04.206 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:04.206 INFO:teuthology.orchestra.run.smithi027.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-09-20T18:55:04.283 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:04.295 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:04.295 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:04.403 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:04.404 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:04.686 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-20T18:55:04.687 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:04.688 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.3 MB/s | 7.0 MB 00:03 2024-09-20T18:55:04.717 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:04.756 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:04.767 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:04.767 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:04.864 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:04.865 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:04.895 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-20T18:55:04.949 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-20T18:55:05.172 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:05.333 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-20T18:55:05.388 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-20T18:55:05.501 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-20T18:55:05.595 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-20T18:55:05.666 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-20T18:55:05.693 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:55:05.915 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-20T18:55:05.998 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-20T18:55:06.061 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-20T18:55:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-20T18:55:06.481 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-20T18:55:06.758 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-20T18:55:06.758 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:06.758 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:06.758 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:06.811 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:55:06.811 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/6 2024-09-20T18:55:06.811 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-20T18:55:06.811 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-20T18:55:06.812 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-20T18:55:06.812 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-20T18:55:06.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-fuse 2024-09-20T18:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-20T18:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:07.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2024-09-20T18:55:07.596 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:29 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:07.734 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 897 k 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-20T18:55:07.735 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Install 2 Packages 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 976 k 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 2.9 M 2024-09-20T18:55:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:07.896 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:31 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:08.028 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 897 k 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 976 k 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 2.9 M 2024-09-20T18:55:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:08.122 INFO:teuthology.orchestra.run.smithi027.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 612 kB/s | 80 kB 00:00 2024-09-20T18:55:08.264 INFO:teuthology.orchestra.run.smithi027.stdout:(2/2): ceph-fuse-19.1.1-369.ged8ee0f2.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-20T18:55:08.264 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:08.265 INFO:teuthology.orchestra.run.smithi027.stdout:Total 1.8 MB/s | 976 kB 00:00 2024-09-20T18:55:08.277 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:08.300 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:08.301 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:08.388 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): ceph-fuse-19.1.1-369.ged8ee0f2.el9.x86_6 3.4 MB/s | 897 kB 00:00 2024-09-20T18:55:08.391 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:08.391 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:08.513 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 208 kB/s | 80 kB 00:00 2024-09-20T18:55:08.514 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:08.514 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.0 MB/s | 976 kB 00:00 2024-09-20T18:55:08.526 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:08.547 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:08.547 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:08.588 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:08.632 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:08.632 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:08.748 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-20T18:55:08.818 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:08.985 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-20T18:55:09.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:55:09.525 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:55:09.525 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/2 2024-09-20T18:55:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:55:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/2 2024-09-20T18:55:09.816 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-20T18:55:09.876 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:09.876 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:09.876 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-20T18:55:09.876 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:09.877 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:09.999 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:10.111 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librados-devel 2024-09-20T18:55:10.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2024-09-20T18:55:10.724 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:32 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:10.862 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:10.863 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:10.863 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2024-09-20T18:55:10.863 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 126 k 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 126 k 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 456 k 2024-09-20T18:55:10.864 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:10.884 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:34 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:11.019 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 126 k 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:11.020 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 126 k 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 456 k 2024-09-20T18:55:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:11.077 INFO:teuthology.orchestra.run.smithi027.stdout:librados-devel-19.1.1-369.ged8ee0f2.el9.x86_64. 594 kB/s | 126 kB 00:00 2024-09-20T18:55:11.078 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:11.078 INFO:teuthology.orchestra.run.smithi027.stdout:Total 590 kB/s | 126 kB 00:00 2024-09-20T18:55:11.078 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:11.085 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:11.085 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:11.152 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:11.152 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:11.227 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-19.1.1-369.ged8ee0f2.el9.x86_64. 613 kB/s | 126 kB 00:00 2024-09-20T18:55:11.228 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:11.228 INFO:teuthology.orchestra.run.smithi098.stdout:Total 609 kB/s | 126 kB 00:00 2024-09-20T18:55:11.228 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:11.234 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:11.234 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:11.297 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:11.297 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:11.315 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:11.412 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:11.847 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:12.123 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:12.123 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:12.123 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:12.124 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:12.124 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:12.124 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:12.267 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:12.407 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install libcephfs2 2024-09-20T18:55:12.511 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2024-09-20T18:55:13.023 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:35 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:13.112 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:37 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:13.117 INFO:teuthology.orchestra.run.smithi027.stdout:Package libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:13.163 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:13.165 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:13.165 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:13.204 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:13.232 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install libcephfs-devel 2024-09-20T18:55:13.248 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:13.249 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:13.249 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:13.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2024-09-20T18:55:13.842 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:35 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:13.899 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:37 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:13.979 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:13.979 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:13.979 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2024-09-20T18:55:13.979 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:13.979 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 32 k 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:13.980 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 32 k 2024-09-20T18:55:13.981 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 142 k 2024-09-20T18:55:13.981 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:14.032 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 32 k 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 32 k 2024-09-20T18:55:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 142 k 2024-09-20T18:55:14.034 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:14.139 INFO:teuthology.orchestra.run.smithi027.stdout:libcephfs-devel-19.1.1-369.ged8ee0f2.el9.x86_64 200 kB/s | 32 kB 00:00 2024-09-20T18:55:14.139 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:14.140 INFO:teuthology.orchestra.run.smithi027.stdout:Total 199 kB/s | 32 kB 00:00 2024-09-20T18:55:14.140 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:14.143 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:14.143 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:14.168 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:14.168 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:14.189 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-19.1.1-369.ged8ee0f2.el9.x86_64 203 kB/s | 32 kB 00:00 2024-09-20T18:55:14.190 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:14.190 INFO:teuthology.orchestra.run.smithi098.stdout:Total 201 kB/s | 32 kB 00:00 2024-09-20T18:55:14.191 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:14.194 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:14.194 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:14.211 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:14.211 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:14.258 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:14.374 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:14.736 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:14.981 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:15.017 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:15.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2024-09-20T18:55:15.204 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librados2 2024-09-20T18:55:15.776 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:39 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:15.803 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:37 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:15.865 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:15.896 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:15.908 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:15.909 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:15.909 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:15.942 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:15.943 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:15.943 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:15.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2024-09-20T18:55:16.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librbd1 2024-09-20T18:55:16.560 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:16.621 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:38 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:16.650 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:16.694 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:16.695 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:16.695 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:16.715 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:16.762 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:16.763 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:16.763 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:16.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2024-09-20T18:55:16.834 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rados 2024-09-20T18:55:17.354 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:41 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:17.443 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:39 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:17.444 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:17.488 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:17.489 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:17.489 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:17.535 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:17.563 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2024-09-20T18:55:17.581 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:17.582 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:17.583 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:17.700 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rgw 2024-09-20T18:55:18.141 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:42 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:18.231 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:18.274 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:18.275 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:18.275 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:18.308 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:18.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2024-09-20T18:55:18.401 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:18.447 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:18.448 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:18.449 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:18.526 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-cephfs 2024-09-20T18:55:18.931 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:42 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:19.020 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:19.063 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:19.064 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:19.064 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:19.135 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:41 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:19.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2024-09-20T18:55:19.227 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:19.272 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:19.273 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:19.273 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:19.341 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rbd 2024-09-20T18:55:19.725 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:43 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:19.815 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:19.858 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:19.859 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-20T18:55:19.859 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:19.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2024-09-20T18:55:19.950 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:41 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:20.042 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:55:20.088 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:20.089 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-20T18:55:20.089 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:20.157 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-fuse 2024-09-20T18:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:44 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:20.640 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:20.641 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-20T18:55:20.641 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:20.641 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 85 k 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 85 k 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 231 k 2024-09-20T18:55:20.642 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:20.763 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:42 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:20.835 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 442 kB/s | 85 kB 00:00 2024-09-20T18:55:20.835 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:20.836 INFO:teuthology.orchestra.run.smithi098.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-20T18:55:20.836 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:20.843 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:20.843 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:20.901 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 85 k 2024-09-20T18:55:20.902 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 85 k 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 231 k 2024-09-20T18:55:20.903 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:20.906 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:20.907 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:21.109 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-fuse-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 415 kB/s | 85 kB 00:00 2024-09-20T18:55:21.109 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:21.110 INFO:teuthology.orchestra.run.smithi027.stdout:Total 412 kB/s | 85 kB 00:00 2024-09-20T18:55:21.110 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:21.117 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:21.117 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:21.157 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:21.184 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:21.184 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:21.344 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:21.451 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:21.575 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:21.820 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:21.829 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:22.065 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:22.065 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:22.066 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:22.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2024-09-20T18:55:22.345 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-mirror 2024-09-20T18:55:22.678 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:46 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:22.820 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:22.821 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-20T18:55:22.821 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:22.821 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.1 M 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:55:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:22.823 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.1 M 2024-09-20T18:55:22.823 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 13 M 2024-09-20T18:55:22.823 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:22.959 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:44 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:23.098 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:23.098 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.1 M 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 3.1 M 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 13 M 2024-09-20T18:55:23.099 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:23.148 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-20T18:55:23.148 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:23.149 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.5 MB/s | 3.1 MB 00:00 2024-09-20T18:55:23.149 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:23.158 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:23.158 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:23.243 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:23.244 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:23.429 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-mirror-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 9.4 MB/s | 3.1 MB 00:00 2024-09-20T18:55:23.430 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:23.430 INFO:teuthology.orchestra.run.smithi027.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-20T18:55:23.430 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:23.440 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:23.440 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:23.527 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:23.527 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:23.678 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:23.740 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:23.766 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:23.766 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:55:23.766 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-20T18:55:23.767 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:55:23.767 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:55:23.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:23.974 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:24.038 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:55:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:24.925 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:24.925 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:24.925 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:24.926 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:25.152 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2024-09-20T18:55:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:25.164 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:25.164 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:25.487 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-nbd 2024-09-20T18:55:25.744 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:49 ago on Fri 20 Sep 2024 06:53:36 PM UTC. 2024-09-20T18:55:25.877 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-20T18:55:25.877 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 170 k 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 170 k 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 494 k 2024-09-20T18:55:25.878 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-20T18:55:26.086 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 821 kB/s | 170 kB 00:00 2024-09-20T18:55:26.086 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:26.087 INFO:teuthology.orchestra.run.smithi098.stdout:Total 815 kB/s | 170 kB 00:00 2024-09-20T18:55:26.087 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-20T18:55:26.095 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-20T18:55:26.095 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-20T18:55:26.097 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:01:48 ago on Fri 20 Sep 2024 06:53:38 PM UTC. 2024-09-20T18:55:26.160 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-20T18:55:26.160 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-20T18:55:26.236 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 170 k 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2024-09-20T18:55:26.237 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:26.238 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 170 k 2024-09-20T18:55:26.238 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 494 k 2024-09-20T18:55:26.238 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-20T18:55:26.316 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-20T18:55:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:26.458 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-nbd-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 775 kB/s | 170 kB 00:00 2024-09-20T18:55:26.459 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:55:26.459 INFO:teuthology.orchestra.run.smithi027.stdout:Total 769 kB/s | 170 kB 00:00 2024-09-20T18:55:26.459 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-20T18:55:26.468 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-20T18:55:26.468 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-20T18:55:26.535 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-20T18:55:26.535 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-20T18:55:26.700 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-20T18:55:26.802 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:27.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:27.118 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:27.118 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-20T18:55:27.118 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:27.119 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:55:27.119 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-20T18:55:27.275 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:27.358 DEBUG:teuthology.parallel:result is None 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:55:27.550 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-20T18:55:27.810 DEBUG:teuthology.parallel:result is None 2024-09-20T18:55:27.810 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:55:27.810 INFO:teuthology.packaging:ref: None 2024-09-20T18:55:27.810 INFO:teuthology.packaging:tag: None 2024-09-20T18:55:27.811 INFO:teuthology.packaging:branch: squid 2024-09-20T18:55:27.811 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:55:27.811 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:55:28.020 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-20T18:55:28.042 INFO:teuthology.orchestra.run.smithi027.stdout:19.1.1-369.ged8ee0f2.el9 2024-09-20T18:55:28.042 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-369.ged8ee0f2.el9 2024-09-20T18:55:28.043 INFO:teuthology.task.install:The correct ceph version 19.1.1-369.ged8ee0f2 is installed. 2024-09-20T18:55:28.044 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:55:28.044 INFO:teuthology.packaging:ref: None 2024-09-20T18:55:28.045 INFO:teuthology.packaging:tag: None 2024-09-20T18:55:28.045 INFO:teuthology.packaging:branch: squid 2024-09-20T18:55:28.045 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:55:28.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:55:28.252 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-20T18:55:28.277 INFO:teuthology.orchestra.run.smithi098.stdout:19.1.1-369.ged8ee0f2.el9 2024-09-20T18:55:28.277 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-369.ged8ee0f2.el9 2024-09-20T18:55:28.277 INFO:teuthology.task.install:The correct ceph version 19.1.1-369.ged8ee0f2 is installed. 2024-09-20T18:55:28.279 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-20T18:55:28.279 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:55:28.279 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T18:55:28.306 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:55:28.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T18:55:28.345 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-20T18:55:28.346 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:55:28.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T18:55:28.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T18:55:28.438 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:55:28.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T18:55:28.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T18:55:28.530 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-20T18:55:28.531 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:55:28.531 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T18:55:28.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T18:55:28.626 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:55:28.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T18:55:28.652 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T18:55:28.718 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-20T18:55:28.718 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:55:28.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T18:55:28.744 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T18:55:28.810 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:55:28.810 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T18:55:28.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T18:55:28.901 INFO:teuthology.run_tasks:Running task print... 2024-09-20T18:55:28.918 INFO:teuthology.task.print:**** done install task... 2024-09-20T18:55:28.918 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-20T18:55:29.041 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'} 2024-09-20T18:55:29.041 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:55:29.042 INFO:tasks.cephadm:Cluster fsid is e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:55:29.042 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-20T18:55:29.042 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-20T18:55:29.042 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi027': '172.21.15.27', 'mon.smithi098': '172.21.15.98'} 2024-09-20T18:55:29.042 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-20T18:55:29.042 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname $(hostname -s) 2024-09-20T18:55:29.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-20T18:55:29.093 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-20T18:55:29.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:55:29.233 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83186/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5099-g88deadb8', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5099.g88deadb8'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-20-1028/88deadb8082f4a33832e228ccefc59cedba158a5/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 12:11:57.149019', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-20-1028', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-20-1028/88deadb8082f4a33832e228ccefc59cedba158a5/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-20T18:55:29.472 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 ed8ee0f26ef720e6504cefa8be1a2d0872192de7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-20T18:55:29.474 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm 2024-09-20T18:55:29.474 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm 2024-09-20T18:55:29.474 DEBUG:teuthology.orchestra.run.smithi027:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r--. 1 ubuntu ubuntu 784376 Sep 20 18:55 /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.026 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.582 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 784376 Sep 20 18:55 /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.583 DEBUG:teuthology.orchestra.run.smithi027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.604 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T18:55:30.633 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-20T18:55:30.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-20T18:55:30.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-20T18:55:32.352 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:55:32.405 INFO:teuthology.orchestra.run.smithi027.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "image_id": "6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30", 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "repo_digests": [ 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65" 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-20T18:56:05.917 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30", 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65" 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-20T18:56:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-20T18:56:07.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph 2024-09-20T18:56:07.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-20T18:56:07.261 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /etc/ceph 2024-09-20T18:56:07.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-20T18:56:07.327 INFO:tasks.cephadm:Writing seed config... 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-20T18:56:07.328 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-20T18:56:07.329 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-20T18:56:07.330 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-20T18:56:07.330 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-20T18:56:07.330 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-20T18:56:07.330 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-20T18:56:07.330 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-20T18:56:07.330 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:56:07.330 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-20T18:56:07.362 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e7838b9c-7781-11ef-baf5-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-20T18:56:07.362 DEBUG:teuthology.orchestra.run.smithi027:mon.smithi027> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service 2024-09-20T18:56:07.405 INFO:tasks.cephadm:Bootstrapping... 2024-09-20T18:56:07.405 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid e7838b9c-7781-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.27 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:56:07.623 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:56:07.623 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.27', '--skip-admin-label'] 2024-09-20T18:56:07.623 INFO:teuthology.orchestra.run.smithi027.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-20T18:56:07.623 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying podman|docker is present... 2024-09-20T18:56:07.647 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-20T18:56:07.648 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying lvm2 is present... 2024-09-20T18:56:07.648 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying time synchronization is in place... 2024-09-20T18:56:07.656 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T18:56:07.656 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T18:56:07.662 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T18:56:07.663 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:56:07.670 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-20T18:56:07.676 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-20T18:56:07.676 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-20T18:56:07.676 INFO:teuthology.orchestra.run.smithi027.stdout:Repeating the final host check... 2024-09-20T18:56:07.699 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-20T18:56:07.699 INFO:teuthology.orchestra.run.smithi027.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-20T18:56:07.699 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl is present 2024-09-20T18:56:07.699 INFO:teuthology.orchestra.run.smithi027.stdout:lvcreate is present 2024-09-20T18:56:07.706 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T18:56:07.706 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T18:56:07.712 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T18:56:07.713 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:56:07.719 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Host looks OK 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Cluster fsid: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Acquiring lock 140175316166496 on /run/cephadm/e7838b9c-7781-11ef-baf5-efdc52797490.lock 2024-09-20T18:56:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Lock 140175316166496 acquired on /run/cephadm/e7838b9c-7781-11ef-baf5-efdc52797490.lock 2024-09-20T18:56:07.727 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 3300 ... 2024-09-20T18:56:07.727 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 6789 ... 2024-09-20T18:56:07.727 INFO:teuthology.orchestra.run.smithi027.stdout:Base mon IP(s) is [172.21.15.27:3300, 172.21.15.27:6789], mon addrv is [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-20T18:56:07.731 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.27 metric 100 2024-09-20T18:56:07.731 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.27 metric 100 2024-09-20T18:56:07.733 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-20T18:56:07.733 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-20T18:56:07.733 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T18:56:07.736 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-20T18:56:07.737 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-20T18:56:07.737 INFO:teuthology.orchestra.run.smithi027.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-20T18:56:07.737 INFO:teuthology.orchestra.run.smithi027.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-20T18:56:07.738 INFO:teuthology.orchestra.run.smithi027.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:56:08.210 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Getting image source signatures 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:92ea49144d6cc6e75ae91004beab5c92b7a8b7054f9361617c16e26264c87e92 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying config sha256:6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 2024-09-20T18:56:08.211 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-20T18:56:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:ceph: stdout ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable) 2024-09-20T18:56:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph version: ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable) 2024-09-20T18:56:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:Extracting ceph user uid/gid from container image... 2024-09-20T18:56:10.238 INFO:teuthology.orchestra.run.smithi027.stdout:stat: stdout 167 167 2024-09-20T18:56:10.238 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial keys... 2024-09-20T18:56:11.352 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBKxe1mE2fRIxAAn1E9TvUrvl+kwLOiJMEK4g== 2024-09-20T18:56:12.424 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBLxe1mEYMmKhAAk+8rZSKTa2UbZGhkfblOIA== 2024-09-20T18:56:13.422 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBMxe1m/mzZLxAAJyCYn8OQWo4NuAbkO+ie8A== 2024-09-20T18:56:13.423 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial monmap... 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool for smithi027 [v2:172.21.15.27:3300,v1:172.21.15.27:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = quincy 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: set fsid to e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:56:14.354 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mon... 2024-09-20T18:56:15.359 INFO:teuthology.orchestra.run.smithi027.stdout:create mon.smithi027 on 2024-09-20T18:56:15.573 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-20T18:56:15.751 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-20T18:56:15.940 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target. 2024-09-20T18:56:15.940 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target. 2024-09-20T18:56:16.189 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027 2024-09-20T18:56:16.189 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service: Unit ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service not loaded. 2024-09-20T18:56:16.385 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target.wants/ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service → /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490@.service. 2024-09-20T18:56:16.491 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 systemd[1]: Starting Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T18:56:16.727 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 podman[27808]: 2024-09-20 18:56:16.603845372 +0000 UTC m=+0.108966051 container create 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-20T18:56:16.727 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 podman[27808]: 2024-09-20 18:56:16.511658087 +0000 UTC m=+0.016778784 image pull 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:56:16.927 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:56:16.927 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-20T18:56:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:56:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:56:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-20T18:56:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T18:56:16.936 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon to start... 2024-09-20T18:56:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon... 2024-09-20T18:56:17.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 podman[27808]: 2024-09-20 18:56:16.814360185 +0000 UTC m=+0.319480874 container init 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-20T18:56:17.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 podman[27808]: 2024-09-20 18:56:16.817886483 +0000 UTC m=+0.323007161 container start 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T18:56:17.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 ceph-mon[27827]: mkfs e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:17.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 ceph-mon[27827]: mon.smithi027 is new leader, mons smithi027 in quorum (ranks 0) 2024-09-20T18:56:17.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 bash[27808]: 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 2024-09-20T18:56:17.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:16 smithi027 systemd[1]: Started Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T18:56:18.059 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: mon.smithi027 is new leader, mons smithi027 in quorum (ranks 0) 2024-09-20T18:56:18.059 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: monmap epoch 1 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: last_changed 2024-09-20T18:56:13.766810+0000 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: min_mon_release 19 (squid) 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: election_strategy: 1 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: fsmap 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: mgrmap e1: no daemons active 2024-09-20T18:56:18.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:17 smithi027 ceph-mon[27827]: from='client.? 172.21.15.27:0/1672720842' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-20T18:56:18.062 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout cluster: 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout id: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout services: 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi027 (age 0.603685s) 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout data: 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-20T18:56:18.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pgs: 2024-09-20T18:56:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:mon is available 2024-09-20T18:56:18.065 INFO:teuthology.orchestra.run.smithi027.stdout:Assimilating anything we can from ceph.conf... 2024-09-20T18:56:19.140 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:18 smithi027 ceph-mon[27827]: from='client.? 172.21.15.27:0/225823127' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T18:56:19.140 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:18 smithi027 ceph-mon[27827]: from='client.? 172.21.15.27:0/225823127' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T18:56:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T18:56:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:Generating new minimal ceph.conf... 2024-09-20T18:56:20.221 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:19 smithi027 ceph-mon[27827]: from='client.? 172.21.15.27:0/2954200739' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:56:20.224 INFO:teuthology.orchestra.run.smithi027.stdout:Restarting the monitor... 2024-09-20T18:56:20.508 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 systemd[1]: Stopping Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T18:56:20.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[27823]: 2024-09-20T18:56:20.493+0000 7fc28e494640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi027 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:56:20.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[27823]: 2024-09-20T18:56:20.493+0000 7fc28e494640 -1 mon.smithi027@0(leader) e1 *** Got Signal Terminated *** 2024-09-20T18:56:20.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 podman[28068]: 2024-09-20 18:56:20.546150017 +0000 UTC m=+0.161902527 container died 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f) 2024-09-20T18:56:21.183 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 podman[28068]: 2024-09-20 18:56:20.91083513 +0000 UTC m=+0.526587639 container cleanup 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-20T18:56:21.184 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:20 smithi027 bash[28068]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027 2024-09-20T18:56:21.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 podman[28080]: 2024-09-20 18:56:21.170307641 +0000 UTC m=+0.621086792 container remove 38407564f614b4623e10039d5b115e7b47bc6e0eb8505b514055cbcc32f308d7 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-20T18:56:21.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service: Deactivated successfully. 2024-09-20T18:56:21.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 systemd[1]: Stopped Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T18:56:21.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 systemd[1]: Starting Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T18:56:21.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 podman[28177]: 2024-09-20 18:56:21.504385985 +0000 UTC m=+0.110426040 container create 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ed8ee0f) 2024-09-20T18:56:21.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 podman[28177]: 2024-09-20 18:56:21.409781613 +0000 UTC m=+0.015821662 image pull 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:56:21.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 podman[28177]: 2024-09-20 18:56:21.748597982 +0000 UTC m=+0.354638031 container init 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-20T18:56:21.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 podman[28177]: 2024-09-20 18:56:21.751915751 +0000 UTC m=+0.357955791 container start 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:56:21.857 INFO:teuthology.orchestra.run.smithi027.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable), process ceph-mon, pid 2 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: pidfile_write: ignore empty --pid-file 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: load: jerasure load: lrc 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: RocksDB version: 7.9.2 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Git sha 0 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Compile date 2024-09-19 20:45:27 2024-09-20T18:56:22.080 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: DB SUMMARY 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: DB Session ID: WCFTLYLYR3DZ9ZPCJ2EB 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: CURRENT file: CURRENT 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi027/store.db dir, Total Num: 1, files: 000008.sst 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi027/store.db: 000009.log size: 95829 ; 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.error_if_exists: 0 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.create_if_missing: 0 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.paranoid_checks: 1 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T18:56:22.081 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.env: 0x561883710940 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.info_log: 0x561885f5b8c0 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.statistics: (nil) 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.use_fsync: 0 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_log_file_size: 0 2024-09-20T18:56:22.082 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_fallocate: 1 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.use_direct_reads: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.db_log_dir: 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.wal_dir: 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T18:56:22.083 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.write_buffer_manager: 0x561885f6adc0 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T18:56:22.084 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.unordered_write: 0 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T18:56:22.085 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.row_cache: None 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.wal_filter: None 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.two_write_queues: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.wal_compression: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.atomic_flush: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.log_readahead_size: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T18:56:22.086 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T18:56:22.087 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T18:56:22.087 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T18:56:22.087 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_background_jobs: 2 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_background_compactions: -1 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_subcompactions: 1 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T18:56:22.088 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_open_files: -1 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_background_flushes: -1 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Compression algorithms supported: 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kZSTD supported: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kXpressCompression supported: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kBZip2Compression supported: 0 2024-09-20T18:56:22.089 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kLZ4Compression supported: 1 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kZlibCompression supported: 1 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: kSnappyCompression supported: 1 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi027/store.db/MANIFEST-000010 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T18:56:22.090 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.merge_operator: 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_filter: None 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T18:56:22.091 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561885f5b520) 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: cache_index_and_filter_blocks: 1 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: pin_top_level_index_and_filter: 1 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_type: 0 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: data_block_index_type: 0 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_shortening: 1 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: checksum: 4 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: no_block_cache: 0 2024-09-20T18:56:22.092 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache: 0x561885f4f1f0 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_name: BinnedLRUCache 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_options: 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: capacity : 536870912 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: num_shard_bits : 4 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: strict_capacity_limit : 0 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: high_pri_pool_ratio: 0.000 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_compressed: (nil) 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: persistent_cache: (nil) 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_size: 4096 2024-09-20T18:56:22.093 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_size_deviation: 10 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_restart_interval: 16 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_block_restart_interval: 1 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: metadata_block_size: 4096 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: partition_filters: 0 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: use_delta_encoding: 1 2024-09-20T18:56:22.094 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: filter_policy: bloomfilter 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: whole_key_filtering: 1 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: verify_compression: 0 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: read_amp_bytes_per_bit: 0 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: format_version: 5 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: enable_index_compression: 1 2024-09-20T18:56:22.095 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_align: 0 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: max_auto_readahead_size: 262144 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: prepopulate_block_cache: 0 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: initial_auto_readahead_size: 8192 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression: NoCompression 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T18:56:22.096 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.num_levels: 7 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:56:22.097 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T18:56:22.098 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T18:56:22.099 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T18:56:22.100 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.inplace_update_support: 0 2024-09-20T18:56:22.101 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.bloom_locality: 0 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.max_successive_merges: 0 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T18:56:22.102 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.ttl: 2592000 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enable_blob_files: false 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.min_blob_size: 0 2024-09-20T18:56:22.103 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T18:56:22.104 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi027/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8e79b0a7-001f-4ea5-8360-aa624a12b024 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726858581778768, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726858581779766, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91830, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89871, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83239, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726858581, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8e79b0a7-001f-4ea5-8360-aa624a12b024", "db_session_id": "WCFTLYLYR3DZ9ZPCJ2EB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726858581779863, "job": 1, "event": "recovery_finished"} 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-20T18:56:22.105 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi027/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561885f7ce00 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: DB pointer 0x561886078000 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** DB Stats ** 2024-09-20T18:56:22.106 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: L0 2/0 91.58 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Sum 2/0 91.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.108 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative compaction: 0.00 GB write, 27.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval compaction: 0.00 GB write, 27.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Block cache BinnedLRUCache@0x561885f4f1f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-20T18:56:22.109 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: starting mon.smithi027 rank 0 at public addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] at bind addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi027 fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???) e1 preinit fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).mds e1 new map 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).mds e1 print_map 2024-09-20T18:56:22.110 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: e1 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: btime 2024-09-20T18:56:16:855186+0000 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: legacy client fscid: -1 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: No filesystems configured 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:56:22.111 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mon.smithi027 is new leader, mons smithi027 in quorum (ranks 0) 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: monmap epoch 1 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: last_changed 2024-09-20T18:56:13.766810+0000 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: min_mon_release 19 (squid) 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: election_strategy: 1 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: fsmap 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 ceph-mon[28196]: mgrmap e1: no daemons active 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 bash[28177]: 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 2024-09-20T18:56:22.112 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:21 smithi027 systemd[1]: Started Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T18:56:22.912 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-20T18:56:22.934 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:56:22.934 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mgr... 2024-09-20T18:56:22.934 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-20T18:56:22.935 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-20T18:56:22.935 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-20T18:56:23.195 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mgr.smithi027.tlgpqo 2024-09-20T18:56:23.195 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mgr.smithi027.tlgpqo.service: Unit ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mgr.smithi027.tlgpqo.service not loaded. 2024-09-20T18:56:23.357 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490.target.wants/ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mgr.smithi027.tlgpqo.service → /etc/systemd/system/ceph-e7838b9c-7781-11ef-baf5-efdc52797490@.service. 2024-09-20T18:56:23.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:23 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2994062556' entity='client.admin' 2024-09-20T18:56:23.920 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:56:23.920 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-20T18:56:23.928 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:56:23.928 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:56:23.928 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-20T18:56:23.928 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T18:56:23.938 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:56:23.938 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-20T18:56:23.946 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:56:23.946 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:56:23.947 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-20T18:56:23.947 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-20T18:56:23.947 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr to start... 2024-09-20T18:56:23.947 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr... 2024-09-20T18:56:24.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:24 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2578677271' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "e7838b9c-7781-11ef-baf5-efdc52797490", 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:25.069 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "smithi027" 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:56:25.070 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:56:25.071 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:56:16:855186+0000", 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:25.072 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:56:16.857875+0000", 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:56:25.073 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (1/15)... 2024-09-20T18:56:27.785 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:27 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/102711936' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:56:28.184 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:28.184 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:56:28.184 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "e7838b9c-7781-11ef-baf5-efdc52797490", 2024-09-20T18:56:28.184 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "smithi027" 2024-09-20T18:56:28.185 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:56:28.186 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:56:28.187 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:56:16:855186+0000", 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:56:16.857875+0000", 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:56:28.189 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (2/15)... 2024-09-20T18:56:29.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: Activating manager daemon smithi027.tlgpqo 2024-09-20T18:56:29.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: mgrmap e2: smithi027.tlgpqo(active, starting, since 0.00314432s) 2024-09-20T18:56:29.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:56:29.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:29.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:28 smithi027 ceph-mon[28196]: from='mgr.14100 172.21.15.27:0/1291481203' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:31.165 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:30 smithi027 ceph-mon[28196]: mgrmap e3: smithi027.tlgpqo(active, since 1.00692s) 2024-09-20T18:56:31.165 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:30 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/180846853' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "e7838b9c-7781-11ef-baf5-efdc52797490", 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.471 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "smithi027" 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:56:31.472 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:56:31.473 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:56:31.476 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:56:16:855186+0000", 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:56:31.477 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:56:16.857875+0000", 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:56:31.478 INFO:teuthology.orchestra.run.smithi027.stdout:mgr is available 2024-09-20T18:56:32.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:31 smithi027 ceph-mon[28196]: mgrmap e4: smithi027.tlgpqo(active, since 2s) 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T18:56:32.676 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T18:56:32.677 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling cephadm module... 2024-09-20T18:56:33.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:32 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3970976184' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T18:56:34.470 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:34 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1625758376' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-20T18:56:35.427 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:35 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1625758376' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-20T18:56:35.427 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:35 smithi027 ceph-mon[28196]: mgrmap e5: smithi027.tlgpqo(active, since 5s) 2024-09-20T18:56:39.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: Active manager daemon smithi027.tlgpqo restarted 2024-09-20T18:56:39.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: Activating manager daemon smithi027.tlgpqo 2024-09-20T18:56:39.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: osdmap e2: 0 total, 0 up, 0 in 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: mgrmap e6: smithi027.tlgpqo(active, starting, since 0.00312394s) 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:56:39.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:39 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T18:56:40.559 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:40 smithi027 ceph-mon[28196]: Found migration_current of "None". Setting to last migration. 2024-09-20T18:56:40.559 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:40 smithi027 ceph-mon[28196]: mgrmap e7: smithi027.tlgpqo(active, since 1.00496s) 2024-09-20T18:56:41.745 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:41 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:41.745 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:41 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:42 smithi027 ceph-mon[28196]: mgrmap e8: smithi027.tlgpqo(active, since 2s) 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:42 smithi027 ceph-mon[28196]: [20/Sep/2024:18:56:41] ENGINE Bus STARTING 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:42 smithi027 ceph-mon[28196]: [20/Sep/2024:18:56:42] ENGINE Serving on https://172.21.15.27:7150 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:42 smithi027 ceph-mon[28196]: [20/Sep/2024:18:56:42] ENGINE Error in HTTPServer.serve 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Traceback (most recent call last): 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:56:42.638 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._run(expiration_interval) 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s = self.context.wrap_socket( 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: return self.sslsocket_class._create( 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self.do_handshake() 2024-09-20T18:56:42.639 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:56:42.640 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._sslobj.do_handshake() 2024-09-20T18:56:42.640 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:56:42.640 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:42 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:56:43.616 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:43 smithi027 ceph-mon[28196]: [20/Sep/2024:18:56:42] ENGINE Serving on http://172.21.15.27:8765 2024-09-20T18:56:43.616 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:43 smithi027 ceph-mon[28196]: [20/Sep/2024:18:56:42] ENGINE Bus STARTED 2024-09-20T18:56:44.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:44 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/444778529' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T18:56:45.572 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:56:45.572 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 8, 2024-09-20T18:56:45.572 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:56:45.573 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "smithi027.tlgpqo", 2024-09-20T18:56:45.573 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T18:56:45.573 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:56:45.573 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-20T18:56:45.573 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 8... 2024-09-20T18:56:46.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:46 smithi027 ceph-mon[28196]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T18:56:46.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:46 smithi027 ceph-mon[28196]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 8 is available 2024-09-20T18:56:46.613 INFO:teuthology.orchestra.run.smithi027.stdout:Setting orchestrator backend to cephadm... 2024-09-20T18:56:48.473 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:48 smithi027 ceph-mon[28196]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:48.473 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:48 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:48.473 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:48 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:56:49.049 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-20T18:56:49.049 INFO:teuthology.orchestra.run.smithi027.stdout:Generating ssh key... 2024-09-20T18:56:49.303 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:49 smithi027 ceph-mon[28196]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:51.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:50 smithi027 ceph-mon[28196]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:51.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:50 smithi027 ceph-mon[28196]: Generating ssh key... 2024-09-20T18:56:51.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:50 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:51.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:50 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:52.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDryhhCS/BJL2msOPHIBj3j8GxFFcxujg5xZeplq1mnxhAU44q/sRg8dS0fNR9YyjMaM5b2YUvP7YlCfSvHsGkfdmgpWkfITvNzWpJ4hWWimQhfua4k/6TQ4abnCjEOhKvk+wj7SWU8zUirQQG6fJ/0BlCr4rQ6AitgVLXkUMYGpwvpy3/zrWYav4kBUsbdRnrf5cRragqC17L+Ls3d1ToPdjS2xmUNhqSmEXAXDqlHE4DkWcBjbj5ssQJ+nB7O9CYzaDq9F1sZXNAqYhBg1rUHfZQiaKXAjR7Z3zsjs628D4lu3hpfQbV4C2eRfgOU1ddSEV3gEBanXApwcW2V6WGRI+deS5rWY798Z5fAf06ODZAHOscQH5NvX06GK0wkt5pPFRZ7NsCKaeo2ibvL//Gb1lL+1GDnwR2TjSbqNPOSWbXhf4Z8YYOcy/7VmeSjWFBqtTsthqoxavD8KXUQRnE2dvxpqkYZauHfabuAR21LZJG23dddOfyWpzHh7WCbnCc= ceph-e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:56:52.217 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-20T18:56:52.217 INFO:teuthology.orchestra.run.smithi027.stdout:Adding key to root@localhost authorized_keys... 2024-09-20T18:56:52.222 INFO:teuthology.orchestra.run.smithi027.stdout:Adding host smithi027... 2024-09-20T18:56:52.453 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:52 smithi027 ceph-mon[28196]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:53.255 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:53 smithi027 ceph-mon[28196]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:54.478 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:54 smithi027 ceph-mon[28196]: Deploying cephadm binary to smithi027 2024-09-20T18:56:57.378 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Added host 'smithi027' with addr '172.21.15.27' 2024-09-20T18:56:57.379 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying mon service with default placement... 2024-09-20T18:56:58.063 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:57 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:56:58.064 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:57 smithi027 ceph-mon[28196]: Added host smithi027 2024-09-20T18:56:58.064 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:57 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:56:58.813 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-20T18:56:58.813 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying mgr service with default placement... 2024-09-20T18:56:59.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:59 smithi027 ceph-mon[28196]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:59.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:59 smithi027 ceph-mon[28196]: Saving service mon spec with placement count:5 2024-09-20T18:56:59.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:56:59 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:00.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-20T18:57:00.097 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying crash service with default placement... 2024-09-20T18:57:00.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:00 smithi027 ceph-mon[28196]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:00.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:00 smithi027 ceph-mon[28196]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:00.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:00 smithi027 ceph-mon[28196]: Saving service mgr spec with placement count:2 2024-09-20T18:57:00.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:00 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:01.546 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-20T18:57:01.547 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying ceph-exporter service with default placement... 2024-09-20T18:57:01.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:01 smithi027 ceph-mon[28196]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:01.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:01 smithi027 ceph-mon[28196]: Saving service crash spec with placement * 2024-09-20T18:57:01.829 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:01 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:03.003 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:02 smithi027 ceph-mon[28196]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:03.003 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:02 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:03.003 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:02 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:03.005 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-20T18:57:03.005 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying prometheus service with default placement... 2024-09-20T18:57:04.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:03 smithi027 ceph-mon[28196]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:04.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:03 smithi027 ceph-mon[28196]: Saving service ceph-exporter spec with placement * 2024-09-20T18:57:04.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:03 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:04.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:03 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:04.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-20T18:57:04.203 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying grafana service with default placement... 2024-09-20T18:57:04.932 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:04 smithi027 ceph-mon[28196]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:04.932 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:04 smithi027 ceph-mon[28196]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:04.932 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:04 smithi027 ceph-mon[28196]: Saving service prometheus spec with placement count:1 2024-09-20T18:57:06.060 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:05 smithi027 ceph-mon[28196]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:06.061 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:05 smithi027 ceph-mon[28196]: Saving service grafana spec with placement count:1 2024-09-20T18:57:06.061 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:05 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:06.061 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:05 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:06.064 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-20T18:57:06.064 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying node-exporter service with default placement... 2024-09-20T18:57:07.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:06 smithi027 ceph-mon[28196]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:07.206 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:06 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:07.320 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-20T18:57:07.320 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying alertmanager service with default placement... 2024-09-20T18:57:08.239 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:07 smithi027 ceph-mon[28196]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:08.240 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:07 smithi027 ceph-mon[28196]: Saving service node-exporter spec with placement * 2024-09-20T18:57:08.240 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:07 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:08.551 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-20T18:57:09.169 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:08 smithi027 ceph-mon[28196]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:09.169 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:08 smithi027 ceph-mon[28196]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:09.169 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:08 smithi027 ceph-mon[28196]: Saving service alertmanager spec with placement count:1 2024-09-20T18:57:09.169 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:08 smithi027 ceph-mon[28196]: from='mgr.14118 172.21.15.27:0/3629248861' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:10.458 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:10 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/326416815' entity='client.admin' 2024-09-20T18:57:11.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:11 smithi027 ceph-mon[28196]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:11.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:11 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1454662676' entity='client.admin' 2024-09-20T18:57:11.629 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling the dashboard module... 2024-09-20T18:57:12.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:12 smithi027 ceph-mon[28196]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:13.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:13 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2025558449' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-20T18:57:14.384 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:14 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2025558449' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-20T18:57:14.384 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:14 smithi027 ceph-mon[28196]: mgrmap e9: smithi027.tlgpqo(active, since 34s) 2024-09-20T18:57:15.010 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:57:15.010 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "smithi027.tlgpqo", 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-20T18:57:15.011 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 9... 2024-09-20T18:57:15.259 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:15 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3298342381' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T18:57:18.607 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: Active manager daemon smithi027.tlgpqo restarted 2024-09-20T18:57:18.607 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: Activating manager daemon smithi027.tlgpqo 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: osdmap e3: 0 total, 0 up, 0 in 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: mgrmap e10: smithi027.tlgpqo(active, starting, since 0.00298722s) 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:57:18.608 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:18 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T18:57:20.327 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:57:20.328 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-20T18:57:20.328 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T18:57:20.328 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:57:20.328 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 9 is available 2024-09-20T18:57:20.328 INFO:teuthology.orchestra.run.smithi027.stdout:Generating a dashboard self-signed certificate... 2024-09-20T18:57:20.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: mgrmap e11: smithi027.tlgpqo(active, since 1.00536s) 2024-09-20T18:57:20.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: [20/Sep/2024:18:57:19] ENGINE Bus STARTING 2024-09-20T18:57:20.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: [20/Sep/2024:18:57:19] ENGINE Serving on https://172.21.15.27:7150 2024-09-20T18:57:20.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: [20/Sep/2024:18:57:19] ENGINE Error in HTTPServer.serve 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Traceback (most recent call last): 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._run(expiration_interval) 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:57:20.579 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s = self.context.wrap_socket( 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: return self.sslsocket_class._create( 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self.do_handshake() 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:57:20.580 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._sslobj.do_handshake() 2024-09-20T18:57:20.581 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:57:20.581 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:20.581 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: [20/Sep/2024:18:57:19] ENGINE Serving on http://172.21.15.27:8765 2024-09-20T18:57:20.581 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:20 smithi027 ceph-mon[28196]: [20/Sep/2024:18:57:19] ENGINE Bus STARTED 2024-09-20T18:57:21.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:21 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:21.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:21 smithi027 ceph-mon[28196]: mgrmap e12: smithi027.tlgpqo(active, since 2s) 2024-09-20T18:57:21.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:21 smithi027 ceph-mon[28196]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:21.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:21 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:21.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:21 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:22.364 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-20T18:57:22.364 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial admin user... 2024-09-20T18:57:24.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$oTzrYqgu01jaj0XI3nXbBeoYeKHOE7fHAvfm4BeOptCJEykfXb97i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726858643, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-20T18:57:24.247 INFO:teuthology.orchestra.run.smithi027.stdout:Fetching dashboard port number... 2024-09-20T18:57:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:24 smithi027 ceph-mon[28196]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:24.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:24 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:25.445 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 8443 2024-09-20T18:57:25.455 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:57:25.455 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-20T18:57:25.463 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:57:25.463 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-20T18:57:25.463 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-20T18:57:25.463 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph Dashboard is now available at: 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: URL: https://smithi027.front.sepia.ceph.com:8443/ 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: User: admin 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: Password: eiuvbq5jgn 2024-09-20T18:57:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:25.466 INFO:teuthology.orchestra.run.smithi027.stdout:Saving cluster configuration to /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config directory 2024-09-20T18:57:25.721 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:25 smithi027 ceph-mon[28196]: mgrmap e13: smithi027.tlgpqo(active, since 6s) 2024-09-20T18:57:25.721 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:25 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2352646734' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout:Or, if you are only running a single cluster on this host: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.777 INFO:teuthology.orchestra.run.smithi027.stdout: ceph telemetry on 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout:For more information see: 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:26.778 INFO:teuthology.orchestra.run.smithi027.stdout:Bootstrap complete. 2024-09-20T18:57:26.818 INFO:tasks.cephadm:Fetching config... 2024-09-20T18:57:26.818 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:57:26.819 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-20T18:57:26.835 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-20T18:57:26.836 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:57:26.836 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-20T18:57:26.893 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-20T18:57:26.893 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:57:26.893 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/keyring of=/dev/stdout 2024-09-20T18:57:26.959 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-20T18:57:26.960 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:57:26.960 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-20T18:57:27.015 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-20T18:57:27.016 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDryhhCS/BJL2msOPHIBj3j8GxFFcxujg5xZeplq1mnxhAU44q/sRg8dS0fNR9YyjMaM5b2YUvP7YlCfSvHsGkfdmgpWkfITvNzWpJ4hWWimQhfua4k/6TQ4abnCjEOhKvk+wj7SWU8zUirQQG6fJ/0BlCr4rQ6AitgVLXkUMYGpwvpy3/zrWYav4kBUsbdRnrf5cRragqC17L+Ls3d1ToPdjS2xmUNhqSmEXAXDqlHE4DkWcBjbj5ssQJ+nB7O9CYzaDq9F1sZXNAqYhBg1rUHfZQiaKXAjR7Z3zsjs628D4lu3hpfQbV4C2eRfgOU1ddSEV3gEBanXApwcW2V6WGRI+deS5rWY798Z5fAf06ODZAHOscQH5NvX06GK0wkt5pPFRZ7NsCKaeo2ibvL//Gb1lL+1GDnwR2TjSbqNPOSWbXhf4Z8YYOcy/7VmeSjWFBqtTsthqoxavD8KXUQRnE2dvxpqkYZauHfabuAR21LZJG23dddOfyWpzHh7WCbnCc= ceph-e7838b9c-7781-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T18:57:27.090 INFO:teuthology.orchestra.run.smithi027.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDryhhCS/BJL2msOPHIBj3j8GxFFcxujg5xZeplq1mnxhAU44q/sRg8dS0fNR9YyjMaM5b2YUvP7YlCfSvHsGkfdmgpWkfITvNzWpJ4hWWimQhfua4k/6TQ4abnCjEOhKvk+wj7SWU8zUirQQG6fJ/0BlCr4rQ6AitgVLXkUMYGpwvpy3/zrWYav4kBUsbdRnrf5cRragqC17L+Ls3d1ToPdjS2xmUNhqSmEXAXDqlHE4DkWcBjbj5ssQJ+nB7O9CYzaDq9F1sZXNAqYhBg1rUHfZQiaKXAjR7Z3zsjs628D4lu3hpfQbV4C2eRfgOU1ddSEV3gEBanXApwcW2V6WGRI+deS5rWY798Z5fAf06ODZAHOscQH5NvX06GK0wkt5pPFRZ7NsCKaeo2ibvL//Gb1lL+1GDnwR2TjSbqNPOSWbXhf4Z8YYOcy/7VmeSjWFBqtTsthqoxavD8KXUQRnE2dvxpqkYZauHfabuAR21LZJG23dddOfyWpzHh7WCbnCc= ceph-e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:57:27.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDryhhCS/BJL2msOPHIBj3j8GxFFcxujg5xZeplq1mnxhAU44q/sRg8dS0fNR9YyjMaM5b2YUvP7YlCfSvHsGkfdmgpWkfITvNzWpJ4hWWimQhfua4k/6TQ4abnCjEOhKvk+wj7SWU8zUirQQG6fJ/0BlCr4rQ6AitgVLXkUMYGpwvpy3/zrWYav4kBUsbdRnrf5cRragqC17L+Ls3d1ToPdjS2xmUNhqSmEXAXDqlHE4DkWcBjbj5ssQJ+nB7O9CYzaDq9F1sZXNAqYhBg1rUHfZQiaKXAjR7Z3zsjs628D4lu3hpfQbV4C2eRfgOU1ddSEV3gEBanXApwcW2V6WGRI+deS5rWY798Z5fAf06ODZAHOscQH5NvX06GK0wkt5pPFRZ7NsCKaeo2ibvL//Gb1lL+1GDnwR2TjSbqNPOSWbXhf4Z8YYOcy/7VmeSjWFBqtTsthqoxavD8KXUQRnE2dvxpqkYZauHfabuAR21LZJG23dddOfyWpzHh7WCbnCc= ceph-e7838b9c-7781-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T18:57:27.147 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDryhhCS/BJL2msOPHIBj3j8GxFFcxujg5xZeplq1mnxhAU44q/sRg8dS0fNR9YyjMaM5b2YUvP7YlCfSvHsGkfdmgpWkfITvNzWpJ4hWWimQhfua4k/6TQ4abnCjEOhKvk+wj7SWU8zUirQQG6fJ/0BlCr4rQ6AitgVLXkUMYGpwvpy3/zrWYav4kBUsbdRnrf5cRragqC17L+Ls3d1ToPdjS2xmUNhqSmEXAXDqlHE4DkWcBjbj5ssQJ+nB7O9CYzaDq9F1sZXNAqYhBg1rUHfZQiaKXAjR7Z3zsjs628D4lu3hpfQbV4C2eRfgOU1ddSEV3gEBanXApwcW2V6WGRI+deS5rWY798Z5fAf06ODZAHOscQH5NvX06GK0wkt5pPFRZ7NsCKaeo2ibvL//Gb1lL+1GDnwR2TjSbqNPOSWbXhf4Z8YYOcy/7VmeSjWFBqtTsthqoxavD8KXUQRnE2dvxpqkYZauHfabuAR21LZJG23dddOfyWpzHh7WCbnCc= ceph-e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:57:27.160 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-20T18:57:27.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:27 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3181434369' entity='client.admin' 2024-09-20T18:57:27.494 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:57:28.892 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-20T18:57:28.892 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-20T18:57:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:57:29.464 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:29 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/32235127' entity='client.admin' 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:57:31.446 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:31 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:57:31.476 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-09-20T18:57:31.476 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:57:31.476 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-09-20T18:57:31.495 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:57:31.495 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:57:31.553 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-09-20T18:57:31.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch host add smithi098 2024-09-20T18:57:31.812 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:57:32.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-20T18:57:32.502 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:32 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:57:33.456 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:33 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:57:33.456 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:33 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:57:33.456 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:33 smithi027 ceph-mon[28196]: Deploying daemon ceph-exporter.smithi027 on smithi027 2024-09-20T18:57:34.397 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:34 smithi027 ceph-mon[28196]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: Deploying cephadm binary to smithi098 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-20T18:57:35.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:35 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:57:36.436 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-09-20T18:57:36.563 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:36 smithi027 ceph-mon[28196]: Deploying daemon crash.smithi027 on smithi027 2024-09-20T18:57:37.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: Added host smithi098 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:37.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:37 smithi027 ceph-mon[28196]: Deploying daemon node-exporter.smithi027 on smithi027 2024-09-20T18:57:37.592 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:57:38.320 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:57:38.320 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-09-20T18:57:38.837 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-20T18:57:38.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-20T18:57:39.109 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:57:39.487 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:39 smithi027 ceph-mon[28196]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:57:39.487 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:39 smithi027 ceph-mon[28196]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:39.487 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:39 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-09-20T18:57:40.654 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:40 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/862416104' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T18:57:41.258 INFO:tasks.cephadm:Adding mon.smithi027 on smithi027 2024-09-20T18:57:41.258 INFO:tasks.cephadm:Adding mon.smithi098 on smithi098 2024-09-20T18:57:41.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch apply mon '2;smithi027:172.21.15.27=smithi027;smithi098:172.21.15.98=smithi098' 2024-09-20T18:57:41.505 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:41 smithi027 ceph-mon[28196]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:41.505 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:41 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/862416104' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T18:57:41.506 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:41 smithi027 ceph-mon[28196]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T18:57:41.513 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:42.154 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mon update... 2024-09-20T18:57:42.705 DEBUG:teuthology.orchestra.run.smithi098:mon.smithi098> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi098.service 2024-09-20T18:57:42.707 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:42.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:43.019 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:43.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:43.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:43.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:43.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:43.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: Deploying daemon alertmanager.smithi027 on smithi027 2024-09-20T18:57:43.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi027:172.21.15.27=smithi027;smithi098:172.21.15.98=smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:43.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: Saving service mon spec with placement smithi027:172.21.15.27=smithi027;smithi098:172.21.15.98=smithi098;count:2 2024-09-20T18:57:43.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:42 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:43.675 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:43.676 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:44.415 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:44 smithi027 ceph-mon[28196]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:44.416 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:44 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:44.416 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:44 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2967632288' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:45.243 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:45.243 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:45.486 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:45.530 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:46.269 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:46.270 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:46.270 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:46.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:46 smithi027 ceph-mon[28196]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:47.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:47 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3696456806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:47.833 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:47.833 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:48.077 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:48.120 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:48.559 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:48 smithi027 ceph-mon[28196]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:48.817 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:48.817 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:49.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:49 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3789623854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:50.414 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:50.415 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:50.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:50.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:57:50.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:50 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:50.703 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:51.329 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:51.330 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:51.330 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:51.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:51 smithi027 ceph-mon[28196]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T18:57:51.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:51 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:57:51.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:51 smithi027 ceph-mon[28196]: Deploying daemon grafana.smithi027 on smithi027 2024-09-20T18:57:52.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:52 smithi027 ceph-mon[28196]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:52.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:52 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1139956470' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:52.922 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:52.922 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:53.175 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:53.219 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:53.929 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:53.929 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:54.433 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:54 smithi027 ceph-mon[28196]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:54.433 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:54 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:57:54.433 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:54 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2567547837' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:55.520 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:55.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:55.760 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:55.804 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:56.430 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:56.430 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:56.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:56 smithi027 ceph-mon[28196]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:57.494 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:57 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2977853040' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:57:57.944 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:57:57.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:57:58.187 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:58.231 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:57:58.453 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:58 smithi027 ceph-mon[28196]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:57:58.923 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:57:59.410 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:57:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/632574873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:00.491 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:00.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.578 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:00 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:00.731 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:00.774 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:01.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:01 smithi027 ceph-mon[28196]: Deploying daemon prometheus.smithi027 on smithi027 2024-09-20T18:58:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:01.406 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:01.406 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:02.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:02 smithi027 ceph-mon[28196]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:02.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:02 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1346950798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:02.929 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:02.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:03.171 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:03.880 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:03.880 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:04.452 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:04 smithi027 ceph-mon[28196]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:04.452 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:04 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:04.452 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:04 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2526647754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:05.435 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:05.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:05.673 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:05.717 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:06.369 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:06.369 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:06.369 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:06.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:06 smithi027 ceph-mon[28196]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:07.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:07 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3136071512' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:07.960 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:07.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:08.203 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:08.247 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:08.576 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:08 smithi027 ceph-mon[28196]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:08.908 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:08.908 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:08.909 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:09.462 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:09 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1107318768' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:10.454 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:10.454 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:10.577 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:10 smithi027 ceph-mon[28196]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:10.694 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:10.738 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:11.369 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:11.369 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:12.513 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:12 smithi027 ceph-mon[28196]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:12.513 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:12 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3752597550' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:12.898 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:12.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:13.142 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:13.186 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:13.800 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:13.801 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:13.801 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:14.467 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:14 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3340571173' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:15.380 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:15.380 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:15.420 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:15 smithi027 ceph-mon[28196]: from='mgr.14162 172.21.15.27:0/1826222331' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T18:58:15.421 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:15 smithi027 ceph-mon[28196]: mgrmap e14: smithi027.tlgpqo(active, since 55s) 2024-09-20T18:58:15.626 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:15.670 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:16.288 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:16.288 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:16.289 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:16.619 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:16 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1540334245' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:17.879 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:17.879 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:18.122 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:18.794 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:18.794 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:19.142 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:18 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2386977954' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: Active manager daemon smithi027.tlgpqo restarted 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: Activating manager daemon smithi027.tlgpqo 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: mgrmap e15: smithi027.tlgpqo(active, starting, since 0.00339817s) 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:58:20.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T18:58:20.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:58:20.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:20.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:58:20.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:58:20.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T18:58:20.344 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:20.344 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:20.577 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:20.620 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:21.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:20 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:21.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:20 smithi027 ceph-mon[28196]: mgrmap e16: smithi027.tlgpqo(active, since 1.00747s) 2024-09-20T18:58:21.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:20 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:21.255 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:21.255 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:22.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: [20/Sep/2024:18:58:20] ENGINE Bus STARTING 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: [20/Sep/2024:18:58:20] ENGINE Serving on http://172.21.15.27:8765 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: [20/Sep/2024:18:58:21] ENGINE Serving on https://172.21.15.27:7150 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: [20/Sep/2024:18:58:21] ENGINE Bus STARTED 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: [20/Sep/2024:18:58:21] ENGINE Error in HTTPServer.serve 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Traceback (most recent call last): 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._run(expiration_interval) 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:58:22.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s = self.context.wrap_socket( 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: return self.sslsocket_class._create( 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self.do_handshake() 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._sslobj.do_handshake() 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/442856569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:22.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:21 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:22.816 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:22.816 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:23.237 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:23.280 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:22 smithi027 ceph-mon[28196]: mgrmap e17: smithi027.tlgpqo(active, since 2s) 2024-09-20T18:58:23.726 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:58:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:24.430 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:24.430 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:58:24.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:24 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2441358049' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:26.032 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:26.032 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:26.274 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:26.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-20T18:58:26.828 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:26.918 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:26.918 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:26.919 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:27.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:27 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:58:27.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:27 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:58:27.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:27 smithi027 ceph-mon[28196]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-20T18:58:27.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:27 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3369347026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:28.805 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:28.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:29.194 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:29.877 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:29.877 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:29.878 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:30.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:29 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3703605497' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:31.806 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:31.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:31.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:31.827 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:31 smithi027 ceph-mon[28196]: Deploying daemon crash.smithi098 on smithi098 2024-09-20T18:58:32.060 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:32.725 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:32.725 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:32.725 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:33.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:32 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1995476962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:34.508 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:34.508 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:34.508 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:34.509 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:34.509 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-20T18:58:34.509 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:34.509 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:58:34.634 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:34.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:34.907 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:35.961 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:35.961 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:35.961 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:36.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:36 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3555379040' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:38.216 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:38.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:39.067 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:39.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:39.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:39.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:39.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:39.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:58:39.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T18:58:39.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:58:39.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:39.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:38 smithi027 ceph-mon[28196]: Deploying daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T18:58:39.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:39 smithi027 ceph-mon[28196]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:39.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:39 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:39.872 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:39.872 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:41.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/4181961238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:41.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:41.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:41.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:41.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:41.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:58:41.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:41.805 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:41.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:42.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:41 smithi027 ceph-mon[28196]: Deploying daemon mon.smithi098 on smithi098 2024-09-20T18:58:42.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:41 smithi027 ceph-mon[28196]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:42.609 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:43.576 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:43 smithi027 ceph-mon[28196]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:43.904 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:43.904 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:56:13.766810Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:58:43.905 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-20T18:58:44.527 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:44 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1193953600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:44.527 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:44 smithi098 systemd[1]: Started Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T18:58:45.612 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:58:45.612 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:58:45.857 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: mon.smithi027 calling monitor election 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: mon.smithi098 calling monitor election 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: monmap epoch 2 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: min_mon_release 19 (squid) 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: election_strategy: 1 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: fsmap 2024-09-20T18:58:50.078 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: mgrmap e17: smithi027.tlgpqo(active, since 30s) 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: overall HEALTH_OK 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.079 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: mon.smithi027 calling monitor election 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T18:58:50.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: mon.smithi098 calling monitor election 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: monmap epoch 2 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T18:58:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: min_mon_release 19 (squid) 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: election_strategy: 1 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: fsmap 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:58:50.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: mgrmap e17: smithi027.tlgpqo(active, since 30s) 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: overall HEALTH_OK 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3448667725' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:58:50.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:50.122 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T18:58:50.122 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","modified":"2024-09-20T18:58:44.714160Z","created":"2024-09-20T18:56:13.766810Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi027","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T18:58:50.123 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-09-20T18:58:50.761 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-20T18:58:50.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-20T18:58:51.003 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:50 smithi098 ceph-mon[35737]: mgrmap e18: smithi027.tlgpqo(active, since 30s), standbys: smithi098.wrcvbg 2024-09-20T18:58:51.003 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T18:58:51.003 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:58:51.003 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:50 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/2067692908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:51.004 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:51.034 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:51.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:50 smithi027 ceph-mon[28196]: mgrmap e18: smithi027.tlgpqo(active, since 30s), standbys: smithi098.wrcvbg 2024-09-20T18:58:51.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T18:58:51.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:58:51.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:50 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2067692908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:58:51.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T18:58:51.683 INFO:teuthology.orchestra.run.smithi027.stdout:# minimal ceph.conf for e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:58:51.683 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-09-20T18:58:51.683 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T18:58:51.684 INFO:teuthology.orchestra.run.smithi027.stdout: mon_host = [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-20T18:58:51.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:51 smithi098 ceph-mon[35737]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:51.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:51 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3865800144' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:51.973 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:51 smithi027 ceph-mon[28196]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:51.973 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:51 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3865800144' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:52.355 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-20T18:58:52.356 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:58:52.356 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T18:58:52.384 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:58:52.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:58:52.452 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:58:52.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T18:58:52.478 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:58:52.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:58:52.544 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-20T18:58:52.544 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-20T18:58:52.546 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-20T18:58:52.547 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-20T18:58:52.589 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-20T18:58:52.590 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-20T18:58:52.633 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-20T18:58:52.633 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-20T18:58:52.676 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-20T18:58:52.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-20T18:58:52.719 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-20T18:58:52.719 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-20T18:58:52.765 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-20T18:58:52.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-20T18:58:52.813 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-20T18:58:52.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-20T18:58:52.866 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-20T18:58:52.866 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-20T18:58:52.924 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-20T18:58:52.924 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-20T18:58:52.976 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-20T18:58:52.976 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-20T18:58:52.977 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:53.036 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-20T18:58:53.036 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-20T18:58:53.087 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-20T18:58:53.087 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-20T18:58:53.135 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-20T18:58:53.136 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-20T18:58:53.179 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-20T18:58:53.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-20T18:58:53.236 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-20T18:58:53.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-20T18:58:53.292 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-20T18:58:53.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-20T18:58:53.337 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-20T18:58:53.337 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-20T18:58:53.390 DEBUG:tasks.cephadm:set 18 configs 2024-09-20T18:58:53.391 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi027') 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.435 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Reconfiguring mon.smithi027 (unknown last config time)... 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: Reconfiguring daemon mon.smithi027 on smithi027 2024-09-20T18:58:53.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:53 smithi027 ceph-mon[28196]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:58:53.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Reconfiguring mon.smithi027 (unknown last config time)... 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: Reconfiguring daemon mon.smithi027 on smithi027 2024-09-20T18:58:53.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:53 smithi098 ceph-mon[35737]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:53.772 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:55.063 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi027') 2024-09-20T18:58:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:55.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:54 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3751709154' entity='client.admin' 2024-09-20T18:58:55.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:55.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:54 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1600842185' entity='client.admin' 2024-09-20T18:58:55.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:54 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3751709154' entity='client.admin' 2024-09-20T18:58:55.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:55.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:54 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1600842185' entity='client.admin' 2024-09-20T18:58:55.675 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi027') 2024-09-20T18:58:56.209 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:55 smithi027 ceph-mon[28196]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:56.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:55 smithi098 ceph-mon[35737]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:56.652 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.653 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.655 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.656 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.674 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.683 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:56.683 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1009831385' entity='client.admin' 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:58:58.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1009831385' entity='client.admin' 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:58:58.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:58:59.123 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:58:59.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:59 smithi098 ceph-mon[35737]: Reconfiguring mgr.smithi027.tlgpqo (unknown last config time)... 2024-09-20T18:58:59.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:59 smithi098 ceph-mon[35737]: Reconfiguring daemon mgr.smithi027.tlgpqo on smithi027 2024-09-20T18:58:59.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:59 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3877284425' entity='client.admin' 2024-09-20T18:58:59.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:58:59 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2874756047' entity='client.admin' 2024-09-20T18:58:59.556 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:59 smithi027 ceph-mon[28196]: Reconfiguring mgr.smithi027.tlgpqo (unknown last config time)... 2024-09-20T18:58:59.556 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:59 smithi027 ceph-mon[28196]: Reconfiguring daemon mgr.smithi027.tlgpqo on smithi027 2024-09-20T18:58:59.556 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3877284425' entity='client.admin' 2024-09-20T18:58:59.556 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:58:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2874756047' entity='client.admin' 2024-09-20T18:59:00.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:00 smithi027 ceph-mon[28196]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:00.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:00 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/4025859702' entity='client.admin' 2024-09-20T18:59:00.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:00 smithi098 ceph-mon[35737]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:00.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:00 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/4025859702' entity='client.admin' 2024-09-20T18:59:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:00.957 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:01.755 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:02.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:02 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2926622089' entity='client.admin' 2024-09-20T18:59:02.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:02 smithi098 ceph-mon[35737]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:02.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:02 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1088228252' entity='client.admin' 2024-09-20T18:59:02.523 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:02 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2926622089' entity='client.admin' 2024-09-20T18:59:02.524 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:02 smithi027 ceph-mon[28196]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:02.524 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:02 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1088228252' entity='client.admin' 2024-09-20T18:59:03.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:03 smithi027 ceph-mon[28196]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:03.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:03 smithi098 ceph-mon[35737]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:04.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:04 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/317930844' entity='client.admin' 2024-09-20T18:59:04.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:04.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:04 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/317930844' entity='client.admin' 2024-09-20T18:59:04.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:06.128 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:05 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2107817351' entity='client.admin' 2024-09-20T18:59:06.128 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:05 smithi027 ceph-mon[28196]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:06.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:05 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2107817351' entity='client.admin' 2024-09-20T18:59:06.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:05 smithi098 ceph-mon[35737]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:06.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f655006e240 msgr2=0x7f6550070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:06.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 --2- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f655006e240 0x7f6550070700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6558009b60 tx=0x7f6558005f90 comp rx=0 tx=0).stop 2024-09-20T18:59:06.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6568104da0 msgr2=0x7f6568197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:06.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 --2- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6568104da0 0x7f6568197970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f655c0045c0 tx=0x7f655c0045f0 comp rx=0 tx=0).stop 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 shutdown_connections 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 --2- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f655006e240 0x7f6550070700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 --2- 172.21.15.27:0/2072518020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6568104da0 0x7f6568197970 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 --2- 172.21.15.27:0/2072518020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6568102470 0x7f6568197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 >> 172.21.15.27:0/2072518020 conn(0x7f65680fc010 msgr2=0x7f65680fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 shutdown_connections 2024-09-20T18:59:06.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:06.783+0000 7f656c9d3640 1 -- 172.21.15.27:0/2072518020 wait complete. 2024-09-20T18:59:06.963 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:07.389 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:07 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2124321526' entity='client.admin' 2024-09-20T18:59:07.389 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:07 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2072518020' entity='client.admin' 2024-09-20T18:59:07.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:07 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2124321526' entity='client.admin' 2024-09-20T18:59:07.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:07 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2072518020' entity='client.admin' 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- 172.21.15.27:0/1844453474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 msgr2=0x7f247c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 --2- 172.21.15.27:0/1844453474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c100c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2478009880 tx=0x7f247802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- 172.21.15.27:0/1844453474 shutdown_connections 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 --2- 172.21.15.27:0/1844453474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f247c101a60 0x7f247c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 --2- 172.21.15.27:0/1844453474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c100c60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- 172.21.15.27:0/1844453474 >> 172.21.15.27:0/1844453474 conn(0x7f247c0fc010 msgr2=0x7f247c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- 172.21.15.27:0/1844453474 shutdown_connections 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- 172.21.15.27:0/1844453474 wait complete. 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 Processor -- start 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 -- start start 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.904+0000 7f2483b37640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2483b37640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f247c101a60 0x7f247c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2483b37640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f247c109700 con 0x7f247c100860 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2483b37640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f247c109580 con 0x7f247c101a60 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38380/0 (socket says 172.21.15.27:38380) 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 -- 172.21.15.27:0/346686558 learned_addr learned my addr 172.21.15.27:0/346686558 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 -- 172.21.15.27:0/346686558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f247c101a60 msgr2=0x7f247c19c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f247c101a60 0x7f247c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 -- 172.21.15.27:0/346686558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c19c820 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f24818d3640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2478006010 tx=0x7f24780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f247803f070 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24780044d0 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c19cab0 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2478035030 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.905+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c19d060 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.906+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247c100c60 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.907+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f2478042070 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.907+0000 7f2472ffd640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 0x7f24680706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.907+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f24780add90 con 0x7f247c100860 2024-09-20T18:59:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.907+0000 7f24810d2640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 0x7f24680706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:08.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.908+0000 7f24810d2640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 0x7f24680706f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f247c06a550 tx=0x7f246c006c90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:08.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:07.912+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f247807c740 con 0x7f247c100860 2024-09-20T18:59:08.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.092+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f247c062df0 con 0x7f247c100860 2024-09-20T18:59:08.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.096+0000 7f2472ffd640 1 -- 172.21.15.27:0/346686558 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f24780803f0 con 0x7f247c100860 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 msgr2=0x7f24680706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 0x7f24680706f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f247c06a550 tx=0x7f246c006c90 comp rx=0 tx=0).stop 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 msgr2=0x7f247c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2478006010 tx=0x7f24780048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 shutdown_connections 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f246806e230 0x7f24680706f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f247c101a60 0x7f247c19c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 --2- 172.21.15.27:0/346686558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f247c100860 0x7f247c06a7d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 >> 172.21.15.27:0/346686558 conn(0x7f247c0fc010 msgr2=0x7f247c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:08.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 shutdown_connections 2024-09-20T18:59:08.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.098+0000 7f2483b37640 1 -- 172.21.15.27:0/346686558 wait complete. 2024-09-20T18:59:08.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:08 smithi027 ceph-mon[28196]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:08.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:08 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/346686558' entity='client.admin' 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.328+0000 7fba1299d640 1 -- 172.21.15.27:0/672701794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 msgr2=0x7fba0c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.328+0000 7fba1299d640 1 --2- 172.21.15.27:0/672701794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c101ee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba00009880 tx=0x7fba0002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 -- 172.21.15.27:0/672701794 shutdown_connections 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 --2- 172.21.15.27:0/672701794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c101ee0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 --2- 172.21.15.27:0/672701794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 0x7fba0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 -- 172.21.15.27:0/672701794 >> 172.21.15.27:0/672701794 conn(0x7fba0c0fc010 msgr2=0x7fba0c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 -- 172.21.15.27:0/672701794 shutdown_connections 2024-09-20T18:59:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 -- 172.21.15.27:0/672701794 wait complete. 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 Processor -- start 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.329+0000 7fba1299d640 1 -- start start 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba1299d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 0x7fba0c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba1299d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba1299d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1096a0 con 0x7fba0c101a60 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba1299d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c109520 con 0x7fba0c100860 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38390/0 (socket says 172.21.15.27:38390) 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 -- 172.21.15.27:0/2663939834 learned_addr learned my addr 172.21.15.27:0/2663939834 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0bfff640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 0x7fba0c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 -- 172.21.15.27:0/2663939834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 msgr2=0x7fba0c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 0x7fba0c197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 -- 172.21.15.27:0/2663939834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c198100 con 0x7fba0c101a60 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba0b7fe640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba00006010 tx=0x7fba000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba0003f070 con 0x7fba0c101a60 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba00004ac0 con 0x7fba0c101a60 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.330+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba00035030 con 0x7fba0c101a60 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.331+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c19cae0 con 0x7fba0c101a60 2024-09-20T18:59:08.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.331+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c19d070 con 0x7fba0c101a60 2024-09-20T18:59:08.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.331+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0c100c60 con 0x7fba0c101a60 2024-09-20T18:59:08.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.332+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fba00042070 con 0x7fba0c101a60 2024-09-20T18:59:08.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.333+0000 7fba097fa640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 0x7fb9f40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:08.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.333+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fba000adc00 con 0x7fba0c101a60 2024-09-20T18:59:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.333+0000 7fba0bfff640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 0x7fb9f40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.333+0000 7fba0bfff640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 0x7fb9f40706f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005fd0 tx=0x7fb9fc00b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:08.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.337+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba000b4080 con 0x7fba0c101a60 2024-09-20T18:59:08.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:08 smithi098 ceph-mon[35737]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:08.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:08 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/346686558' entity='client.admin' 2024-09-20T18:59:08.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.517+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fba0c19d9b0 con 0x7fba0c101a60 2024-09-20T18:59:08.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.520+0000 7fba097fa640 1 -- 172.21.15.27:0/2663939834 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7fba000802f0 con 0x7fba0c101a60 2024-09-20T18:59:08.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 msgr2=0x7fb9f40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 0x7fb9f40706f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005fd0 tx=0x7fb9fc00b390 comp rx=0 tx=0).stop 2024-09-20T18:59:08.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 msgr2=0x7fba0c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:08.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba00006010 tx=0x7fba000046c0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 shutdown_connections 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb9f406e230 0x7fb9f40706f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba0c101a60 0x7fba0c197a80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 --2- 172.21.15.27:0/2663939834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba0c100860 0x7fba0c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 >> 172.21.15.27:0/2663939834 conn(0x7fba0c0fc010 msgr2=0x7fba0c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 shutdown_connections 2024-09-20T18:59:08.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:08.522+0000 7fba1299d640 1 -- 172.21.15.27:0/2663939834 wait complete. 2024-09-20T18:59:08.919 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.919 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.919 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.919 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.920 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.920 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi027') 2024-09-20T18:59:08.920 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi027') 2024-09-20T18:59:09.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 -- 172.21.15.27:0/3943823633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028103930 msgr2=0x7f60280ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 --2- 172.21.15.27:0/3943823633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028103930 0x7f60280ff9e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6018009880 tx=0x7f601802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 -- 172.21.15.27:0/3943823633 shutdown_connections 2024-09-20T18:59:09.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 --2- 172.21.15.27:0/3943823633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028103930 0x7f60280ff9e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 --2- 172.21.15.27:0/3943823633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028102f60 0x7f6028103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 -- 172.21.15.27:0/3943823633 >> 172.21.15.27:0/3943823633 conn(0x7f60280fb770 msgr2=0x7f60280fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 -- 172.21.15.27:0/3943823633 shutdown_connections 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.547+0000 7f603037a640 1 -- 172.21.15.27:0/3943823633 wait complete. 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 Processor -- start 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 -- start start 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 0x7f6028197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f602810a7a0 con 0x7f6028102f60 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f603037a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f602810a620 con 0x7f6028103930 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f602e116640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f602e116640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38416/0 (socket says 172.21.15.27:38416) 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f602e116640 1 -- 172.21.15.27:0/3871324983 learned_addr learned my addr 172.21.15.27:0/3871324983 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.548+0000 7f602d915640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 0x7f6028197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f602e116640 1 -- 172.21.15.27:0/3871324983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 msgr2=0x7f6028197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f602e116640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 0x7f6028197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f602e116640 1 -- 172.21.15.27:0/3871324983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60281980f0 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f602d915640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 0x7f6028197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f602e116640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f602400d6f0 tx=0x7f602400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6024017070 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f602400de00 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602819cb30 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6024003bc0 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.549+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602819d090 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.550+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6028103360 con 0x7f6028102f60 2024-09-20T18:59:09.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.551+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6024003e70 con 0x7f6028102f60 2024-09-20T18:59:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.551+0000 7f601f7fe640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 0x7f60140706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.551+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f602408cc40 con 0x7f6028102f60 2024-09-20T18:59:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.551+0000 7f602d915640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 0x7f60140706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.552+0000 7f602d915640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 0x7f60140706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.555+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f602405b680 con 0x7f6028102f60 2024-09-20T18:59:09.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.738+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f60281915b0 con 0x7f6028102f60 2024-09-20T18:59:09.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.742+0000 7f601f7fe640 1 -- 172.21.15.27:0/3871324983 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f602405f330 con 0x7f6028102f60 2024-09-20T18:59:09.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 msgr2=0x7f60140706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 0x7f60140706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018005a20 comp rx=0 tx=0).stop 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 msgr2=0x7f6028197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f602400d6f0 tx=0x7f602400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 shutdown_connections 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f601406e230 0x7f60140706f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028103930 0x7f6028197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.744+0000 7f603037a640 1 --2- 172.21.15.27:0/3871324983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028102f60 0x7f6028197530 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.745+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 >> 172.21.15.27:0/3871324983 conn(0x7f60280fb770 msgr2=0x7f6028106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.745+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 shutdown_connections 2024-09-20T18:59:09.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.745+0000 7f603037a640 1 -- 172.21.15.27:0/3871324983 wait complete. 2024-09-20T18:59:09.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 -- 172.21.15.27:0/1557596159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 msgr2=0x7fd778101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/1557596159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778101ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd760009880 tx=0x7fd76002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 -- 172.21.15.27:0/1557596159 shutdown_connections 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/1557596159 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778101ee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/1557596159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 0x7fd778100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.653+0000 7fd77cdb4640 1 -- 172.21.15.27:0/1557596159 >> 172.21.15.27:0/1557596159 conn(0x7fd7780fc010 msgr2=0x7fd7780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 -- 172.21.15.27:0/1557596159 shutdown_connections 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 -- 172.21.15.27:0/1557596159 wait complete. 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 Processor -- start 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 -- start start 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 0x7fd778199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd778109720 con 0x7fd778101a60 2024-09-20T18:59:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.654+0000 7fd77cdb4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7781095a0 con 0x7fd778100860 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38442/0 (socket says 172.21.15.27:38442) 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 -- 172.21.15.27:0/658340112 learned_addr learned my addr 172.21.15.27:0/658340112 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd77659c640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 0x7fd778199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 -- 172.21.15.27:0/658340112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 msgr2=0x7fd778199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 0x7fd778199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 -- 172.21.15.27:0/658340112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77819a350 con 0x7fd778101a60 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76ffff640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd760006010 tx=0x7fd7600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd76003f070 con 0x7fd778101a60 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7600044d0 con 0x7fd778101a60 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77819ed30 con 0x7fd778101a60 2024-09-20T18:59:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.655+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd760035030 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.656+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77819f2e0 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.656+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd778100c40 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.657+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fd760042070 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.657+0000 7fd76f7fe640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 0x7fd7640706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.658+0000 7fd77659c640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 0x7fd7640706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.658+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd7600adce0 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.658+0000 7fd77659c640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 0x7fd7640706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7781018c0 tx=0x7fd768009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.666+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd76007c720 con 0x7fd778101a60 2024-09-20T18:59:09.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:09 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2663939834' entity='client.admin' 2024-09-20T18:59:09.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:09 smithi027 ceph-mon[28196]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:09.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.850+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd77819f720 con 0x7fd778101a60 2024-09-20T18:59:09.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.853+0000 7fd76f7fe640 1 -- 172.21.15.27:0/658340112 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fd7600803d0 con 0x7fd778101a60 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 msgr2=0x7fd7640706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 0x7fd7640706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7781018c0 tx=0x7fd768009110 comp rx=0 tx=0).stop 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 msgr2=0x7fd778199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd760006010 tx=0x7fd7600048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 shutdown_connections 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd76406e230 0x7fd7640706f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd778101a60 0x7fd778199cd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 --2- 172.21.15.27:0/658340112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd778100860 0x7fd778199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 >> 172.21.15.27:0/658340112 conn(0x7fd7780fc010 msgr2=0x7fd778069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 shutdown_connections 2024-09-20T18:59:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:09.856+0000 7fd77cdb4640 1 -- 172.21.15.27:0/658340112 wait complete. 2024-09-20T18:59:09.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:09 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2663939834' entity='client.admin' 2024-09-20T18:59:09.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:09 smithi098 ceph-mon[35737]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:10.938 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:10 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3871324983' entity='client.admin' 2024-09-20T18:59:10.939 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:10 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/658340112' entity='client.admin' 2024-09-20T18:59:10.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:10 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3871324983' entity='client.admin' 2024-09-20T18:59:10.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:10 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/658340112' entity='client.admin' 2024-09-20T18:59:11.933 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:11.938 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:12.039 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:11 smithi027 ceph-mon[28196]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:12.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:11 smithi098 ceph-mon[35737]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:12.982 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: Reconfiguring ceph-exporter.smithi027 (monmap changed)... 2024-09-20T18:59:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:59:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:12 smithi027 ceph-mon[28196]: Reconfiguring daemon ceph-exporter.smithi027 on smithi027 2024-09-20T18:59:13.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 -- 172.21.15.27:0/161594327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 msgr2=0x7f94b81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:13.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 --2- 172.21.15.27:0/161594327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b81047e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94a80098b0 tx=0x7f94a802a4d0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 -- 172.21.15.27:0/161594327 shutdown_connections 2024-09-20T18:59:13.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 --2- 172.21.15.27:0/161594327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 --2- 172.21.15.27:0/161594327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b81047e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 -- 172.21.15.27:0/161594327 >> 172.21.15.27:0/161594327 conn(0x7f94b80fc010 msgr2=0x7f94b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 -- 172.21.15.27:0/161594327 shutdown_connections 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.186+0000 7f94be56e640 1 -- 172.21.15.27:0/161594327 wait complete. 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 Processor -- start 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 -- start start 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810a7c0 con 0x7f94b81023f0 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94be56e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810a640 con 0x7f94b8104d20 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38456/0 (socket says 172.21.15.27:38456) 2024-09-20T18:59:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 -- 172.21.15.27:0/1588489246 learned_addr learned my addr 172.21.15.27:0/1588489246 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b77fe640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 -- 172.21.15.27:0/1588489246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 msgr2=0x7f94b8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b7fff640 1 -- 172.21.15.27:0/1588489246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b8198070 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.187+0000 7f94b77fe640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94b7fff640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94a80099d0 tx=0x7f94a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a803f070 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94a8004c70 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b819ca80 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a8035030 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.188+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b819cf80 con 0x7f94b81023f0 2024-09-20T18:59:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.189+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b81027d0 con 0x7f94b81023f0 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.189+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f94a8042070 con 0x7f94b81023f0 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.190+0000 7f94b57fa640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 0x7f94a00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.190+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f94a80add00 con 0x7f94b81023f0 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.190+0000 7f94b77fe640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 0x7f94a00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.190+0000 7f94b77fe640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 0x7f94a00706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94b81989f0 tx=0x7f94ac00a5c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:13.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.194+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94a807c740 con 0x7f94b81023f0 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: Reconfiguring ceph-exporter.smithi027 (monmap changed)... 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:13.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:12 smithi098 ceph-mon[35737]: Reconfiguring daemon ceph-exporter.smithi027 on smithi027 2024-09-20T18:59:13.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.378+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f94b819d8b0 con 0x7f94b81023f0 2024-09-20T18:59:13.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.383+0000 7f94b57fa640 1 -- 172.21.15.27:0/1588489246 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f94a80803f0 con 0x7f94b81023f0 2024-09-20T18:59:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 msgr2=0x7f94a00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 0x7f94a00706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94b81989f0 tx=0x7f94ac00a5c0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 msgr2=0x7f94b8197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94a80099d0 tx=0x7f94a80048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 shutdown_connections 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f94a006e230 0x7f94a00706f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94b8104d20 0x7f94b8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 --2- 172.21.15.27:0/1588489246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94b81023f0 0x7f94b8197540 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 >> 172.21.15.27:0/1588489246 conn(0x7f94b80fc010 msgr2=0x7f94b80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 shutdown_connections 2024-09-20T18:59:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:13.386+0000 7f94be56e640 1 -- 172.21.15.27:0/1588489246 wait complete. 2024-09-20T18:59:14.050 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:13 smithi027 ceph-mon[28196]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:14.050 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:13 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1588489246' entity='client.admin' 2024-09-20T18:59:14.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:13 smithi098 ceph-mon[35737]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:14.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:13 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1588489246' entity='client.admin' 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 -- 172.21.15.27:0/2951826233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 msgr2=0x7f34541047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 --2- 172.21.15.27:0/2951826233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f34541047e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34440098b0 tx=0x7f344402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 -- 172.21.15.27:0/2951826233 shutdown_connections 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 --2- 172.21.15.27:0/2951826233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 0x7f3454107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 --2- 172.21.15.27:0/2951826233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f34541047e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 -- 172.21.15.27:0/2951826233 >> 172.21.15.27:0/2951826233 conn(0x7f34540fc010 msgr2=0x7f34540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:14.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 -- 172.21.15.27:0/2951826233 shutdown_connections 2024-09-20T18:59:14.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.520+0000 7f345a8c3640 1 -- 172.21.15.27:0/2951826233 wait complete. 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 Processor -- start 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 -- start start 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 0x7f34541003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f345410a7e0 con 0x7f34541023f0 2024-09-20T18:59:14.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f345a8c3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f345410a660 con 0x7f3454104d20 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f3453fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f3453fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38476/0 (socket says 172.21.15.27:38476) 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f3453fff640 1 -- 172.21.15.27:0/262429929 learned_addr learned my addr 172.21.15.27:0/262429929 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f34537fe640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 0x7f34541003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f3453fff640 1 -- 172.21.15.27:0/262429929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 msgr2=0x7f34541003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.521+0000 7f3453fff640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 0x7f34541003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f3453fff640 1 -- 172.21.15.27:0/262429929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34541008e0 con 0x7f34541023f0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f3453fff640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3444009880 tx=0x7f34440045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f344403f070 con 0x7f34541023f0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3444004a50 con 0x7f34541023f0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3454100b70 con 0x7f34541023f0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3444035030 con 0x7f34541023f0 2024-09-20T18:59:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.522+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541010a0 con 0x7f34541023f0 2024-09-20T18:59:14.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.523+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34541027d0 con 0x7f34541023f0 2024-09-20T18:59:14.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.523+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f3444042070 con 0x7f34541023f0 2024-09-20T18:59:14.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.524+0000 7f34517fa640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 0x7f343c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:14.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.524+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f34440adac0 con 0x7f34541023f0 2024-09-20T18:59:14.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.524+0000 7f34537fe640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 0x7f343c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:14.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.524+0000 7f34537fe640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 0x7f343c070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3454101a60 tx=0x7f344800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:14.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.529+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3444080230 con 0x7f34541023f0 2024-09-20T18:59:14.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.708+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f345419f560 con 0x7f34541023f0 2024-09-20T18:59:14.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.711+0000 7f34517fa640 1 -- 172.21.15.27:0/262429929 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f3444084a60 con 0x7f34541023f0 2024-09-20T18:59:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.713+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 msgr2=0x7f343c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.713+0000 7f345a8c3640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 0x7f343c070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3454101a60 tx=0x7f344800b390 comp rx=0 tx=0).stop 2024-09-20T18:59:14.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.713+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 msgr2=0x7f3454101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.713+0000 7f345a8c3640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3444009880 tx=0x7f34440045c0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 shutdown_connections 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f343c06e280 0x7f343c070740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3454104d20 0x7f34541003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 --2- 172.21.15.27:0/262429929 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34541023f0 0x7f3454101ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 >> 172.21.15.27:0/262429929 conn(0x7f34540fc010 msgr2=0x7f34540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 shutdown_connections 2024-09-20T18:59:14.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:14.714+0000 7f345a8c3640 1 -- 172.21.15.27:0/262429929 wait complete. 2024-09-20T18:59:15.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/262429929' entity='client.admin' 2024-09-20T18:59:15.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:15.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:15.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:15.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:59:15.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:15 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/262429929' entity='client.admin' 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:59:16.036 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:15 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:16.063 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.063 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e7838b9c-7781-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi027') 2024-09-20T18:59:16.064 INFO:tasks.cephadm:Deploying OSDs... 2024-09-20T18:59:16.065 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T18:59:16.065 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T18:59:16.081 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T18:59:16.082 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-20 18:58:12.437804405 +0000 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-20 18:53:00.872507082 +0000 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-20 18:53:00.872507082 +0000 2024-09-20T18:59:16.138 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-20 18:53:00.872507082 +0000 2024-09-20T18:59:16.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T18:59:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-20T18:59:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-20T18:59:16.206 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000268673 s, 1.9 MB/s 2024-09-20T18:59:16.207 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T18:59:16.264 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-09-20T18:59:16.320 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T18:59:16.320 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:16.320 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-20 18:58:12.437804405 +0000 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-20 18:53:01.200499103 +0000 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-20 18:53:01.200499103 +0000 2024-09-20T18:59:16.321 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-20 18:53:01.200499103 +0000 2024-09-20T18:59:16.321 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T18:59:16.384 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-20T18:59:16.384 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-20T18:59:16.384 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000203463 s, 2.5 MB/s 2024-09-20T18:59:16.385 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T18:59:16.442 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-09-20T18:59:16.498 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T18:59:16.498 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:16.498 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-20T18:59:16.498 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:16.498 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:16.499 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-20 18:58:12.438804381 +0000 2024-09-20T18:59:16.499 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-20 18:53:01.527491149 +0000 2024-09-20T18:59:16.499 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-20 18:53:01.527491149 +0000 2024-09-20T18:59:16.499 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-20 18:53:01.527491149 +0000 2024-09-20T18:59:16.499 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T18:59:16.564 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-20T18:59:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-20T18:59:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00022501 s, 2.3 MB/s 2024-09-20T18:59:16.566 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T18:59:16.623 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-09-20T18:59:16.679 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T18:59:16.679 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-20 18:58:12.438804381 +0000 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-20 18:53:01.880482562 +0000 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-20 18:53:01.880482562 +0000 2024-09-20T18:59:16.680 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-20 18:53:01.880482562 +0000 2024-09-20T18:59:16.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T18:59:16.744 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-20T18:59:16.744 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-20T18:59:16.744 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000196935 s, 2.6 MB/s 2024-09-20T18:59:16.745 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T18:59:16.802 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T18:59:16.803 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T18:59:16.823 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T18:59:16.823 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-20T18:59:16.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:16 smithi027 ceph-mon[28196]: Reconfiguring crash.smithi027 (monmap changed)... 2024-09-20T18:59:16.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:16 smithi027 ceph-mon[28196]: Reconfiguring daemon crash.smithi027 on smithi027 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-20 18:58:43.377315948 +0000 2024-09-20T18:59:16.882 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-20 18:52:56.346601103 +0000 2024-09-20T18:59:16.883 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-20 18:52:56.346601103 +0000 2024-09-20T18:59:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-20 18:52:56.346601103 +0000 2024-09-20T18:59:16.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T18:59:16.951 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-20T18:59:16.951 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-20T18:59:16.951 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000256552 s, 2.0 MB/s 2024-09-20T18:59:16.953 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T18:59:16.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:16 smithi098 ceph-mon[35737]: Reconfiguring crash.smithi027 (monmap changed)... 2024-09-20T18:59:16.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:16 smithi098 ceph-mon[35737]: Reconfiguring daemon crash.smithi027 on smithi027 2024-09-20T18:59:16.998 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-20T18:59:17.055 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T18:59:17.055 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:17.055 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-20 18:58:43.378315936 +0000 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-20 18:52:56.676597072 +0000 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-20 18:52:56.676597072 +0000 2024-09-20T18:59:17.056 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-20 18:52:56.676597072 +0000 2024-09-20T18:59:17.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T18:59:17.123 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-20T18:59:17.124 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-20T18:59:17.124 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000273715 s, 1.9 MB/s 2024-09-20T18:59:17.125 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T18:59:17.183 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:17.241 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-20 18:58:43.378315936 +0000 2024-09-20T18:59:17.242 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-20 18:52:57.006593040 +0000 2024-09-20T18:59:17.242 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-20 18:52:57.006593040 +0000 2024-09-20T18:59:17.242 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-20 18:52:57.006593040 +0000 2024-09-20T18:59:17.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T18:59:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-20T18:59:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-20T18:59:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000204169 s, 2.5 MB/s 2024-09-20T18:59:17.308 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T18:59:17.366 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-20T18:59:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T18:59:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:59:17.423 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-20T18:59:17.423 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:59:17.423 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:59:17.424 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-20 18:58:43.379315924 +0000 2024-09-20T18:59:17.424 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-20 18:52:57.323589167 +0000 2024-09-20T18:59:17.424 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-20 18:52:57.323589167 +0000 2024-09-20T18:59:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-20 18:52:57.323589167 +0000 2024-09-20T18:59:17.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T18:59:17.489 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-20T18:59:17.489 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-20T18:59:17.489 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000213823 s, 2.4 MB/s 2024-09-20T18:59:17.490 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T18:59:17.547 INFO:tasks.cephadm:Deploying osd.0 on smithi027 with /dev/vg_nvme/lv_4... 2024-09-20T18:59:17.548 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T18:59:17.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:17 smithi027 ceph-mon[28196]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:17.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:17 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:17.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:17 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:17.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:17 smithi098 ceph-mon[35737]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:17.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:17 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:17.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:17 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:19.018 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:18 smithi027 ceph-mon[28196]: Reconfiguring alertmanager.smithi027 (dependencies changed)... 2024-09-20T18:59:19.018 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:18 smithi027 ceph-mon[28196]: Reconfiguring daemon alertmanager.smithi027 on smithi027 2024-09-20T18:59:19.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:18 smithi098 ceph-mon[35737]: Reconfiguring alertmanager.smithi027 (dependencies changed)... 2024-09-20T18:59:19.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:18 smithi098 ceph-mon[35737]: Reconfiguring daemon alertmanager.smithi027 on smithi027 2024-09-20T18:59:19.957 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:19 smithi027 ceph-mon[28196]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:19.957 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:20.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:19 smithi098 ceph-mon[35737]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:20.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:21.280 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:21 smithi027 ceph-mon[28196]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:21.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:21 smithi098 ceph-mon[35737]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:24.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:24.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:24.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:24 smithi027 ceph-mon[28196]: Reconfiguring grafana.smithi027 (dependencies changed)... 2024-09-20T18:59:24.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:24 smithi027 ceph-mon[28196]: Reconfiguring daemon grafana.smithi027 on smithi027 2024-09-20T18:59:24.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:24 smithi027 ceph-mon[28196]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:24.452 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T18:59:24.478 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_4 2024-09-20T18:59:24.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:24 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:24.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:24 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:24.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:24 smithi098 ceph-mon[35737]: Reconfiguring grafana.smithi027 (dependencies changed)... 2024-09-20T18:59:24.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:24 smithi098 ceph-mon[35737]: Reconfiguring daemon grafana.smithi027 on smithi027 2024-09-20T18:59:24.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:24 smithi098 ceph-mon[35737]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:25.478 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:25 smithi027 ceph-mon[28196]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:25.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:25 smithi098 ceph-mon[35737]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:25.522 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2836537316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4100860 msgr2=0x7fdee4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2836537316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4100860 0x7fdee4100c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009880 tx=0x7fdee002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2836537316 shutdown_connections 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2836537316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4101a60 0x7fdee4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2836537316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4100860 0x7fdee4100c60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2836537316 >> 172.21.15.27:0/2836537316 conn(0x7fdee40fc010 msgr2=0x7fdee40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2836537316 shutdown_connections 2024-09-20T18:59:26.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.897+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2836537316 wait complete. 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 Processor -- start 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 -- start start 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4100860 0x7fdee4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4109700 con 0x7fdee4101a60 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdeeb0de640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4109580 con 0x7fdee4100860 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdedbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdedbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57862/0 (socket says 172.21.15.27:57862) 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdedbfff640 1 -- 172.21.15.27:0/2235064143 learned_addr learned my addr 172.21.15.27:0/2235064143 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.898+0000 7fdee8e7a640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4100860 0x7fdee4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdedbfff640 1 -- 172.21.15.27:0/2235064143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4100860 msgr2=0x7fdee4196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdedbfff640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4100860 0x7fdee4196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:26.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdedbfff640 1 -- 172.21.15.27:0/2235064143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee4196fd0 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdedbfff640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fded400b420 tx=0x7fded400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded4011630 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fded4016070 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee419ba10 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded4010d40 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.899+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee419c020 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.900+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee4100c60 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.901+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fded401b460 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.901+0000 7fded9ffb640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 0x7fdecc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.901+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fded408c7f0 con 0x7fdee4101a60 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.901+0000 7fdee8e7a640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 0x7fdecc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.902+0000 7fdee8e7a640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 0x7fdecc070740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009230 tx=0x7fdee00058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:26.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:26.906+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fded405b2b0 con 0x7fdee4101a60 2024-09-20T18:59:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:27.100+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdee4062630 con 0x7fdecc06e280 2024-09-20T18:59:27.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:27 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:59:27.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:27 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:59:27.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:27 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:27.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:27 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:59:27.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:27 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:59:27.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:27 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:28.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:28 smithi098 ceph-mon[35737]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:28.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:28 smithi098 ceph-mon[35737]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:28.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:28 smithi027 ceph-mon[28196]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:28.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:28 smithi027 ceph-mon[28196]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:29.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:29 smithi098 ceph-mon[35737]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:29.483 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:29 smithi027 ceph-mon[28196]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:30.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:30 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:30.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:30 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:30.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:30 smithi027 ceph-mon[28196]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T18:59:30.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:30 smithi027 ceph-mon[28196]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T18:59:30.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:30 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:31.069 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:30 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:31.069 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:30 smithi098 ceph-mon[35737]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T18:59:31.069 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:30 smithi098 ceph-mon[35737]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T18:59:31.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1776963613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af00b5b4-770e-4da0-b62e-56d53824b126"}]: dispatch 2024-09-20T18:59:31.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1776963613' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af00b5b4-770e-4da0-b62e-56d53824b126"}]': finished 2024-09-20T18:59:31.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T18:59:31.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:59:31.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:31.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:31 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2675047752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:59:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1776963613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af00b5b4-770e-4da0-b62e-56d53824b126"}]: dispatch 2024-09-20T18:59:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1776963613' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af00b5b4-770e-4da0-b62e-56d53824b126"}]': finished 2024-09-20T18:59:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T18:59:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:59:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:31.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:31 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2675047752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:59:33.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:33 smithi098 ceph-mon[35737]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:33.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:33 smithi027 ceph-mon[28196]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:34.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:34.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:35.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:35 smithi098 ceph-mon[35737]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:35.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:35 smithi027 ceph-mon[28196]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:37.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:37 smithi027 ceph-mon[28196]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:37.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:37 smithi098 ceph-mon[35737]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:39.436 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:39 smithi027 ceph-mon[28196]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:39.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:39 smithi098 ceph-mon[35737]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:41.471 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:41 smithi027 ceph-mon[28196]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:41.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:41 smithi098 ceph-mon[35737]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:43.789 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:43.789 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:43.789 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-20T18:59:43.790 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:59:43.790 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:43.790 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-20T18:59:43.790 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:43 smithi027 ceph-mon[28196]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-20T18:59:43.827 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:43 smithi098 ceph-mon[35737]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: Deploying daemon osd.0 on smithi027 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:44.542 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-20T18:59:44.543 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:59:44.543 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:44.543 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:44 smithi027 ceph-mon[28196]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: Deploying daemon osd.0 on smithi027 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:44 smithi098 ceph-mon[35737]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:59:45.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:45 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:45.777 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:45.778 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:45.778 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:45.778 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:59:45.778 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:59:45.778 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:45 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:46.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:46 smithi098 ceph-mon[35737]: Reconfiguring mgr.smithi098.wrcvbg (monmap changed)... 2024-09-20T18:59:46.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:46 smithi098 ceph-mon[35737]: Reconfiguring daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T18:59:46.611 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:46 smithi027 ceph-mon[28196]: Reconfiguring mgr.smithi098.wrcvbg (monmap changed)... 2024-09-20T18:59:46.611 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:46 smithi027 ceph-mon[28196]: Reconfiguring daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T18:59:47.666 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:47.666 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:47.666 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: Reconfiguring mon.smithi098 (monmap changed)... 2024-09-20T18:59:47.667 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:59:47.667 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:59:47.667 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:47.667 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-20T18:59:47.667 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:47 smithi027 ceph-mon[28196]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:47.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: Reconfiguring mon.smithi098 (monmap changed)... 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-20T18:59:47.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:47 smithi098 ceph-mon[35737]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:49.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:59:49.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi027.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi027.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi027.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi027.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi027.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi027.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:59:49.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.077 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:48 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi027.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi027.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi027.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:59:49.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi027.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi027.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi027.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:49.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:48 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:59:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:49 smithi027 ceph-mon[28196]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:50.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:49 smithi098 ceph-mon[35737]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:59:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:50.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:51.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:51 smithi027 ceph-mon[28196]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:51.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:51 smithi098 ceph-mon[35737]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:52.724 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:52.724 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:52.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:52.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:59:54.290 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:54.291 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:59:55.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:55 smithi098 ceph-mon[35737]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:55.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:55 smithi027 ceph-mon[28196]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:56.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:56 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:56.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:56 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:56.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:56 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:56.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:56 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:56.789 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 0 on host 'smithi027' 2024-09-20T18:59:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.779+0000 7fded9ffb640 1 -- 172.21.15.27:0/2235064143 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdee4062630 con 0x7fdecc06e280 2024-09-20T18:59:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 msgr2=0x7fdecc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 0x7fdecc070740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009230 tx=0x7fdee00058d0 comp rx=0 tx=0).stop 2024-09-20T18:59:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 msgr2=0x7fdee4196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fded400b420 tx=0x7fded400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:59:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 shutdown_connections 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdecc06e280 0x7fdecc070740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdee4101a60 0x7fdee4196950 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 --2- 172.21.15.27:0/2235064143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdee4100860 0x7fdee4196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 >> 172.21.15.27:0/2235064143 conn(0x7fdee40fc010 msgr2=0x7fdee4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 shutdown_connections 2024-09-20T18:59:56.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T18:59:56.782+0000 7fdeeb0de640 1 -- 172.21.15.27:0/2235064143 wait complete. 2024-09-20T18:59:57.655 DEBUG:teuthology.orchestra.run.smithi027:osd.0> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.0.service 2024-09-20T18:59:57.658 INFO:tasks.cephadm:Deploying osd.1 on smithi027 with /dev/vg_nvme/lv_3... 2024-09-20T18:59:57.658 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T18:59:58.074 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T18:59:58.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:58.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:58.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:57 smithi027 ceph-mon[28196]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:58.075 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 18:59:57 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T18:59:57.865+0000 7fd1abce9640 -1 osd.0 0 log_to_monitors true 2024-09-20T18:59:58.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:58.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T18:59:58.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:57 smithi098 ceph-mon[35737]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:58.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:58 smithi027 ceph-mon[28196]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T18:59:59.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:58 smithi098 ceph-mon[35737]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T18:59:59.891 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-mon[28196]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T18:59:59.891 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-mon[28196]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T18:59:59.892 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-mon[28196]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T18:59:59.892 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:59:59.892 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-mon[28196]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:59:59.892 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T18:59:59.790+0000 7fd1a7449640 -1 osd.0 0 waiting for initial osdmap 2024-09-20T18:59:59.892 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 18:59:59 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T18:59:59.794+0000 7fd1a3a83640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:00:00.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:59 smithi098 ceph-mon[35737]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T19:00:00.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:59 smithi098 ceph-mon[35737]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T19:00:00.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:59 smithi098 ceph-mon[35737]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T19:00:00.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:59 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:00.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 18:59:59 smithi098 ceph-mon[35737]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: osdmap e8: 1 total, 0 up, 1 in 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: overall HEALTH_OK 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: from='osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: osdmap e8: 1 total, 0 up, 1 in 2024-09-20T19:00:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: overall HEALTH_OK 2024-09-20T19:00:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] boot 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:02.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:01 smithi027 ceph-mon[28196]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T19:00:02.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:00:02.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:00:02.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: osd.0 [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] boot 2024-09-20T19:00:02.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T19:00:02.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:00:02.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:01 smithi098 ceph-mon[35737]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T19:00:02.423 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:00:02.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_3 2024-09-20T19:00:03.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:02 smithi027 ceph-mon[28196]: osdmap e10: 1 total, 1 up, 1 in 2024-09-20T19:00:03.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:02 smithi098 ceph-mon[35737]: osdmap e10: 1 total, 1 up, 1 in 2024-09-20T19:00:03.441 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 -- 172.21.15.27:0/1659998816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 msgr2=0x7fe6041005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1659998816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe6041005e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe600009880 tx=0x7fe60002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 -- 172.21.15.27:0/1659998816 shutdown_connections 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1659998816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1659998816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe6041005e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:03.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 -- 172.21.15.27:0/1659998816 >> 172.21.15.27:0/1659998816 conn(0x7fe6040fc010 msgr2=0x7fe6040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 -- 172.21.15.27:0/1659998816 shutdown_connections 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.923+0000 7fe60bee4640 1 -- 172.21.15.27:0/1659998816 wait complete. 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 Processor -- start 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 -- start start 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe60410c970 con 0x7fe6041001e0 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe60bee4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe60410c7f0 con 0x7fe604100b20 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe609c80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe609c80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60562/0 (socket says 172.21.15.27:60562) 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.924+0000 7fe609c80640 1 -- 172.21.15.27:0/1398012841 learned_addr learned my addr 172.21.15.27:0/1398012841 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:00:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe60947f640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe609c80640 1 -- 172.21.15.27:0/1398012841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 msgr2=0x7fe604199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe609c80640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe609c80640 1 -- 172.21.15.27:0/1398012841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60419a220 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe60947f640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe609c80640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe600006010 tx=0x7fe6000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe60003f070 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe600004ac0 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60419ec00 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe600035030 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.925+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60419f190 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.926+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6041005e0 con 0x7fe6041001e0 2024-09-20T19:00:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.927+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe600042070 con 0x7fe6041001e0 2024-09-20T19:00:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.927+0000 7fe5faffd640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 0x7fe5f0070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.927+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fe6000ade40 con 0x7fe6041001e0 2024-09-20T19:00:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.927+0000 7fe60947f640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 0x7fe5f0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.928+0000 7fe60947f640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 0x7fe5f0070740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe60419ab10 tx=0x7fe5f4005e50 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:03.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:03.932+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe60007c6a0 con 0x7fe6041001e0 2024-09-20T19:00:03.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:03 smithi027 ceph-mon[28196]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:04.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:04.149+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe604062630 con 0x7fe5f006e280 2024-09-20T19:00:04.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:03 smithi098 ceph-mon[35737]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:04.959 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:04.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:05.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:05.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:05.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:06.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:05 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi027 2024-09-20T19:00:06.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:05 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi027 to 11840M 2024-09-20T19:00:06.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:05 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:06.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:05 smithi027 ceph-mon[28196]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:06.146 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:05 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi027 2024-09-20T19:00:06.146 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:05 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi027 to 11840M 2024-09-20T19:00:06.146 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:05 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:06.146 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:05 smithi098 ceph-mon[35737]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2227288198' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564b02b7-346b-4797-ab71-70a0090c2c4b"}]: dispatch 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2227288198' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "564b02b7-346b-4797-ab71-70a0090c2c4b"}]': finished 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:07.936 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:07 smithi027 ceph-mon[28196]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2227288198' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564b02b7-346b-4797-ab71-70a0090c2c4b"}]: dispatch 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2227288198' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "564b02b7-346b-4797-ab71-70a0090c2c4b"}]': finished 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:07.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:07 smithi098 ceph-mon[35737]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:08.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:08 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3490212192' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:00:09.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:08 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3490212192' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:00:09.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:09 smithi098 ceph-mon[35737]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:09.997 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:09 smithi027 ceph-mon[28196]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:11.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:11.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:11.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:11 smithi027 ceph-mon[28196]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:11.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:11.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:11.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:11.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:11 smithi098 ceph-mon[35737]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:13.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:13 smithi098 ceph-mon[35737]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:13.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:13 smithi027 ceph-mon[28196]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:15.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:15 smithi027 ceph-mon[28196]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:15.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:15 smithi098 ceph-mon[35737]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:16.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T19:00:16.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:16.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:16 smithi027 ceph-mon[28196]: Deploying daemon osd.1 on smithi027 2024-09-20T19:00:16.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T19:00:16.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:16.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:16 smithi098 ceph-mon[35737]: Deploying daemon osd.1 on smithi027 2024-09-20T19:00:17.404 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:17 smithi027 ceph-mon[28196]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:17.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:17 smithi098 ceph-mon[35737]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:19.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:19 smithi027 ceph-mon[28196]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:19.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:19.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:19 smithi098 ceph-mon[35737]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:19.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:21.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:21 smithi027 ceph-mon[28196]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:21.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:21 smithi098 ceph-mon[35737]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:22.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:22.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:22.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:22.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:22.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:22.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:23.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:23 smithi098 ceph-mon[35737]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:23.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:23 smithi027 ceph-mon[28196]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:25.202 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:25.202 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:24 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:25.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:24 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:25.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:24 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:26.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:25 smithi098 ceph-mon[35737]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:26.272 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:25 smithi027 ceph-mon[28196]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.301+0000 7fe5faffd640 1 -- 172.21.15.27:0/1398012841 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe604062630 con 0x7fe5f006e280 2024-09-20T19:00:26.311 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 1 on host 'smithi027' 2024-09-20T19:00:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 msgr2=0x7fe5f0070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 0x7fe5f0070740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe60419ab10 tx=0x7fe5f4005e50 comp rx=0 tx=0).stop 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 msgr2=0x7fe604199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe600006010 tx=0x7fe6000046c0 comp rx=0 tx=0).stop 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 shutdown_connections 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe5f006e280 0x7fe5f0070740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe604100b20 0x7fe604199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 --2- 172.21.15.27:0/1398012841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6041001e0 0x7fe604199660 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 >> 172.21.15.27:0/1398012841 conn(0x7fe6040fc010 msgr2=0x7fe604108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 shutdown_connections 2024-09-20T19:00:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:26.303+0000 7fe60bee4640 1 -- 172.21.15.27:0/1398012841 wait complete. 2024-09-20T19:00:27.289 DEBUG:teuthology.orchestra.run.smithi027:osd.1> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.1.service 2024-09-20T19:00:27.292 INFO:tasks.cephadm:Deploying osd.2 on smithi027 with /dev/vg_nvme/lv_2... 2024-09-20T19:00:27.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T19:00:27.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:27 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:27.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:27 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:27.575 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:27 smithi027 ceph-mon[28196]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:27.684 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:00:27.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:27 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:27.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:27 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:27.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:27 smithi098 ceph-mon[35737]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:28.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:28 smithi098 ceph-mon[35737]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T19:00:28.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:28 smithi027 ceph-mon[28196]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T19:00:28.825 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:00:28 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:00:28.492+0000 7f6a0f3c0640 -1 osd.1 0 log_to_monitors true 2024-09-20T19:00:29.650 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:00:29.555+0000 7f6a0ab20640 -1 osd.1 0 waiting for initial osdmap 2024-09-20T19:00:29.650 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:00:29.560+0000 7f6a0715a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:00:29.650 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T19:00:29.650 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T19:00:29.650 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T19:00:29.650 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:29.650 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:29.651 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:29 smithi027 ceph-mon[28196]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:29.898 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T19:00:29.899 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T19:00:29.899 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T19:00:29.899 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:29.899 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:29.899 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:29 smithi098 ceph-mon[35737]: from='osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:30.499 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:00:30.526 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi027:vg_nvme/lv_2 2024-09-20T19:00:30.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:30 smithi027 ceph-mon[28196]: osdmap e13: 2 total, 1 up, 2 in 2024-09-20T19:00:30.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:30 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:30 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:30 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.852 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:30 smithi098 ceph-mon[35737]: osdmap e13: 2 total, 1 up, 2 in 2024-09-20T19:00:30.852 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:30 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.852 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:30 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.852 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:30 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:30.896 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:00:31.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 -- 172.21.15.27:0/2735748463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc104d20 msgr2=0x7f1cbc107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 --2- 172.21.15.27:0/2735748463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc104d20 0x7f1cbc107110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40098b0 tx=0x7f1ca402a4d0 comp rx=0 tx=0).stop 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 -- 172.21.15.27:0/2735748463 shutdown_connections 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 --2- 172.21.15.27:0/2735748463 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc104d20 0x7f1cbc107110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 --2- 172.21.15.27:0/2735748463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 -- 172.21.15.27:0/2735748463 >> 172.21.15.27:0/2735748463 conn(0x7f1cbc0fc010 msgr2=0x7f1cbc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 -- 172.21.15.27:0/2735748463 shutdown_connections 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.370+0000 7f1cc288f640 1 -- 172.21.15.27:0/2735748463 wait complete. 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 Processor -- start 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 -- start start 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc104d20 0x7f1cbc1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc10a790 con 0x7f1cbc1023f0 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cc288f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc10a610 con 0x7f1cbc104d20 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46160/0 (socket says 172.21.15.27:46160) 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 -- 172.21.15.27:0/635762549 learned_addr learned my addr 172.21.15.27:0/635762549 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cb3fff640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc104d20 0x7f1cbc1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 -- 172.21.15.27:0/635762549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc104d20 msgr2=0x7f1cbc1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc104d20 0x7f1cbc1003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 -- 172.21.15.27:0/635762549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc1008e0 con 0x7f1cbc1023f0 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.371+0000 7f1cbbfff640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00d8d0 tx=0x7f1cac00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.372+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cac017030 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.372+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cac004020 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.372+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc100bd0 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.372+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cac0047a0 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.372+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc101130 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.373+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc1027d0 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.373+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1cac0041d0 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.374+0000 7f1cb9ffb640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 0x7f1ca8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.374+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2414+0+0 (secure 0 0 0) 0x7f1cac018070 con 0x7f1cbc1023f0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.374+0000 7f1cb3fff640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 0x7f1ca8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:31.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.374+0000 7f1cb3fff640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 0x7f1ca8070700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4005ab0 tx=0x7f1ca4005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:31.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.378+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cac05b870 con 0x7f1cbc1023f0 2024-09-20T19:00:31.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:31.590+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1cbc105720 con 0x7f1ca806e240 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] boot 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:31.846 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:31.847 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:31.847 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:31 smithi027 ceph-mon[28196]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:31.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:00:31.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:00:31.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: osd.1 [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] boot 2024-09-20T19:00:31.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T19:00:31.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:00:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:31.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:31 smithi098 ceph-mon[35737]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T19:00:32.868 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:32 smithi027 ceph-mon[28196]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:32.869 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:32.869 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:32.869 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:32.869 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:32 smithi027 ceph-mon[28196]: osdmap e15: 2 total, 2 up, 2 in 2024-09-20T19:00:32.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:32 smithi098 ceph-mon[35737]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:32.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:32.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:32.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:32.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:32 smithi098 ceph-mon[35737]: osdmap e15: 2 total, 2 up, 2 in 2024-09-20T19:00:33.731 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:33 smithi027 ceph-mon[28196]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:33.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:33 smithi098 ceph-mon[35737]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:34.714 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:34.714 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.714 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:00:34.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:34.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:34.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:34.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:35.653 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:35 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi027 2024-09-20T19:00:35.653 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:35 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi027 to 5920M 2024-09-20T19:00:35.654 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:35 smithi027 ceph-mon[28196]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:35.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:35 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi027 2024-09-20T19:00:35.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:35 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi027 to 5920M 2024-09-20T19:00:35.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:35 smithi098 ceph-mon[35737]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:36.632 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:36 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/4234962569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d5dd1f3-60a8-4d53-8318-5815923cbf66"}]: dispatch 2024-09-20T19:00:36.632 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:36 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/4234962569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d5dd1f3-60a8-4d53-8318-5815923cbf66"}]': finished 2024-09-20T19:00:36.632 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:36 smithi027 ceph-mon[28196]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T19:00:36.632 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:36 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:36.632 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:36 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/553057449' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:00:36.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:36 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/4234962569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d5dd1f3-60a8-4d53-8318-5815923cbf66"}]: dispatch 2024-09-20T19:00:36.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:36 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/4234962569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d5dd1f3-60a8-4d53-8318-5815923cbf66"}]': finished 2024-09-20T19:00:36.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:36 smithi098 ceph-mon[35737]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T19:00:36.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:36 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:36.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:36 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/553057449' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:00:37.847 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:37 smithi027 ceph-mon[28196]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:37.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:37 smithi098 ceph-mon[35737]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:40.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:40.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:40.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:40 smithi027 ceph-mon[28196]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:40.362 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:40.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:00:40.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:40.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:40 smithi098 ceph-mon[35737]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:41.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:41 smithi027 ceph-mon[28196]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:41.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:41 smithi098 ceph-mon[35737]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:43.362 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:43 smithi027 ceph-mon[28196]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:43.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:43 smithi098 ceph-mon[35737]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:44.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T19:00:44.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:44 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:44.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T19:00:44.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:44 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:45.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:45 smithi098 ceph-mon[35737]: Deploying daemon osd.2 on smithi027 2024-09-20T19:00:45.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:45 smithi098 ceph-mon[35737]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:46.004 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:45 smithi027 ceph-mon[28196]: Deploying daemon osd.2 on smithi027 2024-09-20T19:00:46.004 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:45 smithi027 ceph-mon[28196]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:47.452 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:47 smithi027 ceph-mon[28196]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:47.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:47 smithi098 ceph-mon[35737]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:49.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:49 smithi027 ceph-mon[28196]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:49.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:49.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:49 smithi098 ceph-mon[35737]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:49.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:00:50.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:50.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:50.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:50.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:00:50.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:50.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:51.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:51 smithi027 ceph-mon[28196]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:51.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:51 smithi098 ceph-mon[35737]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:53.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:53 smithi098 ceph-mon[35737]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:53.512 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:53 smithi027 ceph-mon[28196]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:53.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.542+0000 7f1cb9ffb640 1 -- 172.21.15.27:0/635762549 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1cbc105720 con 0x7f1ca806e240 2024-09-20T19:00:53.551 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 2 on host 'smithi027' 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 msgr2=0x7f1ca8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 0x7f1ca8070700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4005ab0 tx=0x7f1ca4005a20 comp rx=0 tx=0).stop 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 msgr2=0x7f1cbc101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00d8d0 tx=0x7f1cac00dd90 comp rx=0 tx=0).stop 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 shutdown_connections 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1ca806e240 0x7f1ca8070700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cbc104d20 0x7f1cbc1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 --2- 172.21.15.27:0/635762549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cbc1023f0 0x7f1cbc101ce0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 >> 172.21.15.27:0/635762549 conn(0x7f1cbc0fc010 msgr2=0x7f1cbc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 shutdown_connections 2024-09-20T19:00:53.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:00:53.544+0000 7f1cc288f640 1 -- 172.21.15.27:0/635762549 wait complete. 2024-09-20T19:00:54.154 DEBUG:teuthology.orchestra.run.smithi027:osd.2> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.2.service 2024-09-20T19:00:54.156 INFO:tasks.cephadm:Deploying osd.3 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-20T19:00:54.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T19:00:54.412 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:00:54.786 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:54.786 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:54.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:54.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:55.804 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:55 smithi098 ceph-mon[35737]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:55.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:55 smithi027 ceph-mon[28196]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:56.883 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T19:00:56.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-20T19:00:57.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:56 smithi027 ceph-mon[28196]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T19:00:57.074 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:00:56 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:00:56.778+0000 7f991f9ef640 -1 osd.2 0 log_to_monitors true 2024-09-20T19:00:57.162 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:00:57.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:56 smithi098 ceph-mon[35737]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T19:00:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.600+0000 7f0db7c12640 1 -- 172.21.15.98:0/423131991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db0102b30 msgr2=0x7f0db0104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:57.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.600+0000 7f0db7c12640 1 --2- 172.21.15.98:0/423131991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db0102b30 0x7f0db0104fa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009880 tx=0x7f0da402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- 172.21.15.98:0/423131991 shutdown_connections 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 --2- 172.21.15.98:0/423131991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db0102b30 0x7f0db0104fa0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 --2- 172.21.15.98:0/423131991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db01001e0 0x7f0db01025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- 172.21.15.98:0/423131991 >> 172.21.15.98:0/423131991 conn(0x7f0db00fc010 msgr2=0x7f0db00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- 172.21.15.98:0/423131991 shutdown_connections 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- 172.21.15.98:0/423131991 wait complete. 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 Processor -- start 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- start start 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db0102b30 0x7f0db019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0db0110d70 con 0x7f0db0102b30 2024-09-20T19:00:57.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.601+0000 7f0db7c12640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0db0110bf0 con 0x7f0db01001e0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59140/0 (socket says 172.21.15.98:59140) 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 -- 172.21.15.98:0/4035916897 learned_addr learned my addr 172.21.15.98:0/4035916897 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db51ad640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db0102b30 0x7f0db019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 -- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db0102b30 msgr2=0x7f0db019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db0102b30 0x7f0db019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 -- 172.21.15.98:0/4035916897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db019e650 con 0x7f0db01001e0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db59ae640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00d8d0 tx=0x7f0dac00dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0dac017030 con 0x7f0db01001e0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0dac004020 con 0x7f0db01001e0 2024-09-20T19:00:57.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db01a3090 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0dac0047a0 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.602+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db01a35f0 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.603+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db0111550 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.604+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f0dac0041d0 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.604+0000 7f0da2ffd640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 0x7f0d9c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.604+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2550+0+0 (secure 0 0 0) 0x7f0dac018070 con 0x7f0db01001e0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.604+0000 7f0db51ad640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 0x7f0d9c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.605+0000 7f0db51ad640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 0x7f0d9c070740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000c00 tx=0x7f0da40058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:57.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.609+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dac05b850 con 0x7f0db01001e0 2024-09-20T19:00:57.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:00:57.782+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0db0103510 con 0x7f0d9c06e280 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:58.131 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:58.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:58.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: osdmap e18: 3 total, 2 up, 3 in 2024-09-20T19:00:58.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:57 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:00:58.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:00:58.200 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:00:58.200 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:00:58.200 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-20T19:00:58.200 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: osdmap e18: 3 total, 2 up, 3 in 2024-09-20T19:00:58.200 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:57 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-mon[28196]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:58.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-mon[28196]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' 2024-09-20T19:00:58.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:58.967 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:00:58.651+0000 7f991b14f640 -1 osd.2 0 waiting for initial osdmap 2024-09-20T19:00:58.967 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:00:58 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:00:58.659+0000 7f9913781640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:00:59.212 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:58 smithi098 ceph-mon[35737]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:59.212 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:00:59.212 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:58 smithi098 ceph-mon[35737]: from='osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571]' entity='osd.2' 2024-09-20T19:00:59.212 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:58 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] boot 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T19:01:00.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:00:59 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:01:00.186 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:01:00.187 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:01:00.187 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T19:01:00.187 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: osd.2 [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] boot 2024-09-20T19:01:00.187 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T19:01:00.187 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:00:59 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:01:01.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2863091793' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]: dispatch 2024-09-20T19:01:01.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]: dispatch 2024-09-20T19:01:01.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]': finished 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: osdmap e20: 4 total, 3 up, 4 in 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:01.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/4197358035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:01.076 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:00 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/2863091793' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]: dispatch 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]: dispatch 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55195947-e3d8-4a7a-ae4f-75d7b5d33035"}]': finished 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: osdmap e20: 4 total, 3 up, 4 in 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/4197358035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:01.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:00 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:01.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:01 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi027 2024-09-20T19:01:01.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:01 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi027 to 3946M 2024-09-20T19:01:01.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:01 smithi098 ceph-mon[35737]: pgmap v89: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:01.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:01 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T19:01:02.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:01 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi027 2024-09-20T19:01:02.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:01 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi027 to 3946M 2024-09-20T19:01:02.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:01 smithi027 ceph-mon[28196]: pgmap v89: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:02.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:01 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T19:01:03.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:02 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T19:01:03.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:02 smithi098 ceph-mon[35737]: osdmap e21: 4 total, 3 up, 4 in 2024-09-20T19:01:03.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:02 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:03.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:02 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T19:01:03.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:02 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T19:01:03.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:02 smithi027 ceph-mon[28196]: osdmap e21: 4 total, 3 up, 4 in 2024-09-20T19:01:03.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:02 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:03.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:02 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T19:01:04.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:03 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T19:01:04.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:03 smithi098 ceph-mon[35737]: osdmap e22: 4 total, 3 up, 4 in 2024-09-20T19:01:04.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:03 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:04.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:03 smithi098 ceph-mon[35737]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:04.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:03 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T19:01:04.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:03 smithi027 ceph-mon[28196]: osdmap e22: 4 total, 3 up, 4 in 2024-09-20T19:01:04.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:03 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:04.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:03 smithi027 ceph-mon[28196]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:04.574 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T19:01:04.574 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:04.574 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:04.574 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68911]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:05.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:04 smithi027 ceph-mon[28196]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T19:01:05.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:05.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:05.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:05.074 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T19:01:05.074 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:05.074 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:05.075 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:01:04 smithi027 sudo[68914]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:05.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:04 smithi098 ceph-mon[35737]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T19:01:05.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:05.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:05.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:05.574 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68917]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T19:01:05.574 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:05.574 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:05.574 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68917]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:05.916 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68920]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T19:01:05.916 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68920]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:05.916 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:05.916 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:01:05 smithi027 sudo[68920]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:05.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:05.914+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0dac0577c0 con 0x7f0db01001e0 2024-09-20T19:01:06.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:05 smithi098 ceph-mon[35737]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:06.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:05 smithi027 ceph-mon[28196]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:06.324 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T19:01:06.324 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:06.324 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:06.324 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68923]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:06.824 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T19:01:06.824 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:06.824 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:06.824 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68926]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:07.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T19:01:07.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:07.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:06 smithi027 sudo[68929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:07.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 sudo[68929]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:07.585 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 ceph-mon[35737]: mgrmap e19: smithi027.tlgpqo(active, since 2m), standbys: smithi098.wrcvbg 2024-09-20T19:01:07.585 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 ceph-mon[35737]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 sudo[68932]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 sudo[68932]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 sudo[68932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 sudo[68932]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 ceph-mon[28196]: mgrmap e19: smithi027.tlgpqo(active, since 2m), standbys: smithi098.wrcvbg 2024-09-20T19:01:07.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:07 smithi027 ceph-mon[28196]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T19:01:07.933 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T19:01:07.933 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:07.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:07.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41118]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:08.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41134]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T19:01:08.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41134]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T19:01:08.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T19:01:08.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:07 smithi098 sudo[41134]: pam_unix(sudo:session): session closed for user root 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T19:01:08.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:08 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:01:08.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T19:01:08.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:08 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:09.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:09 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T19:01:09.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:09 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:09.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:09 smithi098 ceph-mon[35737]: Deploying daemon osd.3 on smithi098 2024-09-20T19:01:09.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:09 smithi098 ceph-mon[35737]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:09.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:09 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T19:01:09.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:09 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:09.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:09 smithi027 ceph-mon[28196]: Deploying daemon osd.3 on smithi098 2024-09-20T19:01:09.826 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:09 smithi027 ceph-mon[28196]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:11.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:11 smithi027 ceph-mon[28196]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:11.614 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:11 smithi098 ceph-mon[35737]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:13.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:13 smithi027 ceph-mon[28196]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-20T19:01:13.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:13 smithi098 ceph-mon[35737]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-20T19:01:15.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:14 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:15.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:14 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:15.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:14 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:15.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:14 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:15.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:14 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:15.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:14 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:16.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:15 smithi027 ceph-mon[28196]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-20T19:01:16.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:15 smithi098 ceph-mon[35737]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-20T19:01:17.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:17 smithi098 ceph-mon[35737]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T19:01:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:17 smithi027 ceph-mon[28196]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T19:01:19.181 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 3 on host 'smithi098' 2024-09-20T19:01:19.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.172+0000 7f0da2ffd640 1 -- 172.21.15.98:0/4035916897 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0db0103510 con 0x7f0d9c06e280 2024-09-20T19:01:19.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 msgr2=0x7f0d9c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 0x7f0d9c070740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000c00 tx=0x7f0da40058d0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 msgr2=0x7f0db019da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00d8d0 tx=0x7f0dac00dd90 comp rx=0 tx=0).stop 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 shutdown_connections 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0d9c06e280 0x7f0d9c070740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0db0102b30 0x7f0db019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 --2- 172.21.15.98:0/4035916897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db01001e0 0x7f0db019da90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 >> 172.21.15.98:0/4035916897 conn(0x7f0db00fc010 msgr2=0x7f0db00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 shutdown_connections 2024-09-20T19:01:19.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:19.175+0000 7f0db7c12640 1 -- 172.21.15.98:0/4035916897 wait complete. 2024-09-20T19:01:19.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T19:01:19.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:19.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:19.803 DEBUG:teuthology.orchestra.run.smithi098:osd.3> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.3.service 2024-09-20T19:01:19.806 INFO:tasks.cephadm:Deploying osd.4 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-20T19:01:19.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T19:01:19.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:19.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:19.825 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:21.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:20 smithi098 ceph-mon[35737]: from='osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T19:01:21.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:20 smithi098 ceph-mon[35737]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T19:01:21.001 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:01:20 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:01:20.726+0000 7f39f1c30640 -1 osd.3 0 log_to_monitors true 2024-09-20T19:01:21.005 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:01:21.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:20 smithi027 ceph-mon[28196]: from='osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T19:01:21.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:20 smithi027 ceph-mon[28196]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T19:01:21.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T19:01:21.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: from='osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:21.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T19:01:21.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:21.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:21.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T19:01:21.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:01:21.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:21 smithi098 ceph-mon[35737]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T19:01:22.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: from='osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:01:22.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:21 smithi027 ceph-mon[28196]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T19:01:22.978 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:01:22.634+0000 7f39ee3c7640 -1 osd.3 0 waiting for initial osdmap 2024-09-20T19:01:22.978 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:01:22.644+0000 7f39e59c2640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:01:22.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:22.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:22.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: osdmap e26: 4 total, 3 up, 4 in 2024-09-20T19:01:22.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:22.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: from='osd.3 ' entity='osd.3' 2024-09-20T19:01:22.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:23.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:23.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:23.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: osdmap e26: 4 total, 3 up, 4 in 2024-09-20T19:01:23.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:23.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: from='osd.3 ' entity='osd.3' 2024-09-20T19:01:23.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:23.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:01:23.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:01:23.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:23.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:23.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] boot 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T19:01:23.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:23 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:24.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: osd.3 [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] boot 2024-09-20T19:01:24.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T19:01:24.075 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:23 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:01:24.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T19:01:24.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-20T19:01:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:01:25.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:24 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi098 2024-09-20T19:01:25.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:24 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi098 to 14912M 2024-09-20T19:01:25.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:24 smithi027 ceph-mon[28196]: osdmap e28: 4 total, 4 up, 4 in 2024-09-20T19:01:25.088 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:24 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi098 2024-09-20T19:01:25.088 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:24 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi098 to 14912M 2024-09-20T19:01:25.088 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:24 smithi098 ceph-mon[35737]: osdmap e28: 4 total, 4 up, 4 in 2024-09-20T19:01:25.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 -- 172.21.15.98:0/434431540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 msgr2=0x7f8a2c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 --2- 172.21.15.98:0/434431540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c100c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009880 tx=0x7f8a1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 -- 172.21.15.98:0/434431540 shutdown_connections 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 --2- 172.21.15.98:0/434431540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 0x7f8a2c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 --2- 172.21.15.98:0/434431540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c100c60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 -- 172.21.15.98:0/434431540 >> 172.21.15.98:0/434431540 conn(0x7f8a2c0fc010 msgr2=0x7f8a2c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 -- 172.21.15.98:0/434431540 shutdown_connections 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.476+0000 7f8a3193e640 1 -- 172.21.15.98:0/434431540 wait complete. 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 Processor -- start 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 -- start start 2024-09-20T19:01:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 0x7f8a2c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1096a0 con 0x7f8a2c101a60 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a3193e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c109520 con 0x7f8a2c100860 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59244/0 (socket says 172.21.15.98:59244) 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 -- 172.21.15.98:0/2619398626 learned_addr learned my addr 172.21.15.98:0/2619398626 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a23fff640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 0x7f8a2c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 -- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 msgr2=0x7f8a2c197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 0x7f8a2c197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.477+0000 7f8a2affd640 1 -- 172.21.15.98:0/2619398626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c1980c0 con 0x7f8a2c100860 2024-09-20T19:01:25.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a2affd640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c006010 tx=0x7f8a1c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c03f070 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c19caa0 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a1c0049d0 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c035030 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.478+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c19d030 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.479+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c100c60 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.479+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8a1c042070 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.480+0000 7f8a3093c640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 0x7f8a18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.480+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3803+0+0 (secure 0 0 0) 0x7f8a1c0ae590 con 0x7f8a2c100860 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.480+0000 7f8a23fff640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 0x7f8a18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:25.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.481+0000 7f8a23fff640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 0x7f8a18070770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c1989b0 tx=0x7f8a14005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.485+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a1c080220 con 0x7f8a2c100860 2024-09-20T19:01:25.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:25.663+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8a2c06a8c0 con 0x7f8a1806e2b0 2024-09-20T19:01:25.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:25 smithi098 ceph-mon[35737]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:25.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:25 smithi098 ceph-mon[35737]: osdmap e29: 4 total, 4 up, 4 in 2024-09-20T19:01:25.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:25 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:01:25.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:25 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:01:25.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:25 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:26.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:25 smithi027 ceph-mon[28196]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:26.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:25 smithi027 ceph-mon[28196]: osdmap e29: 4 total, 4 up, 4 in 2024-09-20T19:01:26.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:25 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:01:26.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:25 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:01:26.074 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:25 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:26.998 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:26 smithi098 ceph-mon[35737]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:26.998 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:26 smithi098 ceph-mon[35737]: osdmap e30: 4 total, 4 up, 4 in 2024-09-20T19:01:27.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:26 smithi027 ceph-mon[28196]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:27.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:26 smithi027 ceph-mon[28196]: osdmap e30: 4 total, 4 up, 4 in 2024-09-20T19:01:27.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:27 smithi098 ceph-mon[35737]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-20T19:01:27.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:27 smithi098 ceph-mon[35737]: osdmap e31: 4 total, 4 up, 4 in 2024-09-20T19:01:28.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:27 smithi027 ceph-mon[28196]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-20T19:01:28.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:27 smithi027 ceph-mon[28196]: osdmap e31: 4 total, 4 up, 4 in 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/2422054136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]: dispatch 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]: dispatch 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]': finished 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: osdmap e32: 5 total, 4 up, 5 in 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:29.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:28 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/3075109867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:29.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/2422054136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]: dispatch 2024-09-20T19:01:29.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]: dispatch 2024-09-20T19:01:29.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "359c2e8d-a262-4df2-9b6b-42b00a5b9200"}]': finished 2024-09-20T19:01:29.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: osdmap e32: 5 total, 4 up, 5 in 2024-09-20T19:01:29.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:29.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:28 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3075109867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:30.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:29 smithi098 ceph-mon[35737]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-20T19:01:30.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:29 smithi027 ceph-mon[28196]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-20T19:01:31.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:31 smithi027 ceph-mon[28196]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-20T19:01:31.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:31 smithi098 ceph-mon[35737]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-20T19:01:33.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:33 smithi027 ceph-mon[28196]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-20T19:01:33.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:33 smithi098 ceph-mon[35737]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-20T19:01:34.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:34.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:35.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:35 smithi098 ceph-mon[35737]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:35.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:35 smithi027 ceph-mon[28196]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:36.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:36 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T19:01:36.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:36 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:36.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:36 smithi027 ceph-mon[28196]: Deploying daemon osd.4 on smithi098 2024-09-20T19:01:36.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:36 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T19:01:36.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:36 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:36.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:36 smithi098 ceph-mon[35737]: Deploying daemon osd.4 on smithi098 2024-09-20T19:01:37.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:37 smithi098 ceph-mon[35737]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:37.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:37 smithi027 ceph-mon[28196]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:39.553 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:39 smithi098 ceph-mon[35737]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:39.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:39 smithi027 ceph-mon[28196]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:41.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:41 smithi027 ceph-mon[28196]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:41.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:41 smithi098 ceph-mon[35737]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:42.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:42 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:42.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:42 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:42.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:42 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:42.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:42 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:42.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:42 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:42.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:42 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:43.525 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:43 smithi098 ceph-mon[35737]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:43.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:43 smithi027 ceph-mon[28196]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:45.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:45 smithi027 ceph-mon[28196]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:45.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:45 smithi098 ceph-mon[35737]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.044+0000 7f8a3093c640 1 -- 172.21.15.98:0/2619398626 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8a2c06a8c0 con 0x7f8a1806e2b0 2024-09-20T19:01:46.054 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 4 on host 'smithi098' 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 msgr2=0x7f8a18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 0x7f8a18070770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c1989b0 tx=0x7f8a14005f90 comp rx=0 tx=0).stop 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 msgr2=0x7f8a2c197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c006010 tx=0x7f8a1c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 shutdown_connections 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8a1806e2b0 0x7f8a18070770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a2c101a60 0x7f8a2c197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 --2- 172.21.15.98:0/2619398626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a2c100860 0x7f8a2c197500 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 >> 172.21.15.98:0/2619398626 conn(0x7f8a2c0fc010 msgr2=0x7f8a2c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 shutdown_connections 2024-09-20T19:01:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:46.046+0000 7f8a3193e640 1 -- 172.21.15.98:0/2619398626 wait complete. 2024-09-20T19:01:46.838 DEBUG:teuthology.orchestra.run.smithi098:osd.4> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.4.service 2024-09-20T19:01:46.840 INFO:tasks.cephadm:Deploying osd.5 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-20T19:01:46.841 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T19:01:47.153 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:01:47.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:47 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:47.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:47 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:48.316 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:48 smithi098 ceph-mon[35737]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:48.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:48 smithi027 ceph-mon[28196]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:48.678 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:01:48 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:01:48.461+0000 7fafd5afb640 -1 osd.4 0 log_to_monitors true 2024-09-20T19:01:49.296 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:49 smithi098 ceph-mon[35737]: from='osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T19:01:49.296 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:49 smithi098 ceph-mon[35737]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T19:01:49.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:49 smithi027 ceph-mon[28196]: from='osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T19:01:49.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:49 smithi027 ceph-mon[28196]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: from='osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: osdmap e33: 5 total, 4 up, 5 in 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:50.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:50.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:50.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T19:01:50.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: from='osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:50.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: osdmap e33: 5 total, 4 up, 5 in 2024-09-20T19:01:50.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:50.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:01:50.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-20T19:01:50.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:50 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:01:51.188 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:01:50.876+0000 7fafd125b640 -1 osd.4 0 waiting for initial osdmap 2024-09-20T19:01:51.188 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:01:50 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:01:50.886+0000 7fafc988d640 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: osdmap e34: 5 total, 4 up, 5 in 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: from='osd.4 ' entity='osd.4' 2024-09-20T19:01:51.188 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:51 smithi098 ceph-mon[35737]: osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] boot 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: osdmap e34: 5 total, 4 up, 5 in 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: from='osd.4 ' entity='osd.4' 2024-09-20T19:01:51.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:51 smithi027 ceph-mon[28196]: osd.4 [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] boot 2024-09-20T19:01:52.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: osdmap e35: 5 total, 5 up, 5 in 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:52.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:52.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:52.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:52 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:01:52.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: osdmap e35: 5 total, 5 up, 5 in 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:01:52.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:52.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:01:52.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:52 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:01:52.598 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-20T19:01:52.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-20T19:01:52.869 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:01:53.290 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:53 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi098 2024-09-20T19:01:53.290 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:53 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi098 to 7456M 2024-09-20T19:01:53.290 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:53 smithi098 ceph-mon[35737]: osdmap e36: 5 total, 5 up, 5 in 2024-09-20T19:01:53.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 -- 172.21.15.98:0/3678517886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc101960 msgr2=0x7f2bdc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 --2- 172.21.15.98:0/3678517886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc101960 0x7f2bdc101d60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009880 tx=0x7f2bcc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 -- 172.21.15.98:0/3678517886 shutdown_connections 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 --2- 172.21.15.98:0/3678517886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc102b60 0x7f2bdc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 --2- 172.21.15.98:0/3678517886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc101960 0x7f2bdc101d60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 -- 172.21.15.98:0/3678517886 >> 172.21.15.98:0/3678517886 conn(0x7f2bdc0fd0f0 msgr2=0x7f2bdc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 -- 172.21.15.98:0/3678517886 shutdown_connections 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.306+0000 7f2be2776640 1 -- 172.21.15.98:0/3678517886 wait complete. 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 Processor -- start 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 -- start start 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc101960 0x7f2bdc197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:53.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc10a800 con 0x7f2bdc101960 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2be2776640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc10a680 con 0x7f2bdc102b60 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41880/0 (socket says 172.21.15.98:41880) 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 -- 172.21.15.98:0/1641544840 learned_addr learned my addr 172.21.15.98:0/1641544840 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bdbfff640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc101960 0x7f2bdc197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 -- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc101960 msgr2=0x7f2bdc197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc101960 0x7f2bdc197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.307+0000 7f2bd3fff640 1 -- 172.21.15.98:0/1641544840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc1980f0 con 0x7f2bdc102b60 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2bd3fff640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400b420 tx=0x7f2bc400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bc4011630 con 0x7f2bdc102b60 2024-09-20T19:01:53.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bc4016070 con 0x7f2bdc102b60 2024-09-20T19:01:53.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc19cb30 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bc4010d40 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.308+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc19d140 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.309+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bdc101d60 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.309+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2bc401b460 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.310+0000 7f2bd9ffb640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 0x7f2bc80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.310+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4206+0+0 (secure 0 0 0) 0x7f2bc408d4e0 con 0x7f2bdc102b60 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.310+0000 7f2bdbfff640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 0x7f2bc80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:53.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.311+0000 7f2bdbfff640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 0x7f2bc80707d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000c00 tx=0x7f2bcc005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:53.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:53 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi098 2024-09-20T19:01:53.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:53 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi098 to 7456M 2024-09-20T19:01:53.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:53 smithi027 ceph-mon[28196]: osdmap e36: 5 total, 5 up, 5 in 2024-09-20T19:01:53.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.314+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bc405f060 con 0x7f2bdc102b60 2024-09-20T19:01:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:01:53.491+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2bdc062630 con 0x7f2bc806e310 2024-09-20T19:01:54.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:54 smithi098 ceph-mon[35737]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:54.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:01:54.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:01:54.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:54 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:54.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:54 smithi027 ceph-mon[28196]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:54.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T19:01:54.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T19:01:54.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:54 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:01:55.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:55 smithi098 ceph-mon[35737]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:55.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:55 smithi027 ceph-mon[28196]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/1216853433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]: dispatch 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]: dispatch 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]': finished 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T19:01:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:56 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 543 MiB used, 446 GiB / 447 GiB avail 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1216853433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]: dispatch 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]: dispatch 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3f0ca5-e619-4adb-8533-f466b2dccc7f"}]': finished 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T19:01:56.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:56 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:01:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:57 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/1107199470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:57.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:57 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/1107199470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T19:01:58.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:58 smithi098 ceph-mon[35737]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:01:58.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:58 smithi027 ceph-mon[28196]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:01:59.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:01:59 smithi027 ceph-mon[28196]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:01:59.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:01:59 smithi098 ceph-mon[35737]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:01.464 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:01 smithi098 ceph-mon[35737]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:01.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:01 smithi027 ceph-mon[28196]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:03.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:03 smithi098 ceph-mon[35737]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:03.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:03 smithi027 ceph-mon[28196]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:04.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:04.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:05.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:05 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T19:02:05.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:05 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:05.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:05 smithi098 ceph-mon[35737]: Deploying daemon osd.5 on smithi098 2024-09-20T19:02:05.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:05 smithi098 ceph-mon[35737]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:05.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:05 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T19:02:05.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:05 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:05.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:05 smithi027 ceph-mon[28196]: Deploying daemon osd.5 on smithi098 2024-09-20T19:02:05.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:05 smithi027 ceph-mon[28196]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:07 smithi027 ceph-mon[28196]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:07.646 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:07 smithi098 ceph-mon[35737]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:09.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:09 smithi098 ceph-mon[35737]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:09.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:09 smithi027 ceph-mon[28196]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:10.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:10.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:10.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:11.678 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:11 smithi098 ceph-mon[35737]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:11.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:11 smithi027 ceph-mon[28196]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:13.514 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:13 smithi098 ceph-mon[35737]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:13.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.544+0000 7f2bd9ffb640 1 -- 172.21.15.98:0/1641544840 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2bdc062630 con 0x7f2bc806e310 2024-09-20T19:02:13.552 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 5 on host 'smithi098' 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 msgr2=0x7f2bc80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 0x7f2bc80707d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000c00 tx=0x7f2bcc005a20 comp rx=0 tx=0).stop 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 msgr2=0x7f2bdc197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400b420 tx=0x7f2bc400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 shutdown_connections 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2bc806e310 0x7f2bc80707d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bdc102b60 0x7f2bdc197a70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 --2- 172.21.15.98:0/1641544840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2bdc101960 0x7f2bdc197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 >> 172.21.15.98:0/1641544840 conn(0x7f2bdc0fd0f0 msgr2=0x7f2bdc1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 shutdown_connections 2024-09-20T19:02:13.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:13.546+0000 7f2be2776640 1 -- 172.21.15.98:0/1641544840 wait complete. 2024-09-20T19:02:13.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:13 smithi027 ceph-mon[28196]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:14.436 DEBUG:teuthology.orchestra.run.smithi098:osd.5> sudo journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.5.service 2024-09-20T19:02:14.439 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-20T19:02:14.439 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T19:02:14.713 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:14.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:14 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:14.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:14 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:14.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:14 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:14.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:14 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:15.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 -- 172.21.15.27:0/4094002032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 msgr2=0x7fe070101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:15.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 --2- 172.21.15.27:0/4094002032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070101ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe064009880 tx=0x7fe06402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 -- 172.21.15.27:0/4094002032 shutdown_connections 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 --2- 172.21.15.27:0/4094002032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070101ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 --2- 172.21.15.27:0/4094002032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 0x7fe070100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 -- 172.21.15.27:0/4094002032 >> 172.21.15.27:0/4094002032 conn(0x7fe0700fc010 msgr2=0x7fe0700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 -- 172.21.15.27:0/4094002032 shutdown_connections 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.168+0000 7fe076a4f640 1 -- 172.21.15.27:0/4094002032 wait complete. 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 Processor -- start 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 -- start start 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 0x7fe070197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:15.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701096a0 con 0x7fe070101a60 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe076a4f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe070109520 con 0x7fe070100860 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58604/0 (socket says 172.21.15.27:58604) 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 -- 172.21.15.27:0/3079619207 learned_addr learned my addr 172.21.15.27:0/3079619207 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06ffff640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 0x7fe070197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 -- 172.21.15.27:0/3079619207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 msgr2=0x7fe070197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 0x7fe070197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.169+0000 7fe06f7fe640 1 -- 172.21.15.27:0/3079619207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701980d0 con 0x7fe070101a60 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe06f7fe640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe064006010 tx=0x7fe0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe06403f070 con 0x7fe070101a60 2024-09-20T19:02:15.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe064004ac0 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07019cab0 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe064035030 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.170+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07019d040 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.171+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe070100c60 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.172+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe064042070 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.172+0000 7fe06d7fa640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 0x7fe058070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.173+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4321+0+0 (secure 0 0 0) 0x7fe0640ae8d0 con 0x7fe070101a60 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.173+0000 7fe06ffff640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 0x7fe058070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.173+0000 7fe06ffff640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 0x7fe058070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe06000b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:15.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.178+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe064080350 con 0x7fe070101a60 2024-09-20T19:02:15.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.355+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe07019d4f0 con 0x7fe070101a60 2024-09-20T19:02:15.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.356+0000 7fe06d7fa640 1 -- 172.21.15.27:0/3079619207 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7fe064084b80 con 0x7fe070101a60 2024-09-20T19:02:15.363 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 msgr2=0x7fe058070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 0x7fe058070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe060005fd0 tx=0x7fe06000b390 comp rx=0 tx=0).stop 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 msgr2=0x7fe070197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe064006010 tx=0x7fe0640046c0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 shutdown_connections 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe05806e2b0 0x7fe058070770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe070101a60 0x7fe070197a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 --2- 172.21.15.27:0/3079619207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe070100860 0x7fe070197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:15.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 >> 172.21.15.27:0/3079619207 conn(0x7fe0700fc010 msgr2=0x7fe070069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:15.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 shutdown_connections 2024-09-20T19:02:15.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:15.358+0000 7fe076a4f640 1 -- 172.21.15.27:0/3079619207 wait complete. 2024-09-20T19:02:16.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:16.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:16.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:16 smithi027 ceph-mon[28196]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:16.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:16 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3079619207' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:16.305 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726858911,"num_in_osds":6,"osd_in_since":1726858915,"num_remapped_pgs":0} 2024-09-20T19:02:16.358 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:16.359 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:16.359 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:16 smithi098 ceph-mon[35737]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:16.359 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:16 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3079619207' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:16.693 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:02:16 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:02:16.350+0000 7f782cf12640 -1 osd.5 0 log_to_monitors true 2024-09-20T19:02:17.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T19:02:17.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:17 smithi027 ceph-mon[28196]: from='osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T19:02:17.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:17 smithi027 ceph-mon[28196]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T19:02:17.427 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:17 smithi098 ceph-mon[35737]: from='osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T19:02:17.427 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:17 smithi098 ceph-mon[35737]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T19:02:17.576 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 -- 172.21.15.27:0/2031076500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 msgr2=0x7ff61c107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 --2- 172.21.15.27:0/2031076500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c107170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009880 tx=0x7ff60c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 -- 172.21.15.27:0/2031076500 shutdown_connections 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 --2- 172.21.15.27:0/2031076500 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c107170 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 --2- 172.21.15.27:0/2031076500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 0x7ff61c104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 -- 172.21.15.27:0/2031076500 >> 172.21.15.27:0/2031076500 conn(0x7ff61c0fc010 msgr2=0x7ff61c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 -- 172.21.15.27:0/2031076500 shutdown_connections 2024-09-20T19:02:18.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.013+0000 7ff622dae640 1 -- 172.21.15.27:0/2031076500 wait complete. 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 Processor -- start 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 -- start start 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 0x7ff61c101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c10a720 con 0x7ff61c104d80 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff622dae640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c10a5a0 con 0x7ff61c102450 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48746/0 (socket says 172.21.15.27:48746) 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 -- 172.21.15.27:0/3594994499 learned_addr learned my addr 172.21.15.27:0/3594994499 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff620b4a640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 0x7ff61c101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:18.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 -- 172.21.15.27:0/3594994499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 msgr2=0x7ff61c101d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 0x7ff61c101d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.014+0000 7ff61bfff640 1 -- 172.21.15.27:0/3594994499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c100940 con 0x7ff61c104d80 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff61bfff640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006010 tx=0x7ff60c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff60c03f070 con 0x7ff61c104d80 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c100c30 con 0x7ff61c104d80 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff60c004a50 con 0x7ff61c104d80 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff60c035030 con 0x7ff61c104d80 2024-09-20T19:02:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.015+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c1011c0 con 0x7ff61c104d80 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.016+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c102830 con 0x7ff61c104d80 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.016+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff60c042070 con 0x7ff61c104d80 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.017+0000 7ff619ffb640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 0x7ff608070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.017+0000 7ff620b4a640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 0x7ff608070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.017+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4342+0+0 (secure 0 0 0) 0x7ff60c0ae7b0 con 0x7ff61c104d80 2024-09-20T19:02:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.018+0000 7ff620b4a640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 0x7ff608070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff60400bbe0 tx=0x7ff60400b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:18.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.022+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff60c004c00 con 0x7ff61c104d80 2024-09-20T19:02:18.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.200+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff61c19f790 con 0x7ff61c104d80 2024-09-20T19:02:18.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.201+0000 7ff619ffb640 1 -- 172.21.15.27:0/3594994499 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) ==== 74+0+130 (secure 0 0 0) 0x7ff61c19f790 con 0x7ff61c104d80 2024-09-20T19:02:18.209 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 msgr2=0x7ff608070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 0x7ff608070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff60400bbe0 tx=0x7ff60400b390 comp rx=0 tx=0).stop 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 msgr2=0x7ff61c100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006010 tx=0x7ff60c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 shutdown_connections 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff60806e2b0 0x7ff608070770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff61c104d80 0x7ff61c100400 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 --2- 172.21.15.27:0/3594994499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c102450 0x7ff61c101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 >> 172.21.15.27:0/3594994499 conn(0x7ff61c0fc010 msgr2=0x7ff61c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:18.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 shutdown_connections 2024-09-20T19:02:18.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:18.203+0000 7ff622dae640 1 -- 172.21.15.27:0/3594994499 wait complete. 2024-09-20T19:02:18.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T19:02:18.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: osdmap e38: 6 total, 5 up, 6 in 2024-09-20T19:02:18.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:18.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: from='osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:02:18.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:02:18.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:18 smithi027 ceph-mon[28196]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:18.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T19:02:18.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: osdmap e38: 6 total, 5 up, 6 in 2024-09-20T19:02:18.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:18.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: from='osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:02:18.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-20T19:02:18.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-mon[35737]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:18.881 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1726858911,"num_in_osds":6,"osd_in_since":1726858915,"num_remapped_pgs":0} 2024-09-20T19:02:19.227 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:02:18.840+0000 7f7828672640 -1 osd.5 0 waiting for initial osdmap 2024-09-20T19:02:19.228 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:02:18 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:02:18.851+0000 7f7820ca4640 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: osdmap e39: 6 total, 5 up, 6 in 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: Detected new or changed devices on smithi098 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3594994499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.229 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:19 smithi098 ceph-mon[35737]: from='osd.5 ' entity='osd.5' 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: osdmap e39: 6 total, 5 up, 6 in 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: Detected new or changed devices on smithi098 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3594994499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:19.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:19 smithi027 ceph-mon[28196]: from='osd.5 ' entity='osd.5' 2024-09-20T19:02:19.882 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T19:02:20.156 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:20.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: purged_snaps scrub starts 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: purged_snaps scrub ok 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi098 to 4970M 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] boot 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T19:02:20.278 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:20 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:20.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: purged_snaps scrub starts 2024-09-20T19:02:20.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: purged_snaps scrub ok 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi098 to 4970M 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: osd.5 [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] boot 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T19:02:20.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:20 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 -- 172.21.15.27:0/1061189794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 msgr2=0x7fe23c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 --2- 172.21.15.27:0/1061189794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c101d60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe238009880 tx=0x7fe23802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 -- 172.21.15.27:0/1061189794 shutdown_connections 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 --2- 172.21.15.27:0/1061189794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 0x7fe23c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 --2- 172.21.15.27:0/1061189794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c101d60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 -- 172.21.15.27:0/1061189794 >> 172.21.15.27:0/1061189794 conn(0x7fe23c0fd0f0 msgr2=0x7fe23c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.741+0000 7fe2447a7640 1 -- 172.21.15.27:0/1061189794 shutdown_connections 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 -- 172.21.15.27:0/1061189794 wait complete. 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 Processor -- start 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 -- start start 2024-09-20T19:02:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 0x7fe23c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c10a800 con 0x7fe23c101960 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe2447a7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c10a680 con 0x7fe23c102b60 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.742+0000 7fe242543640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48766/0 (socket says 172.21.15.27:48766) 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 -- 172.21.15.27:0/3493905276 learned_addr learned my addr 172.21.15.27:0/3493905276 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe241d42640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 0x7fe23c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 -- 172.21.15.27:0/3493905276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 msgr2=0x7fe23c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 0x7fe23c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 -- 172.21.15.27:0/3493905276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c074b20 con 0x7fe23c101960 2024-09-20T19:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe242543640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe238006010 tx=0x7fe2380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe23803f070 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2380044d0 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c074db0 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe238035030 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.743+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c075360 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.744+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23c101d60 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.745+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe238042070 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.745+0000 7fe2337fe640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 0x7fe2280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.745+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fe2380ae980 con 0x7fe23c101960 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.746+0000 7fe241d42640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 0x7fe2280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.746+0000 7fe241d42640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 0x7fe2280707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe23c075ca0 tx=0x7fe22c009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:20.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.750+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe23807c640 con 0x7fe23c101960 2024-09-20T19:02:20.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.924+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe23c02db70 con 0x7fe23c101960 2024-09-20T19:02:20.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.925+0000 7fe2337fe640 1 -- 172.21.15.27:0/3493905276 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7fe23c02db70 con 0x7fe23c101960 2024-09-20T19:02:20.933 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:20.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 msgr2=0x7fe2280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 0x7fe2280707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe23c075ca0 tx=0x7fe22c009110 comp rx=0 tx=0).stop 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 msgr2=0x7fe23c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe238006010 tx=0x7fe2380048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 shutdown_connections 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe22806e310 0x7fe2280707d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe23c102b60 0x7fe23c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 --2- 172.21.15.27:0/3493905276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe23c101960 0x7fe23c075f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.927+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 >> 172.21.15.27:0/3493905276 conn(0x7fe23c0fd0f0 msgr2=0x7fe23c105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.928+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 shutdown_connections 2024-09-20T19:02:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:20.928+0000 7fe2447a7640 1 -- 172.21.15.27:0/3493905276 wait complete. 2024-09-20T19:02:21.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:21 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3493905276' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:21 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3493905276' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T19:02:21.811 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726858939,"num_in_osds":6,"osd_in_since":1726858915,"num_remapped_pgs":0} 2024-09-20T19:02:21.812 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T19:02:22.072 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:22.406 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:22 smithi027 ceph-mon[28196]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T19:02:22.406 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:22 smithi027 ceph-mon[28196]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:22 smithi098 ceph-mon[35737]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T19:02:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:22 smithi098 ceph-mon[35737]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 -- 172.21.15.27:0/1506636129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 msgr2=0x7f2040107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 --2- 172.21.15.27:0/1506636129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f2040107ce0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2030009880 tx=0x7f203002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 -- 172.21.15.27:0/1506636129 shutdown_connections 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 --2- 172.21.15.27:0/1506636129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f2040101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 --2- 172.21.15.27:0/1506636129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f2040107ce0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 -- 172.21.15.27:0/1506636129 >> 172.21.15.27:0/1506636129 conn(0x7f20400fd600 msgr2=0x7f20400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 -- 172.21.15.27:0/1506636129 shutdown_connections 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.479+0000 7f2044be0640 1 -- 172.21.15.27:0/1506636129 wait complete. 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 Processor -- start 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 -- start start 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f204019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f204010edd0 con 0x7f2040107900 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f2044be0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f204010ec50 con 0x7f2040101900 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f203dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f203dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48780/0 (socket says 172.21.15.27:48780) 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.480+0000 7f203dd9b640 1 -- 172.21.15.27:0/2469800997 learned_addr learned my addr 172.21.15.27:0/2469800997 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203e59c640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f204019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203dd9b640 1 -- 172.21.15.27:0/2469800997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 msgr2=0x7f204019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203dd9b640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f204019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203dd9b640 1 -- 172.21.15.27:0/2469800997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20401977a0 con 0x7f2040107900 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203e59c640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f204019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f203dd9b640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f203400d6f0 tx=0x7f203400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2034017070 con 0x7f2040107900 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f203400de00 con 0x7f2040107900 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2040197a90 con 0x7f2040107900 2024-09-20T19:02:22.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2034004bb0 con 0x7f2040107900 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.481+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2040198020 con 0x7f2040107900 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.482+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040103040 con 0x7f2040107900 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.483+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2034004e60 con 0x7f2040107900 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.483+0000 7f202f7fe640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 0x7f2028070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.483+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f203408da20 con 0x7f2040107900 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.483+0000 7f203e59c640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 0x7f2028070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:22.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.484+0000 7f203e59c640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 0x7f2028070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f2030031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:22.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.488+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f203405b6c0 con 0x7f2040107900 2024-09-20T19:02:22.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.671+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2040109e70 con 0x7f2040107900 2024-09-20T19:02:22.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.672+0000 7f202f7fe640 1 -- 172.21.15.27:0/2469800997 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+11356 (secure 0 0 0) 0x7f203405f370 con 0x7f2040107900 2024-09-20T19:02:22.680 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:22.681 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":41,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","created":"2024-09-20T18:56:16.857389+0000","modified":"2024-09-20T19:02:21.062209+0000","last_up_change":"2024-09-20T19:02:19.843053+0000","last_in_change":"2024-09-20T19:01:55.764402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T19:01:01.653480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af00b5b4-770e-4da0-b62e-56d53824b126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6803","nonce":1816280731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6805","nonce":1816280731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6809","nonce":1816280731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6807","nonce":1816280731}]},"public_addr":"172.21.15.27:6803/1816280731","cluster_addr":"172.21.15.27:6805/1816280731","heartbeat_back_addr":"172.21.15.27:6809/1816280731","heartbeat_front_addr":"172.21.15.27:6807/1816280731","state":["exists","up"]},{"osd":1,"uuid":"564b02b7-346b-4797-ab71-70a0090c2c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6811","nonce":3340066990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6813","nonce":3340066990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6817","nonce":3340066990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6815","nonce":3340066990}]},"public_addr":"172.21.15.27:6811/3340066990","cluster_addr":"172.21.15.27:6813/3340066990","heartbeat_back_addr":"172.21.15.27:6817/3340066990","heartbeat_front_addr":"172.21.15.27:6815/3340066990","state":["exists","up"]},{"osd":2,"uuid":"1d5dd1f3-60a8-4d53-8318-5815923cbf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6819","nonce":409830571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6821","nonce":409830571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6825","nonce":409830571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6823","nonce":409830571}]},"public_addr":"172.21.15.27:6819/409830571","cluster_addr":"172.21.15.27:6821/409830571","heartbeat_back_addr":"172.21.15.27:6825/409830571","heartbeat_front_addr":"172.21.15.27:6823/409830571","state":["exists","up"]},{"osd":3,"uuid":"55195947-e3d8-4a7a-ae4f-75d7b5d33035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6801","nonce":2338774910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6803","nonce":2338774910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6807","nonce":2338774910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6805","nonce":2338774910}]},"public_addr":"172.21.15.98:6801/2338774910","cluster_addr":"172.21.15.98:6803/2338774910","heartbeat_back_addr":"172.21.15.98:6807/2338774910","heartbeat_front_addr":"172.21.15.98:6805/2338774910","state":["exists","up"]},{"osd":4,"uuid":"359c2e8d-a262-4df2-9b6b-42b00a5b9200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6809","nonce":1662141352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6811","nonce":1662141352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6815","nonce":1662141352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6813","nonce":1662141352}]},"public_addr":"172.21.15.98:6809/1662141352","cluster_addr":"172.21.15.98:6811/1662141352","heartbeat_back_addr":"172.21.15.98:6815/1662141352","heartbeat_front_addr":"172.21.15.98:6813/1662141352","state":["exists","up"]},{"osd":5,"uuid":"0d3f0ca5-e619-4adb-8533-f466b2dccc7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6817","nonce":3547678161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6819","nonce":3547678161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6823","nonce":3547678161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6821","nonce":3547678161}]},"public_addr":"172.21.15.98:6817/3547678161","cluster_addr":"172.21.15.98:6819/3547678161","heartbeat_back_addr":"172.21.15.98:6823/3547678161","heartbeat_front_addr":"172.21.15.98:6821/3547678161","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:59:58.871854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:29.453417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:57.769297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:21.729955+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:49.470164+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:02:17.390676+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2690377655":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/2350483020":"2024-09-21T18:58:19.133219+0000","172.21.15.27:0/2663124002":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/931142735":"2024-09-21T18:56:39.148571+0000","172.21.15.27:6800/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/3522474440":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/570952743":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6801/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/4025423151":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/3064380782":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/2799355393":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6800/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/519217990":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6800/2350483020":"2024-09-21T18:58:19.133219+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 msgr2=0x7f2028070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 0x7f2028070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f2030031400 comp rx=0 tx=0).stop 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 msgr2=0x7f204019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f203400d6f0 tx=0x7f203400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 shutdown_connections 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f202806e2b0 0x7f2028070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2040107900 0x7f204019db60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 --2- 172.21.15.27:0/2469800997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2040101900 0x7f204019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 >> 172.21.15.27:0/2469800997 conn(0x7f20400fd600 msgr2=0x7f20400fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 shutdown_connections 2024-09-20T19:02:22.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:22.675+0000 7f2044be0640 1 -- 172.21.15.27:0/2469800997 wait complete. 2024-09-20T19:02:23.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:23 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2469800997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:23.434 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T19:01:01.653480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-20T19:02:23.434 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-20T19:02:23.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:23 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2469800997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:23.696 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 -- 172.21.15.27:0/655609760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010107900 msgr2=0x7f6010107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 --2- 172.21.15.27:0/655609760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010107900 0x7f6010107ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6000009880 tx=0x7f600002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 -- 172.21.15.27:0/655609760 shutdown_connections 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 --2- 172.21.15.27:0/655609760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010101900 0x7f6010101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 --2- 172.21.15.27:0/655609760 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010107900 0x7f6010107ce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 -- 172.21.15.27:0/655609760 >> 172.21.15.27:0/655609760 conn(0x7f60100fd600 msgr2=0x7f60100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 -- 172.21.15.27:0/655609760 shutdown_connections 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.170+0000 7f6015c1d640 1 -- 172.21.15.27:0/655609760 wait complete. 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 Processor -- start 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 -- start start 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010107900 0x7f601019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f601010edd0 con 0x7f6010101900 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6015c1d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f601010ec50 con 0x7f6010107900 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f600f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f600f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48798/0 (socket says 172.21.15.27:48798) 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f600f7fe640 1 -- 172.21.15.27:0/3714462089 learned_addr learned my addr 172.21.15.27:0/3714462089 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.171+0000 7f6007fff640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010107900 0x7f601019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600f7fe640 1 -- 172.21.15.27:0/3714462089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010107900 msgr2=0x7f601019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600f7fe640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010107900 0x7f601019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600f7fe640 1 -- 172.21.15.27:0/3714462089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6010197820 con 0x7f6010101900 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600f7fe640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6000031460 tx=0x7f60000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f600003f070 con 0x7f6010101900 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6010197ab0 con 0x7f6010101900 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6000004cf0 con 0x7f6010101900 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6000035030 con 0x7f6010101900 2024-09-20T19:02:24.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.172+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6010197fe0 con 0x7f6010101900 2024-09-20T19:02:24.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.173+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6010103040 con 0x7f6010101900 2024-09-20T19:02:24.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.174+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6000042070 con 0x7f6010101900 2024-09-20T19:02:24.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.174+0000 7f600d7fa640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 0x7f5ffc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.174+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f60000ae8a0 con 0x7f6010101900 2024-09-20T19:02:24.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.174+0000 7f6007fff640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 0x7f5ffc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.174+0000 7f6007fff640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 0x7f5ffc070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8005fd0 tx=0x7f5ff8005e20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.178+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f600007c540 con 0x7f6010101900 2024-09-20T19:02:24.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.352+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6010109e70 con 0x7f6010101900 2024-09-20T19:02:24.361 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:24 smithi027 ceph-mon[28196]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:24.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.353+0000 7f600d7fa640 1 -- 172.21.15.27:0/3714462089 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f60000801f0 con 0x7f6010101900 2024-09-20T19:02:24.361 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-20T19:02:24.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 msgr2=0x7f5ffc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 0x7f5ffc070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8005fd0 tx=0x7f5ff8005e20 comp rx=0 tx=0).stop 2024-09-20T19:02:24.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 msgr2=0x7f601019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6000031460 tx=0x7f60000048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 shutdown_connections 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f5ffc06e2b0 0x7f5ffc070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6010107900 0x7f601019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 --2- 172.21.15.27:0/3714462089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6010101900 0x7f601019d6a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 >> 172.21.15.27:0/3714462089 conn(0x7f60100fd600 msgr2=0x7f60100fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 shutdown_connections 2024-09-20T19:02:24.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:24.355+0000 7f6015c1d640 1 -- 172.21.15.27:0/3714462089 wait complete. 2024-09-20T19:02:24.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:24 smithi098 ceph-mon[35737]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:25.089 INFO:tasks.cephadm:Setting up client nodes... 2024-09-20T19:02:25.089 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T19:02:25.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:25 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3714462089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T19:02:25.345 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:25.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:25 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3714462089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T19:02:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 -- 172.21.15.27:0/1323483696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0101960 msgr2=0x7f91c0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 --2- 172.21.15.27:0/1323483696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0101960 0x7f91c0101d60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009880 tx=0x7f91bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 -- 172.21.15.27:0/1323483696 shutdown_connections 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 --2- 172.21.15.27:0/1323483696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0102b60 0x7f91c0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 --2- 172.21.15.27:0/1323483696 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0101960 0x7f91c0101d60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 -- 172.21.15.27:0/1323483696 >> 172.21.15.27:0/1323483696 conn(0x7f91c00fd0f0 msgr2=0x7f91c00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 -- 172.21.15.27:0/1323483696 shutdown_connections 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.787+0000 7f91c84a8640 1 -- 172.21.15.27:0/1323483696 wait complete. 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 Processor -- start 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 -- start start 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0101960 0x7f91c0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010a800 con 0x7f91c0102b60 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c84a8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010a680 con 0x7f91c0101960 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c5a43640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:25.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c5a43640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48500/0 (socket says 172.21.15.27:48500) 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c5a43640 1 -- 172.21.15.27:0/2056170290 learned_addr learned my addr 172.21.15.27:0/2056170290 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c6244640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0101960 0x7f91c0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c5a43640 1 -- 172.21.15.27:0/2056170290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0101960 msgr2=0x7f91c0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.788+0000 7f91c5a43640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0101960 0x7f91c0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91c5a43640 1 -- 172.21.15.27:0/2056170290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c0074b20 con 0x7f91c0102b60 2024-09-20T19:02:25.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91c5a43640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b420 tx=0x7f91b000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91b0011630 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91b0016070 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c0074e10 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91b0010d40 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.789+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c0075420 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.790+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c0101d60 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.790+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f91b001b460 con 0x7f91c0102b60 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.791+0000 7f91b77fe640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 0x7f91ac0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.791+0000 7f91c6244640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 0x7f91ac0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.791+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f91b008d5f0 con 0x7f91c0102b60 2024-09-20T19:02:25.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.792+0000 7f91c6244640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 0x7f91ac0707c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc009620 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:25.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:25.796+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91b005b310 con 0x7f91c0102b60 2024-09-20T19:02:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.042+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f91c0062df0 con 0x7f91c0102b60 2024-09-20T19:02:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.045+0000 7f91b77fe640 1 -- 172.21.15.27:0/2056170290 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f91b008d410 con 0x7f91c0102b60 2024-09-20T19:02:26.052 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-09-20T19:02:26.052 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDCxu1mUz2pAhAAXS42lzK4PtV6FjDQ2iZXDQ== 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 msgr2=0x7f91ac0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 0x7f91ac0707c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc009620 comp rx=0 tx=0).stop 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 msgr2=0x7f91c00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b420 tx=0x7f91b000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 shutdown_connections 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f91ac06e300 0x7f91ac0707c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f91c0102b60 0x7f91c00745e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 --2- 172.21.15.27:0/2056170290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91c0101960 0x7f91c0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:26.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 >> 172.21.15.27:0/2056170290 conn(0x7f91c00fd0f0 msgr2=0x7f91c0106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:26.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 shutdown_connections 2024-09-20T19:02:26.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:26.047+0000 7f91c84a8640 1 -- 172.21.15.27:0/2056170290 wait complete. 2024-09-20T19:02:26.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:26 smithi027 ceph-mon[28196]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:26.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:26 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2056170290' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:26.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:26 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2056170290' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T19:02:26.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:26 smithi098 ceph-mon[35737]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:26.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:26 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2056170290' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:26.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:26 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2056170290' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T19:02:26.861 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T19:02:26.861 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-20T19:02:26.861 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-20T19:02:26.899 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T19:02:27.159 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi098/config 2024-09-20T19:02:27.522 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:27 smithi098 ceph-mon[35737]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:27.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:27 smithi027 ceph-mon[28196]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:27.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 -- 172.21.15.98:0/3968310402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 msgr2=0x7f9c401071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:27.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 --2- 172.21.15.98:0/3968310402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c401071d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009880 tx=0x7f9c3402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 -- 172.21.15.98:0/3968310402 shutdown_connections 2024-09-20T19:02:27.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 --2- 172.21.15.98:0/3968310402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c401071d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 --2- 172.21.15.98:0/3968310402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c401048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.604+0000 7f9c44847640 1 -- 172.21.15.98:0/3968310402 >> 172.21.15.98:0/3968310402 conn(0x7f9c400fc010 msgr2=0x7f9c400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 -- 172.21.15.98:0/3968310402 shutdown_connections 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 -- 172.21.15.98:0/3968310402 wait complete. 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 Processor -- start 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 -- start start 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c40197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4010a800 con 0x7f9c401024b0 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.605+0000 7f9c44847640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4010a680 con 0x7f9c40104de0 2024-09-20T19:02:27.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60516/0 (socket says 172.21.15.98:60516) 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 -- 172.21.15.98:0/3878028983 learned_addr learned my addr 172.21.15.98:0/3878028983 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3e59c640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c40197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 -- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 msgr2=0x7f9c40197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c40197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 -- 172.21.15.98:0/3878028983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c401981d0 con 0x7f9c40104de0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3e59c640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c40197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c3dd9b640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9c340048f0 tx=0x7f9c34004920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c3403f070 con 0x7f9c40104de0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c34003ab0 con 0x7f9c40104de0 2024-09-20T19:02:27.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c34035030 con 0x7f9c40104de0 2024-09-20T19:02:27.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4019cbb0 con 0x7f9c40104de0 2024-09-20T19:02:27.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.606+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4019d1c0 con 0x7f9c40104de0 2024-09-20T19:02:27.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.607+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c40102890 con 0x7f9c40104de0 2024-09-20T19:02:27.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.608+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9c34042070 con 0x7f9c40104de0 2024-09-20T19:02:27.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.608+0000 7f9c2f7fe640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:27.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.608+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f9c340aeac0 con 0x7f9c40104de0 2024-09-20T19:02:27.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.608+0000 7f9c3e59c640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:27.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.609+0000 7f9c3e59c640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 0x7f9c28070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c30006fd0 tx=0x7f9c30008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:27.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.613+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c3407c760 con 0x7f9c40104de0 2024-09-20T19:02:27.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.839+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f9c4019da90 con 0x7f9c40104de0 2024-09-20T19:02:27.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.844+0000 7f9c2f7fe640 1 -- 172.21.15.98:0/3878028983 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f9c34080410 con 0x7f9c40104de0 2024-09-20T19:02:27.851 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2024-09-20T19:02:27.851 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDDxu1mPMMrMhAATy9LKI0Hiw0EEPLolCLcUg== 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 msgr2=0x7f9c28070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 0x7f9c28070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c30006fd0 tx=0x7f9c30008040 comp rx=0 tx=0).stop 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 msgr2=0x7f9c40197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9c340048f0 tx=0x7f9c34004920 comp rx=0 tx=0).stop 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 shutdown_connections 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f9c2806e2b0 0x7f9c28070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c40104de0 0x7f9c40197b50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 --2- 172.21.15.98:0/3878028983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c401024b0 0x7f9c40197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:27.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 >> 172.21.15.98:0/3878028983 conn(0x7f9c400fc010 msgr2=0x7f9c400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:27.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 shutdown_connections 2024-09-20T19:02:27.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:02:27.846+0000 7f9c44847640 1 -- 172.21.15.98:0/3878028983 wait complete. 2024-09-20T19:02:28.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:28 smithi098 ceph-mon[35737]: from='client.? 172.21.15.98:0/3878028983' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:28.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:28 smithi098 ceph-mon[35737]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:28.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:28 smithi098 ceph-mon[35737]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T19:02:28.568 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T19:02:28.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-20T19:02:28.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-20T19:02:28.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:28 smithi027 ceph-mon[28196]: from='client.? 172.21.15.98:0/3878028983' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:28.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:28 smithi027 ceph-mon[28196]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T19:02:28.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:28 smithi027 ceph-mon[28196]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T19:02:28.606 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-20T19:02:28.876 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:29.277 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:29 smithi027 ceph-mon[28196]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- 172.21.15.27:0/2635201361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 msgr2=0x7f8c60106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 --2- 172.21.15.27:0/2635201361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60106be0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009880 tx=0x7f8c5c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- 172.21.15.27:0/2635201361 shutdown_connections 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 --2- 172.21.15.27:0/2635201361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 0x7f8c60100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 --2- 172.21.15.27:0/2635201361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60106be0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- 172.21.15.27:0/2635201361 >> 172.21.15.27:0/2635201361 conn(0x7f8c600fc520 msgr2=0x7f8c600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- 172.21.15.27:0/2635201361 shutdown_connections 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- 172.21.15.27:0/2635201361 wait complete. 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 Processor -- start 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.353+0000 7f8c68599640 1 -- start start 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c68599640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 0x7f8c601987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c68599640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c68599640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010dcb0 con 0x7f8c60106800 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c68599640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010db30 con 0x7f8c60100800 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48524/0 (socket says 172.21.15.27:48524) 2024-09-20T19:02:29.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 -- 172.21.15.27:0/3016728722 learned_addr learned my addr 172.21.15.27:0/3016728722 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c66335640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 0x7f8c601987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 -- 172.21.15.27:0/3016728722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 msgr2=0x7f8c601987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 0x7f8c601987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 -- 172.21.15.27:0/3016728722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60199330 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c65b34640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d8d0 tx=0x7f8c5000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c50017030 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c50004020 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601a1810 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.354+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c500047a0 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.355+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601a1c10 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.355+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60101f40 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.356+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8c500041d0 con 0x7f8c60106800 2024-09-20T19:02:29.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.356+0000 7f8c577fe640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 0x7f8c4c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.357+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f8c50018070 con 0x7f8c60106800 2024-09-20T19:02:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.357+0000 7f8c66335640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 0x7f8c4c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.357+0000 7f8c66335640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 0x7f8c4c0707c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0096c0 tx=0x7f8c5c000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.361+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c5005b870 con 0x7f8c60106800 2024-09-20T19:02:29.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.538+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f8c6002d7c0 con 0x7f8c60106800 2024-09-20T19:02:29.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.538+0000 7f8c577fe640 1 -- 172.21.15.27:0/3016728722 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+160 (secure 0 0 0) 0x7f8c5005f520 con 0x7f8c60106800 2024-09-20T19:02:29.546 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:29.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 msgr2=0x7f8c4c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:29.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 0x7f8c4c0707c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0096c0 tx=0x7f8c5c000bc0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 msgr2=0x7f8c60198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:29.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d8d0 tx=0x7f8c5000dd90 comp rx=0 tx=0).stop 2024-09-20T19:02:29.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 shutdown_connections 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8c4c06e300 0x7f8c4c0707c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c60106800 0x7f8c60198ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 --2- 172.21.15.27:0/3016728722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c60100800 0x7f8c601987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 >> 172.21.15.27:0/3016728722 conn(0x7f8c600fc520 msgr2=0x7f8c600fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 shutdown_connections 2024-09-20T19:02:29.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:29.540+0000 7f8c68599640 1 -- 172.21.15.27:0/3016728722 wait complete. 2024-09-20T19:02:29.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:29 smithi098 ceph-mon[35737]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:30.235 INFO:teuthology.orchestra.run.smithi027.stdout:[{"version":41,"timestamp":"2024-09-20T19:02:18.842026+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"8752.662348"}]}] 2024-09-20T19:02:30.235 INFO:tasks.ceph_manager:config epoch is 41 2024-09-20T19:02:30.236 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T19:02:30.236 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-20T19:02:30.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-20T19:02:30.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:30 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3016728722' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-20T19:02:30.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:30 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3016728722' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-20T19:02:30.497 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.967+0000 7f638a4e4640 1 -- 172.21.15.27:0/958300763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 msgr2=0x7f6384101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.967+0000 7f638a4e4640 1 --2- 172.21.15.27:0/958300763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f6384101d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6378009880 tx=0x7f637802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 -- 172.21.15.27:0/958300763 shutdown_connections 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 --2- 172.21.15.27:0/958300763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f6384101d60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 --2- 172.21.15.27:0/958300763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 0x7f6384107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 -- 172.21.15.27:0/958300763 >> 172.21.15.27:0/958300763 conn(0x7f63840fd600 msgr2=0x7f63840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:30.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 -- 172.21.15.27:0/958300763 shutdown_connections 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 -- 172.21.15.27:0/958300763 wait complete. 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 Processor -- start 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.968+0000 7f638a4e4640 1 -- start start 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f638a4e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f638a4e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 0x7f638419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f638a4e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f638410ee30 con 0x7f6384101900 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f638a4e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f638410ecb0 con 0x7f6384107900 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48536/0 (socket says 172.21.15.27:48536) 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 -- 172.21.15.27:0/2117232642 learned_addr learned my addr 172.21.15.27:0/2117232642 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f63837fe640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 0x7f638419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 -- 172.21.15.27:0/2117232642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 msgr2=0x7f638419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:30.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 0x7f638419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 -- 172.21.15.27:0/2117232642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6384197840 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f6383fff640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f637400b420 tx=0x7f637400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6374011630 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6374016070 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6384197b30 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.969+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6374010d40 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.970+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6384198090 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.971+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6384103040 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.971+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f637401b460 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.972+0000 7f63817fa640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 0x7f636c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.972+0000 7f63837fe640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 0x7f636c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.972+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f637408d5f0 con 0x7f6384101900 2024-09-20T19:02:30.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.972+0000 7f63837fe640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 0x7f636c070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6384198b90 tx=0x7f6378031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:30.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:30.976+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f637405b290 con 0x7f6384101900 2024-09-20T19:02:31.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.199+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6384109e90 con 0x7f6384101900 2024-09-20T19:02:31.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.202+0000 7f63817fa640 1 -- 172.21.15.27:0/2117232642 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176565 (secure 0 0 0) 0x7f637408d410 con 0x7f6384101900 2024-09-20T19:02:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 msgr2=0x7f636c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 0x7f636c070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6384198b90 tx=0x7f6378031400 comp rx=0 tx=0).stop 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 msgr2=0x7f638419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f637400b420 tx=0x7f637400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 shutdown_connections 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f636c06e2b0 0x7f636c070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6384107900 0x7f638419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 --2- 172.21.15.27:0/2117232642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6384101900 0x7f638419d6c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.204+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 >> 172.21.15.27:0/2117232642 conn(0x7f63840fd600 msgr2=0x7f63840fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.205+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 shutdown_connections 2024-09-20T19:02:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:31.205+0000 7f638a4e4640 1 -- 172.21.15.27:0/2117232642 wait complete. 2024-09-20T19:02:31.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:31 smithi027 ceph-mon[28196]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:31.530 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:31 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2117232642' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T19:02:31.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:31 smithi098 ceph-mon[35737]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:31.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:31 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2117232642' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T19:02:32.004 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"flags":0,"active_gid":14221,"active_name":"smithi027.tlgpqo","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":3031006288},{"type":"v1","addr":"172.21.15.27:6801","nonce":3031006288}]},"active_addr":"172.21.15.27:6801/3031006288","active_change":"2024-09-20T18:58:19.133331+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14248,"name":"smithi098.wrcvbg","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.27:8443/","prometheus":"http://172.21.15.27:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3748322701}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":245967963}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1562300194}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":2997066595}]}]} 2024-09-20T19:02:32.009 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-20T19:02:32.009 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-20T19:02:32.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T19:02:32.267 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:32.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 -- 172.21.15.27:0/3526619519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 msgr2=0x7f93ec102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 --2- 172.21.15.27:0/3526619519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec102ef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0098b0 tx=0x7f93dc02a560 comp rx=0 tx=0).stop 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 -- 172.21.15.27:0/3526619519 shutdown_connections 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 --2- 172.21.15.27:0/3526619519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 --2- 172.21.15.27:0/3526619519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec102ef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 -- 172.21.15.27:0/3526619519 >> 172.21.15.27:0/3526619519 conn(0x7f93ec0fc550 msgr2=0x7f93ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 -- 172.21.15.27:0/3526619519 shutdown_connections 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 -- 172.21.15.27:0/3526619519 wait complete. 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.724+0000 7f93f1374640 1 Processor -- start 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93f1374640 1 -- start start 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93f1374640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:32.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93f1374640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93f1374640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec10ede0 con 0x7f93ec102b10 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93f1374640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec10ec60 con 0x7f93ec103430 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48562/0 (socket says 172.21.15.27:48562) 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 -- 172.21.15.27:0/1816823230 learned_addr learned my addr 172.21.15.27:0/1816823230 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93ea7fc640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 -- 172.21.15.27:0/1816823230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 msgr2=0x7f93ec100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93eaffd640 1 -- 172.21.15.27:0/1816823230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec1011f0 con 0x7f93ec102b10 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.725+0000 7f93ea7fc640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93eaffd640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f93dc031460 tx=0x7f93dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93dc03f070 con 0x7f93ec102b10 2024-09-20T19:02:32.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec101480 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93dc0044d0 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93dc035030 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.726+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec1a3e30 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.727+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec06a520 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.727+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f93dc042070 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.728+0000 7f93d3fff640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 0x7f93d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.728+0000 7f93ea7fc640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 0x7f93d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.728+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f93dc0ae840 con 0x7f93ec102b10 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.729+0000 7f93ea7fc640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 0x7f93d4070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005fd0 tx=0x7f93e0005ea0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:32.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.733+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93dc07c4e0 con 0x7f93ec102b10 2024-09-20T19:02:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.913+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93ec104f60 con 0x7f93ec102b10 2024-09-20T19:02:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.914+0000 7f93d3fff640 1 -- 172.21.15.27:0/1816823230 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+11356 (secure 0 0 0) 0x7f93dc004cf0 con 0x7f93ec102b10 2024-09-20T19:02:32.922 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:32.922 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":41,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","created":"2024-09-20T18:56:16.857389+0000","modified":"2024-09-20T19:02:21.062209+0000","last_up_change":"2024-09-20T19:02:19.843053+0000","last_in_change":"2024-09-20T19:01:55.764402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T19:01:01.653480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af00b5b4-770e-4da0-b62e-56d53824b126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6803","nonce":1816280731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6805","nonce":1816280731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6809","nonce":1816280731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6807","nonce":1816280731}]},"public_addr":"172.21.15.27:6803/1816280731","cluster_addr":"172.21.15.27:6805/1816280731","heartbeat_back_addr":"172.21.15.27:6809/1816280731","heartbeat_front_addr":"172.21.15.27:6807/1816280731","state":["exists","up"]},{"osd":1,"uuid":"564b02b7-346b-4797-ab71-70a0090c2c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6811","nonce":3340066990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6813","nonce":3340066990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6817","nonce":3340066990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6815","nonce":3340066990}]},"public_addr":"172.21.15.27:6811/3340066990","cluster_addr":"172.21.15.27:6813/3340066990","heartbeat_back_addr":"172.21.15.27:6817/3340066990","heartbeat_front_addr":"172.21.15.27:6815/3340066990","state":["exists","up"]},{"osd":2,"uuid":"1d5dd1f3-60a8-4d53-8318-5815923cbf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6819","nonce":409830571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6821","nonce":409830571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6825","nonce":409830571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6823","nonce":409830571}]},"public_addr":"172.21.15.27:6819/409830571","cluster_addr":"172.21.15.27:6821/409830571","heartbeat_back_addr":"172.21.15.27:6825/409830571","heartbeat_front_addr":"172.21.15.27:6823/409830571","state":["exists","up"]},{"osd":3,"uuid":"55195947-e3d8-4a7a-ae4f-75d7b5d33035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6801","nonce":2338774910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6803","nonce":2338774910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6807","nonce":2338774910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6805","nonce":2338774910}]},"public_addr":"172.21.15.98:6801/2338774910","cluster_addr":"172.21.15.98:6803/2338774910","heartbeat_back_addr":"172.21.15.98:6807/2338774910","heartbeat_front_addr":"172.21.15.98:6805/2338774910","state":["exists","up"]},{"osd":4,"uuid":"359c2e8d-a262-4df2-9b6b-42b00a5b9200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6809","nonce":1662141352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6811","nonce":1662141352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6815","nonce":1662141352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6813","nonce":1662141352}]},"public_addr":"172.21.15.98:6809/1662141352","cluster_addr":"172.21.15.98:6811/1662141352","heartbeat_back_addr":"172.21.15.98:6815/1662141352","heartbeat_front_addr":"172.21.15.98:6813/1662141352","state":["exists","up"]},{"osd":5,"uuid":"0d3f0ca5-e619-4adb-8533-f466b2dccc7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6817","nonce":3547678161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6819","nonce":3547678161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6823","nonce":3547678161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6821","nonce":3547678161}]},"public_addr":"172.21.15.98:6817/3547678161","cluster_addr":"172.21.15.98:6819/3547678161","heartbeat_back_addr":"172.21.15.98:6823/3547678161","heartbeat_front_addr":"172.21.15.98:6821/3547678161","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:59:58.871854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:29.453417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:57.769297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:21.729955+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:49.470164+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:02:17.390676+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2690377655":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/2350483020":"2024-09-21T18:58:19.133219+0000","172.21.15.27:0/2663124002":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/931142735":"2024-09-21T18:56:39.148571+0000","172.21.15.27:6800/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/3522474440":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/570952743":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6801/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/4025423151":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/3064380782":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/2799355393":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6800/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/519217990":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6800/2350483020":"2024-09-21T18:58:19.133219+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T19:02:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 msgr2=0x7f93d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 0x7f93d4070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005fd0 tx=0x7f93e0005ea0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 msgr2=0x7f93ec100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f93dc031460 tx=0x7f93dc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 shutdown_connections 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f93d406e2b0 0x7f93d4070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93ec103430 0x7f93ec100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 --2- 172.21.15.27:0/1816823230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93ec102b10 0x7f93ec100770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.916+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 >> 172.21.15.27:0/1816823230 conn(0x7f93ec0fc550 msgr2=0x7f93ec107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.917+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 shutdown_connections 2024-09-20T19:02:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:32.917+0000 7f93f1374640 1 -- 172.21.15.27:0/1816823230 wait complete. 2024-09-20T19:02:33.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:32 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1816823230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:33.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:32 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1816823230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:33.615 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-20T19:02:33.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T19:02:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:34.249 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:33 smithi027 ceph-mon[28196]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:34.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 -- 172.21.15.27:0/593887585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 msgr2=0x7f7cfc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:34.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 --2- 172.21.15.27:0/593887585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc107ce0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009880 tx=0x7f7cec02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 -- 172.21.15.27:0/593887585 shutdown_connections 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 --2- 172.21.15.27:0/593887585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 0x7f7cfc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 --2- 172.21.15.27:0/593887585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc107ce0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 -- 172.21.15.27:0/593887585 >> 172.21.15.27:0/593887585 conn(0x7f7cfc0fd600 msgr2=0x7f7cfc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 -- 172.21.15.27:0/593887585 shutdown_connections 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.322+0000 7f7d0238a640 1 -- 172.21.15.27:0/593887585 wait complete. 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 Processor -- start 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 -- start start 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 0x7f7cfc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc10edd0 con 0x7f7cfc107900 2024-09-20T19:02:34.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7d0238a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc10ec50 con 0x7f7cfc101900 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48568/0 (socket says 172.21.15.27:48568) 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 -- 172.21.15.27:0/3077517315 learned_addr learned my addr 172.21.15.27:0/3077517315 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cfbfff640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 0x7f7cfc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 -- 172.21.15.27:0/3077517315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 msgr2=0x7f7cfc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 0x7f7cfc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.323+0000 7f7cf3fff640 1 -- 172.21.15.27:0/3077517315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc074f70 con 0x7f7cfc107900 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7cf3fff640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d6f0 tx=0x7f7ce400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ce4017070 con 0x7f7cfc107900 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ce400de00 con 0x7f7cfc107900 2024-09-20T19:02:34.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ce4004bb0 con 0x7f7cfc107900 2024-09-20T19:02:34.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc075260 con 0x7f7cfc107900 2024-09-20T19:02:34.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.324+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc1a3e20 con 0x7f7cfc107900 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.325+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc103040 con 0x7f7cfc107900 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.326+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7ce4004e60 con 0x7f7cfc107900 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.326+0000 7f7cf9ffb640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 0x7f7ce8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.326+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f7ce408da90 con 0x7f7cfc107900 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.326+0000 7f7cfbfff640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 0x7f7ce8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:34.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.327+0000 7f7cfbfff640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 0x7f7ce8070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0096c0 tx=0x7f7cec031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:34.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.331+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ce405b730 con 0x7f7cfc107900 2024-09-20T19:02:34.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:33 smithi098 ceph-mon[35737]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:34.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.507+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cfc109e70 con 0x7f7cfc107900 2024-09-20T19:02:34.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.508+0000 7f7cf9ffb640 1 -- 172.21.15.27:0/3077517315 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+11356 (secure 0 0 0) 0x7f7ce405f3e0 con 0x7f7cfc107900 2024-09-20T19:02:34.516 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:34.516 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":41,"fsid":"e7838b9c-7781-11ef-baf5-efdc52797490","created":"2024-09-20T18:56:16.857389+0000","modified":"2024-09-20T19:02:21.062209+0000","last_up_change":"2024-09-20T19:02:19.843053+0000","last_in_change":"2024-09-20T19:01:55.764402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T19:01:01.653480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af00b5b4-770e-4da0-b62e-56d53824b126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6803","nonce":1816280731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6805","nonce":1816280731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6809","nonce":1816280731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":1816280731},{"type":"v1","addr":"172.21.15.27:6807","nonce":1816280731}]},"public_addr":"172.21.15.27:6803/1816280731","cluster_addr":"172.21.15.27:6805/1816280731","heartbeat_back_addr":"172.21.15.27:6809/1816280731","heartbeat_front_addr":"172.21.15.27:6807/1816280731","state":["exists","up"]},{"osd":1,"uuid":"564b02b7-346b-4797-ab71-70a0090c2c4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6811","nonce":3340066990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6813","nonce":3340066990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6817","nonce":3340066990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3340066990},{"type":"v1","addr":"172.21.15.27:6815","nonce":3340066990}]},"public_addr":"172.21.15.27:6811/3340066990","cluster_addr":"172.21.15.27:6813/3340066990","heartbeat_back_addr":"172.21.15.27:6817/3340066990","heartbeat_front_addr":"172.21.15.27:6815/3340066990","state":["exists","up"]},{"osd":2,"uuid":"1d5dd1f3-60a8-4d53-8318-5815923cbf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6819","nonce":409830571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6821","nonce":409830571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6825","nonce":409830571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":409830571},{"type":"v1","addr":"172.21.15.27:6823","nonce":409830571}]},"public_addr":"172.21.15.27:6819/409830571","cluster_addr":"172.21.15.27:6821/409830571","heartbeat_back_addr":"172.21.15.27:6825/409830571","heartbeat_front_addr":"172.21.15.27:6823/409830571","state":["exists","up"]},{"osd":3,"uuid":"55195947-e3d8-4a7a-ae4f-75d7b5d33035","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6801","nonce":2338774910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6803","nonce":2338774910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6807","nonce":2338774910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2338774910},{"type":"v1","addr":"172.21.15.98:6805","nonce":2338774910}]},"public_addr":"172.21.15.98:6801/2338774910","cluster_addr":"172.21.15.98:6803/2338774910","heartbeat_back_addr":"172.21.15.98:6807/2338774910","heartbeat_front_addr":"172.21.15.98:6805/2338774910","state":["exists","up"]},{"osd":4,"uuid":"359c2e8d-a262-4df2-9b6b-42b00a5b9200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6809","nonce":1662141352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6811","nonce":1662141352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6815","nonce":1662141352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1662141352},{"type":"v1","addr":"172.21.15.98:6813","nonce":1662141352}]},"public_addr":"172.21.15.98:6809/1662141352","cluster_addr":"172.21.15.98:6811/1662141352","heartbeat_back_addr":"172.21.15.98:6815/1662141352","heartbeat_front_addr":"172.21.15.98:6813/1662141352","state":["exists","up"]},{"osd":5,"uuid":"0d3f0ca5-e619-4adb-8533-f466b2dccc7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6817","nonce":3547678161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6819","nonce":3547678161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6823","nonce":3547678161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3547678161},{"type":"v1","addr":"172.21.15.98:6821","nonce":3547678161}]},"public_addr":"172.21.15.98:6817/3547678161","cluster_addr":"172.21.15.98:6819/3547678161","heartbeat_back_addr":"172.21.15.98:6823/3547678161","heartbeat_front_addr":"172.21.15.98:6821/3547678161","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:59:58.871854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:29.453417+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:00:57.769297+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:21.729955+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:01:49.470164+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T19:02:17.390676+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/2690377655":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/2350483020":"2024-09-21T18:58:19.133219+0000","172.21.15.27:0/2663124002":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/931142735":"2024-09-21T18:56:39.148571+0000","172.21.15.27:6800/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/3522474440":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/570952743":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6801/1422110592":"2024-09-21T18:56:39.148571+0000","172.21.15.27:0/4025423151":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/3064380782":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/2799355393":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6800/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:0/519217990":"2024-09-21T18:58:19.133219+0000","172.21.15.27:6801/900682160":"2024-09-21T18:57:18.346866+0000","172.21.15.27:6800/2350483020":"2024-09-21T18:58:19.133219+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T19:02:34.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 msgr2=0x7f7ce8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:34.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 0x7f7ce8070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0096c0 tx=0x7f7cec031400 comp rx=0 tx=0).stop 2024-09-20T19:02:34.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 msgr2=0x7f7cfc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d6f0 tx=0x7f7ce400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 shutdown_connections 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7ce806e2b0 0x7f7ce8070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7cfc107900 0x7f7cfc074a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 --2- 172.21.15.27:0/3077517315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7cfc101900 0x7f7cfc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.510+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 >> 172.21.15.27:0/3077517315 conn(0x7f7cfc0fd600 msgr2=0x7f7cfc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.511+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 shutdown_connections 2024-09-20T19:02:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:34.511+0000 7f7d0238a640 1 -- 172.21.15.27:0/3077517315 wait complete. 2024-09-20T19:02:35.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:35.073 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:34 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3077517315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:35.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-20T19:02:35.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-20T19:02:35.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-20T19:02:35.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-20T19:02:35.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-20T19:02:35.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-20T19:02:35.428 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:35.430 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:35.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:35.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:34 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3077517315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T19:02:36.107 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:35 smithi027 ceph-mon[28196]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 -- 172.21.15.27:0/2800123112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e701033d0 msgr2=0x7f2e7010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/2800123112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e701033d0 0x7f2e7010b8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009880 tx=0x7f2e5802a530 comp rx=0 tx=0).stop 2024-09-20T19:02:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 -- 172.21.15.27:0/2800123112 shutdown_connections 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/2800123112 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e701033d0 0x7f2e7010b8c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/2800123112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e70102ab0 0x7f2e70102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 -- 172.21.15.27:0/2800123112 >> 172.21.15.27:0/2800123112 conn(0x7f2e700fc550 msgr2=0x7f2e700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 -- 172.21.15.27:0/2800123112 shutdown_connections 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 -- 172.21.15.27:0/2800123112 wait complete. 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.278+0000 7f2e76ed9640 1 Processor -- start 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e76ed9640 1 -- start start 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e76ed9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e76ed9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 0x7f2e70100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:36.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e76ed9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7010ede0 con 0x7f2e70102ab0 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e76ed9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7010ec60 con 0x7f2e701033d0 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37388/0 (socket says 172.21.15.27:37388) 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 -- 172.21.15.27:0/3543443803 learned_addr learned my addr 172.21.15.27:0/3543443803 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e6ffff640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 0x7f2e70100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 -- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 msgr2=0x7f2e70100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 0x7f2e70100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e70101190 con 0x7f2e70102ab0 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e6ffff640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 0x7f2e70100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:02:36.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.279+0000 7f2e74c75640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000d6f0 tx=0x7f2e6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.280+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e60017070 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.280+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e6000de00 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.280+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e70101480 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.280+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e60004bb0 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.280+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e701a3e90 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.281+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e700628c0 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.281+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2e60004e60 con 0x7f2e70102ab0 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6dffb640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 0x7f2e5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:36.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f2e6008da90 con 0x7f2e70102ab0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6ffff640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 0x7f2e5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6dffb640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 0x7f2e5c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e6001ee50 con 0x7f2e5c0740a0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2e600922a0 con 0x7f2e70102ab0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e6ffff640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 0x7f2e5c070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006010 tx=0x7f2e580095f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.282+0000 7f2e75476640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 0x7f2e5c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.283+0000 7f2e75476640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 0x7f2e5c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:36.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.284+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== osd.5 v2:172.21.15.98:6816/3547678161 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e6001ee50 con 0x7f2e5c0740a0 2024-09-20T19:02:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.297+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 --> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e70062cc0 con 0x7f2e5c0740a0 2024-09-20T19:02:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e6dffb640 1 -- 172.21.15.27:0/3543443803 <== osd.5 v2:172.21.15.98:6816/3547678161 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2e70062cc0 con 0x7f2e5c0740a0 2024-09-20T19:02:36.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 msgr2=0x7f2e5c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:36.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 0x7f2e5c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 msgr2=0x7f2e5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 0x7f2e5c070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006010 tx=0x7f2e580095f0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 msgr2=0x7f2e70100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.298+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000d6f0 tx=0x7f2e6000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 shutdown_connections 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:6816/3547678161,v1:172.21.15.98:6817/3547678161] conn(0x7f2e5c0740a0 0x7f2e5c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2e5c06e2b0 0x7f2e5c070770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e701033d0 0x7f2e70100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 --2- 172.21.15.27:0/3543443803 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2e70102ab0 0x7f2e70100710 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 >> 172.21.15.27:0/3543443803 conn(0x7f2e700fc550 msgr2=0x7f2e70108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 shutdown_connections 2024-09-20T19:02:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.299+0000 7f2e76ed9640 1 -- 172.21.15.27:0/3543443803 wait complete. 2024-09-20T19:02:36.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:35 smithi098 ceph-mon[35737]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:37.058 INFO:teuthology.orchestra.run.smithi027.stdout:171798691847 2024-09-20T19:02:37.058 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-20T19:02:37.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 -- 172.21.15.27:0/998650753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100af0 msgr2=0x7f88f4106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:37.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 --2- 172.21.15.27:0/998650753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100af0 0x7f88f4106630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009880 tx=0x7f88e402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 -- 172.21.15.27:0/998650753 shutdown_connections 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 --2- 172.21.15.27:0/998650753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100af0 0x7f88f4106630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 --2- 172.21.15.27:0/998650753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100140 0x7f88f4100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 -- 172.21.15.27:0/998650753 >> 172.21.15.27:0/998650753 conn(0x7f88f40fbc90 msgr2=0x7f88f40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 -- 172.21.15.27:0/998650753 shutdown_connections 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.183+0000 7f88fc572640 1 -- 172.21.15.27:0/998650753 wait complete. 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 Processor -- start 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 -- start start 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100af0 0x7f88f4101600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f88f410ee40 con 0x7f88f4100140 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fc572640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88f410ecc0 con 0x7f88f4100af0 2024-09-20T19:02:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37360/0 (socket says 172.21.15.27:37360) 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 -- 172.21.15.27:0/960452648 learned_addr learned my addr 172.21.15.27:0/960452648 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88f9b0d640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100af0 0x7f88f4101600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 -- 172.21.15.27:0/960452648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100af0 msgr2=0x7f88f4101600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100af0 0x7f88f4101600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.184+0000 7f88fa30e640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f4101b40 con 0x7f88f4100140 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88fa30e640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d6f0 tx=0x7f88f000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f0017070 con 0x7f88f4100140 2024-09-20T19:02:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f4101e30 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f000de00 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f0004bb0 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.185+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f41a3e90 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.186+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88f40628c0 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.186+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f88f0004e60 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88eb7fe640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 0x7f88e0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f88f008d9e0 con 0x7f88f4100140 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88f9b0d640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 0x7f88e0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88eb7fe640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 0x7f88e00764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:37.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88f001ee50 con 0x7f88e00740a0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f88f00922a0 con 0x7f88f4100140 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88fab0f640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 0x7f88e00764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88f9b0d640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 0x7f88e0070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88e4000c00 tx=0x7f88e4031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.187+0000 7f88fab0f640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 0x7f88e00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.188+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== osd.2 v2:172.21.15.27:6818/409830571 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88f001ee50 con 0x7f88e00740a0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.202+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 --> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88f4062d10 con 0x7f88e00740a0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88eb7fe640 1 -- 172.21.15.27:0/960452648 <== osd.2 v2:172.21.15.27:6818/409830571 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f88f4062d10 con 0x7f88e00740a0 2024-09-20T19:02:37.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 msgr2=0x7f88e00764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 0x7f88e00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 msgr2=0x7f88e0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 0x7f88e0070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88e4000c00 tx=0x7f88e4031400 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 msgr2=0x7f88f41010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d6f0 tx=0x7f88f000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 shutdown_connections 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6818/409830571,v1:172.21.15.27:6819/409830571] conn(0x7f88e00740a0 0x7f88e00764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f88e006e2b0 0x7f88e0070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88f4100af0 0x7f88f4101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 --2- 172.21.15.27:0/960452648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88f4100140 0x7f88f41010c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 >> 172.21.15.27:0/960452648 conn(0x7f88f40fbc90 msgr2=0x7f88f4105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 shutdown_connections 2024-09-20T19:02:37.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:36.203+0000 7f88fc572640 1 -- 172.21.15.27:0/960452648 wait complete. 2024-09-20T19:02:37.275 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:37.276 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:37.538 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:37 smithi027 ceph-mon[28196]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:37.685 INFO:teuthology.orchestra.run.smithi027.stdout:81604378646 2024-09-20T19:02:37.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-20T19:02:37.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:37 smithi098 ceph-mon[35737]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:37.752 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.440+0000 7ff2fe544640 1 -- 172.21.15.27:0/2826713531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8107900 msgr2=0x7ff2f8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.440+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2826713531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8107900 0x7ff2f8107ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009880 tx=0x7ff2e802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 -- 172.21.15.27:0/2826713531 shutdown_connections 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2826713531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8101900 0x7ff2f8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2826713531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8107900 0x7ff2f8107ce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 -- 172.21.15.27:0/2826713531 >> 172.21.15.27:0/2826713531 conn(0x7ff2f80fd640 msgr2=0x7ff2f80ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 -- 172.21.15.27:0/2826713531 shutdown_connections 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 -- 172.21.15.27:0/2826713531 wait complete. 2024-09-20T19:02:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 Processor -- start 2024-09-20T19:02:38.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.441+0000 7ff2fe544640 1 -- start start 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2fe544640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2fe544640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8107900 0x7ff2f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2fe544640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f810edd0 con 0x7ff2f8101900 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2fe544640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f810ec50 con 0x7ff2f8107900 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37412/0 (socket says 172.21.15.27:37412) 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 -- 172.21.15.27:0/2169463602 learned_addr learned my addr 172.21.15.27:0/2169463602 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f77fe640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8107900 0x7ff2f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 -- 172.21.15.27:0/2169463602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8107900 msgr2=0x7ff2f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8107900 0x7ff2f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f8074f70 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.442+0000 7ff2f7fff640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8031460 tx=0x7ff2e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.443+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2e803f070 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.443+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2e8004b10 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.443+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2e8035030 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.443+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f8075200 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.443+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f81a3de0 con 0x7ff2f8101900 2024-09-20T19:02:38.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.444+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2f80628c0 con 0x7ff2f8101900 2024-09-20T19:02:38.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.444+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff2e8042070 con 0x7ff2f8101900 2024-09-20T19:02:38.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f57fa640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 0x7ff2e00707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7ff2e80ae8b0 con 0x7ff2f8101900 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f77fe640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 0x7ff2e00707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f57fa640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 0x7ff2e0076510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2e803aec0 con 0x7ff2e00740f0 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ff2e80b32a0 con 0x7ff2f8101900 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2fcae1640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 0x7ff2e0076510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2f77fe640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 0x7ff2e00707c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec005fd0 tx=0x7ff2ec005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.445+0000 7ff2fcae1640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 0x7ff2e0076510 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.446+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== osd.0 v2:172.21.15.27:6802/1816280731 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2e803aec0 con 0x7ff2e00740f0 2024-09-20T19:02:38.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 --> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2f8062d40 con 0x7ff2e00740f0 2024-09-20T19:02:38.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2f57fa640 1 -- 172.21.15.27:0/2169463602 <== osd.0 v2:172.21.15.27:6802/1816280731 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2f8062d40 con 0x7ff2e00740f0 2024-09-20T19:02:38.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 msgr2=0x7ff2e0076510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 0x7ff2e0076510 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 msgr2=0x7ff2e00707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 0x7ff2e00707c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec005fd0 tx=0x7ff2ec005850 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 msgr2=0x7ff2f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8031460 tx=0x7ff2e80045e0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 shutdown_connections 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6802/1816280731,v1:172.21.15.27:6803/1816280731] conn(0x7ff2e00740f0 0x7ff2e0076510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff2e006e300 0x7ff2e00707c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f8107900 0x7ff2f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 --2- 172.21.15.27:0/2169463602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff2f8101900 0x7ff2f80744f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 >> 172.21.15.27:0/2169463602 conn(0x7ff2f80fd640 msgr2=0x7ff2f80fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 shutdown_connections 2024-09-20T19:02:38.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.460+0000 7ff2fe544640 1 -- 172.21.15.27:0/2169463602 wait complete. 2024-09-20T19:02:38.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- 172.21.15.27:0/1609756312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 msgr2=0x7fa148106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 --2- 172.21.15.27:0/1609756312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148106bd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa140009880 tx=0x7fa14002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- 172.21.15.27:0/1609756312 shutdown_connections 2024-09-20T19:02:38.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 --2- 172.21.15.27:0/1609756312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 0x7fa148100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 --2- 172.21.15.27:0/1609756312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148106bd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- 172.21.15.27:0/1609756312 >> 172.21.15.27:0/1609756312 conn(0x7fa1480fc550 msgr2=0x7fa1480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- 172.21.15.27:0/1609756312 shutdown_connections 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- 172.21.15.27:0/1609756312 wait complete. 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 Processor -- start 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 -- start start 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.608+0000 7fa14fddf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 0x7fa148107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14fddf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14fddf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810dca0 con 0x7fa1481067f0 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14fddf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810db20 con 0x7fa1481007f0 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37434/0 (socket says 172.21.15.27:37434) 2024-09-20T19:02:38.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 -- 172.21.15.27:0/2637529133 learned_addr learned my addr 172.21.15.27:0/2637529133 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14db7b640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 0x7fa148107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 -- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 msgr2=0x7fa148107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 0x7fa148107720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1481081a0 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14d37a640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00d8d0 tx=0x7fa13c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa13c017070 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa13c010460 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa13c00f5f0 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa148108490 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.609+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1481a3dd0 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.610+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa14806a7b0 con 0x7fa1481067f0 2024-09-20T19:02:38.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa13c009a30 con 0x7fa1481067f0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 0x7fa130070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fa13c08dd30 con 0x7fa1481067f0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa14db7b640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 0x7fa130070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 0x7fa1300764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa13c004470 con 0x7fa1300740a0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.611+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa13c093450 con 0x7fa1481067f0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.612+0000 7fa14e37c640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 0x7fa1300764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.612+0000 7fa14db7b640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 0x7fa130070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa140031460 tx=0x7fa1400095c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.612+0000 7fa14e37c640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 0x7fa1300764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:38.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.613+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== osd.4 v2:172.21.15.98:6808/1662141352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa13c004470 con 0x7fa1300740a0 2024-09-20T19:02:38.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.627+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 --> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa148101f30 con 0x7fa1300740a0 2024-09-20T19:02:38.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.627+0000 7fa146ffd640 1 -- 172.21.15.27:0/2637529133 <== osd.4 v2:172.21.15.98:6808/1662141352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa148101f30 con 0x7fa1300740a0 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 msgr2=0x7fa1300764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 0x7fa1300764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 msgr2=0x7fa130070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 0x7fa130070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa140031460 tx=0x7fa1400095c0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 msgr2=0x7fa148107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00d8d0 tx=0x7fa13c00dd90 comp rx=0 tx=0).stop 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 shutdown_connections 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa13006e2b0 0x7fa130070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1481067f0 0x7fa148107c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:6808/1662141352,v1:172.21.15.98:6809/1662141352] conn(0x7fa1300740a0 0x7fa1300764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 --2- 172.21.15.27:0/2637529133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1481007f0 0x7fa148107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:38.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 >> 172.21.15.27:0/2637529133 conn(0x7fa1480fc550 msgr2=0x7fa148069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:38.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 shutdown_connections 2024-09-20T19:02:38.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:38.628+0000 7fa14fddf640 1 -- 172.21.15.27:0/2637529133 wait complete. 2024-09-20T19:02:39.400 INFO:teuthology.orchestra.run.smithi027.stdout:150323855372 2024-09-20T19:02:39.400 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-20T19:02:39.526 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:39 smithi027 ceph-mon[28196]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:39.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:39 smithi098 ceph-mon[35737]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:39.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 -- 172.21.15.27:0/1768118643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 msgr2=0x7f15dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 --2- 172.21.15.27:0/1768118643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc101d60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009880 tx=0x7f15c402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 -- 172.21.15.27:0/1768118643 shutdown_connections 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 --2- 172.21.15.27:0/1768118643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc101d60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 --2- 172.21.15.27:0/1768118643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 0x7f15dc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.854+0000 7f15e1119640 1 -- 172.21.15.27:0/1768118643 >> 172.21.15.27:0/1768118643 conn(0x7f15dc0fd620 msgr2=0x7f15dc0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.855+0000 7f15e1119640 1 -- 172.21.15.27:0/1768118643 shutdown_connections 2024-09-20T19:02:39.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.855+0000 7f15e1119640 1 -- 172.21.15.27:0/1768118643 wait complete. 2024-09-20T19:02:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.855+0000 7f15e1119640 1 Processor -- start 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.855+0000 7f15e1119640 1 -- start start 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15e1119640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15e1119640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 0x7f15dc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15e1119640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc10edd0 con 0x7f15dc101900 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15e1119640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc10ec50 con 0x7f15dc107900 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37450/0 (socket says 172.21.15.27:37450) 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 -- 172.21.15.27:0/794639811 learned_addr learned my addr 172.21.15.27:0/794639811 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15da59c640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 0x7f15dc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 -- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 msgr2=0x7f15dc19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:39.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 0x7f15dc19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc197800 con 0x7f15dc101900 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.856+0000 7f15dad9d640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00ea00 tx=0x7f15cc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15cc00cb80 con 0x7f15dc101900 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15cc00cd20 con 0x7f15dc101900 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc197af0 con 0x7f15dc101900 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15cc011470 con 0x7f15dc101900 2024-09-20T19:02:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc198050 con 0x7f15dc101900 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.857+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15dc103040 con 0x7f15dc101900 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.858+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f15cc005020 con 0x7f15dc101900 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15d3fff640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 0x7f15c80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f15cc08e240 con 0x7f15dc101900 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15da59c640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 0x7f15c80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15d3fff640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 0x7f15c8076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15cc018ec0 con 0x7f15c8074100 2024-09-20T19:02:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f15cc095050 con 0x7f15dc101900 2024-09-20T19:02:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15db59e640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 0x7f15c8076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.859+0000 7f15da59c640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 0x7f15c80707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15dc198b50 tx=0x7f15c4031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.860+0000 7f15db59e640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 0x7f15c8076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.861+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== osd.3 v2:172.21.15.98:6800/2338774910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15cc018ec0 con 0x7f15c8074100 2024-09-20T19:02:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.874+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 --> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f15dc062880 con 0x7f15c8074100 2024-09-20T19:02:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15d3fff640 1 -- 172.21.15.27:0/794639811 <== osd.3 v2:172.21.15.98:6800/2338774910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f15dc062880 con 0x7f15c8074100 2024-09-20T19:02:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 msgr2=0x7f15c8076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 0x7f15c8076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 msgr2=0x7f15c80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 0x7f15c80707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15dc198b50 tx=0x7f15c4031400 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 msgr2=0x7f15dc19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.875+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00ea00 tx=0x7f15cc00eec0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 shutdown_connections 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:6800/2338774910,v1:172.21.15.98:6801/2338774910] conn(0x7f15c8074100 0x7f15c8076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e310 0x7f15c80707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc107900 0x7f15dc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 --2- 172.21.15.27:0/794639811 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc101900 0x7f15dc19d680 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 >> 172.21.15.27:0/794639811 conn(0x7f15dc0fd620 msgr2=0x7f15dc0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 shutdown_connections 2024-09-20T19:02:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:39.876+0000 7f15e1119640 1 -- 172.21.15.27:0/794639811 wait complete. 2024-09-20T19:02:40.724 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:40.763 INFO:teuthology.orchestra.run.smithi027.stdout:38654705698 2024-09-20T19:02:40.763 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-20T19:02:40.982 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:40.983 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:41.375 INFO:teuthology.orchestra.run.smithi027.stdout:115964117011 2024-09-20T19:02:41.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-20T19:02:41.499 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:41 smithi027 ceph-mon[28196]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.493+0000 7fe4c4c65640 1 -- 172.21.15.27:0/313696719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 msgr2=0x7fe4c0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.493+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/313696719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c0102e90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009880 tx=0x7fe4b002a530 comp rx=0 tx=0).stop 2024-09-20T19:02:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 -- 172.21.15.27:0/313696719 shutdown_connections 2024-09-20T19:02:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/313696719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 0x7fe4c010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/313696719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c0102e90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 -- 172.21.15.27:0/313696719 >> 172.21.15.27:0/313696719 conn(0x7fe4c00fc550 msgr2=0x7fe4c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 -- 172.21.15.27:0/313696719 shutdown_connections 2024-09-20T19:02:41.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 -- 172.21.15.27:0/313696719 wait complete. 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 Processor -- start 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.494+0000 7fe4c4c65640 1 -- start start 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4c4c65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4c4c65640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 0x7fe4c019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4c4c65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c010ede0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4c4c65640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c010ec60 con 0x7fe4c01033d0 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:41.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37466/0 (socket says 172.21.15.27:37466) 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 -- 172.21.15.27:0/1451515306 learned_addr learned my addr 172.21.15.27:0/1451515306 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4bdd9b640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 0x7fe4c019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 -- 172.21.15.27:0/1451515306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 msgr2=0x7fe4c019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 0x7fe4c019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c01977b0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.495+0000 7fe4be59c640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0031460 tx=0x7fe4b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:41.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.496+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4b003f070 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.496+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c0197a40 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.496+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4b00035f0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.496+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4b0035030 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.496+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c0197f70 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.497+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4c01985f0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.497+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe4b0042070 con 0x7fe4c0102ab0 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4af7fe640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 0x7fe4a8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fe4b00ae7b0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4bdd9b640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 0x7fe4a8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4af7fe640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 0x7fe4a80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4b00054e0 con 0x7fe4a80740a0 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe4b00b32a0 con 0x7fe4c0102ab0 2024-09-20T19:02:41.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4bed9d640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 0x7fe4a80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.498+0000 7fe4bdd9b640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 0x7fe4a8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40058c0 tx=0x7fe4b4005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:41.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.499+0000 7fe4bed9d640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 0x7fe4a80764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.500+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== osd.1 v2:172.21.15.27:6810/3340066990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4b00054e0 con 0x7fe4a80740a0 2024-09-20T19:02:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.529+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 --> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4c010b8a0 con 0x7fe4a80740a0 2024-09-20T19:02:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.530+0000 7fe4af7fe640 1 -- 172.21.15.27:0/1451515306 <== osd.1 v2:172.21.15.27:6810/3340066990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4c010b8a0 con 0x7fe4a80740a0 2024-09-20T19:02:41.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.530+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 msgr2=0x7fe4a80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:41.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.530+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 0x7fe4a80764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 msgr2=0x7fe4a8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:41.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 0x7fe4a8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40058c0 tx=0x7fe4b4005850 comp rx=0 tx=0).stop 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 msgr2=0x7fe4c019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0031460 tx=0x7fe4b00045e0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 shutdown_connections 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6810/3340066990,v1:172.21.15.27:6811/3340066990] conn(0x7fe4a80740a0 0x7fe4a80764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe4a806e2b0 0x7fe4a8070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4c01033d0 0x7fe4c019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 --2- 172.21.15.27:0/1451515306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4c0102ab0 0x7fe4c019d630 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:41.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.531+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 >> 172.21.15.27:0/1451515306 conn(0x7fe4c00fc550 msgr2=0x7fe4c010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:41.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.532+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 shutdown_connections 2024-09-20T19:02:41.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:41.532+0000 7fe4c4c65640 1 -- 172.21.15.27:0/1451515306 wait complete. 2024-09-20T19:02:41.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:41 smithi098 ceph-mon[35737]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:41.987 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:42.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 -- 172.21.15.27:0/1809409470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0100800 msgr2=0x7f08b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 --2- 172.21.15.27:0/1809409470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0100800 0x7f08b0100c60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009c20 tx=0x7f08a002a970 comp rx=0 tx=0).stop 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 -- 172.21.15.27:0/1809409470 shutdown_connections 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 --2- 172.21.15.27:0/1809409470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0100800 0x7f08b0100c60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 --2- 172.21.15.27:0/1809409470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0106800 0x7f08b0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 -- 172.21.15.27:0/1809409470 >> 172.21.15.27:0/1809409470 conn(0x7f08b00fc520 msgr2=0x7f08b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 -- 172.21.15.27:0/1809409470 shutdown_connections 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.204+0000 7f08b6db4640 1 -- 172.21.15.27:0/1809409470 wait complete. 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 Processor -- start 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 -- start start 2024-09-20T19:02:42.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0100800 0x7f08b019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010dd30 con 0x7f08b0106800 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b6db4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010dbb0 con 0x7f08b0100800 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37496/0 (socket says 172.21.15.27:37496) 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 -- 172.21.15.27:0/2685290362 learned_addr learned my addr 172.21.15.27:0/2685290362 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08b4b50640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0100800 0x7f08b019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 -- 172.21.15.27:0/2685290362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0100800 msgr2=0x7f08b019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0100800 0x7f08b019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.205+0000 7f08affff640 1 -- 172.21.15.27:0/2685290362 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b0197910 con 0x7f08b0106800 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08affff640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08a0005cc0 tx=0x7f08a002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08a0047070 con 0x7f08b0106800 2024-09-20T19:02:42.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08a002f7e0 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b0197ba0 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08a0034070 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.206+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b01980d0 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.207+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0101f40 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.208+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f08a004a070 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.208+0000 7f08adffb640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 0x7f089c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.208+0000 7f08b4b50640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 0x7f089c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.208+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f08a00aedc0 con 0x7f08b0106800 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.209+0000 7f08b4b50640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 0x7f089c070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08b0198a50 tx=0x7f0898008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:42.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.213+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08a003f070 con 0x7f08b0106800 2024-09-20T19:02:42.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.392+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f08b0198e40 con 0x7f08b0106800 2024-09-20T19:02:42.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.392+0000 7f08adffb640 1 -- 172.21.15.27:0/2685290362 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08a007cb80 con 0x7f08b0106800 2024-09-20T19:02:42.400 INFO:teuthology.orchestra.run.smithi027.stdout:81604378647 2024-09-20T19:02:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 msgr2=0x7f089c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 0x7f089c070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08b0198a50 tx=0x7f0898008040 comp rx=0 tx=0).stop 2024-09-20T19:02:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 msgr2=0x7f08b019dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08a0005cc0 tx=0x7f08a002f5f0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 shutdown_connections 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f089c06e2b0 0x7f089c070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08b0106800 0x7f08b019dc90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 --2- 172.21.15.27:0/2685290362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08b0100800 0x7f08b019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 >> 172.21.15.27:0/2685290362 conn(0x7f08b00fc520 msgr2=0x7f08b006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 shutdown_connections 2024-09-20T19:02:42.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:42.395+0000 7f08b6db4640 1 -- 172.21.15.27:0/2685290362 wait complete. 2024-09-20T19:02:42.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:42 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2685290362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T19:02:42.741 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:42 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2685290362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 -- 172.21.15.27:0/35542856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e001033e0 msgr2=0x7f0e0010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 --2- 172.21.15.27:0/35542856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e001033e0 0x7f0e0010b8d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009880 tx=0x7f0df402a530 comp rx=0 tx=0).stop 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 -- 172.21.15.27:0/35542856 shutdown_connections 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 --2- 172.21.15.27:0/35542856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e001033e0 0x7f0e0010b8d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 --2- 172.21.15.27:0/35542856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e00102ac0 0x7f0e00102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 -- 172.21.15.27:0/35542856 >> 172.21.15.27:0/35542856 conn(0x7f0e000fc520 msgr2=0x7f0e000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 -- 172.21.15.27:0/35542856 shutdown_connections 2024-09-20T19:02:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 -- 172.21.15.27:0/35542856 wait complete. 2024-09-20T19:02:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.138+0000 7f0e05e70640 1 Processor -- start 2024-09-20T19:02:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0e05e70640 1 -- start start 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0e05e70640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0e05e70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e001033e0 0x7f0e00100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0e05e70640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010edf0 con 0x7f0e00102ac0 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0e05e70640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010ec70 con 0x7f0e001033e0 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37508/0 (socket says 172.21.15.27:37508) 2024-09-20T19:02:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 -- 172.21.15.27:0/723148981 learned_addr learned my addr 172.21.15.27:0/723148981 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dfeffd640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e001033e0 0x7f0e00100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 -- 172.21.15.27:0/723148981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e001033e0 msgr2=0x7f0e00100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e001033e0 0x7f0e00100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.139+0000 7f0dff7fe640 1 -- 172.21.15.27:0/723148981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e001011a0 con 0x7f0e00102ac0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0dff7fe640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d6f0 tx=0x7f0df000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0df0017070 con 0x7f0e00102ac0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0df000de00 con 0x7f0e00102ac0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e00101490 con 0x7f0e00102ac0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0df0004bb0 con 0x7f0e00102ac0 2024-09-20T19:02:43.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.140+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e001a3ea0 con 0x7f0e00102ac0 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.141+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0006aa90 con 0x7f0e00102ac0 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.141+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0df0004e60 con 0x7f0e00102ac0 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.142+0000 7f0dfcff9640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.142+0000 7f0dfeffd640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.142+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f0df008d970 con 0x7f0e00102ac0 2024-09-20T19:02:43.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.143+0000 7f0dfeffd640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 0x7f0de8070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e001021b0 tx=0x7f0df4031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:43.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.147+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0df008fe20 con 0x7f0e00102ac0 2024-09-20T19:02:43.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.325+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0e00101c50 con 0x7f0e00102ac0 2024-09-20T19:02:43.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.325+0000 7f0dfcff9640 1 -- 172.21.15.27:0/723148981 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0df005f2c0 con 0x7f0e00102ac0 2024-09-20T19:02:43.332 INFO:teuthology.orchestra.run.smithi027.stdout:150323855373 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 msgr2=0x7f0de8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 0x7f0de8070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e001021b0 tx=0x7f0df4031400 comp rx=0 tx=0).stop 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 msgr2=0x7f0e00100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d6f0 tx=0x7f0df000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 shutdown_connections 2024-09-20T19:02:43.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e001033e0 0x7f0e00100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 --2- 172.21.15.27:0/723148981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e00102ac0 0x7f0e00100720 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.327+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 >> 172.21.15.27:0/723148981 conn(0x7f0e000fc520 msgr2=0x7f0e00108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:43.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.328+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 shutdown_connections 2024-09-20T19:02:43.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.328+0000 7f0e05e70640 1 -- 172.21.15.27:0/723148981 wait complete. 2024-09-20T19:02:43.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 -- 172.21.15.27:0/1036244960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 msgr2=0x7f1d60106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1036244960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d60106d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009c20 tx=0x7f1d5002a970 comp rx=0 tx=0).stop 2024-09-20T19:02:43.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 -- 172.21.15.27:0/1036244960 shutdown_connections 2024-09-20T19:02:43.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1036244960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 0x7f1d60100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1036244960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d60106d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 -- 172.21.15.27:0/1036244960 >> 172.21.15.27:0/1036244960 conn(0x7f1d600fbc90 msgr2=0x7f1d600fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 -- 172.21.15.27:0/1036244960 shutdown_connections 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.378+0000 7f1d6554e640 1 -- 172.21.15.27:0/1036244960 wait complete. 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 Processor -- start 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 -- start start 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 0x7f1d6019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6010ef20 con 0x7f1d601069a0 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.379+0000 7f1d6554e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6010eda0 con 0x7f1d600ffdc0 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37536/0 (socket says 172.21.15.27:37536) 2024-09-20T19:02:43.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 -- 172.21.15.27:0/1493595734 learned_addr learned my addr 172.21.15.27:0/1493595734 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5effd640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 0x7f1d6019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 -- 172.21.15.27:0/1493595734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 msgr2=0x7f1d6019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 0x7f1d6019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 -- 172.21.15.27:0/1493595734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6019e2e0 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d5e7fc640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c8a0 tx=0x7f1d4800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d480079b0 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d48007b50 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d601979d0 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d48018700 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.380+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d60197f30 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.381+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d601030e0 con 0x7f1d601069a0 2024-09-20T19:02:43.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.382+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1d48007d00 con 0x7f1d601069a0 2024-09-20T19:02:43.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.382+0000 7f1d57fff640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 0x7f1d4c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:43.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.383+0000 7f1d5effd640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 0x7f1d4c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:43.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.383+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f1d4808e010 con 0x7f1d601069a0 2024-09-20T19:02:43.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.383+0000 7f1d5effd640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 0x7f1d4c070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009430 tx=0x7f1d5003c040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:43.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.387+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d48014030 con 0x7f1d601069a0 2024-09-20T19:02:43.426 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:43.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.574+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1d60198240 con 0x7f1d601069a0 2024-09-20T19:02:43.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.575+0000 7f1d57fff640 1 -- 172.21.15.27:0/1493595734 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1d4805bcb0 con 0x7f1d601069a0 2024-09-20T19:02:43.582 INFO:teuthology.orchestra.run.smithi027.stdout:171798691848 2024-09-20T19:02:43.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 msgr2=0x7f1d4c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 0x7f1d4c070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009430 tx=0x7f1d5003c040 comp rx=0 tx=0).stop 2024-09-20T19:02:43.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 msgr2=0x7f1d6019dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:43.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c8a0 tx=0x7f1d4800cd60 comp rx=0 tx=0).stop 2024-09-20T19:02:43.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 shutdown_connections 2024-09-20T19:02:43.584 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:43 smithi027 ceph-mon[28196]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:43.584 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:43 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/723148981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T19:02:43.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f1d4c06e2b0 0x7f1d4c070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d601069a0 0x7f1d6019dc30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 --2- 172.21.15.27:0/1493595734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d600ffdc0 0x7f1d6019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:43.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 >> 172.21.15.27:0/1493595734 conn(0x7f1d600fbc90 msgr2=0x7f1d600fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:43.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 shutdown_connections 2024-09-20T19:02:43.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:43.577+0000 7f1d6554e640 1 -- 172.21.15.27:0/1493595734 wait complete. 2024-09-20T19:02:43.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:43 smithi098 ceph-mon[35737]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:43.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:43 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/723148981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T19:02:44.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691847 got 171798691848 for osd.5 2024-09-20T19:02:44.341 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:44.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:44 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1493595734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T19:02:44.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:44 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1493595734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T19:02:44.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378647 for osd.2 2024-09-20T19:02:44.830 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:45.149 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855372 got 150323855373 for osd.4 2024-09-20T19:02:45.149 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:45.486 INFO:teuthology.orchestra.run.smithi027.stdout:60129542173 2024-09-20T19:02:45.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-20T19:02:45.557 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:45.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:45 smithi098 ceph-mon[35737]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:45.758 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:45 smithi027 ceph-mon[28196]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 -- 172.21.15.27:0/2207148231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 msgr2=0x7fc7d0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 --2- 172.21.15.27:0/2207148231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0106c00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009880 tx=0x7fc7c002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 -- 172.21.15.27:0/2207148231 shutdown_connections 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 --2- 172.21.15.27:0/2207148231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 --2- 172.21.15.27:0/2207148231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0106c00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 -- 172.21.15.27:0/2207148231 >> 172.21.15.27:0/2207148231 conn(0x7fc7d00fc540 msgr2=0x7fc7d00fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:45.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 -- 172.21.15.27:0/2207148231 shutdown_connections 2024-09-20T19:02:45.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.953+0000 7fc7d541c640 1 -- 172.21.15.27:0/2207148231 wait complete. 2024-09-20T19:02:45.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.954+0000 7fc7d541c640 1 Processor -- start 2024-09-20T19:02:45.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.954+0000 7fc7d541c640 1 -- start start 2024-09-20T19:02:45.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7d541c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:45.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7d541c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:45.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7d541c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d010dcd0 con 0x7fc7d0106820 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7d541c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d010db50 con 0x7fc7d0100820 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48366/0 (socket says 172.21.15.27:48366) 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 -- 172.21.15.27:0/3614903661 learned_addr learned my addr 172.21.15.27:0/3614903661 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7ceffd640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 -- 172.21.15.27:0/3614903661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 msgr2=0x7fc7d0107750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0107750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 -- 172.21.15.27:0/3614903661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d01081d0 con 0x7fc7d0106820 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7ceffd640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7c67fc640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c8a0 tx=0x7fc7b800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.955+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7b80079b0 con 0x7fc7d0106820 2024-09-20T19:02:45.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.956+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7b8007b50 con 0x7fc7d0106820 2024-09-20T19:02:45.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.956+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d01084c0 con 0x7fc7d0106820 2024-09-20T19:02:45.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.956+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7b8018700 con 0x7fc7d0106820 2024-09-20T19:02:45.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.956+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01a3e50 con 0x7fc7d0106820 2024-09-20T19:02:45.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.957+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d0101f60 con 0x7fc7d0106820 2024-09-20T19:02:45.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.957+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc7b80188c0 con 0x7fc7d0106820 2024-09-20T19:02:45.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.958+0000 7fc7ccff9640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 0x7fc7bc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:45.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.958+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fc7b808e120 con 0x7fc7d0106820 2024-09-20T19:02:45.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.958+0000 7fc7ceffd640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 0x7fc7bc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:45.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.958+0000 7fc7ceffd640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 0x7fc7bc070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0031460 tx=0x7fc7c0009560 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:45.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:45.962+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7b8014030 con 0x7fc7d0106820 2024-09-20T19:02:46.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.157+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7d0100c80 con 0x7fc7d0106820 2024-09-20T19:02:46.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.158+0000 7fc7ccff9640 1 -- 172.21.15.27:0/3614903661 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc7b805bdc0 con 0x7fc7d0106820 2024-09-20T19:02:46.165 INFO:teuthology.orchestra.run.smithi027.stdout:115964117012 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 msgr2=0x7fc7bc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 0x7fc7bc070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0031460 tx=0x7fc7c0009560 comp rx=0 tx=0).stop 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 msgr2=0x7fc7d0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c8a0 tx=0x7fc7b800cd60 comp rx=0 tx=0).stop 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 shutdown_connections 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc7bc06e2b0 0x7fc7bc070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7d0106820 0x7fc7d0107c90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 --2- 172.21.15.27:0/3614903661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7d0100820 0x7fc7d0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 >> 172.21.15.27:0/3614903661 conn(0x7fc7d00fc540 msgr2=0x7fc7d006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:46.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 shutdown_connections 2024-09-20T19:02:46.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.160+0000 7fc7d541c640 1 -- 172.21.15.27:0/3614903661 wait complete. 2024-09-20T19:02:46.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 -- 172.21.15.27:0/2301764178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c101900 msgr2=0x7f172c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 --2- 172.21.15.27:0/2301764178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c101900 0x7f172c101d60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1714009880 tx=0x7f171402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 -- 172.21.15.27:0/2301764178 shutdown_connections 2024-09-20T19:02:46.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 --2- 172.21.15.27:0/2301764178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c101900 0x7f172c101d60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 --2- 172.21.15.27:0/2301764178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c107900 0x7f172c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 -- 172.21.15.27:0/2301764178 >> 172.21.15.27:0/2301764178 conn(0x7f172c0fd600 msgr2=0x7f172c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 -- 172.21.15.27:0/2301764178 shutdown_connections 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.666+0000 7f17308b3640 1 -- 172.21.15.27:0/2301764178 wait complete. 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 Processor -- start 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 -- start start 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c101900 0x7f172c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f172c10ee30 con 0x7f172c107900 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.667+0000 7f17308b3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f172c10ecb0 con 0x7f172c101900 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48372/0 (socket says 172.21.15.27:48372) 2024-09-20T19:02:46.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 -- 172.21.15.27:0/2293211561 learned_addr learned my addr 172.21.15.27:0/2293211561 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f172a59c640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c101900 0x7f172c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 -- 172.21.15.27:0/2293211561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c101900 msgr2=0x7f172c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c101900 0x7f172c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 -- 172.21.15.27:0/2293211561 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c197840 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f1723fff640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1714031460 tx=0x7f17140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f171403f070 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1714004cf0 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c197ad0 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1714035030 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.668+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c198000 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.669+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c103040 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.670+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1714042070 con 0x7f172c107900 2024-09-20T19:02:46.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.670+0000 7f17237fe640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 0x7f1718070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:46.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.670+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f17140ae950 con 0x7f172c107900 2024-09-20T19:02:46.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.670+0000 7f172a59c640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 0x7f1718070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:46.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.671+0000 7f172a59c640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 0x7f1718070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f171c009890 tx=0x7f171c008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:46.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.675+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f171407c5f0 con 0x7f172c107900 2024-09-20T19:02:46.688 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:46.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:46 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3614903661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T19:02:46.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:46 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3614903661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T19:02:46.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.856+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f172c109e90 con 0x7f172c107900 2024-09-20T19:02:46.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.856+0000 7f17237fe640 1 -- 172.21.15.27:0/2293211561 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17140802a0 con 0x7f172c107900 2024-09-20T19:02:46.863 INFO:teuthology.orchestra.run.smithi027.stdout:38654705699 2024-09-20T19:02:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 msgr2=0x7f1718070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 0x7f1718070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f171c009890 tx=0x7f171c008040 comp rx=0 tx=0).stop 2024-09-20T19:02:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 msgr2=0x7f172c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1714031460 tx=0x7f17140048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 shutdown_connections 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f171806e2b0 0x7f1718070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172c107900 0x7f172c19dc00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 --2- 172.21.15.27:0/2293211561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c101900 0x7f172c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 >> 172.21.15.27:0/2293211561 conn(0x7f172c0fd600 msgr2=0x7f172c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 shutdown_connections 2024-09-20T19:02:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:46.858+0000 7f17308b3640 1 -- 172.21.15.27:0/2293211561 wait complete. 2024-09-20T19:02:47.195 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117012 for osd.3 2024-09-20T19:02:47.196 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:47.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:47 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2293211561' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T19:02:47.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:47 smithi098 ceph-mon[35737]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:47.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:47 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2293211561' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T19:02:47.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:47 smithi027 ceph-mon[28196]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:47.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2024-09-20T19:02:47.893 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 -- 172.21.15.27:0/1334191627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c102ab0 msgr2=0x7fb06c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 --2- 172.21.15.27:0/1334191627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c102ab0 0x7fb06c102e90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009c20 tx=0x7fb05c02aa00 comp rx=0 tx=0).stop 2024-09-20T19:02:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 -- 172.21.15.27:0/1334191627 shutdown_connections 2024-09-20T19:02:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 --2- 172.21.15.27:0/1334191627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c1033d0 0x7fb06c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 --2- 172.21.15.27:0/1334191627 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c102ab0 0x7fb06c102e90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 -- 172.21.15.27:0/1334191627 >> 172.21.15.27:0/1334191627 conn(0x7fb06c0fc550 msgr2=0x7fb06c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 -- 172.21.15.27:0/1334191627 shutdown_connections 2024-09-20T19:02:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.405+0000 7fb071061640 1 -- 172.21.15.27:0/1334191627 wait complete. 2024-09-20T19:02:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.406+0000 7fb071061640 1 Processor -- start 2024-09-20T19:02:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.406+0000 7fb071061640 1 -- start start 2024-09-20T19:02:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.406+0000 7fb071061640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c102ab0 0x7fb06c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:48.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.406+0000 7fb071061640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb071061640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c10ede0 con 0x7fb06c1033d0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb071061640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c10ec60 con 0x7fb06c102ab0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48388/0 (socket says 172.21.15.27:48388) 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 -- 172.21.15.27:0/3507264662 learned_addr learned my addr 172.21.15.27:0/3507264662 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06ad9d640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c102ab0 0x7fb06c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 -- 172.21.15.27:0/3507264662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c102ab0 msgr2=0x7fb06c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c102ab0 0x7fb06c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 -- 172.21.15.27:0/3507264662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c1977b0 con 0x7fb06c1033d0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb06a59c640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c8f0 tx=0x7fb05400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb05400ae50 con 0x7fb06c1033d0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb054005020 con 0x7fb06c1033d0 2024-09-20T19:02:48.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb054004d70 con 0x7fb06c1033d0 2024-09-20T19:02:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c197aa0 con 0x7fb06c1033d0 2024-09-20T19:02:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.407+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c198030 con 0x7fb06c1033d0 2024-09-20T19:02:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.408+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c06a580 con 0x7fb06c1033d0 2024-09-20T19:02:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.409+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb0540051d0 con 0x7fb06c1033d0 2024-09-20T19:02:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.409+0000 7fb063fff640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 0x7fb058070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.410+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fb05408dc10 con 0x7fb06c1033d0 2024-09-20T19:02:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.410+0000 7fb06ad9d640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 0x7fb058070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.410+0000 7fb06ad9d640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 0x7fb058070910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb05c000f80 tx=0x7fb05c03a040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:48.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.414+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb054014030 con 0x7fb06c1033d0 2024-09-20T19:02:48.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.589+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb06c198340 con 0x7fb06c1033d0 2024-09-20T19:02:48.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.589+0000 7fb063fff640 1 -- 172.21.15.27:0/3507264662 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb05405b8b0 con 0x7fb06c1033d0 2024-09-20T19:02:48.596 INFO:teuthology.orchestra.run.smithi027.stdout:60129542175 2024-09-20T19:02:48.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 msgr2=0x7fb058070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:48.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 0x7fb058070910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb05c000f80 tx=0x7fb05c03a040 comp rx=0 tx=0).stop 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 msgr2=0x7fb06c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c8f0 tx=0x7fb05400cdb0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 shutdown_connections 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb05806e450 0x7fb058070910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb06c1033d0 0x7fb06c19db70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 --2- 172.21.15.27:0/3507264662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c102ab0 0x7fb06c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 >> 172.21.15.27:0/3507264662 conn(0x7fb06c0fc550 msgr2=0x7fb06c10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 shutdown_connections 2024-09-20T19:02:48.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:48.591+0000 7fb071061640 1 -- 172.21.15.27:0/3507264662 wait complete. 2024-09-20T19:02:48.889 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:48 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3507264662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T19:02:48.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:48 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3507264662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T19:02:49.185 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-09-20T19:02:49.185 DEBUG:teuthology.parallel:result is None 2024-09-20T19:02:49.185 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-20T19:02:49.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T19:02:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:49.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:49 smithi027 ceph-mon[28196]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:49.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 -- 172.21.15.27:0/595213590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3000102ac0 msgr2=0x7f3000102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 --2- 172.21.15.27:0/595213590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3000102ac0 0x7f3000102ea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009880 tx=0x7f2ffc02a530 comp rx=0 tx=0).stop 2024-09-20T19:02:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 -- 172.21.15.27:0/595213590 shutdown_connections 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 --2- 172.21.15.27:0/595213590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30001033e0 0x7f300010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 --2- 172.21.15.27:0/595213590 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3000102ac0 0x7f3000102ea0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 -- 172.21.15.27:0/595213590 >> 172.21.15.27:0/595213590 conn(0x7f30000fc520 msgr2=0x7f30000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.892+0000 7f3008715640 1 -- 172.21.15.27:0/595213590 shutdown_connections 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 -- 172.21.15.27:0/595213590 wait complete. 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 Processor -- start 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 -- start start 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3000102ac0 0x7f3000100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f300010ee50 con 0x7f30001033e0 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.893+0000 7f3008715640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f300010ecd0 con 0x7f3000102ac0 2024-09-20T19:02:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48410/0 (socket says 172.21.15.27:48410) 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 -- 172.21.15.27:0/386539423 learned_addr learned my addr 172.21.15.27:0/386539423 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f30064b1640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3000102ac0 0x7f3000100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 -- 172.21.15.27:0/386539423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3000102ac0 msgr2=0x7f3000100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3000102ac0 0x7f3000100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 -- 172.21.15.27:0/386539423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30001011a0 con 0x7f30001033e0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3005cb0640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b370 tx=0x7f2ff000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ff0015020 con 0x7f30001033e0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3000101490 con 0x7f30001033e0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ff0011af0 con 0x7f30001033e0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ff0010d60 con 0x7f30001033e0 2024-09-20T19:02:49.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.894+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a3ee0 con 0x7f30001033e0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.895+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300006aa90 con 0x7f30001033e0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.896+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2ff0018020 con 0x7f30001033e0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.896+0000 7f2ff77fe640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 0x7f2fec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.896+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f2ff008d7f0 con 0x7f30001033e0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.896+0000 7f30064b1640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 0x7f2fec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.897+0000 7f30064b1640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 0x7f2fec070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0096c0 tx=0x7f2ffc031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:49.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:49.901+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ff001f020 con 0x7f30001033e0 2024-09-20T19:02:49.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:49 smithi098 ceph-mon[35737]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:49.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:02:50.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.072+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f300010b620 con 0x7f2fec06e2b0 2024-09-20T19:02:50.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.073+0000 7f2ff77fe640 1 -- 172.21.15.27:0/386539423 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f300010b620 con 0x7f2fec06e2b0 2024-09-20T19:02:50.080 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:50.080 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 msgr2=0x7f2fec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 0x7f2fec070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0096c0 tx=0x7f2ffc031400 comp rx=0 tx=0).stop 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 msgr2=0x7f3000100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b370 tx=0x7f2ff000b830 comp rx=0 tx=0).stop 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 shutdown_connections 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f2fec06e2b0 0x7f2fec070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30001033e0 0x7f3000100c60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 --2- 172.21.15.27:0/386539423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3000102ac0 0x7f3000100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 >> 172.21.15.27:0/386539423 conn(0x7f30000fc520 msgr2=0x7f300010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 shutdown_connections 2024-09-20T19:02:50.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:50.075+0000 7f3008715640 1 -- 172.21.15.27:0/386539423 wait complete. 2024-09-20T19:02:50.700 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-20T19:02:49.180181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182736,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288176,"statfs":{"total":575970213888,"available":575783092224,"internally_reserved":0,"allocated":4018176,"data_stored":2632026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":182966945},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001995"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-20T19:02:22.267739+0000","last_change":"2024-09-20T19:01:51.056894+0000","last_active":"2024-09-20T19:02:22.267739+0000","last_peered":"2024-09-20T19:02:22.267739+0000","last_clean":"2024-09-20T19:02:22.267739+0000","last_became_active":"2024-09-20T19:01:51.056635+0000","last_became_peered":"2024-09-20T19:01:51.056635+0000","last_unstale":"2024-09-20T19:02:22.267739+0000","last_undegraded":"2024-09-20T19:02:22.267739+0000","last_fullsized":"2024-09-20T19:02:22.267739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T19:01:01.882111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T19:01:01.882111+0000","last_clean_scrub_stamp":"2024-09-20T19:01:01.882111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T19:16:10.836485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713600,"statfs":{"total":95995035648,"available":95962726400,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713596,"statfs":{"total":95995035648,"available":95962722304,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713600,"statfs":{"total":95995035648,"available":95962726400,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T19:02:50.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T19:02:50.959 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:50.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:50 smithi098 ceph-mon[35737]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T19:02:51.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:50 smithi027 ceph-mon[28196]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T19:02:51.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 -- 172.21.15.27:0/1006612273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 msgr2=0x7f3990101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:51.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 --2- 172.21.15.27:0/1006612273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990101410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3978009880 tx=0x7f397802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 -- 172.21.15.27:0/1006612273 shutdown_connections 2024-09-20T19:02:51.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 --2- 172.21.15.27:0/1006612273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990101410 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 --2- 172.21.15.27:0/1006612273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 0x7f3990106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 -- 172.21.15.27:0/1006612273 >> 172.21.15.27:0/1006612273 conn(0x7f39900fbc90 msgr2=0x7f39900fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 -- 172.21.15.27:0/1006612273 shutdown_connections 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.433+0000 7f3995011640 1 -- 172.21.15.27:0/1006612273 wait complete. 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.434+0000 7f3995011640 1 Processor -- start 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.434+0000 7f3995011640 1 -- start start 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.434+0000 7f3995011640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3995011640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 0x7f3990199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3995011640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f399010df60 con 0x7f3990100fb0 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3995011640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f399010dde0 con 0x7f3990106a90 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48434/0 (socket says 172.21.15.27:48434) 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 -- 172.21.15.27:0/2812315651 learned_addr learned my addr 172.21.15.27:0/2812315651 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:51.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398e59c640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 0x7f3990199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 -- 172.21.15.27:0/2812315651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 msgr2=0x7f3990199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 0x7f3990199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 -- 172.21.15.27:0/2812315651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990199630 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f398ed9d640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f398800ea00 tx=0x7f398800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f398800cb80 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f398800cd20 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3990199920 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3988011470 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.435+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39901a1f20 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.436+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39901021d0 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.437+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3988011750 con 0x7f3990100fb0 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.438+0000 7f3987fff640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 0x7f397c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:51.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.438+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f398808e2d0 con 0x7f3990100fb0 2024-09-20T19:02:51.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.438+0000 7f398e59c640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 0x7f397c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:51.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.438+0000 7f398e59c640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 0x7f397c070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39901009f0 tx=0x7f3978031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:51.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.442+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3990199920 con 0x7f3990100fb0 2024-09-20T19:02:51.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.614+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3990069f90 con 0x7f397c06e2b0 2024-09-20T19:02:51.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.614+0000 7f3987fff640 1 -- 172.21.15.27:0/2812315651 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f3990069f90 con 0x7f397c06e2b0 2024-09-20T19:02:51.621 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:51.621 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 msgr2=0x7f397c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 0x7f397c070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39901009f0 tx=0x7f3978031400 comp rx=0 tx=0).stop 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 msgr2=0x7f3990198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f398800ea00 tx=0x7f398800eec0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 shutdown_connections 2024-09-20T19:02:51.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f397c06e2b0 0x7f397c070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3990106a90 0x7f3990199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 --2- 172.21.15.27:0/2812315651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3990100fb0 0x7f3990198af0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:51.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 >> 172.21.15.27:0/2812315651 conn(0x7f39900fbc90 msgr2=0x7f39900fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:51.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 shutdown_connections 2024-09-20T19:02:51.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:51.617+0000 7f3995011640 1 -- 172.21.15.27:0/2812315651 wait complete. 2024-09-20T19:02:51.969 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:51 smithi027 ceph-mon[28196]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:51.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:51 smithi098 ceph-mon[35737]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:52.345 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-20T19:02:51.180488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182736,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288176,"statfs":{"total":575970213888,"available":575783092224,"internally_reserved":0,"allocated":4018176,"data_stored":2632026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":182966945},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001974"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-20T19:02:22.267739+0000","last_change":"2024-09-20T19:01:51.056894+0000","last_active":"2024-09-20T19:02:22.267739+0000","last_peered":"2024-09-20T19:02:22.267739+0000","last_clean":"2024-09-20T19:02:22.267739+0000","last_became_active":"2024-09-20T19:01:51.056635+0000","last_became_peered":"2024-09-20T19:01:51.056635+0000","last_unstale":"2024-09-20T19:02:22.267739+0000","last_undegraded":"2024-09-20T19:02:22.267739+0000","last_fullsized":"2024-09-20T19:02:22.267739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T19:01:01.882111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T19:01:01.882111+0000","last_clean_scrub_stamp":"2024-09-20T19:01:01.882111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T19:16:10.836485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713600,"statfs":{"total":95995035648,"available":95962726400,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855375,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713596,"statfs":{"total":95995035648,"available":95962722304,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713600,"statfs":{"total":95995035648,"available":95962726400,"internally_reserved":0,"allocated":372736,"data_stored":143487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":733855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T19:02:52.345 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-20T19:02:52.345 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T19:02:52.345 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-20T19:02:52.345 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-20T19:02:52.606 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:52.922 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:52 smithi027 ceph-mon[28196]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T19:02:52.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:52 smithi098 ceph-mon[35737]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T19:02:53.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 -- 172.21.15.27:0/3204193488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88101900 msgr2=0x7f7b88101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:53.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3204193488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88101900 0x7f7b88101d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009880 tx=0x7f7b7c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 -- 172.21.15.27:0/3204193488 shutdown_connections 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3204193488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88101900 0x7f7b88101d60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3204193488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88107900 0x7f7b88107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 -- 172.21.15.27:0/3204193488 >> 172.21.15.27:0/3204193488 conn(0x7f7b880fd600 msgr2=0x7f7b880ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 -- 172.21.15.27:0/3204193488 shutdown_connections 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.081+0000 7f7b8f395640 1 -- 172.21.15.27:0/3204193488 wait complete. 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 Processor -- start 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 -- start start 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88101900 0x7f7b8819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8810edb0 con 0x7f7b88107900 2024-09-20T19:02:53.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8f395640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8810ec30 con 0x7f7b88101900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48446/0 (socket says 172.21.15.27:48446) 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 -- 172.21.15.27:0/3310104459 learned_addr learned my addr 172.21.15.27:0/3310104459 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8d131640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88101900 0x7f7b8819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 -- 172.21.15.27:0/3310104459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88101900 msgr2=0x7f7b8819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88101900 0x7f7b8819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.082+0000 7f7b8c930640 1 -- 172.21.15.27:0/3310104459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b88197800 con 0x7f7b88107900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b8c930640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c031460 tx=0x7f7b7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b7c03f070 con 0x7f7b88107900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b88197a90 con 0x7f7b88107900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b7c004cf0 con 0x7f7b88107900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b7c035030 con 0x7f7b88107900 2024-09-20T19:02:53.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.083+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b88197fc0 con 0x7f7b88107900 2024-09-20T19:02:53.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.084+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b88103040 con 0x7f7b88107900 2024-09-20T19:02:53.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.084+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7b7c042070 con 0x7f7b88107900 2024-09-20T19:02:53.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.085+0000 7f7b867fc640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 0x7f7b70070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:53.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.085+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f7b7c0ae8a0 con 0x7f7b88107900 2024-09-20T19:02:53.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.085+0000 7f7b8d131640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 0x7f7b70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:53.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.085+0000 7f7b8d131640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 0x7f7b70070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005e10 tx=0x7f7b80005da0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:53.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.089+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b7c07c540 con 0x7f7b88107900 2024-09-20T19:02:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.302+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b88198d30 con 0x7f7b88107900 2024-09-20T19:02:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.302+0000 7f7b867fc640 1 -- 172.21.15.27:0/3310104459 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7b7c0801f0 con 0x7f7b88107900 2024-09-20T19:02:53.309 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:02:53.309 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 msgr2=0x7f7b70070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 0x7f7b70070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005e10 tx=0x7f7b80005da0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 msgr2=0x7f7b8819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c031460 tx=0x7f7b7c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 shutdown_connections 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f7b7006e2b0 0x7f7b70070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b88107900 0x7f7b8819dbc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 --2- 172.21.15.27:0/3310104459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88101900 0x7f7b8819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:53.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.304+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 >> 172.21.15.27:0/3310104459 conn(0x7f7b880fd600 msgr2=0x7f7b880fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:53.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.305+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 shutdown_connections 2024-09-20T19:02:53.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:53.305+0000 7f7b8f395640 1 -- 172.21.15.27:0/3310104459 wait complete. 2024-09-20T19:02:53.867 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:53 smithi027 ceph-mon[28196]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:53.867 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:53 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3310104459' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T19:02:53.896 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-20T19:02:53.897 INFO:tasks.cephadm:Setup complete, yielding 2024-09-20T19:02:53.897 INFO:teuthology.run_tasks:Running task print... 2024-09-20T19:02:53.906 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-20T19:02:53.907 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:02:53.970 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:02:53.970 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-20T19:02:53.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:53 smithi098 ceph-mon[35737]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:53.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:53 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3310104459' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T19:02:54.228 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:54.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 -- 172.21.15.27:0/2650346548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 msgr2=0x7fbfac101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 --2- 172.21.15.27:0/2650346548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac101f00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009880 tx=0x7fbf9c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 -- 172.21.15.27:0/2650346548 shutdown_connections 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 --2- 172.21.15.27:0/2650346548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac101f00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 --2- 172.21.15.27:0/2650346548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 0x7fbfac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 -- 172.21.15.27:0/2650346548 >> 172.21.15.27:0/2650346548 conn(0x7fbfac0fc010 msgr2=0x7fbfac0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 -- 172.21.15.27:0/2650346548 shutdown_connections 2024-09-20T19:02:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.670+0000 7fbfb4689640 1 -- 172.21.15.27:0/2650346548 wait complete. 2024-09-20T19:02:54.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 Processor -- start 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 -- start start 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 0x7fbfac1047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac109740 con 0x7fbfac101a80 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb4689640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac1095c0 con 0x7fbfac100880 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48458/0 (socket says 172.21.15.27:48458) 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 -- 172.21.15.27:0/4286279153 learned_addr learned my addr 172.21.15.27:0/4286279153 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb2425640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 0x7fbfac1047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 -- 172.21.15.27:0/4286279153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 msgr2=0x7fbfac1047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 0x7fbfac1047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 -- 172.21.15.27:0/4286279153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac1033a0 con 0x7fbfac101a80 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.671+0000 7fbfb1c24640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006010 tx=0x7fbf9c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.672+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c03f070 con 0x7fbfac101a80 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.672+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf9c0044d0 con 0x7fbfac101a80 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.672+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfac103630 con 0x7fbfac101a80 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.672+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c035030 con 0x7fbfac101a80 2024-09-20T19:02:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.672+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfac103be0 con 0x7fbfac101a80 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.673+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac100c60 con 0x7fbfac101a80 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.673+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbf9c042070 con 0x7fbfac101a80 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.674+0000 7fbfa37fe640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 0x7fbf980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.674+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fbf9c0ae9c0 con 0x7fbfac101a80 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.674+0000 7fbfb2425640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 0x7fbf980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.674+0000 7fbfb2425640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 0x7fbf980707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfac1018e0 tx=0x7fbfa8008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:54.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.678+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf9c07c6e0 con 0x7fbfac101a80 2024-09-20T19:02:54.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.856+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7fbfac19fc60 con 0x7fbfac101a80 2024-09-20T19:02:54.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.859+0000 7fbfa37fe640 1 -- 172.21.15.27:0/4286279153 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7fbf9c080390 con 0x7fbfac101a80 2024-09-20T19:02:54.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 msgr2=0x7fbf980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:54.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 0x7fbf980707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfac1018e0 tx=0x7fbfa8008040 comp rx=0 tx=0).stop 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 msgr2=0x7fbfac102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006010 tx=0x7fbf9c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 shutdown_connections 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbf9806e310 0x7fbf980707d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbfac101a80 0x7fbfac102e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 --2- 172.21.15.27:0/4286279153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac100880 0x7fbfac1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 >> 172.21.15.27:0/4286279153 conn(0x7fbfac0fc010 msgr2=0x7fbfac06a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 shutdown_connections 2024-09-20T19:02:54.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:54.862+0000 7fbfb4689640 1 -- 172.21.15.27:0/4286279153 wait complete. 2024-09-20T19:02:55.539 INFO:teuthology.run_tasks:Running task print... 2024-09-20T19:02:55.548 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-20T19:02:55.548 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:02:55.558 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:02:55.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-20T19:02:55.812 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/4286279153' entity='client.admin' 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:56.136 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:55 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:56.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/4286279153' entity='client.admin' 2024-09-20T19:02:56.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:02:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:02:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:02:56.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:55 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 -- 172.21.15.27:0/1345274391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950104d20 msgr2=0x7f7950107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 --2- 172.21.15.27:0/1345274391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950104d20 0x7f7950107110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7944009c50 tx=0x7f794402a9a0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 -- 172.21.15.27:0/1345274391 shutdown_connections 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 --2- 172.21.15.27:0/1345274391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7950104d20 0x7f7950107110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 --2- 172.21.15.27:0/1345274391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79501023f0 0x7f79501047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 -- 172.21.15.27:0/1345274391 >> 172.21.15.27:0/1345274391 conn(0x7f79500fc010 msgr2=0x7f79500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 -- 172.21.15.27:0/1345274391 shutdown_connections 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.356+0000 7f795760c640 1 -- 172.21.15.27:0/1345274391 wait complete. 2024-09-20T19:02:56.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 Processor -- start 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 -- start start 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7950104d20 0x7f7950197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f795010a810 con 0x7f79501023f0 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f795760c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f795010a690 con 0x7f7950104d20 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58006/0 (socket says 172.21.15.27:58006) 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 -- 172.21.15.27:0/4024933033 learned_addr learned my addr 172.21.15.27:0/4024933033 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f7954ba7640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7950104d20 0x7f7950197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 -- 172.21.15.27:0/4024933033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7950104d20 msgr2=0x7f7950197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7950104d20 0x7f7950197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.357+0000 7f79553a8640 1 -- 172.21.15.27:0/4024933033 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7950198220 con 0x7f79501023f0 2024-09-20T19:02:56.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f79553a8640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f794000b420 tx=0x7f794000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7940011630 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795019cc60 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7940016070 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7940010d40 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.358+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795019d1c0 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.359+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795010b020 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.359+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f794001b460 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.360+0000 7f794e7fc640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 0x7f7938070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.360+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f794008d680 con 0x7f79501023f0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.360+0000 7f7954ba7640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 0x7f7938070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.360+0000 7f7954ba7640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 0x7f7938070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7944000f80 tx=0x7f7944009360 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.364+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f795010b020 con 0x7f79501023f0 2024-09-20T19:02:56.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.557+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f79501055c0 con 0x7f793806e2b0 2024-09-20T19:02:56.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.558+0000 7f794e7fc640 1 -- 172.21.15.27:0/4024933033 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f79501055c0 con 0x7f793806e2b0 2024-09-20T19:02:56.565 INFO:teuthology.orchestra.run.smithi027.stdout:Backend: cephadm 2024-09-20T19:02:56.565 INFO:teuthology.orchestra.run.smithi027.stdout:Available: Yes 2024-09-20T19:02:56.565 INFO:teuthology.orchestra.run.smithi027.stdout:Paused: No 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.560+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 msgr2=0x7f7938070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.560+0000 7f795760c640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 0x7f7938070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7944000f80 tx=0x7f7944009360 comp rx=0 tx=0).stop 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.560+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 msgr2=0x7f7950197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.560+0000 7f795760c640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f794000b420 tx=0x7f794000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 shutdown_connections 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f793806e2b0 0x7f7938070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7950104d20 0x7f7950197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 --2- 172.21.15.27:0/4024933033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79501023f0 0x7f7950197660 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 >> 172.21.15.27:0/4024933033 conn(0x7f79500fc010 msgr2=0x7f79500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 shutdown_connections 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:56.561+0000 7f795760c640 1 -- 172.21.15.27:0/4024933033 wait complete. 2024-09-20T19:02:57.235 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-20T19:02:57.497 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:57.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:57 smithi027 ceph-mon[28196]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:57 smithi027 ceph-mon[28196]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:57.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:57 smithi098 ceph-mon[35737]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:57 smithi098 ceph-mon[35737]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 -- 172.21.15.27:0/4068321925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 msgr2=0x7fd458101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 --2- 172.21.15.27:0/4068321925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd458101ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd444009880 tx=0x7fd44402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 -- 172.21.15.27:0/4068321925 shutdown_connections 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 --2- 172.21.15.27:0/4068321925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd458101ee0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 --2- 172.21.15.27:0/4068321925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 0x7fd458100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 -- 172.21.15.27:0/4068321925 >> 172.21.15.27:0/4068321925 conn(0x7fd4580fc010 msgr2=0x7fd4580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 -- 172.21.15.27:0/4068321925 shutdown_connections 2024-09-20T19:02:57.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.937+0000 7fd45f150640 1 -- 172.21.15.27:0/4068321925 wait complete. 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 Processor -- start 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 -- start start 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 0x7fd45806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd458109680 con 0x7fd458101a60 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45f150640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd458109500 con 0x7fd458100860 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd457fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58024/0 (socket says 172.21.15.27:58024) 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd457fff640 1 -- 172.21.15.27:0/1333768298 learned_addr learned my addr 172.21.15.27:0/1333768298 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.938+0000 7fd45ceec640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 0x7fd45806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd457fff640 1 -- 172.21.15.27:0/1333768298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 msgr2=0x7fd45806ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd457fff640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 0x7fd45806ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd457fff640 1 -- 172.21.15.27:0/1333768298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd458197fd0 con 0x7fd458101a60 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd457fff640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd444006010 tx=0x7fd4440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd44403f070 con 0x7fd458101a60 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45819ebc0 con 0x7fd458101a60 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4440044d0 con 0x7fd458101a60 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd444035030 con 0x7fd458101a60 2024-09-20T19:02:57.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.939+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45819f0f0 con 0x7fd458101a60 2024-09-20T19:02:57.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.940+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458100c60 con 0x7fd458101a60 2024-09-20T19:02:57.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.941+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd444042070 con 0x7fd458101a60 2024-09-20T19:02:57.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.941+0000 7fd455ffb640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 0x7fd448070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.941+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fd4440aea80 con 0x7fd458101a60 2024-09-20T19:02:57.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.942+0000 7fd45ceec640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 0x7fd448070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.942+0000 7fd45ceec640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 0x7fd448070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4581018c0 tx=0x7fd44c005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:57.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:57.946+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4440803d0 con 0x7fd458101a60 2024-09-20T19:02:58.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.142+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd458062630 con 0x7fd44806e2b0 2024-09-20T19:02:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.151+0000 7fd455ffb640 1 -- 172.21.15.27:0/1333768298 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7fd458062630 con 0x7fd44806e2b0 2024-09-20T19:02:58.157 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:02:58.157 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (3m) 2m ago 5m 26.4M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:02:58.157 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (5m) 2m ago 5m 7700k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:02:58.157 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (4m) 43s ago 4m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (5m) 2m ago 5m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (4m) 43s ago 4m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (3m) 2m ago 4m 76.0M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (6m) 2m ago 6m 490M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (4m) 43s ago 4m 440M - 19.1.1-369-ged8ee0f2 6acb0a031eab 04b71c60ddaa 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (6m) 2m ago 6m 45.9M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (4m) 43s ago 4m 41.1M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 43s ago 4m 15.4M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (3m) 2m ago 3m 39.0M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (2m) 2m ago 2m 37.8M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:02:58.158 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (2m) 2m ago 2m 12.1M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:02:58.159 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (103s) 43s ago 103s 48.0M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:02:58.159 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (76s) 43s ago 76s 45.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:02:58.159 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (48s) 43s ago 47s 11.6M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:02:58.159 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (3m) 2m ago 4m 44.5M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:02:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 msgr2=0x7fd448070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 0x7fd448070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4581018c0 tx=0x7fd44c005f90 comp rx=0 tx=0).stop 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 msgr2=0x7fd45819e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd444006010 tx=0x7fd4440048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 shutdown_connections 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fd44806e2b0 0x7fd448070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd458101a60 0x7fd45819e5c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 --2- 172.21.15.27:0/1333768298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd458100860 0x7fd45806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 >> 172.21.15.27:0/1333768298 conn(0x7fd4580fc010 msgr2=0x7fd458104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 shutdown_connections 2024-09-20T19:02:58.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:58.153+0000 7fd45f150640 1 -- 172.21.15.27:0/1333768298 wait complete. 2024-09-20T19:02:58.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:58 smithi027 ceph-mon[28196]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:58.628 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:58 smithi098 ceph-mon[35737]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:58.878 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-20T19:02:59.135 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:02:59.544 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:02:59 smithi027 ceph-mon[28196]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:59.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- 172.21.15.27:0/1759947511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea01001e0 msgr2=0x7feea01005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 --2- 172.21.15.27:0/1759947511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea01001e0 0x7feea01005e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097e0 tx=0x7fee9c02a3f0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- 172.21.15.27:0/1759947511 shutdown_connections 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 --2- 172.21.15.27:0/1759947511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea0100b20 0x7feea0100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 --2- 172.21.15.27:0/1759947511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea01001e0 0x7feea01005e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- 172.21.15.27:0/1759947511 >> 172.21.15.27:0/1759947511 conn(0x7feea00fc010 msgr2=0x7feea00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- 172.21.15.27:0/1759947511 shutdown_connections 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- 172.21.15.27:0/1759947511 wait complete. 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 Processor -- start 2024-09-20T19:02:59.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.620+0000 7feea7846640 1 -- start start 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea01001e0 0x7feea01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feea010c990 con 0x7feea0100b20 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feea010c810 con 0x7feea01001e0 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58044/0 (socket says 172.21.15.27:58044) 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 -- 172.21.15.27:0/1779589258 learned_addr learned my addr 172.21.15.27:0/1779589258 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea55e2640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea01001e0 0x7feea01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 -- 172.21.15.27:0/1779589258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea01001e0 msgr2=0x7feea01996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea01001e0 0x7feea01996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 -- 172.21.15.27:0/1779589258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea019a260 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea4de1640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fee9000e970 tx=0x7fee9000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee9000cac0 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea019eca0 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee900054e0 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee90004d70 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.621+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea019f1d0 con 0x7feea0100b20 2024-09-20T19:02:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.623+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea01005e0 con 0x7feea0100b20 2024-09-20T19:02:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.623+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fee90005020 con 0x7feea0100b20 2024-09-20T19:02:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.623+0000 7fee967fc640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 0x7fee8c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.624+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7fee9008e480 con 0x7feea0100b20 2024-09-20T19:02:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.624+0000 7feea55e2640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 0x7fee8c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.624+0000 7feea55e2640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 0x7fee8c070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0095f0 tx=0x7fee9c030890 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:59.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.628+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee9005c120 con 0x7feea0100b20 2024-09-20T19:02:59.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:02:59 smithi098 ceph-mon[35737]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:02:59.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.813+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7feea0062630 con 0x7fee8c06e2b0 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.817+0000 7fee967fc640 1 -- 172.21.15.27:0/1779589258 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1290 (secure 0 0 0) 0x7feea0062630 con 0x7fee8c06e2b0 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:crash 2/2 2m ago 5m * 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-20T19:02:59.825 INFO:teuthology.orchestra.run.smithi027.stdout:mgr 2/2 2m ago 6m count:2 2024-09-20T19:02:59.826 INFO:teuthology.orchestra.run.smithi027.stdout:mon 2/2 2m ago 5m smithi027:172.21.15.27=smithi027;smithi098:172.21.15.98=smithi098;count:2 2024-09-20T19:02:59.826 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-20T19:02:59.826 INFO:teuthology.orchestra.run.smithi027.stdout:osd 6 2m ago - 2024-09-20T19:02:59.826 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 msgr2=0x7fee8c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 0x7fee8c070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0095f0 tx=0x7fee9c030890 comp rx=0 tx=0).stop 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 msgr2=0x7feea0199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fee9000e970 tx=0x7fee9000ee30 comp rx=0 tx=0).stop 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 shutdown_connections 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fee8c06e2b0 0x7fee8c070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feea0100b20 0x7feea0199be0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 --2- 172.21.15.27:0/1779589258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feea01001e0 0x7feea01996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 >> 172.21.15.27:0/1779589258 conn(0x7feea00fc010 msgr2=0x7feea0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 shutdown_connections 2024-09-20T19:02:59.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:02:59.820+0000 7feea7846640 1 -- 172.21.15.27:0/1779589258 wait complete. 2024-09-20T19:03:00.416 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:00 smithi027 ceph-mon[28196]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:00.445 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-20T19:03:00.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:00 smithi098 ceph-mon[35737]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:00.700 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 -- 172.21.15.27:0/2046337558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 msgr2=0x7f7340074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 --2- 172.21.15.27:0/2046337558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f7340074680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7330009880 tx=0x7f733002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 -- 172.21.15.27:0/2046337558 shutdown_connections 2024-09-20T19:03:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 --2- 172.21.15.27:0/2046337558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 0x7f73400750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 --2- 172.21.15.27:0/2046337558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f7340074680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 -- 172.21.15.27:0/2046337558 >> 172.21.15.27:0/2046337558 conn(0x7f73400fd0f0 msgr2=0x7f73400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 -- 172.21.15.27:0/2046337558 shutdown_connections 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.120+0000 7f7345df7640 1 -- 172.21.15.27:0/2046337558 wait complete. 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 Processor -- start 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 -- start start 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 0x7f734019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7340110e00 con 0x7f7340076220 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f7345df7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7340110c80 con 0x7f7340074c50 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f733effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f733effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58052/0 (socket says 172.21.15.27:58052) 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.121+0000 7f733effd640 1 -- 172.21.15.27:0/3362039260 learned_addr learned my addr 172.21.15.27:0/3362039260 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733f7fe640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 0x7f734019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733effd640 1 -- 172.21.15.27:0/3362039260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 msgr2=0x7f734019db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733effd640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 0x7f734019db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733effd640 1 -- 172.21.15.27:0/3362039260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734019e6e0 con 0x7f7340076220 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733effd640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f733400b420 tx=0x7f733400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7334011630 con 0x7f7340076220 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73401a3120 con 0x7f7340076220 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7334016070 con 0x7f7340076220 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7334010d40 con 0x7f7340076220 2024-09-20T19:03:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.122+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401a3730 con 0x7f7340076220 2024-09-20T19:03:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.123+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73400750b0 con 0x7f7340076220 2024-09-20T19:03:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.124+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f73340117d0 con 0x7f7340076220 2024-09-20T19:03:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.124+0000 7f733cff9640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 0x7f7328070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.124+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f733408d6c0 con 0x7f7340076220 2024-09-20T19:03:01.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.124+0000 7f733f7fe640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 0x7f7328070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:01.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.125+0000 7f733f7fe640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 0x7f7328070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7330000c00 tx=0x7f7330005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:01.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.129+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f733405b360 con 0x7f7340076220 2024-09-20T19:03:01.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.312+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f7340062630 con 0x7f732806e2b0 2024-09-20T19:03:01.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.314+0000 7f733cff9640 1 -- 172.21.15.27:0/3362039260 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (secure 0 0 0) 0x7f7340062630 con 0x7f732806e2b0 2024-09-20T19:03:01.321 INFO:teuthology.orchestra.run.smithi027.stdout:HOST ADDR LABELS STATUS 2024-09-20T19:03:01.321 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 172.21.15.27 2024-09-20T19:03:01.322 INFO:teuthology.orchestra.run.smithi027.stdout:smithi098 172.21.15.98 2024-09-20T19:03:01.322 INFO:teuthology.orchestra.run.smithi027.stdout:2 hosts in cluster 2024-09-20T19:03:01.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 msgr2=0x7f7328070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 0x7f7328070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7330000c00 tx=0x7f7330005a20 comp rx=0 tx=0).stop 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 msgr2=0x7f734019e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f733400b420 tx=0x7f733400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 shutdown_connections 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f732806e2b0 0x7f7328070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7340076220 0x7f734019e060 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 --2- 172.21.15.27:0/3362039260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7340074c50 0x7f734019db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:01.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 >> 172.21.15.27:0/3362039260 conn(0x7f73400fd0f0 msgr2=0x7f73401035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:01.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 shutdown_connections 2024-09-20T19:03:01.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:01.316+0000 7f7345df7640 1 -- 172.21.15.27:0/3362039260 wait complete. 2024-09-20T19:03:01.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:01 smithi027 ceph-mon[28196]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:01.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:01 smithi098 ceph-mon[35737]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:01.929 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-20T19:03:02.186 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:02.559 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:02 smithi027 ceph-mon[28196]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 -- 172.21.15.27:0/3517552898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc104d80 msgr2=0x7f15dc107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 --2- 172.21.15.27:0/3517552898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc104d80 0x7f15dc107170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009880 tx=0x7f15cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 -- 172.21.15.27:0/3517552898 shutdown_connections 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 --2- 172.21.15.27:0/3517552898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc104d80 0x7f15dc107170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 --2- 172.21.15.27:0/3517552898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc102450 0x7f15dc104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 -- 172.21.15.27:0/3517552898 >> 172.21.15.27:0/3517552898 conn(0x7f15dc0fc010 msgr2=0x7f15dc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:02.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 -- 172.21.15.27:0/3517552898 shutdown_connections 2024-09-20T19:03:02.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.636+0000 7f15e43a0640 1 -- 172.21.15.27:0/3517552898 wait complete. 2024-09-20T19:03:02.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 Processor -- start 2024-09-20T19:03:02.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 -- start start 2024-09-20T19:03:02.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:02.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc104d80 0x7f15dc1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:02.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc10a720 con 0x7f15dc102450 2024-09-20T19:03:02.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e43a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc10a5a0 con 0x7f15dc104d80 2024-09-20T19:03:02.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e213c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e213c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58062/0 (socket says 172.21.15.27:58062) 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e213c640 1 -- 172.21.15.27:0/591222928 learned_addr learned my addr 172.21.15.27:0/591222928 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.637+0000 7f15e193b640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc104d80 0x7f15dc1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e213c640 1 -- 172.21.15.27:0/591222928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc104d80 msgr2=0x7f15dc1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e213c640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc104d80 0x7f15dc1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e213c640 1 -- 172.21.15.27:0/591222928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc198060 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e213c640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c810 tx=0x7f15d800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d8004020 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15d80041c0 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc19caa0 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d80047a0 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.638+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc19d000 con 0x7f15dc102450 2024-09-20T19:03:02.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.639+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc10af00 con 0x7f15dc102450 2024-09-20T19:03:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.640+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f15d80079b0 con 0x7f15dc102450 2024-09-20T19:03:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.640+0000 7f15d37fe640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 0x7f15c8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.640+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f15d808dd80 con 0x7f15dc102450 2024-09-20T19:03:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.640+0000 7f15e193b640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 0x7f15c8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.641+0000 7f15e193b640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 0x7f15c8070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000c00 tx=0x7f15cc005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.645+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15d8014030 con 0x7f15dc102450 2024-09-20T19:03:02.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:02 smithi098 ceph-mon[35737]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:02.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.827+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f15dc105700 con 0x7f15c806e2b0 2024-09-20T19:03:02.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.829+0000 7f15d37fe640 1 -- 172.21.15.27:0/591222928 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f15dc105700 con 0x7f15c806e2b0 2024-09-20T19:03:02.836 INFO:teuthology.orchestra.run.smithi027.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-20T19:03:02.836 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001C400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-20T19:03:02.837 INFO:teuthology.orchestra.run.smithi027.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 44s ago Has a FileSystem, LVM detected 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 msgr2=0x7f15c8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 0x7f15c8070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000c00 tx=0x7f15cc005a20 comp rx=0 tx=0).stop 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 msgr2=0x7f15dc1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c810 tx=0x7f15d800ccd0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 shutdown_connections 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f15c806e2b0 0x7f15c8070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15dc104d80 0x7f15dc1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 --2- 172.21.15.27:0/591222928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15dc102450 0x7f15dc1974a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 >> 172.21.15.27:0/591222928 conn(0x7f15dc0fc010 msgr2=0x7f15dc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 shutdown_connections 2024-09-20T19:03:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:02.831+0000 7f15e43a0640 1 -- 172.21.15.27:0/591222928 wait complete. 2024-09-20T19:03:03.456 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:03 smithi027 ceph-mon[28196]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:03.456 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:03 smithi027 ceph-mon[28196]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:03.483 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:03:03.492 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:03.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-20T19:03:03.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:03 smithi098 ceph-mon[35737]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:03.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:03 smithi098 ceph-mon[35737]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:03.745 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 -- 172.21.15.27:0/1773038449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c101a60 msgr2=0x7f785c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 --2- 172.21.15.27:0/1773038449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c101a60 0x7f785c101ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7850009880 tx=0x7f785002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 -- 172.21.15.27:0/1773038449 shutdown_connections 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 --2- 172.21.15.27:0/1773038449 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c101a60 0x7f785c101ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 --2- 172.21.15.27:0/1773038449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c100860 0x7f785c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:04.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 -- 172.21.15.27:0/1773038449 >> 172.21.15.27:0/1773038449 conn(0x7f785c0fc010 msgr2=0x7f785c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:04.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 -- 172.21.15.27:0/1773038449 shutdown_connections 2024-09-20T19:03:04.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.158+0000 7f78611c3640 1 -- 172.21.15.27:0/1773038449 wait complete. 2024-09-20T19:03:04.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 Processor -- start 2024-09-20T19:03:04.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 -- start start 2024-09-20T19:03:04.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:04.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c101a60 0x7f785c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:04.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1096a0 con 0x7f785c100860 2024-09-20T19:03:04.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.159+0000 7f78611c3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f785c109520 con 0x7f785c101a60 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58094/0 (socket says 172.21.15.27:58094) 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 -- 172.21.15.27:0/401036466 learned_addr learned my addr 172.21.15.27:0/401036466 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785a59c640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c101a60 0x7f785c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 -- 172.21.15.27:0/401036466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c101a60 msgr2=0x7f785c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c101a60 0x7f785c102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 -- 172.21.15.27:0/401036466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c103380 con 0x7f785c100860 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f785ad9d640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e940 tx=0x7f784c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f784c00cac0 con 0x7f785c100860 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785c103670 con 0x7f785c100860 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f784c00cc60 con 0x7f785c100860 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f784c003e30 con 0x7f785c100860 2024-09-20T19:03:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.160+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785c103c00 con 0x7f785c100860 2024-09-20T19:03:04.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.161+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785c100c60 con 0x7f785c100860 2024-09-20T19:03:04.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.162+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f784c004000 con 0x7f785c100860 2024-09-20T19:03:04.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.162+0000 7f7843fff640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 0x7f7844070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:04.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.163+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4638+0+0 (secure 0 0 0) 0x7f784c08e440 con 0x7f785c100860 2024-09-20T19:03:04.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.163+0000 7f785a59c640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 0x7f7844070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:04.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.163+0000 7f785a59c640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 0x7f7844070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7850006010 tx=0x7f7850000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:04.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.167+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f784c05c0e0 con 0x7f785c100860 2024-09-20T19:03:04.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:04.367+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f785c19f600 con 0x7f784406e2b0 2024-09-20T19:03:04.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:04.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:05.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:05 smithi098 ceph-mon[35737]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:05.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:05 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-20T19:03:05.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:05 smithi098 ceph-mon[35737]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:05.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:05 smithi027 ceph-mon[28196]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:05.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:05 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-20T19:03:05.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:05 smithi027 ceph-mon[28196]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:06.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.297+0000 7f7843fff640 1 -- 172.21.15.27:0/401036466 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f785c19f600 con 0x7f784406e2b0 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 msgr2=0x7f7844070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 0x7f7844070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7850006010 tx=0x7f7850000bc0 comp rx=0 tx=0).stop 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 msgr2=0x7f785c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f784c00e940 tx=0x7f784c00ee00 comp rx=0 tx=0).stop 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 shutdown_connections 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f784406e2b0 0x7f7844070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f785c101a60 0x7f785c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:06.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 --2- 172.21.15.27:0/401036466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f785c100860 0x7f785c104780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:06.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.299+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 >> 172.21.15.27:0/401036466 conn(0x7f785c0fc010 msgr2=0x7f785c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:06.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.300+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 shutdown_connections 2024-09-20T19:03:06.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:06.300+0000 7f78611c3640 1 -- 172.21.15.27:0/401036466 wait complete. 2024-09-20T19:03:06.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:06 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-20T19:03:06.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:06 smithi027 ceph-mon[28196]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T19:03:06.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:06 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-20T19:03:06.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:06 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[28192]: 2024-09-20T19:03:06.272+0000 7f2ef0d96640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:03:06.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:06 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-20T19:03:06.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:06 smithi098 ceph-mon[35737]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T19:03:06.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:06 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-20T19:03:06.963 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: osdmap e44: 6 total, 6 up, 6 in 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: fsmap cephfs:0 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: Saving service mds.cephfs spec with placement count:4 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:07.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: Deploying daemon mds.cephfs.smithi027.paximv on smithi027 2024-09-20T19:03:07.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:07 smithi027 ceph-mon[28196]: pgmap v176: 65 pgs: 14 creating+peering, 40 unknown, 11 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-20T19:03:07.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: osdmap e44: 6 total, 6 up, 6 in 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: fsmap cephfs:0 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: Saving service mds.cephfs spec with placement count:4 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: Deploying daemon mds.cephfs.smithi027.paximv on smithi027 2024-09-20T19:03:07.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:07 smithi098 ceph-mon[35737]: pgmap v176: 65 pgs: 14 creating+peering, 40 unknown, 11 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:08.127 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:08.428 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:08 smithi027 ceph-mon[28196]: osdmap e45: 6 total, 6 up, 6 in 2024-09-20T19:03:08.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:08 smithi098 ceph-mon[35737]: osdmap e45: 6 total, 6 up, 6 in 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.813+0000 7f932156d640 1 -- 172.21.15.27:0/1902797535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 msgr2=0x7f931c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.813+0000 7f932156d640 1 --2- 172.21.15.27:0/1902797535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c1047e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098b0 tx=0x7f930c02a4d0 comp rx=0 tx=0).stop 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 -- 172.21.15.27:0/1902797535 shutdown_connections 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 --2- 172.21.15.27:0/1902797535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 0x7f931c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 --2- 172.21.15.27:0/1902797535 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c1047e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 -- 172.21.15.27:0/1902797535 >> 172.21.15.27:0/1902797535 conn(0x7f931c0fc010 msgr2=0x7f931c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 -- 172.21.15.27:0/1902797535 shutdown_connections 2024-09-20T19:03:08.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 -- 172.21.15.27:0/1902797535 wait complete. 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 Processor -- start 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.814+0000 7f932156d640 1 -- start start 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f932156d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f932156d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 0x7f931c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f932156d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f931c10a7e0 con 0x7f931c1023f0 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f932156d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f931c10a660 con 0x7f931c104d20 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:43998/0 (socket says 172.21.15.27:43998) 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 -- 172.21.15.27:0/1326917370 learned_addr learned my addr 172.21.15.27:0/1326917370 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931a7fc640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 0x7f931c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 -- 172.21.15.27:0/1326917370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 msgr2=0x7f931c1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:08.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 0x7f931c1003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 -- 172.21.15.27:0/1326917370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c1008e0 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f931affd640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f930c0099d0 tx=0x7f930c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f930c03f070 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.816+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c100b70 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.815+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f930c004c70 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.816+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f930c035030 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.816+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c1010a0 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.816+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c1027d0 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.817+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f930c042070 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.817+0000 7f9303fff640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 0x7f9304070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.818+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7f930c0aed90 con 0x7f931c1023f0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.818+0000 7f931a7fc640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 0x7f9304070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.818+0000 7f931a7fc640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 0x7f9304070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f931c101a60 tx=0x7f931000a250 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:08.822+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f930c0803a0 con 0x7f931c1023f0 2024-09-20T19:03:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.049+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f931c19fb00 con 0x7f931c1023f0 2024-09-20T19:03:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.050+0000 7f9303fff640 1 -- 172.21.15.27:0/1326917370 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f930c084bd0 con 0x7f931c1023f0 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:e2 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:06:273766+0000 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 2 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T19:03:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:06.273690+0000 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:03:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:in 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:up {} 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data disabled 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 0 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:03:09.060 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:09.061 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 2 2024-09-20T19:03:09.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 msgr2=0x7f9304070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:09.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 0x7f9304070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f931c101a60 tx=0x7f931000a250 comp rx=0 tx=0).stop 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 msgr2=0x7f931c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f930c0099d0 tx=0x7f930c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 shutdown_connections 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f930406e2b0 0x7f9304070770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f931c104d20 0x7f931c1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 --2- 172.21.15.27:0/1326917370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f931c1023f0 0x7f931c101ce0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 >> 172.21.15.27:0/1326917370 conn(0x7f931c0fc010 msgr2=0x7f931c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 shutdown_connections 2024-09-20T19:03:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:09.052+0000 7f932156d640 1 -- 172.21.15.27:0/1326917370 wait complete. 2024-09-20T19:03:09.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:09 smithi027 ceph-mon[28196]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T19:03:09.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:09 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1326917370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:03:09.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:09 smithi027 ceph-mon[28196]: pgmap v179: 65 pgs: 14 creating+peering, 25 unknown, 26 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:09.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:09 smithi098 ceph-mon[35737]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T19:03:09.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:09 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1326917370' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:03:09.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:09 smithi098 ceph-mon[35737]: pgmap v179: 65 pgs: 14 creating+peering, 25 unknown, 26 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-20T19:03:10.120 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:03:10.131 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:10.131 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-20T19:03:10.397 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:10.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: Deploying daemon mds.cephfs.smithi098.fdtjxi on smithi098 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.27:6826/444076941,v1:172.21.15.27:6827/444076941] up:boot 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: daemon mds.cephfs.smithi027.paximv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: Cluster is now healthy 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: fsmap cephfs:0 1 up:standby 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:03:10.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:creating} 2024-09-20T19:03:10.824 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:10 smithi027 ceph-mon[28196]: daemon mds.cephfs.smithi027.paximv is now active in filesystem cephfs as rank 0 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:10.865 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: Deploying daemon mds.cephfs.smithi098.fdtjxi on smithi098 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.27:6826/444076941,v1:172.21.15.27:6827/444076941] up:boot 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: daemon mds.cephfs.smithi027.paximv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: Cluster is now healthy 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: fsmap cephfs:0 1 up:standby 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:creating} 2024-09-20T19:03:10.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:10 smithi098 ceph-mon[35737]: daemon mds.cephfs.smithi027.paximv is now active in filesystem cephfs as rank 0 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 -- 172.21.15.27:0/1157997253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 msgr2=0x7fdac0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1157997253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0104860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009880 tx=0x7fdabc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 -- 172.21.15.27:0/1157997253 shutdown_connections 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1157997253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1157997253 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0104860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 -- 172.21.15.27:0/1157997253 >> 172.21.15.27:0/1157997253 conn(0x7fdac00fc010 msgr2=0x7fdac00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 -- 172.21.15.27:0/1157997253 shutdown_connections 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.902+0000 7fdac77f1640 1 -- 172.21.15.27:0/1157997253 wait complete. 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 Processor -- start 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 -- start start 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac01979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdac010a770 con 0x7fdac0102470 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac77f1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdac010a5f0 con 0x7fdac0104da0 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44044/0 (socket says 172.21.15.27:44044) 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 -- 172.21.15.27:0/1976536380 learned_addr learned my addr 172.21.15.27:0/1976536380 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac4d8c640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac01979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 -- 172.21.15.27:0/1976536380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 msgr2=0x7fdac01979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac01979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 -- 172.21.15.27:0/1976536380 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac0197fc0 con 0x7fdac0102470 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac4d8c640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.903+0000 7fdac558d640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdabc006010 tx=0x7fdabc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.904+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdabc03f070 con 0x7fdac0102470 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.904+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdabc0044d0 con 0x7fdac0102470 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.904+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac019ca30 con 0x7fdac0102470 2024-09-20T19:03:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.904+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdabc035030 con 0x7fdac0102470 2024-09-20T19:03:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.904+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac019cf90 con 0x7fdac0102470 2024-09-20T19:03:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.905+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac0102850 con 0x7fdac0102470 2024-09-20T19:03:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.905+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdabc042070 con 0x7fdac0102470 2024-09-20T19:03:10.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.906+0000 7fdab67fc640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 0x7fdaac070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.906+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7fdabc0aee90 con 0x7fdac0102470 2024-09-20T19:03:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.906+0000 7fdac4d8c640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 0x7fdaac070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:10.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.906+0000 7fdac4d8c640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 0x7fdaac070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdac0198940 tx=0x7fdab000a5c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:10.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:10.910+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdabc07c7f0 con 0x7fdac0102470 2024-09-20T19:03:11.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.127+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fdac019d240 con 0x7fdac0102470 2024-09-20T19:03:11.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.295+0000 7fdab67fc640 1 -- 172.21.15.27:0/1976536380 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7fdabc0804a0 con 0x7fdac0102470 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 msgr2=0x7fdaac070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 0x7fdaac070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdac0198940 tx=0x7fdab000a5c0 comp rx=0 tx=0).stop 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 msgr2=0x7fdac0197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdabc006010 tx=0x7fdabc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 shutdown_connections 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fdaac06e2b0 0x7fdaac070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdac0104da0 0x7fdac01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 --2- 172.21.15.27:0/1976536380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdac0102470 0x7fdac0197490 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 >> 172.21.15.27:0/1976536380 conn(0x7fdac00fc010 msgr2=0x7fdac00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 shutdown_connections 2024-09-20T19:03:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:11.298+0000 7fdac77f1640 1 -- 172.21.15.27:0/1976536380 wait complete. 2024-09-20T19:03:11.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:11 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1976536380' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-20T19:03:11.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:11 smithi098 ceph-mon[35737]: pgmap v180: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 208 B/s wr, 0 op/s 2024-09-20T19:03:11.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:11 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1976536380' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-20T19:03:11.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:11 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.27:6826/444076941,v1:172.21.15.27:6827/444076941] up:active 2024-09-20T19:03:11.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:11 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 2024-09-20T19:03:12.026 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:11 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1976536380' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-20T19:03:12.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:11 smithi027 ceph-mon[28196]: pgmap v180: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 208 B/s wr, 0 op/s 2024-09-20T19:03:12.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:11 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1976536380' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-20T19:03:12.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:11 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.27:6826/444076941,v1:172.21.15.27:6827/444076941] up:active 2024-09-20T19:03:12.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:11 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 2024-09-20T19:03:12.057 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:03:12.070 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:12.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-20T19:03:12.332 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:12.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/4122327544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 msgr2=0x7f3f38101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:12.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/4122327544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38101d60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009880 tx=0x7f3f3402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:12.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/4122327544 shutdown_connections 2024-09-20T19:03:12.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/4122327544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 0x7f3f38102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:12.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/4122327544 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38101d60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/4122327544 >> 172.21.15.27:0/4122327544 conn(0x7f3f380fd0f0 msgr2=0x7f3f380ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/4122327544 shutdown_connections 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.840+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/4122327544 wait complete. 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 Processor -- start 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 -- start start 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 0x7f3f38197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3810a800 con 0x7f3f38101960 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3f8f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3810a680 con 0x7f3f38102b60 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3d690640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3d690640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44064/0 (socket says 172.21.15.27:44064) 2024-09-20T19:03:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3d690640 1 -- 172.21.15.27:0/22153769 learned_addr learned my addr 172.21.15.27:0/22153769 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.841+0000 7f3f3ce8f640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 0x7f3f38197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3d690640 1 -- 172.21.15.27:0/22153769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 msgr2=0x7f3f38197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3d690640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 0x7f3f38197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3d690640 1 -- 172.21.15.27:0/22153769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f381980d0 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3d690640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f34006010 tx=0x7f3f340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3403f070 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f340044d0 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3819cab0 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f34035030 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.842+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3819d040 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.843+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38101d60 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.844+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3f34042070 con 0x7f3f38101960 2024-09-20T19:03:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.844+0000 7f3f2e7fc640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 0x7f3f240707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.844+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7f3f340aed50 con 0x7f3f38101960 2024-09-20T19:03:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.844+0000 7f3f3ce8f640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 0x7f3f240707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.845+0000 7f3f3ce8f640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 0x7f3f240707d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f381989c0 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:12.849+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f3407c730 con 0x7f3f38101960 2024-09-20T19:03:13.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.065+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f3f38062df0 con 0x7f3f38101960 2024-09-20T19:03:13.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.478+0000 7f3f2e7fc640 1 -- 172.21.15.27:0/22153769 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v7) ==== 121+0+0 (secure 0 0 0) 0x7f3f340803e0 con 0x7f3f38101960 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.481+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 msgr2=0x7f3f240707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.481+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 0x7f3f240707d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f381989c0 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.481+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 msgr2=0x7f3f38197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.481+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f34006010 tx=0x7f3f340048f0 comp rx=0 tx=0).stop 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 shutdown_connections 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3f2406e310 0x7f3f240707d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f38102b60 0x7f3f38197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 --2- 172.21.15.27:0/22153769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f38101960 0x7f3f38197510 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 >> 172.21.15.27:0/22153769 conn(0x7f3f380fd0f0 msgr2=0x7f3f38105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:13.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 shutdown_connections 2024-09-20T19:03:13.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:13.482+0000 7f3f3f8f4640 1 -- 172.21.15.27:0/22153769 wait complete. 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: Deploying daemon mds.cephfs.smithi027.esfeuy on smithi027 2024-09-20T19:03:13.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:boot 2024-09-20T19:03:13.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby 2024-09-20T19:03:13.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:03:13.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/22153769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-20T19:03:13.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:13 smithi098 ceph-mon[35737]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-20T19:03:13.807 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.807 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: Deploying daemon mds.cephfs.smithi027.esfeuy on smithi027 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:boot 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/22153769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-20T19:03:13.808 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:13 smithi027 ceph-mon[28196]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-20T19:03:14.118 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:03:14.129 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:14.129 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-20T19:03:14.621 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:14.748 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:14 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/22153769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-20T19:03:14.748 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:14 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby 2024-09-20T19:03:14.748 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:14 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2024-09-20T19:03:14.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:14 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/22153769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-20T19:03:14.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:14 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby 2024-09-20T19:03:14.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:14 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 -- 172.21.15.27:0/2291883715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0101a60 msgr2=0x7febf0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 --2- 172.21.15.27:0/2291883715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0101a60 0x7febf0101ee0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febe0009880 tx=0x7febe002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 -- 172.21.15.27:0/2291883715 shutdown_connections 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 --2- 172.21.15.27:0/2291883715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0101a60 0x7febf0101ee0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 --2- 172.21.15.27:0/2291883715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0100860 0x7febf0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 -- 172.21.15.27:0/2291883715 >> 172.21.15.27:0/2291883715 conn(0x7febf00fc010 msgr2=0x7febf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 -- 172.21.15.27:0/2291883715 shutdown_connections 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.247+0000 7febf87eb640 1 -- 172.21.15.27:0/2291883715 wait complete. 2024-09-20T19:03:15.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 Processor -- start 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 -- start start 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 0x7febf0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7febf01096a0 con 0x7febf0100860 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf87eb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7febf0109520 con 0x7febf0101a60 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf6587640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf6587640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44086/0 (socket says 172.21.15.27:44086) 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.248+0000 7febf6587640 1 -- 172.21.15.27:0/2947405792 learned_addr learned my addr 172.21.15.27:0/2947405792 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf5d86640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 0x7febf0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf6587640 1 -- 172.21.15.27:0/2947405792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 msgr2=0x7febf0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf6587640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 0x7febf0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf6587640 1 -- 172.21.15.27:0/2947405792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf0196fa0 con 0x7febf0100860 2024-09-20T19:03:15.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf5d86640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 0x7febf0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:03:15.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf6587640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febec00d8d0 tx=0x7febec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:15.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febec017070 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7febec00be10 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febec00f3c0 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.249+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf019b9e0 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.250+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf019bf10 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.251+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf0100c60 con 0x7febf0100860 2024-09-20T19:03:15.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.252+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7febec01a070 con 0x7febf0100860 2024-09-20T19:03:15.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.252+0000 7febe77fe640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 0x7febdc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:15.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.252+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7febec08dcd0 con 0x7febf0100860 2024-09-20T19:03:15.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.252+0000 7febf5d86640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 0x7febdc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:15.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.253+0000 7febf5d86640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 0x7febdc0707d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febe00096c0 tx=0x7febe0009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:15.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.257+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febec05b6b0 con 0x7febf0100860 2024-09-20T19:03:15.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:15.490+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7febf01904b0 con 0x7febf0100860 2024-09-20T19:03:15.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:15 smithi027 ceph-mon[28196]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-20T19:03:15.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:15 smithi098 ceph-mon[35737]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-20T19:03:16.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.490+0000 7febe77fe640 1 -- 172.21.15.27:0/2947405792 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7febec05f360 con 0x7febf0100860 2024-09-20T19:03:16.498 INFO:teuthology.orchestra.run.smithi027.stderr:inline data enabled 2024-09-20T19:03:16.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 msgr2=0x7febdc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 0x7febdc0707d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febe00096c0 tx=0x7febe0009650 comp rx=0 tx=0).stop 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 msgr2=0x7febf01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febec00d8d0 tx=0x7febec00dd90 comp rx=0 tx=0).stop 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 shutdown_connections 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7febdc06e310 0x7febdc0707d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febf0101a60 0x7febf0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 --2- 172.21.15.27:0/2947405792 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febf0100860 0x7febf01963e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 >> 172.21.15.27:0/2947405792 conn(0x7febf00fc010 msgr2=0x7febf0104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 shutdown_connections 2024-09-20T19:03:16.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:16.493+0000 7febf87eb640 1 -- 172.21.15.27:0/2947405792 wait complete. 2024-09-20T19:03:16.574 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2947405792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:16.575 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:16 smithi098 ceph-mon[35737]: Deploying daemon mds.cephfs.smithi098.hnflps on smithi098 2024-09-20T19:03:16.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2947405792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-20T19:03:16.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:16.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T19:03:16.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T19:03:16.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:16.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:16 smithi027 ceph-mon[28196]: Deploying daemon mds.cephfs.smithi098.hnflps on smithi098 2024-09-20T19:03:17.167 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:03:17.180 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:17.180 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T19:03:17.453 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:17.591 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-20T19:03:17.591 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2947405792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-20T19:03:17.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] up:boot 2024-09-20T19:03:17.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 1 up:standby 2024-09-20T19:03:17.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:03:17.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:17 smithi098 ceph-mon[35737]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 930 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2947405792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] up:boot 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 1 up:standby 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:03:17.802 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:17 smithi027 ceph-mon[28196]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 930 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-20T19:03:17.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- 172.21.15.27:0/1770011010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 msgr2=0x7fe478107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 --2- 172.21.15.27:0/1770011010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe478107110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe4640098b0 tx=0x7fe46402a4d0 comp rx=0 tx=0).stop 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- 172.21.15.27:0/1770011010 shutdown_connections 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 --2- 172.21.15.27:0/1770011010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe478107110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 --2- 172.21.15.27:0/1770011010 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 0x7fe4781047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- 172.21.15.27:0/1770011010 >> 172.21.15.27:0/1770011010 conn(0x7fe4780fc010 msgr2=0x7fe4780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- 172.21.15.27:0/1770011010 shutdown_connections 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- 172.21.15.27:0/1770011010 wait complete. 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 Processor -- start 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.879+0000 7fe47ed71640 1 -- start start 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47ed71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 0x7fe478101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47ed71640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47ed71640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810a790 con 0x7fe478104d20 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47ed71640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810a610 con 0x7fe4781023f0 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58032/0 (socket says 172.21.15.27:58032) 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 -- 172.21.15.27:0/404043971 learned_addr learned my addr 172.21.15.27:0/404043971 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47cb0d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 0x7fe478101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 -- 172.21.15.27:0/404043971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 msgr2=0x7fe478101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 0x7fe478101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 -- 172.21.15.27:0/404043971 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4781008e0 con 0x7fe478104d20 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe477fff640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe464009230 tx=0x7fe4640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe46403f070 con 0x7fe478104d20 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe478100b70 con 0x7fe478104d20 2024-09-20T19:03:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe464004a50 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.880+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe464035030 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.881+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4781010a0 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.882+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4781027d0 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.883+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe464042070 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.883+0000 7fe475ffb640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 0x7fe468070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.883+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7fe4640aec40 con 0x7fe478104d20 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.883+0000 7fe47cb0d640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 0x7fe468070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.884+0000 7fe47cb0d640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 0x7fe468070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00bbe0 tx=0x7fe46c00b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:17.892+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe464080250 con 0x7fe478104d20 2024-09-20T19:03:18.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.107+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe47819f730 con 0x7fe478104d20 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.107+0000 7fe475ffb640 1 -- 172.21.15.27:0/404043971 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) ==== 75+0+1822 (secure 0 0 0) 0x7fe464084a80 con 0x7fe478104d20 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:e9 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:16:486291+0000 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:03:18.115 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 9 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:15.492114+0000 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-20T19:03:18.116 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=14560} 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:03:18.117 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 14560 members: 14560 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{0:14560} state up:active seq 2 addr [v2:172.21.15.27:6826/444076941,v1:172.21.15.27:6827/444076941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:standby-replay seq 1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:18.118 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{-1:14580} state up:standby seq 1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 msgr2=0x7fe468070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 0x7fe468070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00bbe0 tx=0x7fe46c00b390 comp rx=0 tx=0).stop 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 msgr2=0x7fe4781003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe464009230 tx=0x7fe4640045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 shutdown_connections 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe46806e2b0 0x7fe468070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe478104d20 0x7fe4781003a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 --2- 172.21.15.27:0/404043971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4781023f0 0x7fe478101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:18.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 >> 172.21.15.27:0/404043971 conn(0x7fe4780fc010 msgr2=0x7fe4780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:18.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 shutdown_connections 2024-09-20T19:03:18.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:18.109+0000 7fe47ed71640 1 -- 172.21.15.27:0/404043971 wait complete. 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/404043971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:18 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:18.772 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/404043971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:18.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:18 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:18.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-20T19:03:19.638 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:boot 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-20T19:03:19.761 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:19.880 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:boot 2024-09-20T19:03:19.880 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:19.880 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:03:19.881 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:19.881 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:19.881 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-20T19:03:19.881 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 -- 172.21.15.27:0/3582671305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 msgr2=0x7fc5e4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 --2- 172.21.15.27:0/3582671305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4101ee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009880 tx=0x7fc5d802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 -- 172.21.15.27:0/3582671305 shutdown_connections 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 --2- 172.21.15.27:0/3582671305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4101ee0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 --2- 172.21.15.27:0/3582671305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 0x7fc5e4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 -- 172.21.15.27:0/3582671305 >> 172.21.15.27:0/3582671305 conn(0x7fc5e40fc010 msgr2=0x7fc5e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 -- 172.21.15.27:0/3582671305 shutdown_connections 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.072+0000 7fc5e899a640 1 -- 172.21.15.27:0/3582671305 wait complete. 2024-09-20T19:03:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 Processor -- start 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 -- start start 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 0x7fc5e4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e41096a0 con 0x7fc5e4101a60 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e899a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e4109520 con 0x7fc5e4100860 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e1d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e1d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58054/0 (socket says 172.21.15.27:58054) 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.073+0000 7fc5e1d9b640 1 -- 172.21.15.27:0/857587566 learned_addr learned my addr 172.21.15.27:0/857587566 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:20.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e259c640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 0x7fc5e4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:20.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e1d9b640 1 -- 172.21.15.27:0/857587566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 msgr2=0x7fc5e4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:20.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e1d9b640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 0x7fc5e4104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e1d9b640 1 -- 172.21.15.27:0/857587566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e4103380 con 0x7fc5e4101a60 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e1d9b640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006010 tx=0x7fc5d8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5d803f070 con 0x7fc5e4101a60 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc5d80049d0 con 0x7fc5e4101a60 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e4103610 con 0x7fc5e4101a60 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5d8035030 con 0x7fc5e4101a60 2024-09-20T19:03:20.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.074+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e4103b40 con 0x7fc5e4101a60 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.075+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e4100c60 con 0x7fc5e4101a60 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.076+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc5d8042070 con 0x7fc5e4101a60 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.076+0000 7fc5d37fe640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 0x7fc5cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.076+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5468+0+0 (secure 0 0 0) 0x7fc5d80aecd0 con 0x7fc5e4101a60 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.076+0000 7fc5e259c640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 0x7fc5cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:20.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.077+0000 7fc5e259c640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 0x7fc5cc070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5e41018c0 tx=0x7fc5d4005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:20.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.081+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5d80802e0 con 0x7fc5e4101a60 2024-09-20T19:03:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.301+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5e419f720 con 0x7fc5e4101a60 2024-09-20T19:03:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.301+0000 7fc5d37fe640 1 -- 172.21.15.27:0/857587566 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+5321 (secure 0 0 0) 0x7fc5d8084b10 con 0x7fc5e4101a60 2024-09-20T19:03:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 10 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 msgr2=0x7fc5cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 0x7fc5cc070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5e41018c0 tx=0x7fc5d4005f90 comp rx=0 tx=0).stop 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 msgr2=0x7fc5e4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006010 tx=0x7fc5d8004570 comp rx=0 tx=0).stop 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 shutdown_connections 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc5cc06e2b0 0x7fc5cc070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e4101a60 0x7fc5e4102e40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 --2- 172.21.15.27:0/857587566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e4100860 0x7fc5e4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 >> 172.21.15.27:0/857587566 conn(0x7fc5e40fc010 msgr2=0x7fc5e406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 shutdown_connections 2024-09-20T19:03:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:20.304+0000 7fc5e899a640 1 -- 172.21.15.27:0/857587566 wait complete. 2024-09-20T19:03:20.320 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:03:21.108 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/857587566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] up:standby 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:standby-replay 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: Dropping low affinity active daemon mds.cephfs.smithi027.paximv in favor of higher affinity standby. 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: Replacing daemon mds.cephfs.smithi027.paximv as rank 0 with standby daemon mds.cephfs.smithi098.fdtjxi 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: osdmap e47: 6 total, 6 up, 6 in 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:replay} 2 up:standby 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:21.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:21 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:21.482 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:21.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/857587566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T19:03:21.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] up:standby 2024-09-20T19:03:21.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:standby-replay 2024-09-20T19:03:21.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: Dropping low affinity active daemon mds.cephfs.smithi027.paximv in favor of higher affinity standby. 2024-09-20T19:03:21.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: Replacing daemon mds.cephfs.smithi027.paximv as rank 0 with standby daemon mds.cephfs.smithi098.fdtjxi 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: osdmap e47: 6 total, 6 up, 6 in 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:replay} 2 up:standby 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:21.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:21 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:22 smithi098 ceph-mon[35737]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-20T19:03:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:22 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] up:boot 2024-09-20T19:03:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:22 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:reconnect 2024-09-20T19:03:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:22 smithi098 ceph-mon[35737]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:reconnect} 3 up:standby 2024-09-20T19:03:22.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:22 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:03:22.536 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:22 smithi027 ceph-mon[28196]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-20T19:03:22.536 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:22 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] up:boot 2024-09-20T19:03:22.536 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:22 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:reconnect 2024-09-20T19:03:22.536 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:22 smithi027 ceph-mon[28196]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:reconnect} 3 up:standby 2024-09-20T19:03:22.536 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:22 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 -- 172.21.15.27:0/551387660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 msgr2=0x7f1128100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 --2- 172.21.15.27:0/551387660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f1128100c60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1110009880 tx=0x7f111002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 -- 172.21.15.27:0/551387660 shutdown_connections 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 --2- 172.21.15.27:0/551387660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 --2- 172.21.15.27:0/551387660 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f1128100c60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 -- 172.21.15.27:0/551387660 >> 172.21.15.27:0/551387660 conn(0x7f11280fc010 msgr2=0x7f11280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 -- 172.21.15.27:0/551387660 shutdown_connections 2024-09-20T19:03:22.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 -- 172.21.15.27:0/551387660 wait complete. 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.617+0000 7f112eef6640 1 Processor -- start 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112eef6640 1 -- start start 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112eef6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112eef6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112eef6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1128109680 con 0x7f1128100860 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112eef6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1128109500 con 0x7f1128101a60 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58092/0 (socket says 172.21.15.27:58092) 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 -- 172.21.15.27:0/4102103775 learned_addr learned my addr 172.21.15.27:0/4102103775 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f1127fff640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 -- 172.21.15.27:0/4102103775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 msgr2=0x7f1128197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 -- 172.21.15.27:0/4102103775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11281980b0 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f1127fff640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.618+0000 7f112cc92640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1110006010 tx=0x7f11100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.619+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f111003f070 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.619+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112819ca90 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.619+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1110004a50 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.619+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1110035030 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.619+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112819d020 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.620+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1128100c60 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.621+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1110042070 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.621+0000 7f1125ffb640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 0x7f1114070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.621+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f11100aed80 con 0x7f1128100860 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.621+0000 7f1127fff640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 0x7f1114070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:22.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.622+0000 7f1127fff640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 0x7f1114070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11281989a0 tx=0x7f1118009520 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:22.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.626+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1110004c00 con 0x7f1128100860 2024-09-20T19:03:22.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.880+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f112819d9c0 con 0x7f1128100860 2024-09-20T19:03:22.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.880+0000 7f1125ffb640 1 -- 172.21.15.27:0/4102103775 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) ==== 78+0+98 (secure 0 0 0) 0x7f111007c680 con 0x7f1128100860 2024-09-20T19:03:22.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 msgr2=0x7f1114070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 0x7f1114070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11281989a0 tx=0x7f1118009520 comp rx=0 tx=0).stop 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 msgr2=0x7f11281974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1110006010 tx=0x7f11100045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 shutdown_connections 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f111406e2b0 0x7f1114070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1128101a60 0x7f1128197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 --2- 172.21.15.27:0/4102103775 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1128100860 0x7f11281974f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 >> 172.21.15.27:0/4102103775 conn(0x7f11280fc010 msgr2=0x7f112806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.882+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 shutdown_connections 2024-09-20T19:03:22.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:22.883+0000 7f112eef6640 1 -- 172.21.15.27:0/4102103775 wait complete. 2024-09-20T19:03:22.897 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:03:23.551 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-20T19:03:23.563 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:rejoin 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:standby 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:rejoin} 3 up:standby 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: daemon mds.cephfs.smithi098.fdtjxi is now active in filesystem cephfs as rank 0 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/4102103775' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-20T19:03:23.768 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:23 smithi027 ceph-mon[28196]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-20T19:03:23.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:rejoin 2024-09-20T19:03:23.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:standby 2024-09-20T19:03:23.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: fsmap cephfs:1/1 {0=cephfs.smithi098.fdtjxi=up:rejoin} 3 up:standby 2024-09-20T19:03:23.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: daemon mds.cephfs.smithi098.fdtjxi is now active in filesystem cephfs as rank 0 2024-09-20T19:03:23.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/4102103775' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-20T19:03:23.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:23 smithi098 ceph-mon[35737]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-20T19:03:24.688 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:24.806 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:24 smithi027 ceph-mon[28196]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:03:24.807 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:24 smithi027 ceph-mon[28196]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:active 2024-09-20T19:03:24.807 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:24 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:03:24.807 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:24 smithi027 ceph-mon[28196]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:24.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:24 smithi098 ceph-mon[35737]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:03:24.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:24 smithi098 ceph-mon[35737]: mds.? [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] up:active 2024-09-20T19:03:24.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:24 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:03:24.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:24 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:03:25.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 -- 172.21.15.27:0/1050988572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4781033e0 msgr2=0x7fa47810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 --2- 172.21.15.27:0/1050988572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4781033e0 0x7fa47810b8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009880 tx=0x7fa46c02a530 comp rx=0 tx=0).stop 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 -- 172.21.15.27:0/1050988572 shutdown_connections 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 --2- 172.21.15.27:0/1050988572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4781033e0 0x7fa47810b8d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 --2- 172.21.15.27:0/1050988572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa478102ac0 0x7fa478102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 -- 172.21.15.27:0/1050988572 >> 172.21.15.27:0/1050988572 conn(0x7fa4780fc520 msgr2=0x7fa4780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 -- 172.21.15.27:0/1050988572 shutdown_connections 2024-09-20T19:03:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.143+0000 7fa47d19b640 1 -- 172.21.15.27:0/1050988572 wait complete. 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.144+0000 7fa47d19b640 1 Processor -- start 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.144+0000 7fa47d19b640 1 -- start start 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4781033e0 0x7fa47819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa47810edd0 con 0x7fa478102ac0 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa47810ec50 con 0x7fa4781033e0 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58108/0 (socket says 172.21.15.27:58108) 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 -- 172.21.15.27:0/28571530 learned_addr learned my addr 172.21.15.27:0/28571530 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47659c640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4781033e0 0x7fa47819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 -- 172.21.15.27:0/28571530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4781033e0 msgr2=0x7fa47819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4781033e0 0x7fa47819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 -- 172.21.15.27:0/28571530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4781977e0 con 0x7fa478102ac0 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa476d9d640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c8a0 tx=0x7fa46800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:25.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4680079b0 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa468007b50 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa478197ad0 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa468018700 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.145+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa478198060 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.146+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47806aa90 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.147+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa468007d00 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.147+0000 7fa45ffff640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 0x7fa460070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.147+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fa46808e4b0 con 0x7fa478102ac0 2024-09-20T19:03:25.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.147+0000 7fa47659c640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 0x7fa460070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:25.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.148+0000 7fa47659c640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 0x7fa460070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa46c031460 tx=0x7fa46c009560 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:25.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.152+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa468014030 con 0x7fa478102ac0 2024-09-20T19:03:25.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.383+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa478105f60 con 0x7fa478102ac0 2024-09-20T19:03:25.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.383+0000 7fa45ffff640 1 -- 172.21.15.27:0/28571530 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5324 (secure 0 0 0) 0x7fa468016300 con 0x7fa478102ac0 2024-09-20T19:03:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:03:25.390 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":16,"btime":"2024-09-20T19:03:23:519637+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14594,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/3242536468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":3242536468},{"type":"v1","addr":"172.21.15.27:6827","nonce":3242536468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:03:23.519617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"cephfs.smithi027.esfeuy","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.27:6829/1555909616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1555909616},{"type":"v1","addr":"172.21.15.27:6829","nonce":1555909616}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:03:25.390 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 msgr2=0x7fa460070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 0x7fa460070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa46c031460 tx=0x7fa46c009560 comp rx=0 tx=0).stop 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 msgr2=0x7fa47819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c8a0 tx=0x7fa46800cd60 comp rx=0 tx=0).stop 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 shutdown_connections 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa46006e2b0 0x7fa460070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4781033e0 0x7fa47819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 --2- 172.21.15.27:0/28571530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa478102ac0 0x7fa47819d660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:25.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 >> 172.21.15.27:0/28571530 conn(0x7fa4780fc520 msgr2=0x7fa478108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:25.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 shutdown_connections 2024-09-20T19:03:25.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:25.386+0000 7fa47d19b640 1 -- 172.21.15.27:0/28571530 wait complete. 2024-09-20T19:03:25.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:25 smithi027 ceph-mon[28196]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 7 op/s 2024-09-20T19:03:25.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:25 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:25.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:25 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:25.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:25 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/28571530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T19:03:25.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:25 smithi098 ceph-mon[35737]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 7 op/s 2024-09-20T19:03:25.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:25 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:25.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:25 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:25.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:25 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/28571530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T19:03:26.101 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-20T19:03:26.101 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-20T19:03:26.133 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-20T19:03:26.134 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-20T19:03:26.134 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-20T19:03:26.134 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-20T19:03:26.134 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:26.134 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-20T19:03:26.134 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-20T19:03:26.134 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:26.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:26.135 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-20T19:03:26.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:26.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-09-20T19:03:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2024-09-20T19:03:26.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:03:26.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:26.226 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-20T19:03:26.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:26.245 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-20T19:03:26.314 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-20T19:03:26.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:03:26.315 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-20T19:03:26.315 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-20T19:03:26.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-20T19:03:26.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:26 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:26.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:26 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:26.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:26 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:26.640 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:26 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:26.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:26.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:26.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:26.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:26 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:03:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:27.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 -- 172.21.15.27:0/692085106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 msgr2=0x7f31a0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 --2- 172.21.15.27:0/692085106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a0106be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3190009880 tx=0x7f319002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 -- 172.21.15.27:0/692085106 shutdown_connections 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 --2- 172.21.15.27:0/692085106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 --2- 172.21.15.27:0/692085106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a0106be0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 -- 172.21.15.27:0/692085106 >> 172.21.15.27:0/692085106 conn(0x7f31a00fc520 msgr2=0x7f31a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 -- 172.21.15.27:0/692085106 shutdown_connections 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.423+0000 7f31a5282640 1 -- 172.21.15.27:0/692085106 wait complete. 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 Processor -- start 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 -- start start 2024-09-20T19:03:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f31a010cbe0 con 0x7f31a0106800 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f31a5282640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31a010ca60 con 0x7f31a0100800 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f319effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f3197fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f319effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:43640/0 (socket says 172.21.15.27:43640) 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.424+0000 7f319effd640 1 -- 172.21.15.27:0/1990801552 learned_addr learned my addr 172.21.15.27:0/1990801552 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f3197fff640 1 -- 172.21.15.27:0/1990801552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 msgr2=0x7f31a019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f3197fff640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f3197fff640 1 -- 172.21.15.27:0/1990801552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a01999f0 con 0x7f31a0106800 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f3197fff640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a019fd70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f318800d6a0 tx=0x7f318800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3188017070 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31880054e0 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a0199ce0 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3188004b90 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.425+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a019a270 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.426+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a0101f40 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.427+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f31880097c0 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.427+0000 7f319cff9640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 0x7f318c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.427+0000 7f319effd640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 0x7f318c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.427+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f318808dc00 con 0x7f31a0106800 2024-09-20T19:03:27.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.428+0000 7f319effd640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 0x7f318c0707c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3190009230 tx=0x7f31900058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.432+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3188093020 con 0x7f31a0106800 2024-09-20T19:03:27.674 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:27 smithi027 ceph-mon[28196]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.667+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31a019af20 con 0x7f31a0106800 2024-09-20T19:03:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.668+0000 7f319cff9640 1 -- 172.21.15.27:0/1990801552 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7f318805f230 con 0x7f31a0106800 2024-09-20T19:03:27.675 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-20T19:03:27.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 msgr2=0x7f318c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 0x7f318c0707c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3190009230 tx=0x7f31900058d0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 msgr2=0x7f31a019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a019fd70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f318800d6a0 tx=0x7f318800db60 comp rx=0 tx=0).stop 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 shutdown_connections 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f318c06e300 0x7f318c0707c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a0106800 0x7f31a019fd70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 --2- 172.21.15.27:0/1990801552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a0100800 0x7f31a019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 >> 172.21.15.27:0/1990801552 conn(0x7f31a00fc520 msgr2=0x7f31a00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 shutdown_connections 2024-09-20T19:03:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:27.670+0000 7f31a5282640 1 -- 172.21.15.27:0/1990801552 wait complete. 2024-09-20T19:03:27.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:27 smithi098 ceph-mon[35737]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:28.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:28 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1990801552' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T19:03:28.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:28 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:28.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:28 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:28.886 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:28 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1990801552' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T19:03:28.886 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:28 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:28.886 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:28 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-20T19:03:28.901 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-20T19:03:28.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:28.902 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:28.919 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42343sec preferred_lft 42343sec 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-20T19:03:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:28.921 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-09-20T19:03:28.921 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-20T19:03:28.921 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:28.921 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-20T19:03:28.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2024-09-20T19:03:28.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2024-09-20T19:03:28.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2024-09-20T19:03:28.922 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-20T19:03:28.922 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-20T19:03:29.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:29.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:29.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:29.196 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-20T19:03:29.222 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-09-20T19:03:29.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:29.224 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-09-20T19:03:29.290 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-09-20T19:03:29.291 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-20T19:03:29.291 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-20T19:03:29.291 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-20T19:03:29.291 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-20T19:03:29.291 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:29.291 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-20T19:03:29.291 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-20T19:03:29.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-20T19:03:29.292 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-20T19:03:29.292 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-20T19:03:29.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:29.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:29.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:29.791 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-20T19:03:29.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:29.808 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2024-09-20T19:03:29.822 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:29 smithi027 ceph-mon[28196]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:29.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:29 smithi098 ceph-mon[35737]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:29.837 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:29.837 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-20T19:03:29.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:29.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-20T19:03:29.837 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-20T19:03:29.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:29.956 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-20T19:03:29.957 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-20T19:03:30.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:30.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:30.106 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:30.106 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-20T19:03:30.106 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2024-09-20T19:03:30.106 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2024-09-20T19:03:30.107 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-20T19:03:30.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:30.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:30.195 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-20T19:03:30.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T19:03:30.195 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:30.222 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-20T19:03:30.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T19:03:30.223 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:30.278 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2024-09-20T19:03:30.346 DEBUG:teuthology.orchestra.run.smithi027:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T19:03:30.403 INFO:teuthology.orchestra.run.smithi027.stdout:/proc 2024-09-20T19:03:30.403 INFO:teuthology.orchestra.run.smithi027.stdout:/sys 2024-09-20T19:03:30.403 INFO:teuthology.orchestra.run.smithi027.stdout:/dev 2024-09-20T19:03:30.403 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/security 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/shm 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/pts 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/run 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/pstore 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/bpf 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/ 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/selinux 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:30.404 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/mqueue 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/hugepages 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/debug 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/tracing 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/fuse/connections 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/config 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/1000 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/ceph 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay 2024-09-20T19:03:30.405 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/4a23994c11b8da0c7881fa66c6f39ea6ce47956f9ac778e2593f875065061bb6/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/89fedce8dcdcccb18e01f7f0f15a5b7a7e342079c54baca8209a7819c5895aeb/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/0 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/5cdc0c10d3adfde5b438b6bd806bfa6833b52b19a7ecae6920477f9b5e26d93d/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/306c469ab738bd9d29077f8064b1635d843aaf94d59d619ccdf0bb91df6e2825/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/63fa37b4a65befc99c383d8fb6d0fa10d60735a5e2c2bc218fced7608e769ea6/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/55c67d9c1c4288176ce9d8e14887377c1f9eb5b9c16f7eef56877f2b5a7431ea/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/0eb10d146591037ce723c8c5adcf3fe83d45cfca61784ca418b8e8de12755844/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/6f94694bee3fa101f2ecce36e0e7136056f762e010c5eb8929535d99dcc98379/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/c407cff1d76afd35c54c59cb940e37b17b9e329b9dce70b033852de256cdb3c4/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/b04fc76dd9fc0a2e3161ebc633218a237a260e02d7304604b8b673f47c90f6ca/merged 2024-09-20T19:03:30.406 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/8c2c75ce65ef9f1dd8a6c842d4bf02449ad0dfdc50784ffb9d4b433e3a780ccb/merged 2024-09-20T19:03:30.407 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/58004d300d1db44975ce529fd810a7aa06324dc02c0f622a7d0dbf88a10788a1/merged 2024-09-20T19:03:30.407 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/f3e523c0ea9996c8975001a4d455d688a0d799405d7d742cd2fe6c5cf8a851e0/merged 2024-09-20T19:03:30.407 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns 2024-09-20T19:03:30.407 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:30.408 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:30.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:30.408 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2024-09-20T19:03:30.461 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-20T19:03:30.461 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-20T19:03:30.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2024-09-20T19:03:30.531 DEBUG:teuthology.orchestra.run.smithi027:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T19:03:30.588 INFO:teuthology.orchestra.run.smithi027.stdout:/proc 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/dev 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/security 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/shm 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/pts 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/run 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/pstore 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/bpf 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/ 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/selinux 2024-09-20T19:03:30.589 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/mqueue 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/hugepages 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/debug 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/tracing 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/fuse/connections 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/config 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/1000 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/ceph 2024-09-20T19:03:30.590 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/4a23994c11b8da0c7881fa66c6f39ea6ce47956f9ac778e2593f875065061bb6/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/89fedce8dcdcccb18e01f7f0f15a5b7a7e342079c54baca8209a7819c5895aeb/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/0 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/5cdc0c10d3adfde5b438b6bd806bfa6833b52b19a7ecae6920477f9b5e26d93d/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/306c469ab738bd9d29077f8064b1635d843aaf94d59d619ccdf0bb91df6e2825/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/63fa37b4a65befc99c383d8fb6d0fa10d60735a5e2c2bc218fced7608e769ea6/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/55c67d9c1c4288176ce9d8e14887377c1f9eb5b9c16f7eef56877f2b5a7431ea/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/0eb10d146591037ce723c8c5adcf3fe83d45cfca61784ca418b8e8de12755844/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/6f94694bee3fa101f2ecce36e0e7136056f762e010c5eb8929535d99dcc98379/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/c407cff1d76afd35c54c59cb940e37b17b9e329b9dce70b033852de256cdb3c4/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/b04fc76dd9fc0a2e3161ebc633218a237a260e02d7304604b8b673f47c90f6ca/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/8c2c75ce65ef9f1dd8a6c842d4bf02449ad0dfdc50784ffb9d4b433e3a780ccb/merged 2024-09-20T19:03:30.591 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/58004d300d1db44975ce529fd810a7aa06324dc02c0f622a7d0dbf88a10788a1/merged 2024-09-20T19:03:30.592 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/f3e523c0ea9996c8975001a4d455d688a0d799405d7d742cd2fe6c5cf8a851e0/merged 2024-09-20T19:03:30.592 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns 2024-09-20T19:03:30.592 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:30.592 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:30.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:30.592 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2024-09-20T19:03:30.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:2024-09-20T19:03:30.640+0000 7f46036fd480 -1 init, newargv = 0x5609df0fa180 newargc=15 2024-09-20T19:03:30.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[76300]: starting ceph client 2024-09-20T19:03:30.651 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[76300]: starting fuse 2024-09-20T19:03:31.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:31 smithi027 ceph-mon[28196]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:31.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:31 smithi098 ceph-mon[35737]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T19:03:31.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2024-09-20T19:03:31.776 DEBUG:teuthology.orchestra.run.smithi027:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T19:03:31.832 INFO:teuthology.orchestra.run.smithi027.stdout:/proc 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/dev 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/security 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/shm 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/pts 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/run 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/pstore 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/bpf 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/ 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/selinux 2024-09-20T19:03:31.833 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/mqueue 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/hugepages 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/debug 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/tracing 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/fuse/connections 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/config 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/1000 2024-09-20T19:03:31.834 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/ceph 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/4a23994c11b8da0c7881fa66c6f39ea6ce47956f9ac778e2593f875065061bb6/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/89fedce8dcdcccb18e01f7f0f15a5b7a7e342079c54baca8209a7819c5895aeb/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/0 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/5cdc0c10d3adfde5b438b6bd806bfa6833b52b19a7ecae6920477f9b5e26d93d/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/306c469ab738bd9d29077f8064b1635d843aaf94d59d619ccdf0bb91df6e2825/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/63fa37b4a65befc99c383d8fb6d0fa10d60735a5e2c2bc218fced7608e769ea6/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/55c67d9c1c4288176ce9d8e14887377c1f9eb5b9c16f7eef56877f2b5a7431ea/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/0eb10d146591037ce723c8c5adcf3fe83d45cfca61784ca418b8e8de12755844/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/6f94694bee3fa101f2ecce36e0e7136056f762e010c5eb8929535d99dcc98379/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/c407cff1d76afd35c54c59cb940e37b17b9e329b9dce70b033852de256cdb3c4/merged 2024-09-20T19:03:31.835 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/b04fc76dd9fc0a2e3161ebc633218a237a260e02d7304604b8b673f47c90f6ca/merged 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/8c2c75ce65ef9f1dd8a6c842d4bf02449ad0dfdc50784ffb9d4b433e3a780ccb/merged 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/58004d300d1db44975ce529fd810a7aa06324dc02c0f622a7d0dbf88a10788a1/merged 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/containers/storage/overlay/f3e523c0ea9996c8975001a4d455d688a0d799405d7d742cd2fe6c5cf8a851e0/merged 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T19:03:31.836 INFO:teuthology.orchestra.run.smithi027.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:31.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:31.837 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2024-09-20T19:03:31.893 INFO:teuthology.orchestra.run.smithi027.stdout:138 2024-09-20T19:03:31.893 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [138] 2024-09-20T19:03:31.893 DEBUG:teuthology.orchestra.run.smithi027:> sudo stdin-killer -- python3 -c ' 2024-09-20T19:03:31.893 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2024-09-20T19:03:31.893 DEBUG:teuthology.orchestra.run.smithi027:> import re 2024-09-20T19:03:31.893 DEBUG:teuthology.orchestra.run.smithi027:> import os 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> 2024-09-20T19:03:31.894 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> return f 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.0")) 2024-09-20T19:03:31.895 DEBUG:teuthology.orchestra.run.smithi027:> ' 2024-09-20T19:03:32.013 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.0.76300.asok 2024-09-20T19:03:32.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:32.023 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76300.asok 2024-09-20T19:03:32.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:32.023 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76300.asok status 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "ed8ee0f26ef720e6504cefa8be1a2d0872192de7", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "0", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "76300", 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:03:32.161 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 14610, 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 14610 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2845282958 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:03:32.162 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "192.168.0.1:0", 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 2845282958 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.14610 192.168.0.1:0/2845282958", 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "192.168.0.1:0/2845282958", 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 16, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 47, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2024-09-20T19:03:32.163 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:03:32.169 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-20T19:03:32.169 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-20T19:03:32.426 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:32.706 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.706 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.706 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:32.706 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:32.706 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:03:32.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:03:32.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 -- 172.21.15.27:0/4004426498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 msgr2=0x7f1958106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 --2- 172.21.15.27:0/4004426498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958106be0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1954009880 tx=0x7f195402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 -- 172.21.15.27:0/4004426498 shutdown_connections 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 --2- 172.21.15.27:0/4004426498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 0x7f1958100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 --2- 172.21.15.27:0/4004426498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958106be0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.906+0000 7f195f3c9640 1 -- 172.21.15.27:0/4004426498 >> 172.21.15.27:0/4004426498 conn(0x7f19580fc520 msgr2=0x7f19580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 -- 172.21.15.27:0/4004426498 shutdown_connections 2024-09-20T19:03:32.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 -- 172.21.15.27:0/4004426498 wait complete. 2024-09-20T19:03:32.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 Processor -- start 2024-09-20T19:03:32.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 -- start start 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 0x7f19581987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.907+0000 7f195f3c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195f3c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f195810dcd0 con 0x7f1958106800 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195f3c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f195810db50 con 0x7f1958100800 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48834/0 (socket says 172.21.15.27:48834) 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 -- 172.21.15.27:0/1967009202 learned_addr learned my addr 172.21.15.27:0/1967009202 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195d165640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 0x7f19581987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 -- 172.21.15.27:0/1967009202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 msgr2=0x7f19581987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 0x7f19581987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 -- 172.21.15.27:0/1967009202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1958199360 con 0x7f1958106800 2024-09-20T19:03:32.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195c964640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f194c00e970 tx=0x7f194c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:32.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f194c00cac0 con 0x7f1958106800 2024-09-20T19:03:32.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f194c0054e0 con 0x7f1958106800 2024-09-20T19:03:32.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19581a1840 con 0x7f1958106800 2024-09-20T19:03:32.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f194c010430 con 0x7f1958106800 2024-09-20T19:03:32.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.908+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19581a1c40 con 0x7f1958106800 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.910+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1958101f40 con 0x7f1958106800 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.910+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f194c004f00 con 0x7f1958106800 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.911+0000 7f194a7fc640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 0x7f19440707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.911+0000 7f195d165640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 0x7f19440707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.911+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f194c08e710 con 0x7f1958106800 2024-09-20T19:03:32.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.911+0000 7f195d165640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 0x7f19440707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19540096c0 tx=0x7f1954031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:32.915+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f194c05c090 con 0x7f1958106800 2024-09-20T19:03:33.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.127+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1958108d70 con 0x7f1958106800 2024-09-20T19:03:33.134 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-20T19:03:33.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.128+0000 7f194a7fc640 1 -- 172.21.15.27:0/1967009202 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7f194c05fd40 con 0x7f1958106800 2024-09-20T19:03:33.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 msgr2=0x7f19440707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:33.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 0x7f19440707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19540096c0 tx=0x7f1954031400 comp rx=0 tx=0).stop 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 msgr2=0x7f1958198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f194c00e970 tx=0x7f194c00ed70 comp rx=0 tx=0).stop 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 shutdown_connections 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f194406e310 0x7f19440707d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1958106800 0x7f1958198d10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 --2- 172.21.15.27:0/1967009202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1958100800 0x7f19581987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 >> 172.21.15.27:0/1967009202 conn(0x7f19580fc520 msgr2=0x7f19580fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 shutdown_connections 2024-09-20T19:03:33.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:33.130+0000 7f195f3c9640 1 -- 172.21.15.27:0/1967009202 wait complete. 2024-09-20T19:03:33.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:33 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1967009202' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T19:03:33.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:33 smithi098 ceph-mon[35737]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T19:03:33.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:33 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1967009202' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T19:03:33.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:33 smithi027 ceph-mon[28196]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T19:03:33.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-20T19:03:33.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-20T19:03:33.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-20T19:03:33.770 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-20T19:03:33.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:33.770 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-20T19:03:33.790 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42299sec preferred_lft 42299sec 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-20T19:03:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-20T19:03:33.791 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-20T19:03:33.792 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-20T19:03:33.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:34.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:34.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:34.015 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-20T19:03:34.039 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-20T19:03:34.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:34.042 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-20T19:03:34.108 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-20T19:03:34.109 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-20T19:03:34.109 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-20T19:03:34.109 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-20T19:03:34.109 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-20T19:03:34.109 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-20T19:03:34.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:34.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:34.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:34.418 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-20T19:03:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:34.434 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-20T19:03:34.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:34.491 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:34.491 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-20T19:03:34.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T19:03:34.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-20T19:03:34.491 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-20T19:03:34.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:34.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:34.608 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-20T19:03:34.608 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:34.608 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-20T19:03:34.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-20T19:03:34.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-20T19:03:34.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-20T19:03:34.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-20T19:03:34.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-20T19:03:34.609 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-20T19:03:34.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:34.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:34.731 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T19:03:34.732 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-20T19:03:34.732 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-20T19:03:34.732 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2024-09-20T19:03:34.732 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-20T19:03:34.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T19:03:34.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:34.807 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-20T19:03:34.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T19:03:34.807 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:34.822 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-20T19:03:34.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T19:03:34.822 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:34.823 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:34.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2024-09-20T19:03:34.956 DEBUG:teuthology.orchestra.run.smithi098:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T19:03:35.012 INFO:teuthology.orchestra.run.smithi098.stdout:/proc 2024-09-20T19:03:35.012 INFO:teuthology.orchestra.run.smithi098.stdout:/sys 2024-09-20T19:03:35.012 INFO:teuthology.orchestra.run.smithi098.stdout:/dev 2024-09-20T19:03:35.012 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/security 2024-09-20T19:03:35.012 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/shm 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/pts 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/run 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/cgroup 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/pstore 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/bpf 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/ 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/selinux 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/mqueue 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/debug 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/hugepages 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/tracing 2024-09-20T19:03:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/fuse/connections 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/config 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/1000 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/ceph 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/0 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/f8d329487fba49760eee5c90220b2660dac7888bf77715b1c0506c8ed43428db/merged 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/7d7afa835529ba81e1358de67cd6560476af7ab43de9de2fb6437ef6fdf4edce/merged 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0dce8f90304b3cb7201e74d4d581eff8f6dc8e2b25f3513a020a4b382ae4cb30/merged 2024-09-20T19:03:35.014 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/ac87580da9a6d43bea09a6204894a8b13b0da02aa29c3138a025f85ef0045c86/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/ceceeb56f460b84248ef71eab28b703df1d9f97ddf89bc3437f8eee66e88671f/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d604b7af71cef0550d4469c66eded3bb5fd925749c32b34a8dfadec1c7113c6f/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0a25bea6e309746e02ec66599f11e9e032b8981c6a99e9a1d4137d2d139f457e/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/afc301b522330b77b68cda73057f65507981c42e79288bbf21e096a8dc1468ba/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/aaa2798d6e1bbb7c74862eeb3b6636de48e264dcc675f342887f7e19735e7c74/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d65cce7431acfbc2f621e901a9db3d6600e37505b12fb65efbdc67742dbc97d6/merged 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T19:03:35.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.015 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2024-09-20T19:03:35.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-20T19:03:35.068 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-20T19:03:35.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2024-09-20T19:03:35.135 DEBUG:teuthology.orchestra.run.smithi098:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T19:03:35.191 INFO:teuthology.orchestra.run.smithi098.stdout:/proc 2024-09-20T19:03:35.191 INFO:teuthology.orchestra.run.smithi098.stdout:/sys 2024-09-20T19:03:35.191 INFO:teuthology.orchestra.run.smithi098.stdout:/dev 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/security 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/shm 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/pts 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/run 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/cgroup 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/pstore 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/bpf 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/ 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/selinux 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/mqueue 2024-09-20T19:03:35.192 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/debug 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/hugepages 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/tracing 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/fuse/connections 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/config 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/1000 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/ceph 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/0 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T19:03:35.193 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/f8d329487fba49760eee5c90220b2660dac7888bf77715b1c0506c8ed43428db/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/7d7afa835529ba81e1358de67cd6560476af7ab43de9de2fb6437ef6fdf4edce/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0dce8f90304b3cb7201e74d4d581eff8f6dc8e2b25f3513a020a4b382ae4cb30/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/ac87580da9a6d43bea09a6204894a8b13b0da02aa29c3138a025f85ef0045c86/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/ceceeb56f460b84248ef71eab28b703df1d9f97ddf89bc3437f8eee66e88671f/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d604b7af71cef0550d4469c66eded3bb5fd925749c32b34a8dfadec1c7113c6f/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0a25bea6e309746e02ec66599f11e9e032b8981c6a99e9a1d4137d2d139f457e/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/afc301b522330b77b68cda73057f65507981c42e79288bbf21e096a8dc1468ba/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/aaa2798d6e1bbb7c74862eeb3b6636de48e264dcc675f342887f7e19735e7c74/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d65cce7431acfbc2f621e901a9db3d6600e37505b12fb65efbdc67742dbc97d6/merged 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns 2024-09-20T19:03:35.194 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T19:03:35.195 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T19:03:35.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.195 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2024-09-20T19:03:35.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:2024-09-20T19:03:35.220+0000 7f141eb62480 -1 init, newargv = 0x559e80b2d100 newargc=15 2024-09-20T19:03:35.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:ceph-fuse[61608]: starting ceph client 2024-09-20T19:03:35.231 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi098.stderr:ceph-fuse[61608]: starting fuse 2024-09-20T19:03:35.243 INFO:teuthology.orchestra.run.smithi098.stdout:129 2024-09-20T19:03:35.243 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-20T19:03:35.243 DEBUG:teuthology.orchestra.run.smithi098:> sudo stdin-killer -- python3 -c ' 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> import re 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> import os 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2024-09-20T19:03:35.244 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> return f 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.1")) 2024-09-20T19:03:35.245 DEBUG:teuthology.orchestra.run.smithi098:> ' 2024-09-20T19:03:35.360 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.1.61608.asok 2024-09-20T19:03:35.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-20T19:03:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T19:03:35.370 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61608.asok 2024-09-20T19:03:35.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61608.asok status 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "ed8ee0f26ef720e6504cefa8be1a2d0872192de7", 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "1", 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2024-09-20T19:03:35.507 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "61608", 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24381, 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 24381 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-20T19:03:35.508 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3323058285 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3323058285 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.24381 192.168.0.1:0/3323058285", 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/3323058285", 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 16, 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 47, 2024-09-20T19:03:35.509 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2024-09-20T19:03:35.510 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2024-09-20T19:03:35.510 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2024-09-20T19:03:35.510 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-20T19:03:35.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.515 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2024-09-20T19:03:35.515 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.536 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2024-09-20T19:03:35.536 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.537 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.611 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2024-09-20T19:03:35.611 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.627 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2024-09-20T19:03:35.627 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:03:35.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.689 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:35 smithi098 ceph-mon[35737]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.8 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-20T19:03:35.695 INFO:teuthology.run_tasks:Running task print... 2024-09-20T19:03:35.714 INFO:teuthology.task.print:**** done client 2024-09-20T19:03:35.714 INFO:teuthology.run_tasks:Running task parallel... 2024-09-20T19:03:35.764 INFO:teuthology.task.parallel:starting parallel... 2024-09-20T19:03:35.764 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-20T19:03:35.765 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T19:03:35.765 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:03:35.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-20T19:03:35.766 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-20T19:03:35.766 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-20T19:03:35.770 INFO:tasks.workunit:Pulling workunits from ref 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:03:35.770 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-20T19:03:35.770 INFO:tasks.workunit:timeout=3h 2024-09-20T19:03:35.770 INFO:tasks.workunit:cleanup=True 2024-09-20T19:03:35.771 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-20T19:03:35.792 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 8ah/138d Inode: 1 Links: 2 2024-09-20T19:03:35.792 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T19:03:35.792 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-20T19:03:35.793 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-20T19:03:35.793 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-20 19:03:10.299092237 +0000 2024-09-20T19:03:35.793 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-20 19:03:35.603020973 +0000 2024-09-20T19:03:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-09-20T19:03:35.793 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-20T19:03:35.793 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-20T19:03:35.797 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:35 smithi027 ceph-mon[28196]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 7.8 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-20T19:03:35.832 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-20 19:03:35.820930177 +0000 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-20 19:03:35.820930177 +0000 2024-09-20T19:03:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-20T19:03:35.849 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-20T19:03:35.849 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-20T19:03:35.919 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:03:35.919 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:03:35.936 INFO:tasks.workunit.client.0.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-20T19:03:35.975 INFO:tasks.workunit.client.1.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-20T19:03:36.047 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 -- 172.21.15.27:0/3335009607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28101a60 msgr2=0x7f6f28101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 --2- 172.21.15.27:0/3335009607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28101a60 0x7f6f28101ee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009880 tx=0x7f6f1802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 -- 172.21.15.27:0/3335009607 shutdown_connections 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 --2- 172.21.15.27:0/3335009607 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28101a60 0x7f6f28101ee0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 --2- 172.21.15.27:0/3335009607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28100860 0x7f6f28100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 -- 172.21.15.27:0/3335009607 >> 172.21.15.27:0/3335009607 conn(0x7f6f280fc010 msgr2=0x7f6f280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:36.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 -- 172.21.15.27:0/3335009607 shutdown_connections 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.522+0000 7f6f3061c640 1 -- 172.21.15.27:0/3335009607 wait complete. 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 Processor -- start 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 -- start start 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28101a60 0x7f6f281969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6f28109720 con 0x7f6f28100860 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f3061c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281095a0 con 0x7f6f28101a60 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58846/0 (socket says 172.21.15.27:58846) 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 -- 172.21.15.27:0/760102215 learned_addr learned my addr 172.21.15.27:0/760102215 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2dbb7640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28101a60 0x7f6f281969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 -- 172.21.15.27:0/760102215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28101a60 msgr2=0x7f6f281969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:36.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28101a60 0x7f6f281969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.523+0000 7f6f2e3b8640 1 -- 172.21.15.27:0/760102215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28197020 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f2e3b8640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400b3d0 tx=0x7f6f2400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f24015020 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2819ba60 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f24011af0 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f24010da0 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.524+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2819c040 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.525+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f28109f00 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.525+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6f24018020 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.526+0000 7f6f1f7fe640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 0x7f6f140707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.526+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f6f2408dc80 con 0x7f6f28100860 2024-09-20T19:03:36.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.526+0000 7f6f2dbb7640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 0x7f6f140707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:36.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.527+0000 7f6f2dbb7640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 0x7f6f140707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000c00 tx=0x7f6f180058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:36.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.530+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f2401f020 con 0x7f6f28100860 2024-09-20T19:03:36.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.710+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f6f2802db50 con 0x7f6f28100860 2024-09-20T19:03:36.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.710+0000 7f6f1f7fe640 1 -- 172.21.15.27:0/760102215 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7f6f2405b600 con 0x7f6f28100860 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 msgr2=0x7f6f140707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 0x7f6f140707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000c00 tx=0x7f6f180058d0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 msgr2=0x7f6f28196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400b3d0 tx=0x7f6f2400b890 comp rx=0 tx=0).stop 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 shutdown_connections 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6f1406e310 0x7f6f140707d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f28101a60 0x7f6f281969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 --2- 172.21.15.27:0/760102215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f28100860 0x7f6f28196460 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 >> 172.21.15.27:0/760102215 conn(0x7f6f280fc010 msgr2=0x7f6f28104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 shutdown_connections 2024-09-20T19:03:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:36.713+0000 7f6f3061c640 1 -- 172.21.15.27:0/760102215 wait complete. 2024-09-20T19:03:37.311 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-20T19:03:37.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:37 smithi027 ceph-mon[28196]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:03:37.614 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:37.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:37 smithi098 ceph-mon[35737]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:03:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 -- 172.21.15.27:0/1509230275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 msgr2=0x7f3ae0107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1509230275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0107190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009880 tx=0x7f3ad402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 -- 172.21.15.27:0/1509230275 shutdown_connections 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1509230275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0107190 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1509230275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 0x7f3ae0104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 -- 172.21.15.27:0/1509230275 >> 172.21.15.27:0/1509230275 conn(0x7f3ae00fc010 msgr2=0x7f3ae00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 -- 172.21.15.27:0/1509230275 shutdown_connections 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.070+0000 7f3ae789f640 1 -- 172.21.15.27:0/1509230275 wait complete. 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 Processor -- start 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 -- start start 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 0x7f3ae01975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae010a800 con 0x7f3ae0104da0 2024-09-20T19:03:38.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.071+0000 7f3ae789f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae010a680 con 0x7f3ae0102470 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58866/0 (socket says 172.21.15.27:58866) 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 -- 172.21.15.27:0/1351624264 learned_addr learned my addr 172.21.15.27:0/1351624264 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae563b640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 0x7f3ae01975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 -- 172.21.15.27:0/1351624264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 msgr2=0x7f3ae01975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 0x7f3ae01975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 -- 172.21.15.27:0/1351624264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae0198160 con 0x7f3ae0104da0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae4e3a640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009230 tx=0x7f3ad40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ad403f070 con 0x7f3ae0104da0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019cb40 con 0x7f3ae0104da0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ad40044d0 con 0x7f3ae0104da0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.072+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4035030 con 0x7f3ae0104da0 2024-09-20T19:03:38.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.073+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae019d150 con 0x7f3ae0104da0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.073+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae0102850 con 0x7f3ae0104da0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.074+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3ad4042070 con 0x7f3ae0104da0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.074+0000 7f3ade7fc640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 0x7f3ac8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.075+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f3ad40aeed0 con 0x7f3ae0104da0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.075+0000 7f3ae563b640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 0x7f3ac8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.075+0000 7f3ae563b640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 0x7f3ac8070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009990 tx=0x7f3ad8009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:38.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.079+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ad407c730 con 0x7f3ae0104da0 2024-09-20T19:03:38.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.254+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f3ae019da00 con 0x7f3ae0104da0 2024-09-20T19:03:38.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.254+0000 7f3ade7fc640 1 -- 172.21.15.27:0/1351624264 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7f3ad40803e0 con 0x7f3ae0104da0 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 msgr2=0x7f3ac8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 0x7f3ac8070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009990 tx=0x7f3ad8009110 comp rx=0 tx=0).stop 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 msgr2=0x7f3ae0197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009230 tx=0x7f3ad40048f0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 shutdown_connections 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f3ac806e2b0 0x7f3ac8070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ae0104da0 0x7f3ae0197ae0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 --2- 172.21.15.27:0/1351624264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae0102470 0x7f3ae01975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:38.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 >> 172.21.15.27:0/1351624264 conn(0x7f3ae00fc010 msgr2=0x7f3ae00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:38.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 shutdown_connections 2024-09-20T19:03:38.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:38.257+0000 7f3ae789f640 1 -- 172.21.15.27:0/1351624264 wait complete. 2024-09-20T19:03:38.893 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-20T19:03:39.150 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:39.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:39 smithi027 ceph-mon[28196]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-20T19:03:39.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 -- 172.21.15.27:0/883879477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 msgr2=0x7fb924107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:39.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/883879477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924107170 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb914009880 tx=0x7fb91402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 -- 172.21.15.27:0/883879477 shutdown_connections 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/883879477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924107170 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/883879477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 -- 172.21.15.27:0/883879477 >> 172.21.15.27:0/883879477 conn(0x7fb9240fc010 msgr2=0x7fb9240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 -- 172.21.15.27:0/883879477 shutdown_connections 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.601+0000 7fb92aeb4640 1 -- 172.21.15.27:0/883879477 wait complete. 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 Processor -- start 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 -- start start 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb92410a740 con 0x7fb924104d80 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb92aeb4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb92410a5c0 con 0x7fb924102450 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:39.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58894/0 (socket says 172.21.15.27:58894) 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 -- 172.21.15.27:0/1001866689 learned_addr learned my addr 172.21.15.27:0/1001866689 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb928c50640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 -- 172.21.15.27:0/1001866689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 msgr2=0x7fb924101d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924101d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb91bfff640 1 -- 172.21.15.27:0/1001866689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924100940 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.602+0000 7fb928c50640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb91bfff640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb914006010 tx=0x7fb9140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb91403f070 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb924100c30 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb914004a50 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb914035030 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.603+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241011c0 con 0x7fb924104d80 2024-09-20T19:03:39.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.604+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb924102830 con 0x7fb924104d80 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.604+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb914042070 con 0x7fb924104d80 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.605+0000 7fb919ffb640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 0x7fb90c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.605+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fb9140aec80 con 0x7fb924104d80 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.605+0000 7fb928c50640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 0x7fb90c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.606+0000 7fb928c50640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 0x7fb90c0707d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9200058c0 tx=0x7fb920005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:39.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.610+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb91407c600 con 0x7fb924104d80 2024-09-20T19:03:39.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:39 smithi098 ceph-mon[35737]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-20T19:03:39.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.786+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fb92419fb80 con 0x7fb924104d80 2024-09-20T19:03:39.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.787+0000 7fb919ffb640 1 -- 172.21.15.27:0/1001866689 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7fb9140802b0 con 0x7fb924104d80 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 msgr2=0x7fb90c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 0x7fb90c0707d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9200058c0 tx=0x7fb920005850 comp rx=0 tx=0).stop 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 msgr2=0x7fb924100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb914006010 tx=0x7fb9140045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 shutdown_connections 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fb90c06e310 0x7fb90c0707d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb924104d80 0x7fb924100400 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 --2- 172.21.15.27:0/1001866689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb924102450 0x7fb924101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:39.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 >> 172.21.15.27:0/1001866689 conn(0x7fb9240fc010 msgr2=0x7fb9240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:39.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 shutdown_connections 2024-09-20T19:03:39.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:39.789+0000 7fb92aeb4640 1 -- 172.21.15.27:0/1001866689 wait complete. 2024-09-20T19:03:40.393 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-20T19:03:40.654 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:03:41.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.132+0000 7fbe4a412640 1 -- 172.21.15.27:0/2773293806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe44104d20 msgr2=0x7fbe44107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:41.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.132+0000 7fbe4a412640 1 --2- 172.21.15.27:0/2773293806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe44104d20 0x7fbe44107110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbe380098b0 tx=0x7fbe3802a4d0 comp rx=0 tx=0).stop 2024-09-20T19:03:41.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 -- 172.21.15.27:0/2773293806 shutdown_connections 2024-09-20T19:03:41.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 --2- 172.21.15.27:0/2773293806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe44104d20 0x7fbe44107110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:41.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 --2- 172.21.15.27:0/2773293806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe441023f0 0x7fbe441047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 -- 172.21.15.27:0/2773293806 >> 172.21.15.27:0/2773293806 conn(0x7fbe440fc010 msgr2=0x7fbe440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 -- 172.21.15.27:0/2773293806 shutdown_connections 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 -- 172.21.15.27:0/2773293806 wait complete. 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 Processor -- start 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.133+0000 7fbe4a412640 1 -- start start 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe4a412640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe4a412640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe44104d20 0x7fbe44197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe4a412640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4410a7b0 con 0x7fbe441023f0 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe4a412640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4410a630 con 0x7fbe44104d20 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58898/0 (socket says 172.21.15.27:58898) 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 -- 172.21.15.27:0/4201763625 learned_addr learned my addr 172.21.15.27:0/4201763625 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:03:41.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe437fe640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe44104d20 0x7fbe44197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 -- 172.21.15.27:0/4201763625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe44104d20 msgr2=0x7fbe44197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe44104d20 0x7fbe44197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 -- 172.21.15.27:0/4201763625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe44198130 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe43fff640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400d6f0 tx=0x7fbe3400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.134+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe34017070 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.135+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4419cb70 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.135+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe3400de00 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.135+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe34004bb0 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.135+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4419d0d0 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.136+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe441027d0 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.136+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbe34004e60 con 0x7fbe441023f0 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.137+0000 7fbe417fa640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 0x7fbe2c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:41.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.137+0000 7fbe437fe640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 0x7fbe2c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.137+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fbe3408ddc0 con 0x7fbe441023f0 2024-09-20T19:03:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.137+0000 7fbe437fe640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 0x7fbe2c070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006010 tx=0x7fbe38009580 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.141+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe3405b6c0 con 0x7fbe441023f0 2024-09-20T19:03:41.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:41 smithi027 ceph-mon[28196]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-20T19:03:41.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:03:41.334+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7fbe44105760 con 0x7fbe2c06e2b0 2024-09-20T19:03:41.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:41 smithi098 ceph-mon[35737]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-20T19:03:42.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:42 smithi027 ceph-mon[28196]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:42.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:42 smithi098 ceph-mon[35737]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:43.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:43 smithi027 ceph-mon[28196]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-20T19:03:43.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:43 smithi098 ceph-mon[35737]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-20T19:03:45.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:45 smithi098 ceph-mon[35737]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-20T19:03:45.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:45 smithi027 ceph-mon[28196]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-20T19:03:47.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:47 smithi027 ceph-mon[28196]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-20T19:03:47.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:47 smithi098 ceph-mon[35737]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-20T19:03:49.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:49.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:49 smithi027 ceph-mon[28196]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-20T19:03:49.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:03:49.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:49 smithi098 ceph-mon[35737]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-20T19:03:51.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:51 smithi027 ceph-mon[28196]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-20T19:03:51.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:51 smithi098 ceph-mon[35737]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-20T19:03:53.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:53 smithi027 ceph-mon[28196]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-20T19:03:53.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:53 smithi098 ceph-mon[35737]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-20T19:03:55.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:55 smithi098 ceph-mon[35737]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-20T19:03:55.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:55 smithi027 ceph-mon[28196]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-20T19:03:57.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:57 smithi027 ceph-mon[28196]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-20T19:03:57.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:57 smithi098 ceph-mon[35737]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-20T19:03:59.528 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:03:59 smithi098 ceph-mon[35737]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:03:59.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:03:59 smithi027 ceph-mon[28196]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:01.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:01 smithi027 ceph-mon[28196]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:01.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:01 smithi098 ceph-mon[35737]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:03.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:03 smithi027 ceph-mon[28196]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:03.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:03 smithi098 ceph-mon[35737]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:04.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:04.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:05.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:05 smithi098 ceph-mon[35737]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:05.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:05 smithi027 ceph-mon[28196]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:07.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:07 smithi027 ceph-mon[28196]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:07.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:07 smithi098 ceph-mon[35737]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:09.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:09 smithi027 ceph-mon[28196]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:09.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:09 smithi098 ceph-mon[35737]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:11.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:11 smithi027 ceph-mon[28196]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:11.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:11 smithi098 ceph-mon[35737]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:13.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:13 smithi027 ceph-mon[28196]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:13.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:13 smithi098 ceph-mon[35737]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:15.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:15 smithi027 ceph-mon[28196]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:15.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:15 smithi098 ceph-mon[35737]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:15.874 INFO:teuthology.orchestra.run.smithi027.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:04:15.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.868+0000 7fbe417fa640 1 -- 172.21.15.27:0/4201763625 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7fbe44105760 con 0x7fbe2c06e2b0 2024-09-20T19:04:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 msgr2=0x7fbe2c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 0x7fbe2c070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006010 tx=0x7fbe38009580 comp rx=0 tx=0).stop 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 msgr2=0x7fbe44197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400d6f0 tx=0x7fbe3400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 shutdown_connections 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe2c06e2b0 0x7fbe2c070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe44104d20 0x7fbe44197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 --2- 172.21.15.27:0/4201763625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe441023f0 0x7fbe44197570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 >> 172.21.15.27:0/4201763625 conn(0x7fbe440fc010 msgr2=0x7fbe440fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 shutdown_connections 2024-09-20T19:04:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:15.871+0000 7fbe4a412640 1 -- 172.21.15.27:0/4201763625 wait complete. 2024-09-20T19:04:16.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-20T19:04:16.994 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:04:17.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:04:17.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:17.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:04:17.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:04:17.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:04:17.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:16 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:04:17.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:16 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.666+0000 7f8e48931640 1 -- 172.21.15.27:0/1965381707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44102470 msgr2=0x7f8e44104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.666+0000 7f8e48931640 1 --2- 172.21.15.27:0/1965381707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44102470 0x7f8e44104860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009880 tx=0x7f8e3402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 -- 172.21.15.27:0/1965381707 shutdown_connections 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 --2- 172.21.15.27:0/1965381707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44104da0 0x7f8e44107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 --2- 172.21.15.27:0/1965381707 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44102470 0x7f8e44104860 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 -- 172.21.15.27:0/1965381707 >> 172.21.15.27:0/1965381707 conn(0x7f8e440fc010 msgr2=0x7f8e440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 -- 172.21.15.27:0/1965381707 shutdown_connections 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.667+0000 7f8e48931640 1 -- 172.21.15.27:0/1965381707 wait complete. 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.668+0000 7f8e48931640 1 Processor -- start 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.668+0000 7f8e48931640 1 -- start start 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e48931640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e48931640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44104da0 0x7f8e44100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e48931640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4410a7b0 con 0x7f8e44104da0 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e48931640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4410a630 con 0x7f8e44102470 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:36776/0 (socket says 172.21.15.27:36776) 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 -- 172.21.15.27:0/950795700 learned_addr learned my addr 172.21.15.27:0/950795700 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e41d9b640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44104da0 0x7f8e44100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:17.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 -- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44104da0 msgr2=0x7f8e44100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44104da0 0x7f8e44100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.669+0000 7f8e4259c640 1 -- 172.21.15.27:0/950795700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4419b150 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e4259c640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009230 tx=0x7f8e34004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e3403f070 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e44100960 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e34004a90 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e34035030 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.670+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e44100e90 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.671+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4410af90 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.672+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8e34042070 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.673+0000 7f8e337fe640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 0x7f8e2c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.673+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f8e340aebf0 con 0x7f8e44102470 2024-09-20T19:04:17.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.673+0000 7f8e41d9b640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 0x7f8e2c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.674+0000 7f8e41d9b640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 0x7f8e2c0707c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e44101ae0 tx=0x7f8e38005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:17.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.682+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e34080220 con 0x7f8e44102470 2024-09-20T19:04:17.940 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:17 smithi027 ceph-mon[28196]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:04:17.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:17 smithi027 ceph-mon[28196]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:17.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.934+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e44105720 con 0x7f8e2c06e300 2024-09-20T19:04:17.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.935+0000 7f8e337fe640 1 -- 172.21.15.27:0/950795700 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f8e44105720 con 0x7f8e2c06e300 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.937+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 msgr2=0x7f8e2c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.937+0000 7f8e48931640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 0x7f8e2c0707c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e44101ae0 tx=0x7f8e38005f90 comp rx=0 tx=0).stop 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.937+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 msgr2=0x7f8e44101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.937+0000 7f8e48931640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009230 tx=0x7f8e34004570 comp rx=0 tx=0).stop 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 shutdown_connections 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f8e2c06e300 0x7f8e2c0707c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e44104da0 0x7f8e44100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 --2- 172.21.15.27:0/950795700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e44102470 0x7f8e44101d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 >> 172.21.15.27:0/950795700 conn(0x7f8e440fc010 msgr2=0x7f8e440fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 shutdown_connections 2024-09-20T19:04:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:17.938+0000 7f8e48931640 1 -- 172.21.15.27:0/950795700 wait complete. 2024-09-20T19:04:17.955 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:04:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 -- 172.21.15.27:0/1865065791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc104d20 msgr2=0x7f60fc107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 --2- 172.21.15.27:0/1865065791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc104d20 0x7f60fc107110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f60f00098b0 tx=0x7f60f002a4d0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 -- 172.21.15.27:0/1865065791 shutdown_connections 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 --2- 172.21.15.27:0/1865065791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc104d20 0x7f60fc107110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 --2- 172.21.15.27:0/1865065791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc1023f0 0x7f60fc1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 -- 172.21.15.27:0/1865065791 >> 172.21.15.27:0/1865065791 conn(0x7f60fc0fc010 msgr2=0x7f60fc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 -- 172.21.15.27:0/1865065791 shutdown_connections 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.047+0000 7f6101a81640 1 -- 172.21.15.27:0/1865065791 wait complete. 2024-09-20T19:04:18.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.048+0000 7f6101a81640 1 Processor -- start 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.048+0000 7f6101a81640 1 -- start start 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.048+0000 7f6101a81640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.048+0000 7f6101a81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 0x7f60fc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f6101a81640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc10a7b0 con 0x7f60fc1023f0 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f6101a81640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc10a630 con 0x7f60fc104d20 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48768/0 (socket says 172.21.15.27:48768) 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 -- 172.21.15.27:0/2888397714 learned_addr learned my addr 172.21.15.27:0/2888397714 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60faffd640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 0x7f60fc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 -- 172.21.15.27:0/2888397714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 msgr2=0x7f60fc197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 0x7f60fc197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60fb7fe640 1 -- 172.21.15.27:0/2888397714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc1980f0 con 0x7f60fc1023f0 2024-09-20T19:04:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.049+0000 7f60faffd640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 0x7f60fc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f60fb7fe640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00e970 tx=0x7f60ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ec00cac0 con 0x7f60fc1023f0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60ec0054e0 con 0x7f60fc1023f0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ec010430 con 0x7f60fc1023f0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc19cb30 con 0x7f60fc1023f0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.050+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc19d090 con 0x7f60fc1023f0 2024-09-20T19:04:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.052+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60fc10af90 con 0x7f60fc1023f0 2024-09-20T19:04:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.052+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f60ec0106e0 con 0x7f60fc1023f0 2024-09-20T19:04:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.053+0000 7f60f8ff9640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 0x7f60e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.053+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f60ec08ea10 con 0x7f60fc1023f0 2024-09-20T19:04:18.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.054+0000 7f60faffd640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 0x7f60e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.054+0000 7f60faffd640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 0x7f60e4070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60f0006010 tx=0x7f60f0009640 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:18.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.057+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60ec05c270 con 0x7f60fc1023f0 2024-09-20T19:04:18.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:17 smithi098 ceph-mon[35737]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:04:18.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:17 smithi098 ceph-mon[35737]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:18.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.452+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f60fc105780 con 0x7f60e406e2b0 2024-09-20T19:04:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.454+0000 7f60f8ff9640 1 -- 172.21.15.27:0/2888397714 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f60fc105780 con 0x7f60e406e2b0 2024-09-20T19:04:18.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 msgr2=0x7f60e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 0x7f60e4070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60f0006010 tx=0x7f60f0009640 comp rx=0 tx=0).stop 2024-09-20T19:04:18.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 msgr2=0x7f60fc197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00e970 tx=0x7f60ec00ed70 comp rx=0 tx=0).stop 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 shutdown_connections 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f60e406e2b0 0x7f60e4070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60fc104d20 0x7f60fc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 --2- 172.21.15.27:0/2888397714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60fc1023f0 0x7f60fc197530 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.457+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 >> 172.21.15.27:0/2888397714 conn(0x7f60fc0fc010 msgr2=0x7f60fc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:18.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.458+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 shutdown_connections 2024-09-20T19:04:18.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.458+0000 7f6101a81640 1 -- 172.21.15.27:0/2888397714 wait complete. 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 -- 172.21.15.27:0/3659757292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 msgr2=0x7fc1e4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 --2- 172.21.15.27:0/3659757292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4104840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009880 tx=0x7fc1e002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 -- 172.21.15.27:0/3659757292 shutdown_connections 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 --2- 172.21.15.27:0/3659757292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 --2- 172.21.15.27:0/3659757292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4104840 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 -- 172.21.15.27:0/3659757292 >> 172.21.15.27:0/3659757292 conn(0x7fc1e40fc010 msgr2=0x7fc1e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:18.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.589+0000 7fc1eb758640 1 -- 172.21.15.27:0/3659757292 shutdown_connections 2024-09-20T19:04:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.590+0000 7fc1eb758640 1 -- 172.21.15.27:0/3659757292 wait complete. 2024-09-20T19:04:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.591+0000 7fc1eb758640 1 Processor -- start 2024-09-20T19:04:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.591+0000 7fc1eb758640 1 -- start start 2024-09-20T19:04:18.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.591+0000 7fc1eb758640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1eb758640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1eb758640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410a770 con 0x7fc1e4102450 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1eb758640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410a5f0 con 0x7fc1e4104d80 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e94f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:36816/0 (socket says 172.21.15.27:36816) 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 -- 172.21.15.27:0/2718868182 learned_addr learned my addr 172.21.15.27:0/2718868182 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 -- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 msgr2=0x7fc1e4197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:18.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.592+0000 7fc1e8cf3640 1 -- 172.21.15.27:0/2718868182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4198030 con 0x7fc1e4104d80 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1e8cf3640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400e970 tx=0x7fc1d400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1d400cac0 con 0x7fc1e4104d80 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e419ca70 con 0x7fc1e4104d80 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1d40054e0 con 0x7fc1e4104d80 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4010430 con 0x7fc1e4104d80 2024-09-20T19:04:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.593+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e419d000 con 0x7fc1e4104d80 2024-09-20T19:04:18.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.594+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4102830 con 0x7fc1e4104d80 2024-09-20T19:04:18.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.595+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc1d40105d0 con 0x7fc1e4104d80 2024-09-20T19:04:18.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.596+0000 7fc1da7fc640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 0x7fc1d00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:18.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.596+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fc1d408e8e0 con 0x7fc1e4104d80 2024-09-20T19:04:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.596+0000 7fc1e94f4640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 0x7fc1d00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.597+0000 7fc1e94f4640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 0x7fc1d00707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0005ab0 tx=0x7fc1e0005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:18.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.605+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1d405c1c0 con 0x7fc1e4104d80 2024-09-20T19:04:18.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.984+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc1e4105640 con 0x7fc1d006e310 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.995+0000 7fc1da7fc640 1 -- 172.21.15.27:0/2718868182 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7fc1e4105640 con 0x7fc1d006e310 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (4m) 47s ago 6m 25.3M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (6m) 47s ago 6m 8128k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (5m) 51s ago 5m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:04:19.000 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (6m) 47s ago 6m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (5m) 51s ago 5m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (4m) 47s ago 6m 80.6M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (63s) 47s ago 63s 13.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (70s) 47s ago 69s 11.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (67s) 51s ago 66s 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (61s) 51s ago 60s 12.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (7m) 47s ago 7m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (5m) 51s ago 5m 441M - 19.1.1-369-ged8ee0f2 6acb0a031eab 04b71c60ddaa 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (7m) 47s ago 8m 48.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (5m) 51s ago 5m 35.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (6m) 47s ago 6m 16.2M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:04:19.001 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 51s ago 5m 14.6M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (4m) 47s ago 4m 47.2M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (3m) 47s ago 3m 47.3M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (3m) 47s ago 3m 52.8M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (3m) 51s ago 3m 52.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (2m) 51s ago 2m 50.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (2m) 51s ago 2m 47.9M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (4m) 47s ago 6m 59.4M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:04:19.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 msgr2=0x7fc1d00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 0x7fc1d00707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0005ab0 tx=0x7fc1e0005a20 comp rx=0 tx=0).stop 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 msgr2=0x7fc1e41979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400e970 tx=0x7fc1d400ee30 comp rx=0 tx=0).stop 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 shutdown_connections 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fc1d006e310 0x7fc1d00707d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1e4104d80 0x7fc1e41979b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 --2- 172.21.15.27:0/2718868182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1e4102450 0x7fc1e4197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.997+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 >> 172.21.15.27:0/2718868182 conn(0x7fc1e40fc010 msgr2=0x7fc1e40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.998+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 shutdown_connections 2024-09-20T19:04:19.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:18.998+0000 7fc1eb758640 1 -- 172.21.15.27:0/2718868182 wait complete. 2024-09-20T19:04:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.085+0000 7ff051f19640 1 -- 172.21.15.27:0/1117499072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c102bf0 msgr2=0x7ff04c103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.085+0000 7ff051f19640 1 --2- 172.21.15.27:0/1117499072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c102bf0 0x7ff04c103070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff040009880 tx=0x7ff04002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.085+0000 7ff051f19640 1 -- 172.21.15.27:0/1117499072 shutdown_connections 2024-09-20T19:04:19.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 --2- 172.21.15.27:0/1117499072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c102bf0 0x7ff04c103070 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 --2- 172.21.15.27:0/1117499072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c0ffc10 0x7ff04c100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 -- 172.21.15.27:0/1117499072 >> 172.21.15.27:0/1117499072 conn(0x7ff04c0fb760 msgr2=0x7ff04c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 -- 172.21.15.27:0/1117499072 shutdown_connections 2024-09-20T19:04:19.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 -- 172.21.15.27:0/1117499072 wait complete. 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.086+0000 7ff051f19640 1 Processor -- start 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff051f19640 1 -- start start 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff051f19640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff051f19640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c197bf0 0x7ff04c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff051f19640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c10a790 con 0x7ff04c0ffc10 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff051f19640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c10a610 con 0x7ff04c197bf0 2024-09-20T19:04:19.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff04b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff04b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48794/0 (socket says 172.21.15.27:48794) 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff04b7fe640 1 -- 172.21.15.27:0/84937480 learned_addr learned my addr 172.21.15.27:0/84937480 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.087+0000 7ff04affd640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c197bf0 0x7ff04c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff04b7fe640 1 -- 172.21.15.27:0/84937480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c197bf0 msgr2=0x7ff04c19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff04b7fe640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c197bf0 0x7ff04c19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff04b7fe640 1 -- 172.21.15.27:0/84937480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c198120 con 0x7ff04c0ffc10 2024-09-20T19:04:19.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff04b7fe640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e940 tx=0x7ff03c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff03c00cac0 con 0x7ff04c0ffc10 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c1009e0 con 0x7ff04c0ffc10 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff03c00cc60 con 0x7ff04c0ffc10 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff03c003e30 con 0x7ff04c0ffc10 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.088+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c100f70 con 0x7ff04c0ffc10 2024-09-20T19:04:19.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.090+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c1029f0 con 0x7ff04c0ffc10 2024-09-20T19:04:19.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.090+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff03c004000 con 0x7ff04c0ffc10 2024-09-20T19:04:19.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.091+0000 7ff048ff9640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 0x7ff0340707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.091+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7ff03c08e790 con 0x7ff04c0ffc10 2024-09-20T19:04:19.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.091+0000 7ff04affd640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 0x7ff0340707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.092+0000 7ff04affd640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 0x7ff0340707d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff040009230 tx=0x7ff0400095c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:19.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.095+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff03c05c080 con 0x7ff04c0ffc10 2024-09-20T19:04:19.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:18 smithi098 ceph-mon[35737]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:19.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:18 smithi027 ceph-mon[28196]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:19.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.480+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff04c02dac0 con 0x7ff04c0ffc10 2024-09-20T19:04:19.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.480+0000 7ff048ff9640 1 -- 172.21.15.27:0/84937480 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7ff03c05fd30 con 0x7ff04c0ffc10 2024-09-20T19:04:19.486 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:04:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:04:19.486 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:19.487 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:04:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 14 2024-09-20T19:04:19.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:04:19.488 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 msgr2=0x7ff0340707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 0x7ff0340707d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff040009230 tx=0x7ff0400095c0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 msgr2=0x7ff04c1976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e940 tx=0x7ff03c00ee00 comp rx=0 tx=0).stop 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 shutdown_connections 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7ff03406e310 0x7ff0340707d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff04c197bf0 0x7ff04c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 --2- 172.21.15.27:0/84937480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff04c0ffc10 0x7ff04c1976b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 >> 172.21.15.27:0/84937480 conn(0x7ff04c0fb760 msgr2=0x7ff04c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:19.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.483+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 shutdown_connections 2024-09-20T19:04:19.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.484+0000 7ff051f19640 1 -- 172.21.15.27:0/84937480 wait complete. 2024-09-20T19:04:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.615+0000 7f4ffc839640 1 -- 172.21.15.27:0/371782529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 msgr2=0x7f4ff8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.615+0000 7f4ffc839640 1 --2- 172.21.15.27:0/371782529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff8100c60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009880 tx=0x7f4fe802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 -- 172.21.15.27:0/371782529 shutdown_connections 2024-09-20T19:04:19.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 --2- 172.21.15.27:0/371782529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 --2- 172.21.15.27:0/371782529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff8100c60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 -- 172.21.15.27:0/371782529 >> 172.21.15.27:0/371782529 conn(0x7f4ff80fc010 msgr2=0x7f4ff80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 -- 172.21.15.27:0/371782529 shutdown_connections 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.616+0000 7f4ffc839640 1 -- 172.21.15.27:0/371782529 wait complete. 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.617+0000 7f4ffc839640 1 Processor -- start 2024-09-20T19:04:19.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.617+0000 7f4ffc839640 1 -- start start 2024-09-20T19:04:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.617+0000 7f4ffc839640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.617+0000 7f4ffc839640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4ffc839640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff81096a0 con 0x7f4ff8100860 2024-09-20T19:04:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4ffc839640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8109520 con 0x7f4ff8101a60 2024-09-20T19:04:19.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4ff659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4ff659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff806a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48810/0 (socket says 172.21.15.27:48810) 2024-09-20T19:04:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4ff659c640 1 -- 172.21.15.27:0/2218350783 learned_addr learned my addr 172.21.15.27:0/2218350783 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4feffff640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.618+0000 7f4feffff640 1 -- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 msgr2=0x7f4ff806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4feffff640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4feffff640 1 -- 172.21.15.27:0/2218350783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff819c7f0 con 0x7f4ff8101a60 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4feffff640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff819c230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000e9a0 tx=0x7f4fe000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fe000cac0 con 0x7f4ff8101a60 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fe000cc60 con 0x7f4ff8101a60 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fe00049d0 con 0x7f4ff8101a60 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff819cae0 con 0x7f4ff8101a60 2024-09-20T19:04:19.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.619+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff819d070 con 0x7f4ff8101a60 2024-09-20T19:04:19.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.620+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff8100c60 con 0x7f4ff8101a60 2024-09-20T19:04:19.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.622+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4fe0004b70 con 0x7f4ff8101a60 2024-09-20T19:04:19.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.623+0000 7f4fef7fe640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 0x7f4fe4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:19.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.623+0000 7f4ff659c640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 0x7f4fe4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:19.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.623+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f4fe008e5f0 con 0x7f4ff8101a60 2024-09-20T19:04:19.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.624+0000 7f4ff659c640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 0x7f4fe4070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000c00 tx=0x7f4fe8005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:19.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.630+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fe005bf70 con 0x7f4ff8101a60 2024-09-20T19:04:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.843+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ff8062630 con 0x7f4fe406e2b0 2024-09-20T19:04:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.844+0000 7f4fef7fe640 1 -- 172.21.15.27:0/2218350783 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f4ff8062630 con 0x7f4fe406e2b0 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "0/2 daemons upgraded", 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 image on host smithi098", 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:04:19.850 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:04:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 msgr2=0x7f4fe4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 0x7f4fe4070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000c00 tx=0x7f4fe8005a20 comp rx=0 tx=0).stop 2024-09-20T19:04:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 msgr2=0x7f4ff819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff819c230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000e9a0 tx=0x7f4fe000ee60 comp rx=0 tx=0).stop 2024-09-20T19:04:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 shutdown_connections 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f4fe406e2b0 0x7f4fe4070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff8101a60 0x7f4ff819c230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 --2- 172.21.15.27:0/2218350783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ff8100860 0x7f4ff806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.847+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 >> 172.21.15.27:0/2218350783 conn(0x7f4ff80fc010 msgr2=0x7f4ff8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.848+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 shutdown_connections 2024-09-20T19:04:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:19.848+0000 7f4ffc839640 1 -- 172.21.15.27:0/2218350783 wait complete. 2024-09-20T19:04:20.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:20.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:20.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T19:04:20.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T19:04:20.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:04:20.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: Upgrade: Need to upgrade myself (mgr.smithi027.tlgpqo) 2024-09-20T19:04:20.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:20.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:20.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:20.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:19 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/84937480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:04:20.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: Upgrade: Need to upgrade myself (mgr.smithi027.tlgpqo) 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:20.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:19 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/84937480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:04:21.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:20 smithi098 ceph-mon[35737]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 on smithi098 2024-09-20T19:04:21.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:20 smithi098 ceph-mon[35737]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:21.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:20 smithi027 ceph-mon[28196]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 on smithi098 2024-09-20T19:04:21.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:20 smithi027 ceph-mon[28196]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:22.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:21 smithi098 ceph-mon[35737]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:22.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:21 smithi027 ceph-mon[28196]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:23.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:23 smithi027 ceph-mon[28196]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:23.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:23 smithi098 ceph-mon[35737]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:25.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:25 smithi098 ceph-mon[35737]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:25.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:25 smithi027 ceph-mon[28196]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:27.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:27 smithi027 ceph-mon[28196]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:27.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:27 smithi098 ceph-mon[35737]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:29.528 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:29 smithi098 ceph-mon[35737]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:29.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:29 smithi027 ceph-mon[28196]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:31.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:31 smithi027 ceph-mon[28196]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:31.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:31 smithi098 ceph-mon[35737]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:33.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:33 smithi027 ceph-mon[28196]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:33.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:33 smithi098 ceph-mon[35737]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:34.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:34.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:35.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:35 smithi098 ceph-mon[35737]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:35.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:35 smithi027 ceph-mon[28196]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:37.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:37 smithi027 ceph-mon[28196]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:37.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:37 smithi098 ceph-mon[35737]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:39.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:39 smithi027 ceph-mon[28196]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:39.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:39 smithi098 ceph-mon[35737]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:41.051 INFO:tasks.workunit.client.0.smithi027.stderr:Updating files: 89% (11411/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-20T19:04:41.448 INFO:tasks.workunit.client.0.smithi027.stderr:Note: switching to '88deadb8082f4a33832e228ccefc59cedba158a5'. 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:state without impacting any branches by switching back to a branch. 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: git switch -c 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr:Or undo this operation with: 2024-09-20T19:04:41.449 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.450 INFO:tasks.workunit.client.0.smithi027.stderr: git switch - 2024-09-20T19:04:41.450 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.450 INFO:tasks.workunit.client.0.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-20T19:04:41.450 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-20T19:04:41.450 INFO:tasks.workunit.client.0.smithi027.stderr:HEAD is now at 88deadb8082 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-20T19:04:41.455 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-20T19:04:41.560 INFO:tasks.workunit.client.0.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-20T19:04:41.568 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T19:04:41.568 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-20T19:04:41.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:41 smithi027 ceph-mon[28196]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:41.663 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:41 smithi098 ceph-mon[35737]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:41.798 INFO:tasks.workunit.client.1.smithi098.stderr:Updating files: 87% (11095/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:Note: switching to '88deadb8082f4a33832e228ccefc59cedba158a5'. 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-20T19:04:42.828 INFO:tasks.workunit.client.1.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: git switch -c 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr:Or undo this operation with: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: git switch - 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr: 2024-09-20T19:04:42.829 INFO:tasks.workunit.client.1.smithi098.stderr:HEAD is now at 88deadb8082 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-20T19:04:42.834 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-20T19:04:42.902 INFO:tasks.workunit.client.1.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-20T19:04:42.905 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-20T19:04:42.905 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-20T19:04:43.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:43 smithi027 ceph-mon[28196]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:43.607 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-20T19:04:43.686 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-20T19:04:43.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:43 smithi098 ceph-mon[35737]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:04:43.731 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-20T19:04:43.733 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-20T19:04:43.733 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-20T19:04:43.778 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-20T19:04:43.781 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-20T19:04:43.781 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-20T19:04:43.839 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-20T19:04:43.841 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-20T19:04:43.841 DEBUG:teuthology.orchestra.run.smithi098:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88deadb8082f4a33832e228ccefc59cedba158a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-20T19:04:43.908 INFO:tasks.workunit.client.1.smithi098.stderr:+ mkdir -p fsstress 2024-09-20T19:04:43.910 INFO:tasks.workunit.client.1.smithi098.stderr:+ pushd fsstress 2024-09-20T19:04:43.911 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T19:04:43.912 INFO:tasks.workunit.client.1.smithi098.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-20T19:04:45.281 INFO:tasks.workunit.client.1.smithi098.stderr:+ tar xzf ltp-full.tgz 2024-09-20T19:04:45.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:45 smithi098 ceph-mon[35737]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:45.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:45 smithi027 ceph-mon[28196]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:04:47.379 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-20T19:04:47.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:47 smithi027 ceph-mon[28196]: pgmap v229: 65 pgs: 65 active+clean; 7.7 MiB data, 198 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 610 KiB/s wr, 9 op/s 2024-09-20T19:04:47.722 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-20T19:04:47.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:47 smithi098 ceph-mon[35737]: pgmap v229: 65 pgs: 65 active+clean; 7.7 MiB data, 198 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 610 KiB/s wr, 9 op/s 2024-09-20T19:04:47.879 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T19:04:47.880 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T19:04:47.881 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-20T19:04:48.063 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T19:04:48.066 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T19:04:48.067 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-20T19:04:48.083 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-20T19:04:48.085 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-20T19:04:48.085 DEBUG:teuthology.orchestra.run.smithi027:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88deadb8082f4a33832e228ccefc59cedba158a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-20T19:04:48.150 INFO:tasks.workunit.client.0.smithi027.stderr:+ mkdir -p fsstress 2024-09-20T19:04:48.152 INFO:tasks.workunit.client.0.smithi027.stderr:+ pushd fsstress 2024-09-20T19:04:48.153 INFO:tasks.workunit.client.0.smithi027.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T19:04:48.153 INFO:tasks.workunit.client.0.smithi027.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-20T19:04:49.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:49.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:49 smithi098 ceph-mon[35737]: pgmap v230: 65 pgs: 65 active+clean; 10 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 843 KiB/s wr, 17 op/s 2024-09-20T19:04:49.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:04:49.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:49 smithi027 ceph-mon[28196]: pgmap v230: 65 pgs: 65 active+clean; 10 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 843 KiB/s wr, 17 op/s 2024-09-20T19:04:49.860 INFO:tasks.workunit.client.0.smithi027.stderr:+ tar xzf ltp-full.tgz 2024-09-20T19:04:49.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/4217109794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0104dc0 msgr2=0x7fe0b01071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:49.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/4217109794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0104dc0 0x7fe0b01071b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009880 tx=0x7fe0a402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:49.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/4217109794 shutdown_connections 2024-09-20T19:04:49.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/4217109794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0104dc0 0x7fe0b01071b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:49.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/4217109794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0102490 0x7fe0b0104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:49.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/4217109794 >> 172.21.15.27:0/4217109794 conn(0x7fe0b00fc010 msgr2=0x7fe0b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:49.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/4217109794 shutdown_connections 2024-09-20T19:04:49.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/4217109794 wait complete. 2024-09-20T19:04:49.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.944+0000 7fe0b5d2d640 1 Processor -- start 2024-09-20T19:04:49.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0b5d2d640 1 -- start start 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0b5d2d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0b5d2d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0104dc0 0x7fe0b0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0b5d2d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b010a7a0 con 0x7fe0b0102490 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0b5d2d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b010a620 con 0x7fe0b0104dc0 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42266/0 (socket says 172.21.15.27:42266) 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 -- 172.21.15.27:0/2825104209 learned_addr learned my addr 172.21.15.27:0/2825104209 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0aeffd640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0104dc0 0x7fe0b0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 -- 172.21.15.27:0/2825104209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0104dc0 msgr2=0x7fe0b0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0104dc0 0x7fe0b0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.945+0000 7fe0af7fe640 1 -- 172.21.15.27:0/2825104209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b01980c0 con 0x7fe0b0102490 2024-09-20T19:04:49.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0af7fe640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e970 tx=0x7fe0a000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0a000cac0 con 0x7fe0b0102490 2024-09-20T19:04:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0a00054e0 con 0x7fe0b0102490 2024-09-20T19:04:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b019cb00 con 0x7fe0b0102490 2024-09-20T19:04:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0a0010430 con 0x7fe0b0102490 2024-09-20T19:04:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.946+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b019d060 con 0x7fe0b0102490 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.947+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b010af80 con 0x7fe0b0102490 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.948+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe0a0004f00 con 0x7fe0b0102490 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.948+0000 7fe0acff9640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 0x7fe0980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.948+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fe0a008e770 con 0x7fe0b0102490 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.949+0000 7fe0aeffd640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 0x7fe0980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.949+0000 7fe0aeffd640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 0x7fe0980707d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009230 tx=0x7fe0a40058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:49.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:49.953+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0a005c0f0 con 0x7fe0b0102490 2024-09-20T19:04:50.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.160+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe0b0105800 con 0x7fe09806e310 2024-09-20T19:04:50.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.161+0000 7fe0acff9640 1 -- 172.21.15.27:0/2825104209 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fe0b0105800 con 0x7fe09806e310 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 msgr2=0x7fe0980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 0x7fe0980707d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009230 tx=0x7fe0a40058d0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 msgr2=0x7fe0b0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e970 tx=0x7fe0a000ed70 comp rx=0 tx=0).stop 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 shutdown_connections 2024-09-20T19:04:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe09806e310 0x7fe0980707d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b0104dc0 0x7fe0b0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 --2- 172.21.15.27:0/2825104209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0b0102490 0x7fe0b0197500 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 >> 172.21.15.27:0/2825104209 conn(0x7fe0b00fc010 msgr2=0x7fe0b00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 shutdown_connections 2024-09-20T19:04:50.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.163+0000 7fe0b5d2d640 1 -- 172.21.15.27:0/2825104209 wait complete. 2024-09-20T19:04:50.176 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:04:50.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 -- 172.21.15.27:0/2930593419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 msgr2=0x7fbe84101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 --2- 172.21.15.27:0/2930593419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84101ee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009880 tx=0x7fbe7802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 -- 172.21.15.27:0/2930593419 shutdown_connections 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 --2- 172.21.15.27:0/2930593419 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84101ee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 --2- 172.21.15.27:0/2930593419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe84100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 -- 172.21.15.27:0/2930593419 >> 172.21.15.27:0/2930593419 conn(0x7fbe840fc010 msgr2=0x7fbe840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 -- 172.21.15.27:0/2930593419 shutdown_connections 2024-09-20T19:04:50.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.248+0000 7fbe88e31640 1 -- 172.21.15.27:0/2930593419 wait complete. 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 Processor -- start 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 -- start start 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe841974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841096a0 con 0x7fbe84101a60 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe88e31640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84109520 con 0x7fbe84100860 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe81d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe81d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42290/0 (socket says 172.21.15.27:42290) 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe81d9b640 1 -- 172.21.15.27:0/3765353234 learned_addr learned my addr 172.21.15.27:0/3765353234 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.249+0000 7fbe8259c640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe841974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe81d9b640 1 -- 172.21.15.27:0/3765353234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 msgr2=0x7fbe841974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe81d9b640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe841974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe81d9b640 1 -- 172.21.15.27:0/3765353234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe84198080 con 0x7fbe84101a60 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe8259c640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe841974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe81d9b640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbe78006010 tx=0x7fbe78004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe7803f070 con 0x7fbe84101a60 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe780049d0 con 0x7fbe84101a60 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8419ca60 con 0x7fbe84101a60 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe78035030 con 0x7fbe84101a60 2024-09-20T19:04:50.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.250+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8419cff0 con 0x7fbe84101a60 2024-09-20T19:04:50.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.251+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe84100c60 con 0x7fbe84101a60 2024-09-20T19:04:50.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.252+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbe78042070 con 0x7fbe84101a60 2024-09-20T19:04:50.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.252+0000 7fbe737fe640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 0x7fbe6c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.252+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fbe780aed00 con 0x7fbe84101a60 2024-09-20T19:04:50.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.252+0000 7fbe8259c640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 0x7fbe6c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.253+0000 7fbe8259c640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 0x7fbe6c0707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe841018c0 tx=0x7fbe74005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.257+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe78080290 con 0x7fbe84101a60 2024-09-20T19:04:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.456+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe84062630 con 0x7fbe6c06e310 2024-09-20T19:04:50.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.457+0000 7fbe737fe640 1 -- 172.21.15.27:0/3765353234 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fbe84062630 con 0x7fbe6c06e310 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 msgr2=0x7fbe6c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 0x7fbe6c0707d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe841018c0 tx=0x7fbe74005f90 comp rx=0 tx=0).stop 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 msgr2=0x7fbe84197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbe78006010 tx=0x7fbe78004570 comp rx=0 tx=0).stop 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 shutdown_connections 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fbe6c06e310 0x7fbe6c0707d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe84101a60 0x7fbe84197a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 --2- 172.21.15.27:0/3765353234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe84100860 0x7fbe841974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.459+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 >> 172.21.15.27:0/3765353234 conn(0x7fbe840fc010 msgr2=0x7fbe840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.460+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 shutdown_connections 2024-09-20T19:04:50.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.460+0000 7fbe88e31640 1 -- 172.21.15.27:0/3765353234 wait complete. 2024-09-20T19:04:50.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:50 smithi098 ceph-mon[35737]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:50.531 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:50 smithi027 ceph-mon[28196]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 -- 172.21.15.27:0/2972361498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 msgr2=0x7fa864100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 --2- 172.21.15.27:0/2972361498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864100c60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa860009880 tx=0x7fa86002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 -- 172.21.15.27:0/2972361498 shutdown_connections 2024-09-20T19:04:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 --2- 172.21.15.27:0/2972361498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 --2- 172.21.15.27:0/2972361498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864100c60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 -- 172.21.15.27:0/2972361498 >> 172.21.15.27:0/2972361498 conn(0x7fa8640fc010 msgr2=0x7fa8640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 -- 172.21.15.27:0/2972361498 shutdown_connections 2024-09-20T19:04:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.547+0000 7fa86c397640 1 -- 172.21.15.27:0/2972361498 wait complete. 2024-09-20T19:04:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 Processor -- start 2024-09-20T19:04:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 -- start start 2024-09-20T19:04:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641096a0 con 0x7fa864100860 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86c397640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa864109520 con 0x7fa864101a60 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86a133640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86a133640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42300/0 (socket says 172.21.15.27:42300) 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86a133640 1 -- 172.21.15.27:0/1223606155 learned_addr learned my addr 172.21.15.27:0/1223606155 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa869932640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.548+0000 7fa86a133640 1 -- 172.21.15.27:0/1223606155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 msgr2=0x7fa864102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa86a133640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa86a133640 1 -- 172.21.15.27:0/1223606155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa864103380 con 0x7fa864100860 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa869932640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa86a133640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa860006010 tx=0x7fa8600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa86003f070 con 0x7fa864100860 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8600049d0 con 0x7fa864100860 2024-09-20T19:04:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa860035030 con 0x7fa864100860 2024-09-20T19:04:50.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa864103610 con 0x7fa864100860 2024-09-20T19:04:50.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.549+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa864103b40 con 0x7fa864100860 2024-09-20T19:04:50.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.550+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa864100c60 con 0x7fa864100860 2024-09-20T19:04:50.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.551+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa860042070 con 0x7fa864100860 2024-09-20T19:04:50.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.551+0000 7fa8577fe640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 0x7fa8500707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.552+0000 7fa869932640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 0x7fa8500707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.552+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fa8600aebd0 con 0x7fa864100860 2024-09-20T19:04:50.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.552+0000 7fa869932640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 0x7fa8500707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa864104500 tx=0x7fa858005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.556+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa860080200 con 0x7fa864100860 2024-09-20T19:04:50.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.759+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa86406a460 con 0x7fa85006e310 2024-09-20T19:04:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.769+0000 7fa8577fe640 1 -- 172.21.15.27:0/1223606155 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa86406a460 con 0x7fa85006e310 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (5m) 79s ago 7m 25.3M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (7m) 79s ago 7m 8128k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (6m) 82s ago 6m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (7m) 79s ago 7m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (6m) 82s ago 6m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (5m) 79s ago 6m 80.6M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (95s) 79s ago 94s 13.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (101s) 79s ago 101s 11.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (98s) 82s ago 98s 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:04:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (92s) 82s ago 92s 12.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (8m) 79s ago 8m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (6m) 82s ago 6m 441M - 19.1.1-369-ged8ee0f2 6acb0a031eab 04b71c60ddaa 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (8m) 79s ago 8m 48.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (6m) 82s ago 6m 35.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (7m) 79s ago 7m 16.2M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 82s ago 6m 14.6M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (4m) 79s ago 4m 47.2M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (4m) 79s ago 4m 47.3M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (4m) 79s ago 4m 52.8M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (3m) 82s ago 3m 52.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (3m) 82s ago 3m 50.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:04:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (2m) 82s ago 2m 47.9M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:04:50.777 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (5m) 79s ago 6m 59.4M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:04:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.771+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 msgr2=0x7fa8500707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.771+0000 7fa86c397640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 0x7fa8500707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa864104500 tx=0x7fa858005f90 comp rx=0 tx=0).stop 2024-09-20T19:04:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.771+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 msgr2=0x7fa864104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.771+0000 7fa86c397640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa860006010 tx=0x7fa8600045e0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 shutdown_connections 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fa85006e310 0x7fa8500707d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa864101a60 0x7fa864102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 --2- 172.21.15.27:0/1223606155 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa864100860 0x7fa864104780 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 >> 172.21.15.27:0/1223606155 conn(0x7fa8640fc010 msgr2=0x7fa864069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 shutdown_connections 2024-09-20T19:04:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.772+0000 7fa86c397640 1 -- 172.21.15.27:0/1223606155 wait complete. 2024-09-20T19:04:50.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 -- 172.21.15.27:0/816815987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 msgr2=0x7fe288101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/816815987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe288101d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe278009880 tx=0x7fe27802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 -- 172.21.15.27:0/816815987 shutdown_connections 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/816815987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 0x7fe288102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/816815987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe288101d60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 -- 172.21.15.27:0/816815987 >> 172.21.15.27:0/816815987 conn(0x7fe2880fd0d0 msgr2=0x7fe2880ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 -- 172.21.15.27:0/816815987 shutdown_connections 2024-09-20T19:04:50.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.886+0000 7fe28dd3a640 1 -- 172.21.15.27:0/816815987 wait complete. 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 Processor -- start 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 -- start start 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 0x7fe288197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe28810a7a0 con 0x7fe288101960 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe28dd3a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe28810a620 con 0x7fe288102b60 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42318/0 (socket says 172.21.15.27:42318) 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe2877fe640 1 -- 172.21.15.27:0/3167830127 learned_addr learned my addr 172.21.15.27:0/3167830127 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.887+0000 7fe27ffff640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 0x7fe288197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2877fe640 1 -- 172.21.15.27:0/3167830127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 msgr2=0x7fe288197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2877fe640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 0x7fe288197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2877fe640 1 -- 172.21.15.27:0/3167830127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2881980b0 con 0x7fe288101960 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2877fe640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe278006010 tx=0x7fe2780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe27803f070 con 0x7fe288101960 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2780049d0 con 0x7fe288101960 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28819ca90 con 0x7fe288101960 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe278035030 con 0x7fe288101960 2024-09-20T19:04:50.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.888+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28819d020 con 0x7fe288101960 2024-09-20T19:04:50.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.889+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe288101d60 con 0x7fe288101960 2024-09-20T19:04:50.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.890+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe278042070 con 0x7fe288101960 2024-09-20T19:04:50.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.891+0000 7fe2857fa640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 0x7fe2740707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:50.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.891+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7fe2780aebd0 con 0x7fe288101960 2024-09-20T19:04:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.891+0000 7fe27ffff640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 0x7fe2740707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.891+0000 7fe27ffff640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 0x7fe2740707d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2881989a0 tx=0x7fe270005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:50.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:50.896+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe278080200 con 0x7fe288101960 2024-09-20T19:04:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.182+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe28819d4d0 con 0x7fe288101960 2024-09-20T19:04:51.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.183+0000 7fe2857fa640 1 -- 172.21.15.27:0/3167830127 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fe28819d4d0 con 0x7fe288101960 2024-09-20T19:04:51.188 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:04:51.188 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:04:51.188 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 14 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:04:51.189 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 msgr2=0x7fe2740707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 0x7fe2740707d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2881989a0 tx=0x7fe270005f90 comp rx=0 tx=0).stop 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 msgr2=0x7fe2881974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe278006010 tx=0x7fe2780045e0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 shutdown_connections 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7fe27406e310 0x7fe2740707d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe288102b60 0x7fe288197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 --2- 172.21.15.27:0/3167830127 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe288101960 0x7fe2881974f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 >> 172.21.15.27:0/3167830127 conn(0x7fe2880fd0d0 msgr2=0x7fe2880ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:51.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 shutdown_connections 2024-09-20T19:04:51.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.186+0000 7fe28dd3a640 1 -- 172.21.15.27:0/3167830127 wait complete. 2024-09-20T19:04:51.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 -- 172.21.15.27:0/232530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6570104d20 msgr2=0x7f6570107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 --2- 172.21.15.27:0/232530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6570104d20 0x7f6570107110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f655c0098b0 tx=0x7f655c02a4d0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 -- 172.21.15.27:0/232530405 shutdown_connections 2024-09-20T19:04:51.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 --2- 172.21.15.27:0/232530405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6570104d20 0x7f6570107110 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 --2- 172.21.15.27:0/232530405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65701023f0 0x7f65701047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 -- 172.21.15.27:0/232530405 >> 172.21.15.27:0/232530405 conn(0x7f65700fc010 msgr2=0x7f65700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:51.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 -- 172.21.15.27:0/232530405 shutdown_connections 2024-09-20T19:04:51.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.284+0000 7f6576ba1640 1 -- 172.21.15.27:0/232530405 wait complete. 2024-09-20T19:04:51.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 Processor -- start 2024-09-20T19:04:51.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 -- start start 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570104d20 0x7f65701003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f657010a7b0 con 0x7f65701023f0 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f6576ba1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f657010a630 con 0x7f6570104d20 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42336/0 (socket says 172.21.15.27:42336) 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 -- 172.21.15.27:0/3891540926 learned_addr learned my addr 172.21.15.27:0/3891540926 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f656ffff640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570104d20 0x7f65701003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 -- 172.21.15.27:0/3891540926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570104d20 msgr2=0x7f65701003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570104d20 0x7f65701003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.285+0000 7f657493d640 1 -- 172.21.15.27:0/3891540926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65701008e0 con 0x7f65701023f0 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f657493d640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f656400e970 tx=0x7f656400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f656400cac0 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65640054e0 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6570100bd0 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6564010430 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.286+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6570101130 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.287+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65701027d0 con 0x7f65701023f0 2024-09-20T19:04:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.288+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6564004f00 con 0x7f65701023f0 2024-09-20T19:04:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.289+0000 7f656dffb640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 0x7f65600707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.289+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f656408e710 con 0x7f65701023f0 2024-09-20T19:04:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.289+0000 7f656ffff640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 0x7f65600707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:51.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.289+0000 7f656ffff640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 0x7f65600707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f655c009880 tx=0x7f655c0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.294+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f656405c090 con 0x7f65701023f0 2024-09-20T19:04:51.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:51 smithi098 ceph-mon[35737]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:51.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:51 smithi098 ceph-mon[35737]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:51.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:51 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3167830127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:04:51.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:51 smithi098 ceph-mon[35737]: pgmap v231: 65 pgs: 65 active+clean; 20 MiB data, 233 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 1.6 MiB/s wr, 39 op/s 2024-09-20T19:04:51.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.521+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6570105780 con 0x7f656006e310 2024-09-20T19:04:51.526 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:51 smithi027 ceph-mon[28196]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:51.527 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:51 smithi027 ceph-mon[28196]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:51.527 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:51 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3167830127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:04:51.527 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:51 smithi027 ceph-mon[28196]: pgmap v231: 65 pgs: 65 active+clean; 20 MiB data, 233 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 1.6 MiB/s wr, 39 op/s 2024-09-20T19:04:51.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.522+0000 7f656dffb640 1 -- 172.21.15.27:0/3891540926 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f6570105780 con 0x7f656006e310 2024-09-20T19:04:51.527 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:04:51.527 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:04:51.527 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "0/2 daemons upgraded", 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 image on host smithi098", 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:04:51.528 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:04:51.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 msgr2=0x7f65600707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 0x7f65600707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f655c009880 tx=0x7f655c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 msgr2=0x7f6570101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f656400e970 tx=0x7f656400ed70 comp rx=0 tx=0).stop 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 shutdown_connections 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f656006e310 0x7f65600707d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6570104d20 0x7f65701003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 --2- 172.21.15.27:0/3891540926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65701023f0 0x7f6570101ce0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.524+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 >> 172.21.15.27:0/3891540926 conn(0x7f65700fc010 msgr2=0x7f65700fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.525+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 shutdown_connections 2024-09-20T19:04:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:04:51.525+0000 7f6576ba1640 1 -- 172.21.15.27:0/3891540926 wait complete. 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: Upgrade: Updating mgr.smithi098.wrcvbg 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:04:53.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:53 smithi098 ceph-mon[35737]: Deploying daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: Upgrade: Updating mgr.smithi098.wrcvbg 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:04:53.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:53 smithi027 ceph-mon[28196]: Deploying daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T19:04:54.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:54 smithi098 ceph-mon[35737]: pgmap v232: 65 pgs: 65 active+clean; 25 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 2.1 MiB/s wr, 61 op/s 2024-09-20T19:04:54.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:54 smithi027 ceph-mon[28196]: pgmap v232: 65 pgs: 65 active+clean; 25 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s rd, 2.1 MiB/s wr, 61 op/s 2024-09-20T19:04:55.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:55 smithi098 ceph-mon[35737]: pgmap v233: 65 pgs: 65 active+clean; 34 MiB data, 298 MiB used, 536 GiB / 536 GiB avail; 362 KiB/s rd, 2.8 MiB/s wr, 106 op/s 2024-09-20T19:04:55.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:55 smithi027 ceph-mon[28196]: pgmap v233: 65 pgs: 65 active+clean; 34 MiB data, 298 MiB used, 536 GiB / 536 GiB avail; 362 KiB/s rd, 2.8 MiB/s wr, 106 op/s 2024-09-20T19:04:57.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:57 smithi098 ceph-mon[35737]: pgmap v234: 65 pgs: 65 active+clean; 43 MiB data, 327 MiB used, 536 GiB / 536 GiB avail; 703 KiB/s rd, 3.6 MiB/s wr, 133 op/s 2024-09-20T19:04:57.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:57 smithi027 ceph-mon[28196]: pgmap v234: 65 pgs: 65 active+clean; 43 MiB data, 327 MiB used, 536 GiB / 536 GiB avail; 703 KiB/s rd, 3.6 MiB/s wr, 133 op/s 2024-09-20T19:04:59.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:04:59 smithi027 ceph-mon[28196]: pgmap v235: 65 pgs: 65 active+clean; 50 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 139 op/s 2024-09-20T19:04:59.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:04:59 smithi098 ceph-mon[35737]: pgmap v235: 65 pgs: 65 active+clean; 50 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 139 op/s 2024-09-20T19:05:01.357 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:01 smithi098 ceph-mon[35737]: pgmap v236: 65 pgs: 65 active+clean; 59 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 167 op/s 2024-09-20T19:05:01.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:01 smithi027 ceph-mon[28196]: pgmap v236: 65 pgs: 65 active+clean; 59 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 167 op/s 2024-09-20T19:05:03.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:03 smithi027 ceph-mon[28196]: pgmap v237: 65 pgs: 65 active+clean; 62 MiB data, 398 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 172 op/s 2024-09-20T19:05:03.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:03 smithi098 ceph-mon[35737]: pgmap v237: 65 pgs: 65 active+clean; 62 MiB data, 398 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 172 op/s 2024-09-20T19:05:04.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:04 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:04.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:04 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:05.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:05 smithi098 ceph-mon[35737]: pgmap v238: 65 pgs: 65 active+clean; 78 MiB data, 433 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 185 op/s 2024-09-20T19:05:05.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:05 smithi027 ceph-mon[28196]: pgmap v238: 65 pgs: 65 active+clean; 78 MiB data, 433 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 185 op/s 2024-09-20T19:05:07.364 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:07 smithi027 ceph-mon[28196]: pgmap v239: 65 pgs: 65 active+clean; 85 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 163 op/s 2024-09-20T19:05:07.565 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:07 smithi098 ceph-mon[35737]: pgmap v239: 65 pgs: 65 active+clean; 85 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 163 op/s 2024-09-20T19:05:09.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:09 smithi027 ceph-mon[28196]: pgmap v240: 65 pgs: 65 active+clean; 88 MiB data, 468 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-09-20T19:05:09.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:09 smithi098 ceph-mon[35737]: pgmap v240: 65 pgs: 65 active+clean; 88 MiB data, 468 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-09-20T19:05:11.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:11.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:11.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:11 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:11.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:11 smithi098 ceph-mon[35737]: pgmap v241: 65 pgs: 65 active+clean; 97 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-09-20T19:05:12.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:12.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:12.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:11 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:12.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:11 smithi027 ceph-mon[28196]: pgmap v241: 65 pgs: 65 active+clean; 97 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-09-20T19:05:13.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:13 smithi027 ceph-mon[28196]: pgmap v242: 65 pgs: 65 active+clean; 99 MiB data, 542 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 169 op/s 2024-09-20T19:05:13.656 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:13 smithi098 ceph-mon[35737]: pgmap v242: 65 pgs: 65 active+clean; 99 MiB data, 542 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 169 op/s 2024-09-20T19:05:15.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:15 smithi098 ceph-mon[35737]: pgmap v243: 65 pgs: 65 active+clean; 107 MiB data, 558 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 165 op/s 2024-09-20T19:05:15.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:15 smithi027 ceph-mon[28196]: pgmap v243: 65 pgs: 65 active+clean; 107 MiB data, 558 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 165 op/s 2024-09-20T19:05:16.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg restarted 2024-09-20T19:05:16.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:05:16.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:05:16.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:05:16.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:05:16.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:16 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg restarted 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:05:16.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:16 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:05:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:17 smithi027 ceph-mon[28196]: mgrmap e20: smithi027.tlgpqo(active, since 6m), standbys: smithi098.wrcvbg 2024-09-20T19:05:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:17 smithi027 ceph-mon[28196]: pgmap v244: 65 pgs: 65 active+clean; 112 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-20T19:05:17.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:17 smithi098 ceph-mon[35737]: mgrmap e20: smithi027.tlgpqo(active, since 6m), standbys: smithi098.wrcvbg 2024-09-20T19:05:17.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:17 smithi098 ceph-mon[35737]: pgmap v244: 65 pgs: 65 active+clean; 112 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-20T19:05:19.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:19 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:19.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:19 smithi027 ceph-mon[28196]: pgmap v245: 65 pgs: 65 active+clean; 117 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 151 op/s 2024-09-20T19:05:19.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:19 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:19.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:19 smithi098 ceph-mon[35737]: pgmap v245: 65 pgs: 65 active+clean; 117 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 151 op/s 2024-09-20T19:05:21.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:21 smithi027 ceph-mon[28196]: pgmap v246: 65 pgs: 65 active+clean; 126 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 182 op/s 2024-09-20T19:05:21.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:21 smithi098 ceph-mon[35737]: pgmap v246: 65 pgs: 65 active+clean; 126 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 182 op/s 2024-09-20T19:05:21.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.625+0000 7f691e718640 1 -- 172.21.15.27:0/227927030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 msgr2=0x7f6918101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.625+0000 7f691e718640 1 --2- 172.21.15.27:0/227927030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f6918101ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f690c0097e0 tx=0x7f690c02a3f0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 -- 172.21.15.27:0/227927030 shutdown_connections 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 --2- 172.21.15.27:0/227927030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f6918101ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 --2- 172.21.15.27:0/227927030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f6918100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 -- 172.21.15.27:0/227927030 >> 172.21.15.27:0/227927030 conn(0x7f69180fc010 msgr2=0x7f69180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 -- 172.21.15.27:0/227927030 shutdown_connections 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 -- 172.21.15.27:0/227927030 wait complete. 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 Processor -- start 2024-09-20T19:05:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.626+0000 7f691e718640 1 -- start start 2024-09-20T19:05:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f691e718640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f691e718640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f691e718640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6918109680 con 0x7f6918100860 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f691e718640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6918109500 con 0x7f6918101a60 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f6917fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f69177fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f69177fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:36114/0 (socket says 172.21.15.27:36114) 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f6917fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42902/0 (socket says 172.21.15.27:42902) 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.627+0000 7f69177fe640 1 -- 172.21.15.27:0/2447399304 learned_addr learned my addr 172.21.15.27:0/2447399304 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f6917fff640 1 -- 172.21.15.27:0/2447399304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 msgr2=0x7f691819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f6917fff640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f6917fff640 1 -- 172.21.15.27:0/2447399304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691819c790 con 0x7f6918100860 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f69177fe640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f6917fff640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69181018c0 tx=0x7f691000bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f691001e070 con 0x7f6918100860 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6910003b80 con 0x7f6918100860 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6918195fd0 con 0x7f6918100860 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f691000a9e0 con 0x7f6918100860 2024-09-20T19:05:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.628+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6918196560 con 0x7f6918100860 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.629+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6918100c60 con 0x7f6918100860 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.630+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f6910021070 con 0x7f6918100860 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.631+0000 7f69157fa640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 0x7f6900076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.631+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f6910016070 con 0x7f6918100860 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.631+0000 7f69177fe640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 0x7f6900076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.632+0000 7f69177fe640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 0x7f6900076e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f690c0095f0 tx=0x7f690c030890 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.636+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69100098b0 con 0x7f6918100860 2024-09-20T19:05:21.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.852+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6918062680 con 0x7f6900074950 2024-09-20T19:05:21.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.853+0000 7f69157fa640 1 -- 172.21.15.27:0/2447399304 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f6918062680 con 0x7f6900074950 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 msgr2=0x7f6900076e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 0x7f6900076e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f690c0095f0 tx=0x7f690c030890 comp rx=0 tx=0).stop 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 msgr2=0x7f691806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69181018c0 tx=0x7f691000bae0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 shutdown_connections 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6900074950 0x7f6900076e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6918101a60 0x7f691819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 --2- 172.21.15.27:0/2447399304 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6918100860 0x7f691806a7d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 >> 172.21.15.27:0/2447399304 conn(0x7f69180fc010 msgr2=0x7f6918104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 shutdown_connections 2024-09-20T19:05:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.855+0000 7f691e718640 1 -- 172.21.15.27:0/2447399304 wait complete. 2024-09-20T19:05:21.870 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3001325876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 msgr2=0x7f58e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3001325876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e4100c60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009880 tx=0x7f58d402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3001325876 shutdown_connections 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3001325876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 0x7f58e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3001325876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e4100c60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.950+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3001325876 >> 172.21.15.27:0/3001325876 conn(0x7f58e40fc010 msgr2=0x7f58e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.951+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3001325876 shutdown_connections 2024-09-20T19:05:21.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.951+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3001325876 wait complete. 2024-09-20T19:05:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.951+0000 7f58ea7c8640 1 Processor -- start 2024-09-20T19:05:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58ea7c8640 1 -- start start 2024-09-20T19:05:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58ea7c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58ea7c8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 0x7f58e4196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58ea7c8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f58e41096a0 con 0x7f58e4100860 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58ea7c8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4109520 con 0x7f58e4101a60 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42918/0 (socket says 172.21.15.27:42918) 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58e3fff640 1 -- 172.21.15.27:0/3004565443 learned_addr learned my addr 172.21.15.27:0/3004565443 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.952+0000 7f58e37fe640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 0x7f58e4196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e3fff640 1 -- 172.21.15.27:0/3004565443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 msgr2=0x7f58e4196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e3fff640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 0x7f58e4196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e3fff640 1 -- 172.21.15.27:0/3004565443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4196f90 con 0x7f58e4100860 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e3fff640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006010 tx=0x7f58d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58d403f070 con 0x7f58e4100860 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58d40049d0 con 0x7f58e4100860 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e4069ca0 con 0x7f58e4100860 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e406a230 con 0x7f58e4100860 2024-09-20T19:05:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.953+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58d4035030 con 0x7f58e4100860 2024-09-20T19:05:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.954+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e4109e80 con 0x7f58e4100860 2024-09-20T19:05:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.955+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f58d4042070 con 0x7f58e4100860 2024-09-20T19:05:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.956+0000 7f58e17fa640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 0x7f58cc076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.956+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f58d40b6a70 con 0x7f58e4100860 2024-09-20T19:05:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.956+0000 7f58e37fe640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 0x7f58cc076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.956+0000 7f58e37fe640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 0x7f58cc076e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58e4197880 tx=0x7f58d8010040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:21.960+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58d40880a0 con 0x7f58e4100860 2024-09-20T19:05:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.208+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f58e41904a0 con 0x7f58cc074940 2024-09-20T19:05:22.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.210+0000 7f58e17fa640 1 -- 172.21.15.27:0/3004565443 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f58e41904a0 con 0x7f58cc074940 2024-09-20T19:05:22.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 msgr2=0x7f58cc076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 0x7f58cc076e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58e4197880 tx=0x7f58d8010040 comp rx=0 tx=0).stop 2024-09-20T19:05:22.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 msgr2=0x7f58e41963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006010 tx=0x7f58d40045e0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 shutdown_connections 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f58cc074940 0x7f58cc076e00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58e4101a60 0x7f58e4196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 --2- 172.21.15.27:0/3004565443 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58e4100860 0x7f58e41963d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.212+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 >> 172.21.15.27:0/3004565443 conn(0x7f58e40fc010 msgr2=0x7f58e4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.213+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 shutdown_connections 2024-09-20T19:05:22.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.213+0000 7f58ea7c8640 1 -- 172.21.15.27:0/3004565443 wait complete. 2024-09-20T19:05:22.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 -- 172.21.15.27:0/74948975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98101a60 msgr2=0x7f6b98101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/74948975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98101a60 0x7f6b98101ee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009880 tx=0x7f6b8c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 -- 172.21.15.27:0/74948975 shutdown_connections 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/74948975 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98101a60 0x7f6b98101ee0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/74948975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98100860 0x7f6b98100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 -- 172.21.15.27:0/74948975 >> 172.21.15.27:0/74948975 conn(0x7f6b980fc010 msgr2=0x7f6b980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.311+0000 7f6b9ca87640 1 -- 172.21.15.27:0/74948975 shutdown_connections 2024-09-20T19:05:22.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.312+0000 7f6b9ca87640 1 -- 172.21.15.27:0/74948975 wait complete. 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 Processor -- start 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 -- start start 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98101a60 0x7f6b98196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98109680 con 0x7f6b98100860 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9ca87640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98109500 con 0x7f6b98101a60 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42936/0 (socket says 172.21.15.27:42936) 2024-09-20T19:05:22.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 -- 172.21.15.27:0/3393439282 learned_addr learned my addr 172.21.15.27:0/3393439282 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:22.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b95d9b640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98101a60 0x7f6b98196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 -- 172.21.15.27:0/3393439282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98101a60 msgr2=0x7f6b98196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98101a60 0x7f6b98196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.313+0000 7f6b9659c640 1 -- 172.21.15.27:0/3393439282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b98196f80 con 0x7f6b98100860 2024-09-20T19:05:22.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b9659c640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800e940 tx=0x7f6b8800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:22.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b8800cac0 con 0x7f6b98100860 2024-09-20T19:05:22.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b8800cc60 con 0x7f6b98100860 2024-09-20T19:05:22.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9819b9c0 con 0x7f6b98100860 2024-09-20T19:05:22.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b88003de0 con 0x7f6b98100860 2024-09-20T19:05:22.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.314+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9819bf20 con 0x7f6b98100860 2024-09-20T19:05:22.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.315+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b98109e60 con 0x7f6b98100860 2024-09-20T19:05:22.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.316+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f6b88004020 con 0x7f6b98100860 2024-09-20T19:05:22.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.316+0000 7f6b877fe640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 0x7f6b80076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.316+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f6b880965d0 con 0x7f6b98100860 2024-09-20T19:05:22.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.317+0000 7f6b95d9b640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 0x7f6b80076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.317+0000 7f6b95d9b640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 0x7f6b80076e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:22.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.322+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b88063f50 con 0x7f6b98100860 2024-09-20T19:05:22.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.543+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6b9802dba0 con 0x7f6b80074940 2024-09-20T19:05:22.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:22 smithi027 ceph-mon[28196]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:22.550 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:22 smithi027 ceph-mon[28196]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:22.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.556+0000 7f6b877fe640 1 -- 172.21.15.27:0/3393439282 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3768 (secure 0 0 0) 0x7f6b9802dba0 con 0x7f6b80074940 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (6m) 111s ago 7m 25.3M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (7m) 111s ago 7m 8128k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (6m) 114s ago 6m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (7m) 111s ago 7m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (6m) 114s ago 6m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (5m) 111s ago 7m 80.6M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (2m) 111s ago 2m 13.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:05:22.562 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (2m) 111s ago 2m 11.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (2m) 114s ago 2m 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (2m) 114s ago 2m 12.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (8m) 111s ago 8m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 starting - - - - 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (9m) 111s ago 9m 48.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (6m) 114s ago 6m 35.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (7m) 111s ago 7m 16.2M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 114s ago 6m 14.6M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (5m) 111s ago 5m 47.2M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (5m) 111s ago 5m 47.3M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (4m) 111s ago 4m 52.8M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (4m) 114s ago 4m 52.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (3m) 114s ago 3m 50.2M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:05:22.563 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (3m) 114s ago 3m 47.9M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (5m) 111s ago 7m 59.4M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 msgr2=0x7f6b80076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 0x7f6b80076e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 msgr2=0x7f6b981963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800e940 tx=0x7f6b8800ee00 comp rx=0 tx=0).stop 2024-09-20T19:05:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 shutdown_connections 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f6b80074940 0x7f6b80076e00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b98101a60 0x7f6b98196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 --2- 172.21.15.27:0/3393439282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b98100860 0x7f6b981963c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 >> 172.21.15.27:0/3393439282 conn(0x7f6b980fc010 msgr2=0x7f6b98104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 shutdown_connections 2024-09-20T19:05:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.558+0000 7f6b9ca87640 1 -- 172.21.15.27:0/3393439282 wait complete. 2024-09-20T19:05:22.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 -- 172.21.15.27:0/3407074987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704102b60 msgr2=0x7f0704102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 --2- 172.21.15.27:0/3407074987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704102b60 0x7f0704102fe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009880 tx=0x7f06f802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 -- 172.21.15.27:0/3407074987 shutdown_connections 2024-09-20T19:05:22.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 --2- 172.21.15.27:0/3407074987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704102b60 0x7f0704102fe0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 --2- 172.21.15.27:0/3407074987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704101960 0x7f0704101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 -- 172.21.15.27:0/3407074987 >> 172.21.15.27:0/3407074987 conn(0x7f07040fd0f0 msgr2=0x7f07040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 -- 172.21.15.27:0/3407074987 shutdown_connections 2024-09-20T19:05:22.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.653+0000 7f070a61e640 1 -- 172.21.15.27:0/3407074987 wait complete. 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 Processor -- start 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 -- start start 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 0x7f07041979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f070410a780 con 0x7f0704101960 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f070a61e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f070410a600 con 0x7f0704102b60 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f0703fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f0703fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42942/0 (socket says 172.21.15.27:42942) 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f07037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 0x7f07041979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.654+0000 7f0703fff640 1 -- 172.21.15.27:0/60038662 learned_addr learned my addr 172.21.15.27:0/60038662 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f0703fff640 1 -- 172.21.15.27:0/60038662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 msgr2=0x7f07041979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f0703fff640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 0x7f07041979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f0703fff640 1 -- 172.21.15.27:0/60038662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0704198050 con 0x7f0704101960 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f07037fe640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 0x7f07041979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f0703fff640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e940 tx=0x7f06f400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06f400cac0 con 0x7f0704101960 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06f400cc60 con 0x7f0704101960 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0704074480 con 0x7f0704101960 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06f4003de0 con 0x7f0704101960 2024-09-20T19:05:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.655+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07040749e0 con 0x7f0704101960 2024-09-20T19:05:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.657+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0704076460 con 0x7f0704101960 2024-09-20T19:05:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.657+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f06f4003fa0 con 0x7f0704101960 2024-09-20T19:05:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.658+0000 7f07017fa640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 0x7f06ec076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.658+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f06f4096690 con 0x7f0704101960 2024-09-20T19:05:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.658+0000 7f07037fe640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 0x7f06ec076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.658+0000 7f07037fe640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 0x7f06ec076db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000c00 tx=0x7f06f80058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.663+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06f4063f90 con 0x7f0704101960 2024-09-20T19:05:22.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:22 smithi098 ceph-mon[35737]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:22.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:22 smithi098 ceph-mon[35737]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.958+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f070402db50 con 0x7f0704101960 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.959+0000 7f07017fa640 1 -- 172.21.15.27:0/60038662 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f06f4067c40 con 0x7f0704101960 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:05:22.967 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 13, 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:05:22.968 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 msgr2=0x7f06ec076db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 0x7f06ec076db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000c00 tx=0x7f06f80058d0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 msgr2=0x7f0704197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f06f400e940 tx=0x7f06f400ee00 comp rx=0 tx=0).stop 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 shutdown_connections 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f06ec0748f0 0x7f06ec076db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0704102b60 0x7f07041979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 --2- 172.21.15.27:0/60038662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0704101960 0x7f0704197490 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 >> 172.21.15.27:0/60038662 conn(0x7f07040fd0f0 msgr2=0x7f0704106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.961+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 shutdown_connections 2024-09-20T19:05:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:22.962+0000 7f070a61e640 1 -- 172.21.15.27:0/60038662 wait complete. 2024-09-20T19:05:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- 172.21.15.27:0/3438958142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 msgr2=0x7f7734100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 --2- 172.21.15.27:0/3438958142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f7734100c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7724009880 tx=0x7f772402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- 172.21.15.27:0/3438958142 shutdown_connections 2024-09-20T19:05:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 --2- 172.21.15.27:0/3438958142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 0x7f7734101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 --2- 172.21.15.27:0/3438958142 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f7734100c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- 172.21.15.27:0/3438958142 >> 172.21.15.27:0/3438958142 conn(0x7f77340fc010 msgr2=0x7f77340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- 172.21.15.27:0/3438958142 shutdown_connections 2024-09-20T19:05:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- 172.21.15.27:0/3438958142 wait complete. 2024-09-20T19:05:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 Processor -- start 2024-09-20T19:05:23.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.051+0000 7f773a38c640 1 -- start start 2024-09-20T19:05:23.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f773a38c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f773a38c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 0x7f7734197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f773a38c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f77341096a0 con 0x7f7734100860 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f773a38c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7734109520 con 0x7f7734101a60 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42964/0 (socket says 172.21.15.27:42964) 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 -- 172.21.15.27:0/4034523787 learned_addr learned my addr 172.21.15.27:0/4034523787 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f772bfff640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 0x7f7734197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 -- 172.21.15.27:0/4034523787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 msgr2=0x7f7734197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 0x7f7734197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 -- 172.21.15.27:0/4034523787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77341980b0 con 0x7f7734100860 2024-09-20T19:05:23.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.052+0000 7f7733fff640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7724006010 tx=0x7f77240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.053+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f772403f070 con 0x7f7734100860 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.053+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77240049d0 con 0x7f7734100860 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.053+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773419ca90 con 0x7f7734100860 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.053+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7724035030 con 0x7f7734100860 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.053+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773419d020 con 0x7f7734100860 2024-09-20T19:05:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.054+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7734100c60 con 0x7f7734100860 2024-09-20T19:05:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.054+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) ==== 97939+0+0 (secure 0 0 0) 0x7f7724042070 con 0x7f7734100860 2024-09-20T19:05:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.055+0000 7f7731ffb640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 0x7f7720076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.055+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5554+0+0 (secure 0 0 0) 0x7f77240b6a50 con 0x7f7734100860 2024-09-20T19:05:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.055+0000 7f772bfff640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 0x7f7720076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:23.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.055+0000 7f772bfff640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 0x7f7720076db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77341989a0 tx=0x7f771c005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.059+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7724088000 con 0x7f7734100860 2024-09-20T19:05:23.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.269+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 --> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f773406a3e0 con 0x7f77200748f0 2024-09-20T19:05:23.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.271+0000 7f7731ffb640 1 -- 172.21.15.27:0/4034523787 <== mgr.14221 v2:172.21.15.27:6800/3031006288 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f773406a3e0 con 0x7f77200748f0 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "", 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:05:23.277 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:05:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 msgr2=0x7f7720076db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 0x7f7720076db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77341989a0 tx=0x7f771c005f90 comp rx=0 tx=0).stop 2024-09-20T19:05:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 msgr2=0x7f77341974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7724006010 tx=0x7f77240045e0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 shutdown_connections 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:6800/3031006288,v1:172.21.15.27:6801/3031006288] conn(0x7f77200748f0 0x7f7720076db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734101a60 0x7f7734197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 --2- 172.21.15.27:0/4034523787 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7734100860 0x7f77341974f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 >> 172.21.15.27:0/4034523787 conn(0x7f77340fc010 msgr2=0x7f7734069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 shutdown_connections 2024-09-20T19:05:23.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:23.273+0000 7f773a38c640 1 -- 172.21.15.27:0/4034523787 wait complete. 2024-09-20T19:05:23.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:23 smithi027 ceph-mon[28196]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:23.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:23 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/60038662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:05:23.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:23 smithi027 ceph-mon[28196]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 176 op/s 2024-09-20T19:05:23.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:23 smithi098 ceph-mon[35737]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:23.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:23 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/60038662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:05:23.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:23 smithi098 ceph-mon[35737]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 176 op/s 2024-09-20T19:05:24.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:24 smithi027 ceph-mon[28196]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:24.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:24 smithi098 ceph-mon[35737]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:25.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:25 smithi098 ceph-mon[35737]: pgmap v248: 65 pgs: 65 active+clean; 144 MiB data, 652 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-09-20T19:05:25.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:25 smithi027 ceph-mon[28196]: pgmap v248: 65 pgs: 65 active+clean; 144 MiB data, 652 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-09-20T19:05:27.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:27 smithi027 ceph-mon[28196]: pgmap v249: 65 pgs: 65 active+clean; 151 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 237 op/s 2024-09-20T19:05:27.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:27 smithi098 ceph-mon[35737]: pgmap v249: 65 pgs: 65 active+clean; 151 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 237 op/s 2024-09-20T19:05:29.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:29 smithi027 ceph-mon[28196]: pgmap v250: 65 pgs: 65 active+clean; 156 MiB data, 696 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 233 op/s 2024-09-20T19:05:29.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:29 smithi098 ceph-mon[35737]: pgmap v250: 65 pgs: 65 active+clean; 156 MiB data, 696 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 233 op/s 2024-09-20T19:05:31.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:31 smithi027 ceph-mon[28196]: pgmap v251: 65 pgs: 65 active+clean; 165 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 291 op/s 2024-09-20T19:05:31.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:31 smithi098 ceph-mon[35737]: pgmap v251: 65 pgs: 65 active+clean; 165 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 291 op/s 2024-09-20T19:05:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:32 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:32.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:32 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:33.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:33 smithi027 ceph-mon[28196]: pgmap v252: 65 pgs: 65 active+clean; 172 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 293 op/s 2024-09-20T19:05:33.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:33 smithi098 ceph-mon[35737]: pgmap v252: 65 pgs: 65 active+clean; 172 MiB data, 708 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 293 op/s 2024-09-20T19:05:34.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:34 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:34.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:34 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:35.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:35 smithi098 ceph-mon[35737]: pgmap v253: 65 pgs: 65 active+clean; 179 MiB data, 744 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 341 op/s 2024-09-20T19:05:35.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:35 smithi027 ceph-mon[28196]: pgmap v253: 65 pgs: 65 active+clean; 179 MiB data, 744 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 341 op/s 2024-09-20T19:05:37.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:37 smithi027 ceph-mon[28196]: pgmap v254: 65 pgs: 65 active+clean; 185 MiB data, 771 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 340 op/s 2024-09-20T19:05:37.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:37 smithi098 ceph-mon[35737]: pgmap v254: 65 pgs: 65 active+clean; 185 MiB data, 771 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 340 op/s 2024-09-20T19:05:38.701 INFO:tasks.workunit.client.1.smithi098.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-20T19:05:38.705 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T19:05:38.705 INFO:tasks.workunit.client.1.smithi098.stderr:+ make 2024-09-20T19:05:38.867 INFO:tasks.workunit.client.1.smithi098.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-20T19:05:39.558 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:39 smithi098 ceph-mon[35737]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 324 op/s 2024-09-20T19:05:39.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:39 smithi027 ceph-mon[28196]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 324 op/s 2024-09-20T19:05:39.587 INFO:tasks.workunit.client.1.smithi098.stderr:++ readlink -f fsstress 2024-09-20T19:05:39.589 INFO:tasks.workunit.client.1.smithi098.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-20T19:05:39.589 INFO:tasks.workunit.client.1.smithi098.stderr:+ popd 2024-09-20T19:05:39.590 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T19:05:39.591 INFO:tasks.workunit.client.1.smithi098.stderr:+ popd 2024-09-20T19:05:39.591 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-20T19:05:39.591 INFO:tasks.workunit.client.1.smithi098.stderr:++ mktemp -d -p . 2024-09-20T19:05:39.595 INFO:tasks.workunit.client.1.smithi098.stderr:+ T=./tmp.xImaChM8Rj 2024-09-20T19:05:39.595 INFO:tasks.workunit.client.1.smithi098.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xImaChM8Rj -l 1 -n 1000 -p 10 -v 2024-09-20T19:05:39.600 INFO:tasks.workunit.client.1.smithi098.stdout:seed = 1726274837 2024-09-20T19:05:39.605 INFO:tasks.workunit.client.1.smithi098.stdout:0/0: dread - no filename 2024-09-20T19:05:39.608 INFO:tasks.workunit.client.1.smithi098.stdout:0/1: mkdir d0 0 2024-09-20T19:05:39.608 INFO:tasks.workunit.client.1.smithi098.stdout:0/2: chown d0 16829 1 2024-09-20T19:05:39.608 INFO:tasks.workunit.client.1.smithi098.stdout:0/3: chown d0 3 1 2024-09-20T19:05:39.609 INFO:tasks.workunit.client.1.smithi098.stdout:0/4: chown d0 7243 1 2024-09-20T19:05:39.609 INFO:tasks.workunit.client.1.smithi098.stdout:0/5: chown d0 39892281 1 2024-09-20T19:05:39.609 INFO:tasks.workunit.client.1.smithi098.stdout:0/6: chown d0 204845927 1 2024-09-20T19:05:39.609 INFO:tasks.workunit.client.1.smithi098.stdout:2/0: stat - no entries 2024-09-20T19:05:39.610 INFO:tasks.workunit.client.1.smithi098.stdout:2/1: dwrite - no filename 2024-09-20T19:05:39.610 INFO:tasks.workunit.client.1.smithi098.stdout:0/7: chown d0 2306565 1 2024-09-20T19:05:39.610 INFO:tasks.workunit.client.1.smithi098.stdout:0/8: write - no filename 2024-09-20T19:05:39.610 INFO:tasks.workunit.client.1.smithi098.stdout:0/9: rename d0 to d0/d1 22 2024-09-20T19:05:39.611 INFO:tasks.workunit.client.1.smithi098.stdout:1/0: creat f0 x:0 0 0 2024-09-20T19:05:39.611 INFO:tasks.workunit.client.1.smithi098.stdout:1/1: dread - f0 zero size 2024-09-20T19:05:39.613 INFO:tasks.workunit.client.1.smithi098.stdout:2/2: symlink l0 0 2024-09-20T19:05:39.614 INFO:tasks.workunit.client.1.smithi098.stdout:1/2: mkdir d1 0 2024-09-20T19:05:39.618 INFO:tasks.workunit.client.1.smithi098.stdout:0/10: creat d0/f2 x:0 0 0 2024-09-20T19:05:39.618 INFO:tasks.workunit.client.1.smithi098.stdout:2/3: creat f1 x:0 0 0 2024-09-20T19:05:39.625 INFO:tasks.workunit.client.1.smithi098.stdout:3/0: symlink l0 0 2024-09-20T19:05:39.628 INFO:tasks.workunit.client.1.smithi098.stdout:5/0: dwrite - no filename 2024-09-20T19:05:39.628 INFO:tasks.workunit.client.1.smithi098.stdout:4/0: symlink l0 0 2024-09-20T19:05:39.628 INFO:tasks.workunit.client.1.smithi098.stdout:4/1: dwrite - no filename 2024-09-20T19:05:39.631 INFO:tasks.workunit.client.1.smithi098.stdout:6/0: stat - no entries 2024-09-20T19:05:39.631 INFO:tasks.workunit.client.1.smithi098.stdout:6/1: unlink - no file 2024-09-20T19:05:39.631 INFO:tasks.workunit.client.1.smithi098.stdout:3/1: mknod c1 0 2024-09-20T19:05:39.632 INFO:tasks.workunit.client.1.smithi098.stdout:2/4: dwrite f1 [0,4194304] 0 2024-09-20T19:05:39.632 INFO:tasks.workunit.client.1.smithi098.stdout:2/5: rmdir - no directory 2024-09-20T19:05:39.634 INFO:tasks.workunit.client.1.smithi098.stdout:0/11: dwrite d0/f2 [0,4194304] 0 2024-09-20T19:05:39.635 INFO:tasks.workunit.client.1.smithi098.stdout:4/2: creat f1 x:0 0 0 2024-09-20T19:05:39.635 INFO:tasks.workunit.client.1.smithi098.stdout:2/6: write f1 [3853306,47995] 0 2024-09-20T19:05:39.636 INFO:tasks.workunit.client.1.smithi098.stdout:4/3: write f1 [142562,3931] 0 2024-09-20T19:05:39.648 INFO:tasks.workunit.client.1.smithi098.stdout:5/1: getdents . 0 2024-09-20T19:05:39.648 INFO:tasks.workunit.client.1.smithi098.stdout:0/12: dwrite d0/f2 [0,4194304] 0 2024-09-20T19:05:39.651 INFO:tasks.workunit.client.1.smithi098.stdout:4/4: symlink l2 0 2024-09-20T19:05:39.654 INFO:tasks.workunit.client.1.smithi098.stdout:6/2: mkdir d0 0 2024-09-20T19:05:39.654 INFO:tasks.workunit.client.1.smithi098.stdout:6/3: write - no filename 2024-09-20T19:05:39.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/0: chown . 7 1 2024-09-20T19:05:39.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/1: read - no filename 2024-09-20T19:05:39.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/2: chown . 4411 1 2024-09-20T19:05:39.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/3: write - no filename 2024-09-20T19:05:39.657 INFO:tasks.workunit.client.1.smithi098.stdout:8/4: read - no filename 2024-09-20T19:05:39.657 INFO:tasks.workunit.client.1.smithi098.stdout:8/5: rename - no filename 2024-09-20T19:05:39.660 INFO:tasks.workunit.client.1.smithi098.stdout:0/13: creat d0/f3 x:0 0 0 2024-09-20T19:05:39.662 INFO:tasks.workunit.client.1.smithi098.stdout:4/5: mkdir d3 0 2024-09-20T19:05:39.666 INFO:tasks.workunit.client.1.smithi098.stdout:9/0: dread - no filename 2024-09-20T19:05:39.668 INFO:tasks.workunit.client.1.smithi098.stdout:7/0: symlink l0 0 2024-09-20T19:05:39.671 INFO:tasks.workunit.client.1.smithi098.stdout:4/6: dwrite f1 [0,4194304] 0 2024-09-20T19:05:39.671 INFO:tasks.workunit.client.1.smithi098.stdout:5/2: mknod c0 0 2024-09-20T19:05:39.672 INFO:tasks.workunit.client.1.smithi098.stdout:0/14: rmdir d0 39 2024-09-20T19:05:39.676 INFO:tasks.workunit.client.1.smithi098.stdout:6/4: getdents d0 0 2024-09-20T19:05:39.676 INFO:tasks.workunit.client.1.smithi098.stdout:6/5: truncate - no filename 2024-09-20T19:05:39.678 INFO:tasks.workunit.client.1.smithi098.stdout:8/6: creat f0 x:0 0 0 2024-09-20T19:05:39.678 INFO:tasks.workunit.client.1.smithi098.stdout:8/7: readlink - no filename 2024-09-20T19:05:39.681 INFO:tasks.workunit.client.1.smithi098.stdout:7/1: rename l0 to l1 0 2024-09-20T19:05:39.682 INFO:tasks.workunit.client.1.smithi098.stdout:5/3: mkdir d1 0 2024-09-20T19:05:39.686 INFO:tasks.workunit.client.1.smithi098.stdout:9/1: getdents . 0 2024-09-20T19:05:39.687 INFO:tasks.workunit.client.1.smithi098.stdout:7/2: symlink l2 0 2024-09-20T19:05:39.688 INFO:tasks.workunit.client.1.smithi098.stdout:7/3: chown l2 6 1 2024-09-20T19:05:39.688 INFO:tasks.workunit.client.1.smithi098.stdout:7/4: truncate - no filename 2024-09-20T19:05:39.692 INFO:tasks.workunit.client.1.smithi098.stdout:7/5: unlink l2 0 2024-09-20T19:05:39.693 INFO:tasks.workunit.client.1.smithi098.stdout:5/4: creat d1/f2 x:0 0 0 2024-09-20T19:05:39.694 INFO:tasks.workunit.client.1.smithi098.stdout:5/5: dread - d1/f2 zero size 2024-09-20T19:05:39.695 INFO:tasks.workunit.client.1.smithi098.stdout:5/6: write d1/f2 [708544,90813] 0 2024-09-20T19:05:39.696 INFO:tasks.workunit.client.1.smithi098.stdout:5/7: stat c0 0 2024-09-20T19:05:39.696 INFO:tasks.workunit.client.1.smithi098.stdout:5/8: readlink - no filename 2024-09-20T19:05:39.700 INFO:tasks.workunit.client.1.smithi098.stdout:9/2: getdents . 0 2024-09-20T19:05:39.700 INFO:tasks.workunit.client.1.smithi098.stdout:9/3: chown . 103489 1 2024-09-20T19:05:39.700 INFO:tasks.workunit.client.1.smithi098.stdout:9/4: truncate - no filename 2024-09-20T19:05:39.702 INFO:tasks.workunit.client.1.smithi098.stdout:7/6: mkdir d3 0 2024-09-20T19:05:39.702 INFO:tasks.workunit.client.1.smithi098.stdout:7/7: dwrite - no filename 2024-09-20T19:05:39.705 INFO:tasks.workunit.client.1.smithi098.stdout:5/9: mknod d1/c3 0 2024-09-20T19:05:39.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/5: getdents . 0 2024-09-20T19:05:39.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/6: dwrite - no filename 2024-09-20T19:05:39.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/7: stat - no entries 2024-09-20T19:05:39.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/8: creat f0 x:0 0 0 2024-09-20T19:05:39.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/9: dread - f0 zero size 2024-09-20T19:05:39.719 INFO:tasks.workunit.client.1.smithi098.stdout:9/10: creat f1 x:0 0 0 2024-09-20T19:05:39.721 INFO:tasks.workunit.client.1.smithi098.stdout:9/11: mknod c2 0 2024-09-20T19:05:39.722 INFO:tasks.workunit.client.1.smithi098.stdout:9/12: write f1 [926179,105955] 0 2024-09-20T19:05:39.731 INFO:tasks.workunit.client.1.smithi098.stdout:9/13: dwrite f0 [0,4194304] 0 2024-09-20T19:05:39.731 INFO:tasks.workunit.client.1.smithi098.stdout:9/14: stat c2 0 2024-09-20T19:05:39.739 INFO:tasks.workunit.client.1.smithi098.stdout:9/15: dwrite f1 [0,4194304] 0 2024-09-20T19:05:39.739 INFO:tasks.workunit.client.1.smithi098.stdout:9/16: read f0 [3202013,60601] 0 2024-09-20T19:05:39.743 INFO:tasks.workunit.client.1.smithi098.stdout:9/17: creat f3 x:0 0 0 2024-09-20T19:05:40.001 INFO:tasks.workunit.client.1.smithi098.stdout:0/15: dread - d0/f3 zero size 2024-09-20T19:05:40.001 INFO:tasks.workunit.client.1.smithi098.stdout:0/16: dread - d0/f3 zero size 2024-09-20T19:05:40.002 INFO:tasks.workunit.client.1.smithi098.stdout:0/17: mknod d0/c4 0 2024-09-20T19:05:40.003 INFO:tasks.workunit.client.1.smithi098.stdout:0/18: chown d0/f3 962441 1 2024-09-20T19:05:40.004 INFO:tasks.workunit.client.1.smithi098.stdout:0/19: write d0/f2 [3069095,93447] 0 2024-09-20T19:05:40.004 INFO:tasks.workunit.client.1.smithi098.stdout:1/3: fsync f0 0 2024-09-20T19:05:40.005 INFO:tasks.workunit.client.1.smithi098.stdout:1/4: write f0 [913713,25147] 0 2024-09-20T19:05:40.006 INFO:tasks.workunit.client.1.smithi098.stdout:0/20: write d0/f3 [943918,108750] 0 2024-09-20T19:05:40.011 INFO:tasks.workunit.client.1.smithi098.stdout:1/5: dread f0 [0,4194304] 0 2024-09-20T19:05:40.013 INFO:tasks.workunit.client.1.smithi098.stdout:1/6: creat d1/f2 x:0 0 0 2024-09-20T19:05:40.014 INFO:tasks.workunit.client.1.smithi098.stdout:1/7: dread - d1/f2 zero size 2024-09-20T19:05:40.015 INFO:tasks.workunit.client.1.smithi098.stdout:0/21: write d0/f2 [4169675,92550] 0 2024-09-20T19:05:40.020 INFO:tasks.workunit.client.1.smithi098.stdout:0/22: creat d0/f5 x:0 0 0 2024-09-20T19:05:40.023 INFO:tasks.workunit.client.1.smithi098.stdout:0/23: mkdir d0/d6 0 2024-09-20T19:05:40.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/7: dwrite f1 [4194304,4194304] 0 2024-09-20T19:05:40.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/8: stat f1 0 2024-09-20T19:05:40.024 INFO:tasks.workunit.client.1.smithi098.stdout:0/24: write d0/f2 [4864252,30534] 0 2024-09-20T19:05:40.025 INFO:tasks.workunit.client.1.smithi098.stdout:0/25: dread - d0/f5 zero size 2024-09-20T19:05:40.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/9: write f1 [4101612,56182] 0 2024-09-20T19:05:40.042 INFO:tasks.workunit.client.1.smithi098.stdout:2/10: dread f1 [0,4194304] 0 2024-09-20T19:05:40.046 INFO:tasks.workunit.client.1.smithi098.stdout:8/8: getdents . 0 2024-09-20T19:05:40.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/8: readlink l1 0 2024-09-20T19:05:40.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/9: dread - no filename 2024-09-20T19:05:40.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/10: write - no filename 2024-09-20T19:05:40.055 INFO:tasks.workunit.client.1.smithi098.stdout:8/9: dwrite f0 [0,4194304] 0 2024-09-20T19:05:40.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/10: chown f0 8103684 1 2024-09-20T19:05:40.059 INFO:tasks.workunit.client.1.smithi098.stdout:8/11: read f0 [3815802,43413] 0 2024-09-20T19:05:40.059 INFO:tasks.workunit.client.1.smithi098.stdout:4/7: dwrite f1 [4194304,4194304] 0 2024-09-20T19:05:40.066 INFO:tasks.workunit.client.1.smithi098.stdout:5/10: truncate d1/f2 12863 0 2024-09-20T19:05:40.083 INFO:tasks.workunit.client.1.smithi098.stdout:9/18: getdents . 0 2024-09-20T19:05:40.086 INFO:tasks.workunit.client.1.smithi098.stdout:9/19: dread f0 [0,4194304] 0 2024-09-20T19:05:40.230 INFO:tasks.workunit.client.1.smithi098.stdout:2/11: creat f2 x:0 0 0 2024-09-20T19:05:40.231 INFO:tasks.workunit.client.1.smithi098.stdout:7/11: readlink l1 0 2024-09-20T19:05:40.231 INFO:tasks.workunit.client.1.smithi098.stdout:7/12: stat l1 0 2024-09-20T19:05:40.231 INFO:tasks.workunit.client.1.smithi098.stdout:7/13: write - no filename 2024-09-20T19:05:40.238 INFO:tasks.workunit.client.1.smithi098.stdout:9/20: mkdir d4 0 2024-09-20T19:05:40.238 INFO:tasks.workunit.client.1.smithi098.stdout:9/21: truncate f3 49880 0 2024-09-20T19:05:40.241 INFO:tasks.workunit.client.1.smithi098.stdout:0/26: creat d0/d6/f7 x:0 0 0 2024-09-20T19:05:40.242 INFO:tasks.workunit.client.1.smithi098.stdout:2/12: mkdir d3 0 2024-09-20T19:05:40.245 INFO:tasks.workunit.client.1.smithi098.stdout:7/14: rename l1 to d3/l4 0 2024-09-20T19:05:40.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/27: mknod d0/d6/c8 0 2024-09-20T19:05:40.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/28: readlink - no filename 2024-09-20T19:05:40.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/29: chown d0 148782056 1 2024-09-20T19:05:40.259 INFO:tasks.workunit.client.1.smithi098.stdout:7/15: symlink d3/l5 0 2024-09-20T19:05:40.260 INFO:tasks.workunit.client.1.smithi098.stdout:7/16: dwrite - no filename 2024-09-20T19:05:40.260 INFO:tasks.workunit.client.1.smithi098.stdout:7/17: dwrite - no filename 2024-09-20T19:05:40.260 INFO:tasks.workunit.client.1.smithi098.stdout:7/18: write - no filename 2024-09-20T19:05:40.262 INFO:tasks.workunit.client.1.smithi098.stdout:0/30: dwrite d0/d6/f7 [0,4194304] 0 2024-09-20T19:05:40.263 INFO:tasks.workunit.client.1.smithi098.stdout:9/22: creat d4/f5 x:0 0 0 2024-09-20T19:05:40.264 INFO:tasks.workunit.client.1.smithi098.stdout:5/11: dread d1/f2 [0,4194304] 0 2024-09-20T19:05:40.265 INFO:tasks.workunit.client.1.smithi098.stdout:2/13: mknod d3/c4 0 2024-09-20T19:05:40.265 INFO:tasks.workunit.client.1.smithi098.stdout:5/12: chown d1/c3 1647 1 2024-09-20T19:05:40.271 INFO:tasks.workunit.client.1.smithi098.stdout:9/23: rename d4/f5 to d4/f6 0 2024-09-20T19:05:40.275 INFO:tasks.workunit.client.1.smithi098.stdout:2/14: dwrite f2 [0,4194304] 0 2024-09-20T19:05:40.284 INFO:tasks.workunit.client.1.smithi098.stdout:9/24: mkdir d4/d7 0 2024-09-20T19:05:40.285 INFO:tasks.workunit.client.1.smithi098.stdout:2/15: mknod d3/c5 0 2024-09-20T19:05:40.290 INFO:tasks.workunit.client.1.smithi098.stdout:2/16: write f1 [7342870,41758] 0 2024-09-20T19:05:40.291 INFO:tasks.workunit.client.1.smithi098.stdout:2/17: stat f1 0 2024-09-20T19:05:40.295 INFO:tasks.workunit.client.1.smithi098.stdout:2/18: creat d3/f6 x:0 0 0 2024-09-20T19:05:40.297 INFO:tasks.workunit.client.1.smithi098.stdout:9/25: rmdir d4/d7 0 2024-09-20T19:05:40.301 INFO:tasks.workunit.client.1.smithi098.stdout:9/26: creat d4/f8 x:0 0 0 2024-09-20T19:05:40.304 INFO:tasks.workunit.client.1.smithi098.stdout:2/19: dwrite d3/f6 [0,4194304] 0 2024-09-20T19:05:40.307 INFO:tasks.workunit.client.1.smithi098.stdout:9/27: dread f1 [0,4194304] 0 2024-09-20T19:05:40.307 INFO:tasks.workunit.client.1.smithi098.stdout:9/28: truncate f0 5085706 0 2024-09-20T19:05:40.312 INFO:tasks.workunit.client.1.smithi098.stdout:9/29: dread f0 [0,4194304] 0 2024-09-20T19:05:40.313 INFO:tasks.workunit.client.1.smithi098.stdout:9/30: stat d4/f8 0 2024-09-20T19:05:40.388 INFO:tasks.workunit.client.1.smithi098.stdout:9/31: dwrite f0 [4194304,4194304] 0 2024-09-20T19:05:40.393 INFO:tasks.workunit.client.1.smithi098.stdout:9/32: write f1 [3783234,19769] 0 2024-09-20T19:05:40.396 INFO:tasks.workunit.client.1.smithi098.stdout:9/33: rmdir d4 39 2024-09-20T19:05:40.396 INFO:tasks.workunit.client.1.smithi098.stdout:9/34: chown f3 1579629893 1 2024-09-20T19:05:40.505 INFO:tasks.workunit.client.1.smithi098.stdout:9/35: dread - d4/f8 zero size 2024-09-20T19:05:40.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/12: dwrite f0 [4194304,4194304] 0 2024-09-20T19:05:40.506 INFO:tasks.workunit.client.1.smithi098.stdout:9/36: write f0 [6048625,27099] 0 2024-09-20T19:05:40.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/19: chown d3/l4 2494829 1 2024-09-20T19:05:40.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/20: write - no filename 2024-09-20T19:05:40.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/21: dwrite - no filename 2024-09-20T19:05:40.512 INFO:tasks.workunit.client.1.smithi098.stdout:9/37: mkdir d4/d9 0 2024-09-20T19:05:40.514 INFO:tasks.workunit.client.1.smithi098.stdout:7/22: creat d3/f6 x:0 0 0 2024-09-20T19:05:40.515 INFO:tasks.workunit.client.1.smithi098.stdout:4/8: truncate f1 1738546 0 2024-09-20T19:05:40.517 INFO:tasks.workunit.client.1.smithi098.stdout:7/23: symlink d3/l7 0 2024-09-20T19:05:40.521 INFO:tasks.workunit.client.1.smithi098.stdout:7/24: creat d3/f8 x:0 0 0 2024-09-20T19:05:40.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/25: read - d3/f8 zero size 2024-09-20T19:05:40.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/26: readlink d3/l4 0 2024-09-20T19:05:40.524 INFO:tasks.workunit.client.1.smithi098.stdout:7/27: symlink d3/l9 0 2024-09-20T19:05:40.527 INFO:tasks.workunit.client.1.smithi098.stdout:5/13: truncate d1/f2 819238 0 2024-09-20T19:05:40.528 INFO:tasks.workunit.client.1.smithi098.stdout:2/20: write f2 [4995941,10210] 0 2024-09-20T19:05:40.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/13: fsync f0 0 2024-09-20T19:05:40.530 INFO:tasks.workunit.client.1.smithi098.stdout:5/14: creat d1/f4 x:0 0 0 2024-09-20T19:05:40.532 INFO:tasks.workunit.client.1.smithi098.stdout:7/28: dwrite d3/f6 [0,4194304] 0 2024-09-20T19:05:40.532 INFO:tasks.workunit.client.1.smithi098.stdout:2/21: rmdir d3 39 2024-09-20T19:05:40.534 INFO:tasks.workunit.client.1.smithi098.stdout:8/14: creat f1 x:0 0 0 2024-09-20T19:05:40.537 INFO:tasks.workunit.client.1.smithi098.stdout:5/15: mkdir d1/d5 0 2024-09-20T19:05:40.540 INFO:tasks.workunit.client.1.smithi098.stdout:7/29: rename d3/l4 to d3/la 0 2024-09-20T19:05:40.541 INFO:tasks.workunit.client.1.smithi098.stdout:2/22: dread d3/f6 [0,4194304] 0 2024-09-20T19:05:40.542 INFO:tasks.workunit.client.1.smithi098.stdout:8/15: creat f2 x:0 0 0 2024-09-20T19:05:40.547 INFO:tasks.workunit.client.1.smithi098.stdout:7/30: mknod d3/cb 0 2024-09-20T19:05:40.547 INFO:tasks.workunit.client.1.smithi098.stdout:2/23: dwrite f2 [0,4194304] 0 2024-09-20T19:05:40.550 INFO:tasks.workunit.client.1.smithi098.stdout:8/16: creat f3 x:0 0 0 2024-09-20T19:05:40.551 INFO:tasks.workunit.client.1.smithi098.stdout:8/17: read - f2 zero size 2024-09-20T19:05:40.551 INFO:tasks.workunit.client.1.smithi098.stdout:8/18: rmdir - no directory 2024-09-20T19:05:40.552 INFO:tasks.workunit.client.1.smithi098.stdout:7/31: symlink d3/lc 0 2024-09-20T19:05:40.554 INFO:tasks.workunit.client.1.smithi098.stdout:2/24: rename f2 to d3/f7 0 2024-09-20T19:05:40.556 INFO:tasks.workunit.client.1.smithi098.stdout:5/16: rmdir d1/d5 0 2024-09-20T19:05:40.557 INFO:tasks.workunit.client.1.smithi098.stdout:5/17: chown d1/c3 938 1 2024-09-20T19:05:40.559 INFO:tasks.workunit.client.1.smithi098.stdout:7/32: symlink d3/ld 0 2024-09-20T19:05:40.567 INFO:tasks.workunit.client.1.smithi098.stdout:7/33: dwrite d3/f8 [0,4194304] 0 2024-09-20T19:05:40.570 INFO:tasks.workunit.client.1.smithi098.stdout:2/25: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:40.572 INFO:tasks.workunit.client.1.smithi098.stdout:2/26: write d3/f6 [3843685,12654] 0 2024-09-20T19:05:40.610 INFO:tasks.workunit.client.1.smithi098.stdout:9/38: truncate f1 1292616 0 2024-09-20T19:05:40.619 INFO:tasks.workunit.client.1.smithi098.stdout:7/34: unlink d3/la 0 2024-09-20T19:05:40.623 INFO:tasks.workunit.client.1.smithi098.stdout:7/35: creat d3/fe x:0 0 0 2024-09-20T19:05:40.630 INFO:tasks.workunit.client.1.smithi098.stdout:2/27: truncate f1 979720 0 2024-09-20T19:05:40.636 INFO:tasks.workunit.client.1.smithi098.stdout:4/9: write f1 [1800657,17053] 0 2024-09-20T19:05:40.642 INFO:tasks.workunit.client.1.smithi098.stdout:5/18: dwrite d1/f2 [0,4194304] 0 2024-09-20T19:05:40.642 INFO:tasks.workunit.client.1.smithi098.stdout:4/10: symlink d3/l4 0 2024-09-20T19:05:40.647 INFO:tasks.workunit.client.1.smithi098.stdout:5/19: unlink c0 0 2024-09-20T19:05:40.648 INFO:tasks.workunit.client.1.smithi098.stdout:4/11: creat d3/f5 x:0 0 0 2024-09-20T19:05:40.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/39: link f1 d4/fa 0 2024-09-20T19:05:40.656 INFO:tasks.workunit.client.1.smithi098.stdout:4/12: mkdir d3/d6 0 2024-09-20T19:05:40.656 INFO:tasks.workunit.client.1.smithi098.stdout:4/13: fdatasync d3/f5 0 2024-09-20T19:05:40.657 INFO:tasks.workunit.client.1.smithi098.stdout:4/14: write d3/f5 [912601,76161] 0 2024-09-20T19:05:40.658 INFO:tasks.workunit.client.1.smithi098.stdout:4/15: stat d3 0 2024-09-20T19:05:40.660 INFO:tasks.workunit.client.1.smithi098.stdout:5/20: link d1/f2 d1/f6 0 2024-09-20T19:05:40.664 INFO:tasks.workunit.client.1.smithi098.stdout:5/21: write d1/f2 [646660,108847] 0 2024-09-20T19:05:40.670 INFO:tasks.workunit.client.1.smithi098.stdout:2/28: write f1 [764042,33634] 0 2024-09-20T19:05:40.670 INFO:tasks.workunit.client.1.smithi098.stdout:5/22: dwrite d1/f6 [0,4194304] 0 2024-09-20T19:05:40.671 INFO:tasks.workunit.client.1.smithi098.stdout:2/29: write f1 [613263,9045] 0 2024-09-20T19:05:40.671 INFO:tasks.workunit.client.1.smithi098.stdout:4/16: getdents d3 0 2024-09-20T19:05:40.677 INFO:tasks.workunit.client.1.smithi098.stdout:5/23: creat d1/f7 x:0 0 0 2024-09-20T19:05:40.678 INFO:tasks.workunit.client.1.smithi098.stdout:2/30: dwrite f1 [0,4194304] 0 2024-09-20T19:05:40.683 INFO:tasks.workunit.client.1.smithi098.stdout:5/24: dread d1/f2 [0,4194304] 0 2024-09-20T19:05:40.683 INFO:tasks.workunit.client.1.smithi098.stdout:4/17: creat d3/f7 x:0 0 0 2024-09-20T19:05:40.684 INFO:tasks.workunit.client.1.smithi098.stdout:2/31: dread d3/f6 [0,4194304] 0 2024-09-20T19:05:40.685 INFO:tasks.workunit.client.1.smithi098.stdout:4/18: truncate d3/f7 477896 0 2024-09-20T19:05:40.689 INFO:tasks.workunit.client.1.smithi098.stdout:5/25: mknod d1/c8 0 2024-09-20T19:05:40.689 INFO:tasks.workunit.client.1.smithi098.stdout:2/32: dread f1 [0,4194304] 0 2024-09-20T19:05:40.693 INFO:tasks.workunit.client.1.smithi098.stdout:5/26: creat d1/f9 x:0 0 0 2024-09-20T19:05:40.693 INFO:tasks.workunit.client.1.smithi098.stdout:2/33: dread f1 [0,4194304] 0 2024-09-20T19:05:40.697 INFO:tasks.workunit.client.1.smithi098.stdout:4/19: link d3/f5 d3/f8 0 2024-09-20T19:05:40.698 INFO:tasks.workunit.client.1.smithi098.stdout:4/20: truncate d3/f5 1348196 0 2024-09-20T19:05:40.699 INFO:tasks.workunit.client.1.smithi098.stdout:2/34: rename f1 to d3/f8 0 2024-09-20T19:05:40.700 INFO:tasks.workunit.client.1.smithi098.stdout:5/27: dwrite d1/f7 [0,4194304] 0 2024-09-20T19:05:40.706 INFO:tasks.workunit.client.1.smithi098.stdout:2/35: rename d3/f6 to d3/f9 0 2024-09-20T19:05:40.708 INFO:tasks.workunit.client.1.smithi098.stdout:5/28: dread d1/f7 [0,4194304] 0 2024-09-20T19:05:40.709 INFO:tasks.workunit.client.1.smithi098.stdout:4/21: symlink d3/d6/l9 0 2024-09-20T19:05:40.710 INFO:tasks.workunit.client.1.smithi098.stdout:9/40: dwrite f1 [0,4194304] 0 2024-09-20T19:05:40.711 INFO:tasks.workunit.client.1.smithi098.stdout:9/41: chown d4/f8 16617343 1 2024-09-20T19:05:40.712 INFO:tasks.workunit.client.1.smithi098.stdout:9/42: dread - d4/f8 zero size 2024-09-20T19:05:40.714 INFO:tasks.workunit.client.1.smithi098.stdout:9/43: dread - d4/f6 zero size 2024-09-20T19:05:40.715 INFO:tasks.workunit.client.1.smithi098.stdout:4/22: unlink l2 0 2024-09-20T19:05:40.715 INFO:tasks.workunit.client.1.smithi098.stdout:5/29: write d1/f2 [1562335,87245] 0 2024-09-20T19:05:40.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/44: dread f3 [0,4194304] 0 2024-09-20T19:05:40.717 INFO:tasks.workunit.client.1.smithi098.stdout:5/30: dread - d1/f9 zero size 2024-09-20T19:05:40.719 INFO:tasks.workunit.client.1.smithi098.stdout:9/45: dread - d4/f8 zero size 2024-09-20T19:05:40.720 INFO:tasks.workunit.client.1.smithi098.stdout:4/23: read d3/f5 [256683,73124] 0 2024-09-20T19:05:40.721 INFO:tasks.workunit.client.1.smithi098.stdout:2/36: dwrite d3/f8 [4194304,4194304] 0 2024-09-20T19:05:40.722 INFO:tasks.workunit.client.1.smithi098.stdout:5/31: rmdir d1 39 2024-09-20T19:05:40.730 INFO:tasks.workunit.client.1.smithi098.stdout:9/46: rename d4/f6 to d4/fb 0 2024-09-20T19:05:40.737 INFO:tasks.workunit.client.1.smithi098.stdout:4/24: write d3/f8 [144978,44094] 0 2024-09-20T19:05:40.741 INFO:tasks.workunit.client.1.smithi098.stdout:4/25: unlink d3/f8 0 2024-09-20T19:05:40.743 INFO:tasks.workunit.client.1.smithi098.stdout:2/37: getdents d3 0 2024-09-20T19:05:40.743 INFO:tasks.workunit.client.1.smithi098.stdout:4/26: readlink d3/l4 0 2024-09-20T19:05:40.745 INFO:tasks.workunit.client.1.smithi098.stdout:5/32: dwrite d1/f7 [0,4194304] 0 2024-09-20T19:05:40.747 INFO:tasks.workunit.client.1.smithi098.stdout:9/47: getdents d4 0 2024-09-20T19:05:40.749 INFO:tasks.workunit.client.1.smithi098.stdout:4/27: rename d3/l4 to d3/d6/la 0 2024-09-20T19:05:40.750 INFO:tasks.workunit.client.1.smithi098.stdout:2/38: dwrite d3/f8 [0,4194304] 0 2024-09-20T19:05:40.754 INFO:tasks.workunit.client.1.smithi098.stdout:9/48: creat d4/fc x:0 0 0 2024-09-20T19:05:40.756 INFO:tasks.workunit.client.1.smithi098.stdout:4/28: mknod d3/d6/cb 0 2024-09-20T19:05:40.760 INFO:tasks.workunit.client.1.smithi098.stdout:2/39: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:40.761 INFO:tasks.workunit.client.1.smithi098.stdout:9/49: dread f1 [0,4194304] 0 2024-09-20T19:05:40.762 INFO:tasks.workunit.client.1.smithi098.stdout:9/50: write f0 [7414195,111485] 0 2024-09-20T19:05:40.763 INFO:tasks.workunit.client.1.smithi098.stdout:2/40: creat d3/fa x:0 0 0 2024-09-20T19:05:40.768 INFO:tasks.workunit.client.1.smithi098.stdout:9/51: fdatasync f1 0 2024-09-20T19:05:40.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/29: link d3/f5 d3/fc 0 2024-09-20T19:05:40.772 INFO:tasks.workunit.client.1.smithi098.stdout:5/33: truncate d1/f6 143276 0 2024-09-20T19:05:40.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/41: dwrite d3/f7 [4194304,4194304] 0 2024-09-20T19:05:40.773 INFO:tasks.workunit.client.1.smithi098.stdout:9/52: symlink d4/d9/ld 0 2024-09-20T19:05:40.774 INFO:tasks.workunit.client.1.smithi098.stdout:5/34: chown d1/f9 1601118 1 2024-09-20T19:05:40.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/42: stat d3/fa 0 2024-09-20T19:05:40.780 INFO:tasks.workunit.client.1.smithi098.stdout:2/43: creat d3/fb x:0 0 0 2024-09-20T19:05:40.782 INFO:tasks.workunit.client.1.smithi098.stdout:4/30: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:40.784 INFO:tasks.workunit.client.1.smithi098.stdout:2/44: truncate d3/f7 9261978 0 2024-09-20T19:05:40.786 INFO:tasks.workunit.client.1.smithi098.stdout:4/31: creat d3/d6/fd x:0 0 0 2024-09-20T19:05:40.786 INFO:tasks.workunit.client.1.smithi098.stdout:2/45: truncate d3/fa 693118 0 2024-09-20T19:05:40.787 INFO:tasks.workunit.client.1.smithi098.stdout:5/35: dwrite d1/f7 [4194304,4194304] 0 2024-09-20T19:05:40.790 INFO:tasks.workunit.client.1.smithi098.stdout:9/53: rename d4/d9 to d4/de 0 2024-09-20T19:05:40.791 INFO:tasks.workunit.client.1.smithi098.stdout:4/32: read d3/f5 [1107669,100959] 0 2024-09-20T19:05:40.793 INFO:tasks.workunit.client.1.smithi098.stdout:5/36: rename d1/f4 to d1/fa 0 2024-09-20T19:05:40.795 INFO:tasks.workunit.client.1.smithi098.stdout:9/54: mknod d4/cf 0 2024-09-20T19:05:40.796 INFO:tasks.workunit.client.1.smithi098.stdout:2/46: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:40.798 INFO:tasks.workunit.client.1.smithi098.stdout:4/33: creat d3/fe x:0 0 0 2024-09-20T19:05:40.801 INFO:tasks.workunit.client.1.smithi098.stdout:5/37: creat d1/fb x:0 0 0 2024-09-20T19:05:40.803 INFO:tasks.workunit.client.1.smithi098.stdout:9/55: creat d4/f10 x:0 0 0 2024-09-20T19:05:40.803 INFO:tasks.workunit.client.1.smithi098.stdout:2/47: rmdir d3 39 2024-09-20T19:05:40.805 INFO:tasks.workunit.client.1.smithi098.stdout:4/34: creat d3/ff x:0 0 0 2024-09-20T19:05:40.806 INFO:tasks.workunit.client.1.smithi098.stdout:4/35: chown d3/d6 63 1 2024-09-20T19:05:40.807 INFO:tasks.workunit.client.1.smithi098.stdout:5/38: creat d1/fc x:0 0 0 2024-09-20T19:05:40.808 INFO:tasks.workunit.client.1.smithi098.stdout:9/56: symlink d4/l11 0 2024-09-20T19:05:40.810 INFO:tasks.workunit.client.1.smithi098.stdout:4/36: creat d3/d6/f10 x:0 0 0 2024-09-20T19:05:40.811 INFO:tasks.workunit.client.1.smithi098.stdout:4/37: fdatasync d3/fe 0 2024-09-20T19:05:40.812 INFO:tasks.workunit.client.1.smithi098.stdout:5/39: rename d1/f7 to d1/fd 0 2024-09-20T19:05:40.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/57: mknod d4/c12 0 2024-09-20T19:05:40.813 INFO:tasks.workunit.client.1.smithi098.stdout:2/48: rmdir d3 39 2024-09-20T19:05:40.814 INFO:tasks.workunit.client.1.smithi098.stdout:9/58: write d4/fc [461370,48412] 0 2024-09-20T19:05:40.816 INFO:tasks.workunit.client.1.smithi098.stdout:5/40: creat d1/fe x:0 0 0 2024-09-20T19:05:40.821 INFO:tasks.workunit.client.1.smithi098.stdout:2/49: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:40.828 INFO:tasks.workunit.client.1.smithi098.stdout:2/50: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:40.829 INFO:tasks.workunit.client.1.smithi098.stdout:2/51: write d3/f7 [9840078,111450] 0 2024-09-20T19:05:40.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/52: write d3/fa [3837492,33906] 0 2024-09-20T19:05:40.831 INFO:tasks.workunit.client.1.smithi098.stdout:2/53: chown d3 129069 1 2024-09-20T19:05:40.834 INFO:tasks.workunit.client.1.smithi098.stdout:2/54: creat d3/fc x:0 0 0 2024-09-20T19:05:40.840 INFO:tasks.workunit.client.1.smithi098.stdout:4/38: write d3/fc [1036442,86572] 0 2024-09-20T19:05:40.841 INFO:tasks.workunit.client.1.smithi098.stdout:9/59: write f3 [218548,32481] 0 2024-09-20T19:05:40.843 INFO:tasks.workunit.client.1.smithi098.stdout:2/55: dwrite d3/f8 [8388608,4194304] 0 2024-09-20T19:05:40.844 INFO:tasks.workunit.client.1.smithi098.stdout:9/60: rename d4 to d4/de/d13 22 2024-09-20T19:05:40.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/39: write d3/f7 [2896521,116631] 0 2024-09-20T19:05:40.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/61: write d4/fc [414129,91112] 0 2024-09-20T19:05:40.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/40: write f1 [135368,113029] 0 2024-09-20T19:05:40.846 INFO:tasks.workunit.client.1.smithi098.stdout:9/62: dread - d4/f10 zero size 2024-09-20T19:05:40.848 INFO:tasks.workunit.client.1.smithi098.stdout:5/41: write d1/f6 [851915,95049] 0 2024-09-20T19:05:40.850 INFO:tasks.workunit.client.1.smithi098.stdout:2/56: unlink d3/fb 0 2024-09-20T19:05:40.851 INFO:tasks.workunit.client.1.smithi098.stdout:4/41: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:40.855 INFO:tasks.workunit.client.1.smithi098.stdout:9/63: creat d4/de/f14 x:0 0 0 2024-09-20T19:05:40.858 INFO:tasks.workunit.client.1.smithi098.stdout:5/42: rename d1/fa to d1/ff 0 2024-09-20T19:05:40.858 INFO:tasks.workunit.client.1.smithi098.stdout:5/43: readlink - no filename 2024-09-20T19:05:40.859 INFO:tasks.workunit.client.1.smithi098.stdout:4/42: mkdir d3/d6/d11 0 2024-09-20T19:05:40.861 INFO:tasks.workunit.client.1.smithi098.stdout:9/64: rename d4/fa to d4/f15 0 2024-09-20T19:05:40.862 INFO:tasks.workunit.client.1.smithi098.stdout:9/65: chown f1 2668 1 2024-09-20T19:05:40.862 INFO:tasks.workunit.client.1.smithi098.stdout:5/44: mknod d1/c10 0 2024-09-20T19:05:40.863 INFO:tasks.workunit.client.1.smithi098.stdout:5/45: dread - d1/f9 zero size 2024-09-20T19:05:40.863 INFO:tasks.workunit.client.1.smithi098.stdout:4/43: symlink d3/d6/l12 0 2024-09-20T19:05:40.864 INFO:tasks.workunit.client.1.smithi098.stdout:4/44: dread - d3/d6/f10 zero size 2024-09-20T19:05:40.867 INFO:tasks.workunit.client.1.smithi098.stdout:9/66: rename d4/de/f14 to d4/f16 0 2024-09-20T19:05:40.868 INFO:tasks.workunit.client.1.smithi098.stdout:9/67: truncate d4/f8 641727 0 2024-09-20T19:05:40.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/46: symlink d1/l11 0 2024-09-20T19:05:40.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/47: write d1/fc [1018042,124714] 0 2024-09-20T19:05:40.870 INFO:tasks.workunit.client.1.smithi098.stdout:5/48: dread - d1/ff zero size 2024-09-20T19:05:40.871 INFO:tasks.workunit.client.1.smithi098.stdout:5/49: truncate d1/ff 983853 0 2024-09-20T19:05:40.871 INFO:tasks.workunit.client.1.smithi098.stdout:4/45: creat d3/d6/f13 x:0 0 0 2024-09-20T19:05:40.873 INFO:tasks.workunit.client.1.smithi098.stdout:2/57: getdents d3 0 2024-09-20T19:05:40.876 INFO:tasks.workunit.client.1.smithi098.stdout:9/68: write d4/fb [819625,67828] 0 2024-09-20T19:05:40.881 INFO:tasks.workunit.client.1.smithi098.stdout:4/46: dwrite d3/d6/f10 [0,4194304] 0 2024-09-20T19:05:40.882 INFO:tasks.workunit.client.1.smithi098.stdout:4/47: dread - d3/d6/fd zero size 2024-09-20T19:05:40.883 INFO:tasks.workunit.client.1.smithi098.stdout:9/69: mkdir d4/d17 0 2024-09-20T19:05:40.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/48: write d3/d6/f10 [91000,108533] 0 2024-09-20T19:05:40.885 INFO:tasks.workunit.client.1.smithi098.stdout:9/70: truncate d4/fc 828402 0 2024-09-20T19:05:40.887 INFO:tasks.workunit.client.1.smithi098.stdout:5/50: link d1/c3 d1/c12 0 2024-09-20T19:05:40.890 INFO:tasks.workunit.client.1.smithi098.stdout:9/71: unlink d4/fc 0 2024-09-20T19:05:40.893 INFO:tasks.workunit.client.1.smithi098.stdout:4/49: dwrite d3/ff [0,4194304] 0 2024-09-20T19:05:40.894 INFO:tasks.workunit.client.1.smithi098.stdout:5/51: fdatasync d1/ff 0 2024-09-20T19:05:40.900 INFO:tasks.workunit.client.1.smithi098.stdout:5/52: truncate d1/f2 1519749 0 2024-09-20T19:05:40.903 INFO:tasks.workunit.client.1.smithi098.stdout:2/58: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:40.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/72: link d4/l11 d4/de/l18 0 2024-09-20T19:05:40.905 INFO:tasks.workunit.client.1.smithi098.stdout:5/53: creat d1/f13 x:0 0 0 2024-09-20T19:05:40.909 INFO:tasks.workunit.client.1.smithi098.stdout:2/59: creat d3/fd x:0 0 0 2024-09-20T19:05:40.909 INFO:tasks.workunit.client.1.smithi098.stdout:4/50: dwrite d3/f5 [0,4194304] 0 2024-09-20T19:05:40.909 INFO:tasks.workunit.client.1.smithi098.stdout:9/73: mkdir d4/de/d19 0 2024-09-20T19:05:40.911 INFO:tasks.workunit.client.1.smithi098.stdout:5/54: creat d1/f14 x:0 0 0 2024-09-20T19:05:40.912 INFO:tasks.workunit.client.1.smithi098.stdout:9/74: write d4/f8 [823412,20857] 0 2024-09-20T19:05:40.912 INFO:tasks.workunit.client.1.smithi098.stdout:2/60: rmdir d3 39 2024-09-20T19:05:40.913 INFO:tasks.workunit.client.1.smithi098.stdout:4/51: mknod d3/d6/d11/c14 0 2024-09-20T19:05:40.914 INFO:tasks.workunit.client.1.smithi098.stdout:5/55: chown d1/c3 27365903 1 2024-09-20T19:05:40.915 INFO:tasks.workunit.client.1.smithi098.stdout:5/56: stat d1/c3 0 2024-09-20T19:05:40.915 INFO:tasks.workunit.client.1.smithi098.stdout:9/75: creat d4/f1a x:0 0 0 2024-09-20T19:05:40.917 INFO:tasks.workunit.client.1.smithi098.stdout:4/52: creat d3/d6/d11/f15 x:0 0 0 2024-09-20T19:05:40.920 INFO:tasks.workunit.client.1.smithi098.stdout:9/76: creat d4/de/f1b x:0 0 0 2024-09-20T19:05:40.921 INFO:tasks.workunit.client.1.smithi098.stdout:2/61: symlink d3/le 0 2024-09-20T19:05:40.921 INFO:tasks.workunit.client.1.smithi098.stdout:9/77: write d4/fb [623526,84185] 0 2024-09-20T19:05:40.922 INFO:tasks.workunit.client.1.smithi098.stdout:2/62: fsync d3/f9 0 2024-09-20T19:05:40.922 INFO:tasks.workunit.client.1.smithi098.stdout:4/53: creat d3/f16 x:0 0 0 2024-09-20T19:05:40.923 INFO:tasks.workunit.client.1.smithi098.stdout:9/78: readlink d4/de/ld 0 2024-09-20T19:05:40.925 INFO:tasks.workunit.client.1.smithi098.stdout:4/54: symlink d3/d6/l17 0 2024-09-20T19:05:40.925 INFO:tasks.workunit.client.1.smithi098.stdout:4/55: chown d3/d6/f13 2 1 2024-09-20T19:05:40.929 INFO:tasks.workunit.client.1.smithi098.stdout:4/56: link d3/f5 d3/d6/f18 0 2024-09-20T19:05:40.931 INFO:tasks.workunit.client.1.smithi098.stdout:4/57: fdatasync d3/fc 0 2024-09-20T19:05:40.933 INFO:tasks.workunit.client.1.smithi098.stdout:2/63: fsync d3/fd 0 2024-09-20T19:05:40.935 INFO:tasks.workunit.client.1.smithi098.stdout:4/58: dread d3/d6/f10 [0,4194304] 0 2024-09-20T19:05:40.936 INFO:tasks.workunit.client.1.smithi098.stdout:2/64: mkdir d3/df 0 2024-09-20T19:05:40.943 INFO:tasks.workunit.client.1.smithi098.stdout:2/65: dwrite d3/f8 [4194304,4194304] 0 2024-09-20T19:05:40.945 INFO:tasks.workunit.client.1.smithi098.stdout:4/59: link l0 d3/d6/d11/l19 0 2024-09-20T19:05:40.948 INFO:tasks.workunit.client.1.smithi098.stdout:2/66: dread d3/f8 [0,4194304] 0 2024-09-20T19:05:40.955 INFO:tasks.workunit.client.1.smithi098.stdout:2/67: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:40.956 INFO:tasks.workunit.client.1.smithi098.stdout:2/68: fdatasync d3/f7 0 2024-09-20T19:05:40.958 INFO:tasks.workunit.client.1.smithi098.stdout:2/69: fdatasync d3/f8 0 2024-09-20T19:05:40.961 INFO:tasks.workunit.client.1.smithi098.stdout:2/70: mknod d3/df/c10 0 2024-09-20T19:05:40.961 INFO:tasks.workunit.client.1.smithi098.stdout:2/71: stat d3 0 2024-09-20T19:05:40.962 INFO:tasks.workunit.client.1.smithi098.stdout:2/72: fsync d3/fc 0 2024-09-20T19:05:40.965 INFO:tasks.workunit.client.1.smithi098.stdout:2/73: link d3/f9 d3/df/f11 0 2024-09-20T19:05:40.969 INFO:tasks.workunit.client.1.smithi098.stdout:2/74: rename d3/f8 to d3/f12 0 2024-09-20T19:05:40.970 INFO:tasks.workunit.client.1.smithi098.stdout:2/75: rmdir d3/df 39 2024-09-20T19:05:40.976 INFO:tasks.workunit.client.1.smithi098.stdout:2/76: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:40.978 INFO:tasks.workunit.client.1.smithi098.stdout:2/77: mkdir d3/df/d13 0 2024-09-20T19:05:40.979 INFO:tasks.workunit.client.1.smithi098.stdout:2/78: mknod d3/df/c14 0 2024-09-20T19:05:41.004 INFO:tasks.workunit.client.1.smithi098.stdout:2/79: link d3/f12 d3/f15 0 2024-09-20T19:05:41.067 INFO:tasks.workunit.client.1.smithi098.stdout:2/80: truncate d3/f12 9553852 0 2024-09-20T19:05:41.067 INFO:tasks.workunit.client.1.smithi098.stdout:2/81: stat d3/fc 0 2024-09-20T19:05:41.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/82: chown d3/fa 398 1 2024-09-20T19:05:41.178 INFO:tasks.workunit.client.1.smithi098.stdout:2/83: mkdir d3/d16 0 2024-09-20T19:05:41.184 INFO:tasks.workunit.client.1.smithi098.stdout:2/84: dwrite d3/fc [0,4194304] 0 2024-09-20T19:05:41.184 INFO:tasks.workunit.client.1.smithi098.stdout:2/85: readlink d3/le 0 2024-09-20T19:05:41.188 INFO:tasks.workunit.client.1.smithi098.stdout:2/86: mknod d3/d16/c17 0 2024-09-20T19:05:41.189 INFO:tasks.workunit.client.1.smithi098.stdout:2/87: stat d3/df/f11 0 2024-09-20T19:05:41.189 INFO:tasks.workunit.client.1.smithi098.stdout:2/88: fsync d3/fd 0 2024-09-20T19:05:41.192 INFO:tasks.workunit.client.1.smithi098.stdout:2/89: creat d3/df/d13/f18 x:0 0 0 2024-09-20T19:05:41.194 INFO:tasks.workunit.client.1.smithi098.stdout:2/90: symlink d3/df/d13/l19 0 2024-09-20T19:05:41.196 INFO:tasks.workunit.client.1.smithi098.stdout:2/91: mkdir d3/d16/d1a 0 2024-09-20T19:05:41.198 INFO:tasks.workunit.client.1.smithi098.stdout:2/92: symlink d3/df/l1b 0 2024-09-20T19:05:41.202 INFO:tasks.workunit.client.1.smithi098.stdout:2/93: link l0 d3/l1c 0 2024-09-20T19:05:41.208 INFO:tasks.workunit.client.1.smithi098.stdout:2/94: dwrite d3/fc [0,4194304] 0 2024-09-20T19:05:41.345 INFO:tasks.workunit.client.1.smithi098.stdout:2/95: truncate d3/fa 1574246 0 2024-09-20T19:05:41.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/96: mkdir d3/d16/d1d 0 2024-09-20T19:05:41.349 INFO:tasks.workunit.client.1.smithi098.stdout:2/97: creat d3/f1e x:0 0 0 2024-09-20T19:05:41.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/98: getdents d3 0 2024-09-20T19:05:41.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/99: readlink l0 0 2024-09-20T19:05:41.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/100: link d3/l1c d3/d16/l1f 0 2024-09-20T19:05:41.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/101: dread d3/fc [0,4194304] 0 2024-09-20T19:05:41.496 INFO:tasks.workunit.client.1.smithi098.stdout:2/102: truncate d3/fc 2427893 0 2024-09-20T19:05:41.497 INFO:tasks.workunit.client.1.smithi098.stdout:2/103: creat d3/f20 x:0 0 0 2024-09-20T19:05:41.499 INFO:tasks.workunit.client.1.smithi098.stdout:2/104: fdatasync d3/df/f11 0 2024-09-20T19:05:41.502 INFO:tasks.workunit.client.1.smithi098.stdout:2/105: dread d3/df/f11 [0,4194304] 0 2024-09-20T19:05:41.509 INFO:tasks.workunit.client.1.smithi098.stdout:2/106: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:41.515 INFO:tasks.workunit.client.1.smithi098.stdout:2/107: unlink d3/fc 0 2024-09-20T19:05:41.517 INFO:tasks.workunit.client.1.smithi098.stdout:2/108: symlink d3/d16/l21 0 2024-09-20T19:05:41.521 INFO:tasks.workunit.client.1.smithi098.stdout:2/109: dread d3/f15 [4194304,4194304] 0 2024-09-20T19:05:41.522 INFO:tasks.workunit.client.1.smithi098.stdout:2/110: symlink d3/d16/d1a/l22 0 2024-09-20T19:05:41.530 INFO:tasks.workunit.client.1.smithi098.stdout:2/111: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:41.533 INFO:tasks.workunit.client.1.smithi098.stdout:2/112: fdatasync d3/f12 0 2024-09-20T19:05:41.535 INFO:tasks.workunit.client.1.smithi098.stdout:2/113: creat d3/df/d13/f23 x:0 0 0 2024-09-20T19:05:41.535 INFO:tasks.workunit.client.1.smithi098.stdout:2/114: fsync d3/f9 0 2024-09-20T19:05:41.537 INFO:tasks.workunit.client.1.smithi098.stdout:2/115: link d3/d16/l21 d3/d16/d1a/l24 0 2024-09-20T19:05:41.542 INFO:tasks.workunit.client.1.smithi098.stdout:2/116: mknod d3/d16/c25 0 2024-09-20T19:05:41.542 INFO:tasks.workunit.client.1.smithi098.stdout:2/117: symlink d3/d16/d1a/l26 0 2024-09-20T19:05:41.546 INFO:tasks.workunit.client.1.smithi098.stdout:2/118: dwrite d3/df/f11 [4194304,4194304] 0 2024-09-20T19:05:41.549 INFO:tasks.workunit.client.1.smithi098.stdout:2/119: rename d3/f20 to d3/d16/d1a/f27 0 2024-09-20T19:05:41.554 INFO:tasks.workunit.client.1.smithi098.stdout:2/120: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:41.555 INFO:tasks.workunit.client.1.smithi098.stdout:2/121: dread - d3/f1e zero size 2024-09-20T19:05:41.557 INFO:tasks.workunit.client.1.smithi098.stdout:2/122: symlink d3/d16/d1d/l28 0 2024-09-20T19:05:41.557 INFO:tasks.workunit.client.1.smithi098.stdout:2/123: dread - d3/fd zero size 2024-09-20T19:05:41.559 INFO:tasks.workunit.client.1.smithi098.stdout:2/124: creat d3/df/d13/f29 x:0 0 0 2024-09-20T19:05:41.560 INFO:tasks.workunit.client.1.smithi098.stdout:2/125: write d3/df/d13/f29 [259061,21691] 0 2024-09-20T19:05:41.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:41 smithi027 ceph-mon[28196]: pgmap v256: 65 pgs: 65 active+clean; 214 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2024-09-20T19:05:41.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:41 smithi098 ceph-mon[35737]: pgmap v256: 65 pgs: 65 active+clean; 214 MiB data, 862 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2024-09-20T19:05:43.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:43 smithi027 ceph-mon[28196]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.4 MiB/s wr, 335 op/s 2024-09-20T19:05:43.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:43 smithi098 ceph-mon[35737]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.4 MiB/s wr, 335 op/s 2024-09-20T19:05:44.023 INFO:tasks.workunit.client.1.smithi098.stdout:3/2: sync 2024-09-20T19:05:44.117 INFO:tasks.workunit.client.1.smithi098.stdout:6/6: sync 2024-09-20T19:05:44.117 INFO:tasks.workunit.client.1.smithi098.stdout:1/8: sync 2024-09-20T19:05:44.117 INFO:tasks.workunit.client.1.smithi098.stdout:6/7: dread - no filename 2024-09-20T19:05:44.117 INFO:tasks.workunit.client.1.smithi098.stdout:6/8: write - no filename 2024-09-20T19:05:44.117 INFO:tasks.workunit.client.1.smithi098.stdout:6/9: dread - no filename 2024-09-20T19:05:44.118 INFO:tasks.workunit.client.1.smithi098.stdout:6/10: dread - no filename 2024-09-20T19:05:44.168 INFO:tasks.workunit.client.1.smithi098.stdout:1/9: mkdir d1/d3 0 2024-09-20T19:05:44.168 INFO:tasks.workunit.client.1.smithi098.stdout:6/11: mknod d0/c1 0 2024-09-20T19:05:44.168 INFO:tasks.workunit.client.1.smithi098.stdout:6/12: read - no filename 2024-09-20T19:05:44.170 INFO:tasks.workunit.client.1.smithi098.stdout:6/13: creat d0/f2 x:0 0 0 2024-09-20T19:05:44.170 INFO:tasks.workunit.client.1.smithi098.stdout:1/10: mknod d1/d3/c4 0 2024-09-20T19:05:44.170 INFO:tasks.workunit.client.1.smithi098.stdout:6/14: read - d0/f2 zero size 2024-09-20T19:05:44.178 INFO:tasks.workunit.client.1.smithi098.stdout:1/11: dwrite d1/f2 [0,4194304] 0 2024-09-20T19:05:44.178 INFO:tasks.workunit.client.1.smithi098.stdout:6/15: dwrite d0/f2 [0,4194304] 0 2024-09-20T19:05:44.179 INFO:tasks.workunit.client.1.smithi098.stdout:1/12: chown d1/f2 328440 1 2024-09-20T19:05:44.183 INFO:tasks.workunit.client.1.smithi098.stdout:1/13: write f0 [1077557,107071] 0 2024-09-20T19:05:44.185 INFO:tasks.workunit.client.1.smithi098.stdout:6/16: rename d0/c1 to d0/c3 0 2024-09-20T19:05:44.186 INFO:tasks.workunit.client.1.smithi098.stdout:6/17: stat d0/f2 0 2024-09-20T19:05:44.189 INFO:tasks.workunit.client.1.smithi098.stdout:1/14: dread d1/f2 [0,4194304] 0 2024-09-20T19:05:44.193 INFO:tasks.workunit.client.1.smithi098.stdout:1/15: unlink d1/d3/c4 0 2024-09-20T19:05:44.194 INFO:tasks.workunit.client.1.smithi098.stdout:1/16: write f0 [463455,98528] 0 2024-09-20T19:05:44.194 INFO:tasks.workunit.client.1.smithi098.stdout:1/17: stat d1/f2 0 2024-09-20T19:05:44.198 INFO:tasks.workunit.client.1.smithi098.stdout:1/18: dread f0 [0,4194304] 0 2024-09-20T19:05:44.200 INFO:tasks.workunit.client.1.smithi098.stdout:1/19: creat d1/d3/f5 x:0 0 0 2024-09-20T19:05:44.203 INFO:tasks.workunit.client.1.smithi098.stdout:1/20: write f0 [1568796,56552] 0 2024-09-20T19:05:44.204 INFO:tasks.workunit.client.1.smithi098.stdout:1/21: write f0 [1649274,15367] 0 2024-09-20T19:05:44.204 INFO:tasks.workunit.client.1.smithi098.stdout:1/22: readlink - no filename 2024-09-20T19:05:44.205 INFO:tasks.workunit.client.1.smithi098.stdout:1/23: rmdir d1 39 2024-09-20T19:05:44.208 INFO:tasks.workunit.client.1.smithi098.stdout:1/24: link d1/d3/f5 d1/d3/f6 0 2024-09-20T19:05:44.210 INFO:tasks.workunit.client.1.smithi098.stdout:1/25: creat d1/d3/f7 x:0 0 0 2024-09-20T19:05:44.211 INFO:tasks.workunit.client.1.smithi098.stdout:1/26: symlink d1/d3/l8 0 2024-09-20T19:05:44.215 INFO:tasks.workunit.client.1.smithi098.stdout:1/27: link d1/d3/f7 d1/d3/f9 0 2024-09-20T19:05:44.218 INFO:tasks.workunit.client.1.smithi098.stdout:1/28: link d1/d3/f6 d1/fa 0 2024-09-20T19:05:44.222 INFO:tasks.workunit.client.1.smithi098.stdout:1/29: dread d1/f2 [0,4194304] 0 2024-09-20T19:05:44.251 INFO:tasks.workunit.client.1.smithi098.stdout:0/31: sync 2024-09-20T19:05:44.252 INFO:tasks.workunit.client.1.smithi098.stdout:8/19: sync 2024-09-20T19:05:44.252 INFO:tasks.workunit.client.1.smithi098.stdout:8/20: dread - f2 zero size 2024-09-20T19:05:44.252 INFO:tasks.workunit.client.1.smithi098.stdout:8/21: read - f3 zero size 2024-09-20T19:05:44.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/32: symlink d0/l9 0 2024-09-20T19:05:44.255 INFO:tasks.workunit.client.1.smithi098.stdout:0/33: read d0/f2 [3006798,35963] 0 2024-09-20T19:05:44.255 INFO:tasks.workunit.client.1.smithi098.stdout:0/34: dread - d0/f5 zero size 2024-09-20T19:05:44.256 INFO:tasks.workunit.client.1.smithi098.stdout:0/35: chown d0/f2 1025865737 1 2024-09-20T19:05:44.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/22: symlink l4 0 2024-09-20T19:05:44.257 INFO:tasks.workunit.client.1.smithi098.stdout:0/36: write d0/f5 [791008,25681] 0 2024-09-20T19:05:44.261 INFO:tasks.workunit.client.1.smithi098.stdout:0/37: creat d0/fa x:0 0 0 2024-09-20T19:05:44.265 INFO:tasks.workunit.client.1.smithi098.stdout:8/23: dwrite f2 [0,4194304] 0 2024-09-20T19:05:44.265 INFO:tasks.workunit.client.1.smithi098.stdout:8/24: rmdir - no directory 2024-09-20T19:05:44.267 INFO:tasks.workunit.client.1.smithi098.stdout:8/25: read f2 [3614668,79143] 0 2024-09-20T19:05:44.272 INFO:tasks.workunit.client.1.smithi098.stdout:0/38: dwrite d0/fa [0,4194304] 0 2024-09-20T19:05:44.281 INFO:tasks.workunit.client.1.smithi098.stdout:8/26: unlink f2 0 2024-09-20T19:05:44.282 INFO:tasks.workunit.client.1.smithi098.stdout:8/27: rmdir - no directory 2024-09-20T19:05:44.282 INFO:tasks.workunit.client.1.smithi098.stdout:8/28: read - f1 zero size 2024-09-20T19:05:44.288 INFO:tasks.workunit.client.1.smithi098.stdout:8/29: symlink l5 0 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:2/126: sync 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:5/57: sync 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:4/60: sync 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:3/3: sync 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:3/4: write - no filename 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:3/5: dwrite - no filename 2024-09-20T19:05:44.383 INFO:tasks.workunit.client.1.smithi098.stdout:7/36: sync 2024-09-20T19:05:44.384 INFO:tasks.workunit.client.1.smithi098.stdout:9/79: sync 2024-09-20T19:05:44.384 INFO:tasks.workunit.client.1.smithi098.stdout:6/18: sync 2024-09-20T19:05:44.388 INFO:tasks.workunit.client.1.smithi098.stdout:3/6: creat f2 x:0 0 0 2024-09-20T19:05:44.392 INFO:tasks.workunit.client.1.smithi098.stdout:6/19: creat d0/f4 x:0 0 0 2024-09-20T19:05:44.392 INFO:tasks.workunit.client.1.smithi098.stdout:6/20: readlink - no filename 2024-09-20T19:05:44.394 INFO:tasks.workunit.client.1.smithi098.stdout:9/80: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:05:44.398 INFO:tasks.workunit.client.1.smithi098.stdout:4/61: mknod d3/d6/d11/c1a 0 2024-09-20T19:05:44.400 INFO:tasks.workunit.client.1.smithi098.stdout:6/21: dwrite d0/f4 [0,4194304] 0 2024-09-20T19:05:44.401 INFO:tasks.workunit.client.1.smithi098.stdout:6/22: chown d0/f4 708290 1 2024-09-20T19:05:44.402 INFO:tasks.workunit.client.1.smithi098.stdout:3/7: rename c1 to c3 0 2024-09-20T19:05:44.410 INFO:tasks.workunit.client.1.smithi098.stdout:9/81: mkdir d4/de/d1c 0 2024-09-20T19:05:44.414 INFO:tasks.workunit.client.1.smithi098.stdout:9/82: dread d4/f8 [0,4194304] 0 2024-09-20T19:05:44.418 INFO:tasks.workunit.client.1.smithi098.stdout:9/83: dread d4/fb [0,4194304] 0 2024-09-20T19:05:44.418 INFO:tasks.workunit.client.1.smithi098.stdout:6/23: rename d0/f2 to d0/f5 0 2024-09-20T19:05:44.420 INFO:tasks.workunit.client.1.smithi098.stdout:3/8: mkdir d4 0 2024-09-20T19:05:44.425 INFO:tasks.workunit.client.1.smithi098.stdout:9/84: dwrite d4/f10 [0,4194304] 0 2024-09-20T19:05:44.434 INFO:tasks.workunit.client.1.smithi098.stdout:6/24: symlink d0/l6 0 2024-09-20T19:05:44.435 INFO:tasks.workunit.client.1.smithi098.stdout:9/85: dwrite d4/de/f1b [0,4194304] 0 2024-09-20T19:05:44.440 INFO:tasks.workunit.client.1.smithi098.stdout:2/127: rename d3/l1c to d3/l2a 0 2024-09-20T19:05:44.441 INFO:tasks.workunit.client.1.smithi098.stdout:2/128: write d3/df/d13/f18 [624327,16959] 0 2024-09-20T19:05:44.445 INFO:tasks.workunit.client.1.smithi098.stdout:7/37: getdents d3 0 2024-09-20T19:05:44.452 INFO:tasks.workunit.client.1.smithi098.stdout:9/86: write d4/fb [669442,97792] 0 2024-09-20T19:05:44.452 INFO:tasks.workunit.client.1.smithi098.stdout:9/87: fdatasync f0 0 2024-09-20T19:05:44.454 INFO:tasks.workunit.client.1.smithi098.stdout:2/129: mkdir d3/d16/d1d/d2b 0 2024-09-20T19:05:44.456 INFO:tasks.workunit.client.1.smithi098.stdout:7/38: symlink d3/lf 0 2024-09-20T19:05:44.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/39: mkdir d3/d10 0 2024-09-20T19:05:44.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/40: unlink d3/lf 0 2024-09-20T19:05:44.470 INFO:tasks.workunit.client.1.smithi098.stdout:7/41: write d3/f8 [1736644,12389] 0 2024-09-20T19:05:44.471 INFO:tasks.workunit.client.1.smithi098.stdout:7/42: write d3/fe [635663,2197] 0 2024-09-20T19:05:44.471 INFO:tasks.workunit.client.1.smithi098.stdout:7/43: chown d3 0 1 2024-09-20T19:05:44.475 INFO:tasks.workunit.client.1.smithi098.stdout:7/44: rename d3/fe to d3/f11 0 2024-09-20T19:05:44.484 INFO:tasks.workunit.client.1.smithi098.stdout:7/45: dwrite d3/f11 [0,4194304] 0 2024-09-20T19:05:44.485 INFO:tasks.workunit.client.1.smithi098.stdout:7/46: write d3/f8 [5242878,88174] 0 2024-09-20T19:05:44.489 INFO:tasks.workunit.client.1.smithi098.stdout:7/47: creat d3/f12 x:0 0 0 2024-09-20T19:05:44.494 INFO:tasks.workunit.client.1.smithi098.stdout:7/48: creat d3/d10/f13 x:0 0 0 2024-09-20T19:05:44.494 INFO:tasks.workunit.client.1.smithi098.stdout:7/49: dread - d3/f12 zero size 2024-09-20T19:05:44.496 INFO:tasks.workunit.client.1.smithi098.stdout:7/50: write d3/d10/f13 [820008,43764] 0 2024-09-20T19:05:44.497 INFO:tasks.workunit.client.1.smithi098.stdout:7/51: write d3/d10/f13 [913737,18528] 0 2024-09-20T19:05:44.505 INFO:tasks.workunit.client.1.smithi098.stdout:7/52: dwrite d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:44.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/53: mknod d3/d10/c14 0 2024-09-20T19:05:44.515 INFO:tasks.workunit.client.1.smithi098.stdout:7/54: dwrite d3/f11 [0,4194304] 0 2024-09-20T19:05:44.519 INFO:tasks.workunit.client.1.smithi098.stdout:7/55: rename d3/cb to d3/d10/c15 0 2024-09-20T19:05:44.523 INFO:tasks.workunit.client.1.smithi098.stdout:7/56: mkdir d3/d10/d16 0 2024-09-20T19:05:44.524 INFO:tasks.workunit.client.1.smithi098.stdout:7/57: write d3/f6 [4856993,53304] 0 2024-09-20T19:05:44.607 INFO:tasks.workunit.client.1.smithi098.stdout:1/30: fsync d1/d3/f9 0 2024-09-20T19:05:44.608 INFO:tasks.workunit.client.1.smithi098.stdout:1/31: mknod d1/cb 0 2024-09-20T19:05:44.610 INFO:tasks.workunit.client.1.smithi098.stdout:1/32: unlink d1/d3/f7 0 2024-09-20T19:05:44.611 INFO:tasks.workunit.client.1.smithi098.stdout:1/33: rmdir d1 39 2024-09-20T19:05:44.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/34: dwrite d1/f2 [0,4194304] 0 2024-09-20T19:05:44.625 INFO:tasks.workunit.client.1.smithi098.stdout:0/39: truncate d0/d6/f7 3993420 0 2024-09-20T19:05:44.626 INFO:tasks.workunit.client.1.smithi098.stdout:8/30: getdents . 0 2024-09-20T19:05:44.630 INFO:tasks.workunit.client.1.smithi098.stdout:0/40: dread d0/fa [0,4194304] 0 2024-09-20T19:05:44.633 INFO:tasks.workunit.client.1.smithi098.stdout:0/41: mkdir d0/db 0 2024-09-20T19:05:44.634 INFO:tasks.workunit.client.1.smithi098.stdout:8/31: dwrite f1 [0,4194304] 0 2024-09-20T19:05:44.636 INFO:tasks.workunit.client.1.smithi098.stdout:0/42: mkdir d0/d6/dc 0 2024-09-20T19:05:44.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/32: truncate f0 8030849 0 2024-09-20T19:05:44.645 INFO:tasks.workunit.client.1.smithi098.stdout:8/33: creat f6 x:0 0 0 2024-09-20T19:05:44.646 INFO:tasks.workunit.client.1.smithi098.stdout:8/34: chown l5 0 1 2024-09-20T19:05:44.646 INFO:tasks.workunit.client.1.smithi098.stdout:8/35: read - f3 zero size 2024-09-20T19:05:44.647 INFO:tasks.workunit.client.1.smithi098.stdout:8/36: truncate f3 166484 0 2024-09-20T19:05:44.648 INFO:tasks.workunit.client.1.smithi098.stdout:8/37: mkdir d7 0 2024-09-20T19:05:44.648 INFO:tasks.workunit.client.1.smithi098.stdout:8/38: truncate f3 952647 0 2024-09-20T19:05:44.650 INFO:tasks.workunit.client.1.smithi098.stdout:8/39: creat d7/f8 x:0 0 0 2024-09-20T19:05:44.651 INFO:tasks.workunit.client.1.smithi098.stdout:8/40: symlink d7/l9 0 2024-09-20T19:05:44.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/41: fdatasync d7/f8 0 2024-09-20T19:05:44.654 INFO:tasks.workunit.client.1.smithi098.stdout:8/42: rename l5 to d7/la 0 2024-09-20T19:05:44.654 INFO:tasks.workunit.client.1.smithi098.stdout:8/43: truncate f6 133874 0 2024-09-20T19:05:44.655 INFO:tasks.workunit.client.1.smithi098.stdout:8/44: fdatasync f6 0 2024-09-20T19:05:44.655 INFO:tasks.workunit.client.1.smithi098.stdout:8/45: chown l4 3780289 1 2024-09-20T19:05:44.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/46: creat d7/fb x:0 0 0 2024-09-20T19:05:44.702 INFO:tasks.workunit.client.1.smithi098.stdout:3/9: stat c3 0 2024-09-20T19:05:44.702 INFO:tasks.workunit.client.1.smithi098.stdout:3/10: dread - f2 zero size 2024-09-20T19:05:44.703 INFO:tasks.workunit.client.1.smithi098.stdout:3/11: write f2 [651408,80902] 0 2024-09-20T19:05:44.704 INFO:tasks.workunit.client.1.smithi098.stdout:9/88: write d4/f16 [4235860,58220] 0 2024-09-20T19:05:44.705 INFO:tasks.workunit.client.1.smithi098.stdout:9/89: chown c2 80047529 1 2024-09-20T19:05:44.707 INFO:tasks.workunit.client.1.smithi098.stdout:9/90: creat d4/de/f1d x:0 0 0 2024-09-20T19:05:44.708 INFO:tasks.workunit.client.1.smithi098.stdout:9/91: chown d4/d17 4107817 1 2024-09-20T19:05:44.708 INFO:tasks.workunit.client.1.smithi098.stdout:3/12: mkdir d4/d5 0 2024-09-20T19:05:44.708 INFO:tasks.workunit.client.1.smithi098.stdout:9/92: fdatasync d4/f16 0 2024-09-20T19:05:44.710 INFO:tasks.workunit.client.1.smithi098.stdout:5/58: truncate d1/f6 1291961 0 2024-09-20T19:05:44.712 INFO:tasks.workunit.client.1.smithi098.stdout:3/13: dread f2 [0,4194304] 0 2024-09-20T19:05:44.713 INFO:tasks.workunit.client.1.smithi098.stdout:9/93: write d4/f8 [350509,92197] 0 2024-09-20T19:05:44.714 INFO:tasks.workunit.client.1.smithi098.stdout:9/94: dread - d4/de/f1d zero size 2024-09-20T19:05:44.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/14: dread f2 [0,4194304] 0 2024-09-20T19:05:44.723 INFO:tasks.workunit.client.1.smithi098.stdout:3/15: rmdir d4/d5 0 2024-09-20T19:05:44.724 INFO:tasks.workunit.client.1.smithi098.stdout:3/16: truncate f2 1491833 0 2024-09-20T19:05:44.724 INFO:tasks.workunit.client.1.smithi098.stdout:9/95: getdents d4 0 2024-09-20T19:05:44.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/17: mkdir d4/d6 0 2024-09-20T19:05:44.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/18: stat f2 0 2024-09-20T19:05:44.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/19: stat d4 0 2024-09-20T19:05:44.728 INFO:tasks.workunit.client.1.smithi098.stdout:9/96: unlink c2 0 2024-09-20T19:05:44.731 INFO:tasks.workunit.client.1.smithi098.stdout:9/97: link d4/f15 d4/de/d19/f1e 0 2024-09-20T19:05:44.739 INFO:tasks.workunit.client.1.smithi098.stdout:9/98: dwrite f1 [0,4194304] 0 2024-09-20T19:05:44.745 INFO:tasks.workunit.client.1.smithi098.stdout:9/99: rename d4/de/d19/f1e to d4/de/f1f 0 2024-09-20T19:05:44.746 INFO:tasks.workunit.client.1.smithi098.stdout:2/130: dwrite d3/f15 [8388608,4194304] 0 2024-09-20T19:05:44.750 INFO:tasks.workunit.client.1.smithi098.stdout:2/131: write d3/f9 [3394057,22776] 0 2024-09-20T19:05:44.754 INFO:tasks.workunit.client.1.smithi098.stdout:9/100: truncate f0 1465726 0 2024-09-20T19:05:44.759 INFO:tasks.workunit.client.1.smithi098.stdout:2/132: dwrite d3/fd [0,4194304] 0 2024-09-20T19:05:44.759 INFO:tasks.workunit.client.1.smithi098.stdout:9/101: mknod d4/de/d1c/c20 0 2024-09-20T19:05:44.764 INFO:tasks.workunit.client.1.smithi098.stdout:2/133: creat d3/df/d13/f2c x:0 0 0 2024-09-20T19:05:44.769 INFO:tasks.workunit.client.1.smithi098.stdout:9/102: dwrite d4/fb [0,4194304] 0 2024-09-20T19:05:44.769 INFO:tasks.workunit.client.1.smithi098.stdout:9/103: stat d4/cf 0 2024-09-20T19:05:44.770 INFO:tasks.workunit.client.1.smithi098.stdout:9/104: chown f0 0 1 2024-09-20T19:05:44.771 INFO:tasks.workunit.client.1.smithi098.stdout:9/105: chown d4/c12 8 1 2024-09-20T19:05:44.771 INFO:tasks.workunit.client.1.smithi098.stdout:2/134: dread d3/df/f11 [0,4194304] 0 2024-09-20T19:05:44.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/135: fsync d3/df/d13/f23 0 2024-09-20T19:05:44.773 INFO:tasks.workunit.client.1.smithi098.stdout:2/136: chown d3/fd 1475 1 2024-09-20T19:05:44.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/137: chown d3 1 1 2024-09-20T19:05:44.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/138: dread - d3/d16/d1a/f27 zero size 2024-09-20T19:05:44.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/139: readlink d3/d16/d1a/l26 0 2024-09-20T19:05:44.775 INFO:tasks.workunit.client.1.smithi098.stdout:9/106: mkdir d4/d17/d21 0 2024-09-20T19:05:44.779 INFO:tasks.workunit.client.1.smithi098.stdout:2/140: mknod d3/d16/d1d/d2b/c2d 0 2024-09-20T19:05:44.782 INFO:tasks.workunit.client.1.smithi098.stdout:7/58: getdents d3 0 2024-09-20T19:05:44.782 INFO:tasks.workunit.client.1.smithi098.stdout:7/59: stat d3/f12 0 2024-09-20T19:05:44.786 INFO:tasks.workunit.client.1.smithi098.stdout:7/60: dread - d3/f12 zero size 2024-09-20T19:05:44.786 INFO:tasks.workunit.client.1.smithi098.stdout:2/141: dwrite d3/fd [0,4194304] 0 2024-09-20T19:05:44.788 INFO:tasks.workunit.client.1.smithi098.stdout:7/61: mkdir d3/d10/d16/d17 0 2024-09-20T19:05:44.791 INFO:tasks.workunit.client.1.smithi098.stdout:2/142: symlink d3/df/d13/l2e 0 2024-09-20T19:05:44.793 INFO:tasks.workunit.client.1.smithi098.stdout:7/62: mkdir d3/d10/d18 0 2024-09-20T19:05:44.793 INFO:tasks.workunit.client.1.smithi098.stdout:7/63: fsync d3/f8 0 2024-09-20T19:05:44.797 INFO:tasks.workunit.client.1.smithi098.stdout:7/64: creat d3/d10/f19 x:0 0 0 2024-09-20T19:05:44.798 INFO:tasks.workunit.client.1.smithi098.stdout:7/65: write d3/d10/f19 [465961,104871] 0 2024-09-20T19:05:44.799 INFO:tasks.workunit.client.1.smithi098.stdout:2/143: rename d3/d16/c25 to d3/c2f 0 2024-09-20T19:05:44.803 INFO:tasks.workunit.client.1.smithi098.stdout:2/144: rename d3/df/l1b to d3/d16/d1a/l30 0 2024-09-20T19:05:44.805 INFO:tasks.workunit.client.1.smithi098.stdout:7/66: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:44.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/67: mkdir d3/d10/d16/d1a 0 2024-09-20T19:05:44.820 INFO:tasks.workunit.client.1.smithi098.stdout:1/35: dwrite d1/d3/f6 [0,4194304] 0 2024-09-20T19:05:44.820 INFO:tasks.workunit.client.1.smithi098.stdout:7/68: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:44.826 INFO:tasks.workunit.client.1.smithi098.stdout:1/36: creat d1/fc x:0 0 0 2024-09-20T19:05:44.827 INFO:tasks.workunit.client.1.smithi098.stdout:1/37: stat d1/fa 0 2024-09-20T19:05:44.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/43: write d0/f2 [2798445,53469] 0 2024-09-20T19:05:44.830 INFO:tasks.workunit.client.1.smithi098.stdout:1/38: write f0 [1034979,45055] 0 2024-09-20T19:05:44.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/47: dwrite f1 [4194304,4194304] 0 2024-09-20T19:05:44.834 INFO:tasks.workunit.client.1.smithi098.stdout:8/48: truncate d7/f8 562458 0 2024-09-20T19:05:44.836 INFO:tasks.workunit.client.1.smithi098.stdout:8/49: read d7/f8 [53110,13259] 0 2024-09-20T19:05:44.836 INFO:tasks.workunit.client.1.smithi098.stdout:8/50: chown f1 53 1 2024-09-20T19:05:44.840 INFO:tasks.workunit.client.1.smithi098.stdout:0/44: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:44.867 INFO:tasks.workunit.client.1.smithi098.stdout:5/59: truncate d1/fc 342990 0 2024-09-20T19:05:44.872 INFO:tasks.workunit.client.1.smithi098.stdout:5/60: getdents d1 0 2024-09-20T19:05:44.874 INFO:tasks.workunit.client.1.smithi098.stdout:5/61: rename d1/c12 to d1/c15 0 2024-09-20T19:05:44.874 INFO:tasks.workunit.client.1.smithi098.stdout:5/62: chown d1/fb 3102909 1 2024-09-20T19:05:44.876 INFO:tasks.workunit.client.1.smithi098.stdout:5/63: symlink d1/l16 0 2024-09-20T19:05:44.879 INFO:tasks.workunit.client.1.smithi098.stdout:5/64: mkdir d1/d17 0 2024-09-20T19:05:44.886 INFO:tasks.workunit.client.1.smithi098.stdout:9/107: dread f0 [0,4194304] 0 2024-09-20T19:05:44.890 INFO:tasks.workunit.client.0.smithi027.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-20T19:05:44.893 INFO:tasks.workunit.client.1.smithi098.stdout:9/108: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:05:44.895 INFO:tasks.workunit.client.0.smithi027.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T19:05:44.895 INFO:tasks.workunit.client.0.smithi027.stderr:+ make 2024-09-20T19:05:44.897 INFO:tasks.workunit.client.1.smithi098.stdout:9/109: getdents d4/de 0 2024-09-20T19:05:44.905 INFO:tasks.workunit.client.1.smithi098.stdout:9/110: dwrite d4/de/f1f [0,4194304] 0 2024-09-20T19:05:44.995 INFO:tasks.workunit.client.1.smithi098.stdout:7/69: truncate d3/f6 2421517 0 2024-09-20T19:05:44.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/70: dread d3/f8 [0,4194304] 0 2024-09-20T19:05:45.001 INFO:tasks.workunit.client.1.smithi098.stdout:8/51: write f0 [4074060,8477] 0 2024-09-20T19:05:45.008 INFO:tasks.workunit.client.1.smithi098.stdout:7/71: mknod d3/d10/d18/c1b 0 2024-09-20T19:05:45.010 INFO:tasks.workunit.client.1.smithi098.stdout:9/111: getdents d4 0 2024-09-20T19:05:45.014 INFO:tasks.workunit.client.1.smithi098.stdout:9/112: dread d4/de/f1b [0,4194304] 0 2024-09-20T19:05:45.015 INFO:tasks.workunit.client.1.smithi098.stdout:9/113: write f1 [533650,51972] 0 2024-09-20T19:05:45.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/114: mknod d4/de/c22 0 2024-09-20T19:05:45.022 INFO:tasks.workunit.client.1.smithi098.stdout:8/52: getdents d7 0 2024-09-20T19:05:45.024 INFO:tasks.workunit.client.1.smithi098.stdout:9/115: creat d4/de/d1c/f23 x:0 0 0 2024-09-20T19:05:45.024 INFO:tasks.workunit.client.1.smithi098.stdout:9/116: readlink d4/de/ld 0 2024-09-20T19:05:45.024 INFO:tasks.workunit.client.1.smithi098.stdout:8/53: symlink d7/lc 0 2024-09-20T19:05:45.025 INFO:tasks.workunit.client.1.smithi098.stdout:0/45: read d0/d6/f7 [388131,93013] 0 2024-09-20T19:05:45.027 INFO:tasks.workunit.client.1.smithi098.stdout:9/117: mkdir d4/de/d24 0 2024-09-20T19:05:45.029 INFO:tasks.workunit.client.1.smithi098.stdout:8/54: creat d7/fd x:0 0 0 2024-09-20T19:05:45.031 INFO:tasks.workunit.client.1.smithi098.stdout:8/55: unlink f3 0 2024-09-20T19:05:45.034 INFO:tasks.workunit.client.1.smithi098.stdout:8/56: write f1 [2943647,109749] 0 2024-09-20T19:05:45.034 INFO:tasks.workunit.client.1.smithi098.stdout:0/46: creat d0/db/fd x:0 0 0 2024-09-20T19:05:45.035 INFO:tasks.workunit.client.1.smithi098.stdout:8/57: mkdir d7/de 0 2024-09-20T19:05:45.036 INFO:tasks.workunit.client.1.smithi098.stdout:0/47: fsync d0/f5 0 2024-09-20T19:05:45.037 INFO:tasks.workunit.client.1.smithi098.stdout:7/72: getdents d3/d10/d18 0 2024-09-20T19:05:45.039 INFO:tasks.workunit.client.1.smithi098.stdout:1/39: dwrite d1/d3/f9 [0,4194304] 0 2024-09-20T19:05:45.040 INFO:tasks.workunit.client.1.smithi098.stdout:8/58: mknod d7/cf 0 2024-09-20T19:05:45.044 INFO:tasks.workunit.client.1.smithi098.stdout:4/62: sync 2024-09-20T19:05:45.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/59: creat d7/f10 x:0 0 0 2024-09-20T19:05:45.048 INFO:tasks.workunit.client.1.smithi098.stdout:1/40: write d1/d3/f5 [2980374,114096] 0 2024-09-20T19:05:45.050 INFO:tasks.workunit.client.1.smithi098.stdout:8/60: read - d7/f10 zero size 2024-09-20T19:05:45.050 INFO:tasks.workunit.client.1.smithi098.stdout:0/48: dwrite d0/f3 [0,4194304] 0 2024-09-20T19:05:45.050 INFO:tasks.workunit.client.0.smithi027.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-20T19:05:45.055 INFO:tasks.workunit.client.1.smithi098.stdout:7/73: dwrite d3/f11 [0,4194304] 0 2024-09-20T19:05:45.055 INFO:tasks.workunit.client.1.smithi098.stdout:8/61: write f6 [94793,91661] 0 2024-09-20T19:05:45.058 INFO:tasks.workunit.client.1.smithi098.stdout:7/74: chown d3/l7 207233180 1 2024-09-20T19:05:45.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/49: creat d0/d6/fe x:0 0 0 2024-09-20T19:05:45.063 INFO:tasks.workunit.client.1.smithi098.stdout:4/63: dwrite d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:45.066 INFO:tasks.workunit.client.1.smithi098.stdout:4/64: fsync d3/d6/f13 0 2024-09-20T19:05:45.066 INFO:tasks.workunit.client.1.smithi098.stdout:8/62: mkdir d7/de/d11 0 2024-09-20T19:05:45.067 INFO:tasks.workunit.client.1.smithi098.stdout:0/50: truncate d0/db/fd 982455 0 2024-09-20T19:05:45.068 INFO:tasks.workunit.client.1.smithi098.stdout:7/75: chown d3/f6 2 1 2024-09-20T19:05:45.068 INFO:tasks.workunit.client.1.smithi098.stdout:8/63: stat l4 0 2024-09-20T19:05:45.073 INFO:tasks.workunit.client.1.smithi098.stdout:5/65: dwrite d1/f6 [0,4194304] 0 2024-09-20T19:05:45.073 INFO:tasks.workunit.client.1.smithi098.stdout:4/65: write d3/f16 [1024767,75573] 0 2024-09-20T19:05:45.073 INFO:tasks.workunit.client.1.smithi098.stdout:0/51: mknod d0/db/cf 0 2024-09-20T19:05:45.074 INFO:tasks.workunit.client.1.smithi098.stdout:7/76: write d3/d10/f19 [111472,113528] 0 2024-09-20T19:05:45.080 INFO:tasks.workunit.client.1.smithi098.stdout:1/41: truncate d1/d3/f6 2869296 0 2024-09-20T19:05:45.081 INFO:tasks.workunit.client.1.smithi098.stdout:5/66: symlink d1/l18 0 2024-09-20T19:05:45.082 INFO:tasks.workunit.client.1.smithi098.stdout:4/66: readlink d3/d6/la 0 2024-09-20T19:05:45.084 INFO:tasks.workunit.client.1.smithi098.stdout:4/67: fsync d3/ff 0 2024-09-20T19:05:45.084 INFO:tasks.workunit.client.1.smithi098.stdout:7/77: mknod d3/c1c 0 2024-09-20T19:05:45.085 INFO:tasks.workunit.client.1.smithi098.stdout:0/52: creat d0/d6/dc/f10 x:0 0 0 2024-09-20T19:05:45.087 INFO:tasks.workunit.client.1.smithi098.stdout:8/64: dwrite f6 [0,4194304] 0 2024-09-20T19:05:45.088 INFO:tasks.workunit.client.1.smithi098.stdout:7/78: symlink d3/d10/l1d 0 2024-09-20T19:05:45.089 INFO:tasks.workunit.client.1.smithi098.stdout:0/53: write d0/d6/fe [763959,71813] 0 2024-09-20T19:05:45.092 INFO:tasks.workunit.client.1.smithi098.stdout:4/68: link l0 d3/l1b 0 2024-09-20T19:05:45.094 INFO:tasks.workunit.client.1.smithi098.stdout:7/79: dread d3/f6 [0,4194304] 0 2024-09-20T19:05:45.095 INFO:tasks.workunit.client.1.smithi098.stdout:8/65: creat d7/de/d11/f12 x:0 0 0 2024-09-20T19:05:45.097 INFO:tasks.workunit.client.1.smithi098.stdout:4/69: mknod d3/c1c 0 2024-09-20T19:05:45.098 INFO:tasks.workunit.client.1.smithi098.stdout:4/70: write d3/f16 [1010033,128775] 0 2024-09-20T19:05:45.100 INFO:tasks.workunit.client.1.smithi098.stdout:8/66: mkdir d7/de/d13 0 2024-09-20T19:05:45.103 INFO:tasks.workunit.client.1.smithi098.stdout:4/71: creat d3/d6/f1d x:0 0 0 2024-09-20T19:05:45.104 INFO:tasks.workunit.client.1.smithi098.stdout:8/67: mknod d7/de/d11/c14 0 2024-09-20T19:05:45.105 INFO:tasks.workunit.client.1.smithi098.stdout:8/68: chown d7/de 170187 1 2024-09-20T19:05:45.105 INFO:tasks.workunit.client.1.smithi098.stdout:7/80: dwrite d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:45.106 INFO:tasks.workunit.client.1.smithi098.stdout:4/72: mkdir d3/d6/d11/d1e 0 2024-09-20T19:05:45.107 INFO:tasks.workunit.client.1.smithi098.stdout:1/42: write d1/fa [546592,24374] 0 2024-09-20T19:05:45.108 INFO:tasks.workunit.client.1.smithi098.stdout:4/73: write d3/fe [532450,103289] 0 2024-09-20T19:05:45.110 INFO:tasks.workunit.client.1.smithi098.stdout:0/54: truncate d0/f2 2916092 0 2024-09-20T19:05:45.110 INFO:tasks.workunit.client.1.smithi098.stdout:8/69: link l4 d7/l15 0 2024-09-20T19:05:45.112 INFO:tasks.workunit.client.1.smithi098.stdout:1/43: dread d1/d3/f6 [0,4194304] 0 2024-09-20T19:05:45.114 INFO:tasks.workunit.client.1.smithi098.stdout:1/44: write d1/f2 [3134525,62108] 0 2024-09-20T19:05:45.117 INFO:tasks.workunit.client.1.smithi098.stdout:4/74: dread d3/fc [0,4194304] 0 2024-09-20T19:05:45.117 INFO:tasks.workunit.client.1.smithi098.stdout:1/45: stat d1/d3/f5 0 2024-09-20T19:05:45.119 INFO:tasks.workunit.client.1.smithi098.stdout:4/75: chown d3/c1c 5716481 1 2024-09-20T19:05:45.119 INFO:tasks.workunit.client.1.smithi098.stdout:0/55: dread d0/d6/f7 [0,4194304] 0 2024-09-20T19:05:45.119 INFO:tasks.workunit.client.1.smithi098.stdout:1/46: chown d1/d3/f9 7 1 2024-09-20T19:05:45.120 INFO:tasks.workunit.client.1.smithi098.stdout:8/70: dwrite f0 [0,4194304] 0 2024-09-20T19:05:45.120 INFO:tasks.workunit.client.1.smithi098.stdout:1/47: fsync d1/d3/f9 0 2024-09-20T19:05:45.122 INFO:tasks.workunit.client.1.smithi098.stdout:1/48: chown d1/d3/f5 4441 1 2024-09-20T19:05:45.123 INFO:tasks.workunit.client.1.smithi098.stdout:0/56: creat d0/db/f11 x:0 0 0 2024-09-20T19:05:45.124 INFO:tasks.workunit.client.1.smithi098.stdout:8/71: mknod d7/de/d11/c16 0 2024-09-20T19:05:45.126 INFO:tasks.workunit.client.1.smithi098.stdout:4/76: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:45.126 INFO:tasks.workunit.client.1.smithi098.stdout:0/57: rmdir d0/d6/dc 39 2024-09-20T19:05:45.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/58: chown d0 5008 1 2024-09-20T19:05:45.127 INFO:tasks.workunit.client.1.smithi098.stdout:4/77: chown d3/d6/f18 132313437 1 2024-09-20T19:05:45.128 INFO:tasks.workunit.client.1.smithi098.stdout:8/72: symlink d7/de/d11/l17 0 2024-09-20T19:05:45.131 INFO:tasks.workunit.client.1.smithi098.stdout:1/49: creat d1/d3/fd x:0 0 0 2024-09-20T19:05:45.132 INFO:tasks.workunit.client.1.smithi098.stdout:4/78: symlink d3/l1f 0 2024-09-20T19:05:45.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/50: write d1/d3/f9 [3510433,74495] 0 2024-09-20T19:05:45.138 INFO:tasks.workunit.client.1.smithi098.stdout:1/51: write d1/fc [185117,68983] 0 2024-09-20T19:05:45.139 INFO:tasks.workunit.client.1.smithi098.stdout:8/73: rmdir d7/de/d13 0 2024-09-20T19:05:45.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/79: dwrite d3/fe [0,4194304] 0 2024-09-20T19:05:45.142 INFO:tasks.workunit.client.1.smithi098.stdout:8/74: symlink d7/de/l18 0 2024-09-20T19:05:45.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/80: mknod d3/c20 0 2024-09-20T19:05:45.146 INFO:tasks.workunit.client.1.smithi098.stdout:1/52: creat d1/d3/fe x:0 0 0 2024-09-20T19:05:45.146 INFO:tasks.workunit.client.1.smithi098.stdout:8/75: mkdir d7/de/d11/d19 0 2024-09-20T19:05:45.147 INFO:tasks.workunit.client.1.smithi098.stdout:8/76: chown d7/f8 53 1 2024-09-20T19:05:45.149 INFO:tasks.workunit.client.1.smithi098.stdout:8/77: read - d7/fd zero size 2024-09-20T19:05:45.149 INFO:tasks.workunit.client.1.smithi098.stdout:1/53: unlink d1/fc 0 2024-09-20T19:05:45.149 INFO:tasks.workunit.client.1.smithi098.stdout:0/59: dwrite d0/f3 [4194304,4194304] 0 2024-09-20T19:05:45.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/78: write f6 [2378699,78648] 0 2024-09-20T19:05:45.151 INFO:tasks.workunit.client.1.smithi098.stdout:8/79: dread - d7/fb zero size 2024-09-20T19:05:45.152 INFO:tasks.workunit.client.1.smithi098.stdout:1/54: unlink d1/f2 0 2024-09-20T19:05:45.155 INFO:tasks.workunit.client.1.smithi098.stdout:1/55: unlink f0 0 2024-09-20T19:05:45.156 INFO:tasks.workunit.client.1.smithi098.stdout:1/56: write d1/d3/fe [845813,18074] 0 2024-09-20T19:05:45.157 INFO:tasks.workunit.client.1.smithi098.stdout:8/80: rename l4 to d7/de/l1a 0 2024-09-20T19:05:45.158 INFO:tasks.workunit.client.1.smithi098.stdout:8/81: stat d7/fb 0 2024-09-20T19:05:45.160 INFO:tasks.workunit.client.1.smithi098.stdout:8/82: creat d7/de/d11/f1b x:0 0 0 2024-09-20T19:05:45.161 INFO:tasks.workunit.client.1.smithi098.stdout:8/83: truncate d7/fd 934094 0 2024-09-20T19:05:45.162 INFO:tasks.workunit.client.1.smithi098.stdout:8/84: chown f1 183 1 2024-09-20T19:05:45.162 INFO:tasks.workunit.client.1.smithi098.stdout:0/60: truncate d0/f2 2275854 0 2024-09-20T19:05:45.164 INFO:tasks.workunit.client.1.smithi098.stdout:8/85: unlink f6 0 2024-09-20T19:05:45.166 INFO:tasks.workunit.client.1.smithi098.stdout:8/86: creat d7/f1c x:0 0 0 2024-09-20T19:05:45.168 INFO:tasks.workunit.client.1.smithi098.stdout:8/87: write d7/fb [83703,49192] 0 2024-09-20T19:05:45.168 INFO:tasks.workunit.client.1.smithi098.stdout:0/61: creat d0/d6/f12 x:0 0 0 2024-09-20T19:05:45.169 INFO:tasks.workunit.client.1.smithi098.stdout:0/62: symlink d0/l13 0 2024-09-20T19:05:45.170 INFO:tasks.workunit.client.1.smithi098.stdout:0/63: readlink d0/l13 0 2024-09-20T19:05:45.170 INFO:tasks.workunit.client.1.smithi098.stdout:8/88: mkdir d7/de/d11/d1d 0 2024-09-20T19:05:45.171 INFO:tasks.workunit.client.1.smithi098.stdout:0/64: creat d0/db/f14 x:0 0 0 2024-09-20T19:05:45.172 INFO:tasks.workunit.client.1.smithi098.stdout:8/89: creat d7/de/d11/d1d/f1e x:0 0 0 2024-09-20T19:05:45.173 INFO:tasks.workunit.client.1.smithi098.stdout:0/65: mkdir d0/d15 0 2024-09-20T19:05:45.175 INFO:tasks.workunit.client.1.smithi098.stdout:0/66: truncate d0/d6/f7 661215 0 2024-09-20T19:05:45.176 INFO:tasks.workunit.client.1.smithi098.stdout:0/67: getdents d0/d15 0 2024-09-20T19:05:45.180 INFO:tasks.workunit.client.1.smithi098.stdout:0/68: creat d0/d6/f16 x:0 0 0 2024-09-20T19:05:45.181 INFO:tasks.workunit.client.1.smithi098.stdout:0/69: write d0/db/f14 [27018,40938] 0 2024-09-20T19:05:45.184 INFO:tasks.workunit.client.1.smithi098.stdout:8/90: getdents d7 0 2024-09-20T19:05:45.185 INFO:tasks.workunit.client.1.smithi098.stdout:8/91: write d7/f10 [288757,23577] 0 2024-09-20T19:05:45.187 INFO:tasks.workunit.client.1.smithi098.stdout:8/92: unlink f0 0 2024-09-20T19:05:45.189 INFO:tasks.workunit.client.1.smithi098.stdout:8/93: mkdir d7/de/d11/d1f 0 2024-09-20T19:05:45.190 INFO:tasks.workunit.client.1.smithi098.stdout:8/94: chown d7/l9 14410 1 2024-09-20T19:05:45.192 INFO:tasks.workunit.client.1.smithi098.stdout:8/95: mknod d7/de/d11/d1f/c20 0 2024-09-20T19:05:45.194 INFO:tasks.workunit.client.1.smithi098.stdout:8/96: mknod d7/de/d11/c21 0 2024-09-20T19:05:45.194 INFO:tasks.workunit.client.1.smithi098.stdout:8/97: dread - d7/de/d11/d1d/f1e zero size 2024-09-20T19:05:45.195 INFO:tasks.workunit.client.1.smithi098.stdout:8/98: fdatasync d7/f10 0 2024-09-20T19:05:45.199 INFO:tasks.workunit.client.1.smithi098.stdout:8/99: mknod d7/de/d11/d1f/c22 0 2024-09-20T19:05:45.200 INFO:tasks.workunit.client.1.smithi098.stdout:0/70: dwrite d0/d6/f7 [0,4194304] 0 2024-09-20T19:05:45.202 INFO:tasks.workunit.client.1.smithi098.stdout:0/71: creat d0/db/f17 x:0 0 0 2024-09-20T19:05:45.203 INFO:tasks.workunit.client.1.smithi098.stdout:8/100: creat d7/de/d11/d1d/f23 x:0 0 0 2024-09-20T19:05:45.204 INFO:tasks.workunit.client.1.smithi098.stdout:8/101: creat d7/de/d11/f24 x:0 0 0 2024-09-20T19:05:45.206 INFO:tasks.workunit.client.1.smithi098.stdout:8/102: creat d7/de/d11/d1f/f25 x:0 0 0 2024-09-20T19:05:45.208 INFO:tasks.workunit.client.1.smithi098.stdout:8/103: truncate d7/de/d11/f1b 739664 0 2024-09-20T19:05:45.216 INFO:tasks.workunit.client.1.smithi098.stdout:8/104: dwrite d7/f1c [0,4194304] 0 2024-09-20T19:05:45.217 INFO:tasks.workunit.client.1.smithi098.stdout:8/105: fdatasync f1 0 2024-09-20T19:05:45.218 INFO:tasks.workunit.client.1.smithi098.stdout:8/106: mknod d7/c26 0 2024-09-20T19:05:45.219 INFO:tasks.workunit.client.1.smithi098.stdout:8/107: symlink d7/de/d11/d1d/l27 0 2024-09-20T19:05:45.227 INFO:tasks.workunit.client.1.smithi098.stdout:8/108: dwrite d7/fb [0,4194304] 0 2024-09-20T19:05:45.235 INFO:tasks.workunit.client.1.smithi098.stdout:8/109: dwrite d7/de/d11/d1d/f1e [0,4194304] 0 2024-09-20T19:05:45.238 INFO:tasks.workunit.client.1.smithi098.stdout:8/110: chown d7/de/l1a 0 1 2024-09-20T19:05:45.240 INFO:tasks.workunit.client.1.smithi098.stdout:8/111: symlink d7/de/l28 0 2024-09-20T19:05:45.249 INFO:tasks.workunit.client.1.smithi098.stdout:8/112: dwrite d7/de/d11/d1d/f23 [0,4194304] 0 2024-09-20T19:05:45.250 INFO:tasks.workunit.client.1.smithi098.stdout:8/113: dread - d7/de/d11/d1f/f25 zero size 2024-09-20T19:05:45.253 INFO:tasks.workunit.client.1.smithi098.stdout:8/114: mknod d7/de/d11/d1f/c29 0 2024-09-20T19:05:45.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/115: dread d7/de/d11/f1b [0,4194304] 0 2024-09-20T19:05:45.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/116: chown d7/de/d11/c14 41950 1 2024-09-20T19:05:45.276 INFO:tasks.workunit.client.1.smithi098.stdout:8/117: write d7/f8 [1433578,61089] 0 2024-09-20T19:05:45.280 INFO:tasks.workunit.client.1.smithi098.stdout:8/118: dread f1 [0,4194304] 0 2024-09-20T19:05:45.286 INFO:tasks.workunit.client.1.smithi098.stdout:8/119: dwrite d7/de/d11/d1d/f23 [0,4194304] 0 2024-09-20T19:05:45.289 INFO:tasks.workunit.client.1.smithi098.stdout:8/120: creat d7/de/d11/d1f/f2a x:0 0 0 2024-09-20T19:05:45.292 INFO:tasks.workunit.client.1.smithi098.stdout:8/121: symlink d7/de/d11/d1d/l2b 0 2024-09-20T19:05:45.292 INFO:tasks.workunit.client.1.smithi098.stdout:8/122: chown d7/de/d11/d1f/f2a 1965757 1 2024-09-20T19:05:45.293 INFO:tasks.workunit.client.1.smithi098.stdout:8/123: dread - d7/de/d11/f24 zero size 2024-09-20T19:05:45.311 INFO:tasks.workunit.client.1.smithi098.stdout:6/25: sync 2024-09-20T19:05:45.311 INFO:tasks.workunit.client.1.smithi098.stdout:3/20: sync 2024-09-20T19:05:45.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/21: chown f2 16 1 2024-09-20T19:05:45.313 INFO:tasks.workunit.client.1.smithi098.stdout:3/22: write f2 [351009,32308] 0 2024-09-20T19:05:45.315 INFO:tasks.workunit.client.1.smithi098.stdout:6/26: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.320 INFO:tasks.workunit.client.1.smithi098.stdout:3/23: dwrite f2 [0,4194304] 0 2024-09-20T19:05:45.321 INFO:tasks.workunit.client.1.smithi098.stdout:6/27: dread d0/f4 [0,4194304] 0 2024-09-20T19:05:45.326 INFO:tasks.workunit.client.1.smithi098.stdout:6/28: mkdir d0/d7 0 2024-09-20T19:05:45.327 INFO:tasks.workunit.client.1.smithi098.stdout:3/24: dwrite f2 [0,4194304] 0 2024-09-20T19:05:45.328 INFO:tasks.workunit.client.1.smithi098.stdout:3/25: read f2 [912279,19874] 0 2024-09-20T19:05:45.329 INFO:tasks.workunit.client.1.smithi098.stdout:3/26: write f2 [2173149,47505] 0 2024-09-20T19:05:45.331 INFO:tasks.workunit.client.1.smithi098.stdout:6/29: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.334 INFO:tasks.workunit.client.1.smithi098.stdout:3/27: creat d4/f7 x:0 0 0 2024-09-20T19:05:45.336 INFO:tasks.workunit.client.1.smithi098.stdout:6/30: creat d0/f8 x:0 0 0 2024-09-20T19:05:45.345 INFO:tasks.workunit.client.1.smithi098.stdout:6/31: dwrite d0/f8 [0,4194304] 0 2024-09-20T19:05:45.348 INFO:tasks.workunit.client.1.smithi098.stdout:3/28: dwrite f2 [0,4194304] 0 2024-09-20T19:05:45.352 INFO:tasks.workunit.client.1.smithi098.stdout:6/32: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.355 INFO:tasks.workunit.client.1.smithi098.stdout:6/33: dread d0/f4 [0,4194304] 0 2024-09-20T19:05:45.356 INFO:tasks.workunit.client.1.smithi098.stdout:3/29: symlink d4/d6/l8 0 2024-09-20T19:05:45.359 INFO:tasks.workunit.client.1.smithi098.stdout:3/30: unlink d4/d6/l8 0 2024-09-20T19:05:45.361 INFO:tasks.workunit.client.1.smithi098.stdout:6/34: symlink d0/d7/l9 0 2024-09-20T19:05:45.363 INFO:tasks.workunit.client.1.smithi098.stdout:3/31: mkdir d4/d6/d9 0 2024-09-20T19:05:45.365 INFO:tasks.workunit.client.1.smithi098.stdout:6/35: symlink d0/d7/la 0 2024-09-20T19:05:45.367 INFO:tasks.workunit.client.1.smithi098.stdout:3/32: dread f2 [0,4194304] 0 2024-09-20T19:05:45.373 INFO:tasks.workunit.client.1.smithi098.stdout:6/36: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:45.382 INFO:tasks.workunit.client.1.smithi098.stdout:6/37: unlink d0/f4 0 2024-09-20T19:05:45.422 INFO:tasks.workunit.client.1.smithi098.stdout:2/145: sync 2024-09-20T19:05:45.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/118: sync 2024-09-20T19:05:45.423 INFO:tasks.workunit.client.1.smithi098.stdout:2/146: write d3/f15 [11595180,125369] 0 2024-09-20T19:05:45.427 INFO:tasks.workunit.client.1.smithi098.stdout:2/147: dwrite d3/f12 [4194304,4194304] 0 2024-09-20T19:05:45.429 INFO:tasks.workunit.client.1.smithi098.stdout:9/119: mkdir d4/d17/d21/d25 0 2024-09-20T19:05:45.431 INFO:tasks.workunit.client.1.smithi098.stdout:9/120: write d4/de/f1d [983160,124626] 0 2024-09-20T19:05:45.432 INFO:tasks.workunit.client.1.smithi098.stdout:9/121: dread - d4/de/d1c/f23 zero size 2024-09-20T19:05:45.490 INFO:tasks.workunit.client.1.smithi098.stdout:3/33: truncate f2 2441074 0 2024-09-20T19:05:45.491 INFO:tasks.workunit.client.1.smithi098.stdout:3/34: dread - d4/f7 zero size 2024-09-20T19:05:45.497 INFO:tasks.workunit.client.1.smithi098.stdout:2/148: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:45.497 INFO:tasks.workunit.client.1.smithi098.stdout:6/38: dwrite d0/f8 [4194304,4194304] 0 2024-09-20T19:05:45.498 INFO:tasks.workunit.client.1.smithi098.stdout:9/122: dread d4/f10 [0,4194304] 0 2024-09-20T19:05:45.498 INFO:tasks.workunit.client.1.smithi098.stdout:9/123: dread - d4/f1a zero size 2024-09-20T19:05:45.499 INFO:tasks.workunit.client.1.smithi098.stdout:9/124: truncate d4/f1a 294044 0 2024-09-20T19:05:45.501 INFO:tasks.workunit.client.1.smithi098.stdout:2/149: creat d3/d16/f31 x:0 0 0 2024-09-20T19:05:45.502 INFO:tasks.workunit.client.1.smithi098.stdout:6/39: mknod d0/d7/cb 0 2024-09-20T19:05:45.503 INFO:tasks.workunit.client.1.smithi098.stdout:6/40: write d0/f8 [5748828,104402] 0 2024-09-20T19:05:45.504 INFO:tasks.workunit.client.1.smithi098.stdout:6/41: fdatasync d0/f5 0 2024-09-20T19:05:45.508 INFO:tasks.workunit.client.1.smithi098.stdout:6/42: mkdir d0/d7/dc 0 2024-09-20T19:05:45.509 INFO:tasks.workunit.client.1.smithi098.stdout:9/125: getdents d4/de 0 2024-09-20T19:05:45.511 INFO:tasks.workunit.client.1.smithi098.stdout:6/43: unlink d0/d7/la 0 2024-09-20T19:05:45.512 INFO:tasks.workunit.client.1.smithi098.stdout:9/126: fsync d4/de/f1b 0 2024-09-20T19:05:45.513 INFO:tasks.workunit.client.1.smithi098.stdout:9/127: write d4/f15 [412886,4170] 0 2024-09-20T19:05:45.513 INFO:tasks.workunit.client.0.smithi027.stderr:++ readlink -f fsstress 2024-09-20T19:05:45.515 INFO:tasks.workunit.client.0.smithi027.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-20T19:05:45.516 INFO:tasks.workunit.client.0.smithi027.stderr:+ popd 2024-09-20T19:05:45.516 INFO:tasks.workunit.client.1.smithi098.stdout:6/44: creat d0/d7/dc/fd x:0 0 0 2024-09-20T19:05:45.516 INFO:tasks.workunit.client.0.smithi027.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T19:05:45.517 INFO:tasks.workunit.client.0.smithi027.stderr:+ popd 2024-09-20T19:05:45.517 INFO:tasks.workunit.client.1.smithi098.stdout:6/45: mkdir d0/de 0 2024-09-20T19:05:45.518 INFO:tasks.workunit.client.0.smithi027.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-20T19:05:45.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/46: chown d0/d7/l9 3 1 2024-09-20T19:05:45.518 INFO:tasks.workunit.client.0.smithi027.stderr:++ mktemp -d -p . 2024-09-20T19:05:45.518 INFO:tasks.workunit.client.1.smithi098.stdout:9/128: link d4/fb d4/d17/d21/d25/f26 0 2024-09-20T19:05:45.519 INFO:tasks.workunit.client.1.smithi098.stdout:9/129: chown d4/de/c22 0 1 2024-09-20T19:05:45.519 INFO:tasks.workunit.client.1.smithi098.stdout:9/130: fsync f3 0 2024-09-20T19:05:45.519 INFO:tasks.workunit.client.1.smithi098.stdout:6/47: creat d0/d7/ff x:0 0 0 2024-09-20T19:05:45.520 INFO:tasks.workunit.client.0.smithi027.stderr:+ T=./tmp.lvDftocJUl 2024-09-20T19:05:45.520 INFO:tasks.workunit.client.0.smithi027.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.lvDftocJUl -l 1 -n 1000 -p 10 -v 2024-09-20T19:05:45.522 INFO:tasks.workunit.client.1.smithi098.stdout:9/131: mkdir d4/de/d27 0 2024-09-20T19:05:45.522 INFO:tasks.workunit.client.1.smithi098.stdout:3/35: truncate f2 2585569 0 2024-09-20T19:05:45.524 INFO:tasks.workunit.client.1.smithi098.stdout:3/36: dread - d4/f7 zero size 2024-09-20T19:05:45.524 INFO:tasks.workunit.client.1.smithi098.stdout:9/132: truncate d4/f8 1230922 0 2024-09-20T19:05:45.525 INFO:tasks.workunit.client.0.smithi027.stdout:seed = 1726623782 2024-09-20T19:05:45.526 INFO:tasks.workunit.client.1.smithi098.stdout:6/48: dwrite d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:45.528 INFO:tasks.workunit.client.1.smithi098.stdout:9/133: mknod d4/d17/d21/c28 0 2024-09-20T19:05:45.535 INFO:tasks.workunit.client.1.smithi098.stdout:9/134: creat d4/de/f29 x:0 0 0 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/0: stat - no entries 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/1: dread - no filename 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/2: rename - no filename 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/3: write - no filename 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/4: dread - no filename 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/5: dread - no filename 2024-09-20T19:05:45.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/6: fdatasync - no filename 2024-09-20T19:05:45.539 INFO:tasks.workunit.client.1.smithi098.stdout:9/135: mknod d4/d17/d21/c2a 0 2024-09-20T19:05:45.539 INFO:tasks.workunit.client.0.smithi027.stdout:0/0: symlink l0 0 2024-09-20T19:05:45.541 INFO:tasks.workunit.client.0.smithi027.stdout:2/0: read - no filename 2024-09-20T19:05:45.542 INFO:tasks.workunit.client.1.smithi098.stdout:9/136: unlink d4/de/d1c/f23 0 2024-09-20T19:05:45.544 INFO:tasks.workunit.client.0.smithi027.stdout:0/1: creat f1 x:0 0 0 2024-09-20T19:05:45.544 INFO:tasks.workunit.client.0.smithi027.stdout:0/2: chown f1 397839 1 2024-09-20T19:05:45.544 INFO:tasks.workunit.client.0.smithi027.stdout:0/3: dread - f1 zero size 2024-09-20T19:05:45.545 INFO:tasks.workunit.client.1.smithi098.stdout:9/137: symlink d4/de/d1c/l2b 0 2024-09-20T19:05:45.545 INFO:tasks.workunit.client.0.smithi027.stdout:0/4: read - f1 zero size 2024-09-20T19:05:45.546 INFO:tasks.workunit.client.1.smithi098.stdout:9/138: fdatasync d4/de/f1d 0 2024-09-20T19:05:45.546 INFO:tasks.workunit.client.1.smithi098.stdout:9/139: readlink d4/de/ld 0 2024-09-20T19:05:45.547 INFO:tasks.workunit.client.0.smithi027.stdout:1/7: mknod c0 0 2024-09-20T19:05:45.548 INFO:tasks.workunit.client.1.smithi098.stdout:9/140: readlink d4/de/l18 0 2024-09-20T19:05:45.549 INFO:tasks.workunit.client.0.smithi027.stdout:0/5: mkdir d2 0 2024-09-20T19:05:45.549 INFO:tasks.workunit.client.0.smithi027.stdout:0/6: chown l0 38790804 1 2024-09-20T19:05:45.550 INFO:tasks.workunit.client.0.smithi027.stdout:2/1: mknod c0 0 2024-09-20T19:05:45.550 INFO:tasks.workunit.client.0.smithi027.stdout:2/2: write - no filename 2024-09-20T19:05:45.550 INFO:tasks.workunit.client.0.smithi027.stdout:0/7: fdatasync f1 0 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:0/8: chown f1 14060 1 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:0/9: readlink l0 0 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/0: dwrite - no filename 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/1: fsync - no filename 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/2: write - no filename 2024-09-20T19:05:45.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/3: link - no file 2024-09-20T19:05:45.552 INFO:tasks.workunit.client.0.smithi027.stdout:4/4: truncate - no filename 2024-09-20T19:05:45.552 INFO:tasks.workunit.client.0.smithi027.stdout:4/5: read - no filename 2024-09-20T19:05:45.552 INFO:tasks.workunit.client.0.smithi027.stdout:4/6: truncate - no filename 2024-09-20T19:05:45.552 INFO:tasks.workunit.client.0.smithi027.stdout:0/10: stat d2 0 2024-09-20T19:05:45.552 INFO:tasks.workunit.client.1.smithi098.stdout:9/141: dread d4/d17/d21/d25/f26 [0,4194304] 0 2024-09-20T19:05:45.553 INFO:tasks.workunit.client.0.smithi027.stdout:1/8: creat f1 x:0 0 0 2024-09-20T19:05:45.556 INFO:tasks.workunit.client.1.smithi098.stdout:9/142: creat d4/de/d24/f2c x:0 0 0 2024-09-20T19:05:45.557 INFO:tasks.workunit.client.0.smithi027.stdout:3/0: mkdir d0 0 2024-09-20T19:05:45.557 INFO:tasks.workunit.client.0.smithi027.stdout:3/1: write - no filename 2024-09-20T19:05:45.559 INFO:tasks.workunit.client.0.smithi027.stdout:1/9: mkdir d2 0 2024-09-20T19:05:45.559 INFO:tasks.workunit.client.0.smithi027.stdout:1/10: rename d2 to d2/d3 22 2024-09-20T19:05:45.559 INFO:tasks.workunit.client.0.smithi027.stdout:1/11: dread - f1 zero size 2024-09-20T19:05:45.559 INFO:tasks.workunit.client.1.smithi098.stdout:9/143: mkdir d4/de/d1c/d2d 0 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/0: truncate - no filename 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/1: dread - no filename 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/2: dwrite - no filename 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/3: dwrite - no filename 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/4: dread - no filename 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/5: chown . 1187560 1 2024-09-20T19:05:45.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/6: truncate - no filename 2024-09-20T19:05:45.563 INFO:tasks.workunit.client.1.smithi098.stdout:2/150: truncate d3/fd 1855329 0 2024-09-20T19:05:45.563 INFO:tasks.workunit.client.0.smithi027.stdout:4/7: symlink l0 0 2024-09-20T19:05:45.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/151: creat d3/df/d13/f32 x:0 0 0 2024-09-20T19:05:45.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/152: chown d3/f15 1222 1 2024-09-20T19:05:45.566 INFO:tasks.workunit.client.0.smithi027.stdout:0/11: symlink d2/l3 0 2024-09-20T19:05:45.568 INFO:tasks.workunit.client.0.smithi027.stdout:2/3: link c0 c1 0 2024-09-20T19:05:45.570 INFO:tasks.workunit.client.1.smithi098.stdout:9/144: getdents d4/de/d19 0 2024-09-20T19:05:45.571 INFO:tasks.workunit.client.1.smithi098.stdout:6/49: getdents d0/d7 0 2024-09-20T19:05:45.574 INFO:tasks.workunit.client.0.smithi027.stdout:5/0: getdents . 0 2024-09-20T19:05:45.574 INFO:tasks.workunit.client.0.smithi027.stdout:5/1: chown . 155267 1 2024-09-20T19:05:45.574 INFO:tasks.workunit.client.0.smithi027.stdout:5/2: fsync - no filename 2024-09-20T19:05:45.574 INFO:tasks.workunit.client.0.smithi027.stdout:5/3: dread - no filename 2024-09-20T19:05:45.575 INFO:tasks.workunit.client.0.smithi027.stdout:4/8: creat f1 x:0 0 0 2024-09-20T19:05:45.575 INFO:tasks.workunit.client.1.smithi098.stdout:9/145: write d4/f10 [1439649,426] 0 2024-09-20T19:05:45.575 INFO:tasks.workunit.client.1.smithi098.stdout:2/153: dwrite d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:45.576 INFO:tasks.workunit.client.1.smithi098.stdout:3/37: write f2 [1119134,76494] 0 2024-09-20T19:05:45.576 INFO:tasks.workunit.client.1.smithi098.stdout:9/146: chown d4/f16 1 1 2024-09-20T19:05:45.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/147: chown d4/f15 2250 1 2024-09-20T19:05:45.577 INFO:tasks.workunit.client.0.smithi027.stdout:3/2: mkdir d0/d1 0 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/3: fdatasync - no filename 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/4: chown d0/d1 1 1 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/5: dwrite - no filename 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/6: dread - no filename 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/7: link - no file 2024-09-20T19:05:45.578 INFO:tasks.workunit.client.0.smithi027.stdout:3/8: fdatasync - no filename 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/9: chown d0 0 1 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/10: dread - no filename 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/11: link - no file 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/12: truncate - no filename 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/13: truncate - no filename 2024-09-20T19:05:45.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/14: dwrite - no filename 2024-09-20T19:05:45.580 INFO:tasks.workunit.client.0.smithi027.stdout:0/12: creat d2/f4 x:0 0 0 2024-09-20T19:05:45.581 INFO:tasks.workunit.client.0.smithi027.stdout:0/13: dread - d2/f4 zero size 2024-09-20T19:05:45.582 INFO:tasks.workunit.client.1.smithi098.stdout:3/38: rename d4/d6/d9 to d4/da 0 2024-09-20T19:05:45.582 INFO:tasks.workunit.client.1.smithi098.stdout:3/39: readlink l0 0 2024-09-20T19:05:45.584 INFO:tasks.workunit.client.0.smithi027.stdout:8/0: stat - no entries 2024-09-20T19:05:45.584 INFO:tasks.workunit.client.0.smithi027.stdout:8/1: fsync - no filename 2024-09-20T19:05:45.585 INFO:tasks.workunit.client.0.smithi027.stdout:0/14: write d2/f4 [421007,51312] 0 2024-09-20T19:05:45.585 INFO:tasks.workunit.client.1.smithi098.stdout:9/148: unlink d4/c12 0 2024-09-20T19:05:45.586 INFO:tasks.workunit.client.0.smithi027.stdout:4/9: dwrite f1 [0,4194304] 0 2024-09-20T19:05:45.586 INFO:tasks.workunit.client.0.smithi027.stdout:4/10: rmdir - no directory 2024-09-20T19:05:45.587 INFO:tasks.workunit.client.1.smithi098.stdout:9/149: dread d4/f1a [0,4194304] 0 2024-09-20T19:05:45.587 INFO:tasks.workunit.client.0.smithi027.stdout:6/7: creat f0 x:0 0 0 2024-09-20T19:05:45.590 INFO:tasks.workunit.client.1.smithi098.stdout:2/154: link d3/f12 d3/df/d13/f33 0 2024-09-20T19:05:45.594 INFO:tasks.workunit.client.1.smithi098.stdout:3/40: creat d4/da/fb x:0 0 0 2024-09-20T19:05:45.594 INFO:tasks.workunit.client.1.smithi098.stdout:2/155: dread d3/df/f11 [4194304,4194304] 0 2024-09-20T19:05:45.595 INFO:tasks.workunit.client.1.smithi098.stdout:2/156: readlink d3/df/d13/l2e 0 2024-09-20T19:05:45.595 INFO:tasks.workunit.client.0.smithi027.stdout:3/15: creat d0/f2 x:0 0 0 2024-09-20T19:05:45.596 INFO:tasks.workunit.client.1.smithi098.stdout:2/157: write d3/df/d13/f32 [195954,16731] 0 2024-09-20T19:05:45.596 INFO:tasks.workunit.client.0.smithi027.stdout:2/4: stat c1 0 2024-09-20T19:05:45.596 INFO:tasks.workunit.client.0.smithi027.stdout:2/5: rmdir - no directory 2024-09-20T19:05:45.598 INFO:tasks.workunit.client.1.smithi098.stdout:5/67: sync 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/0: unlink - no file 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/1: fdatasync - no filename 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/2: dread - no filename 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/3: write - no filename 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/4: rmdir - no directory 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/5: dread - no filename 2024-09-20T19:05:45.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/6: stat - no entries 2024-09-20T19:05:45.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/7: rename - no filename 2024-09-20T19:05:45.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/8: chown . 2 1 2024-09-20T19:05:45.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/9: fdatasync - no filename 2024-09-20T19:05:45.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/10: read - no filename 2024-09-20T19:05:45.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/11: write - no filename 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.1.smithi098.stdout:5/68: chown d1/f14 22 1 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.1.smithi098.stdout:6/50: link d0/d7/l9 d0/d7/dc/l10 0 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/12: fsync f1 0 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/13: dread - f1 zero size 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/14: chown d2 6245 1 2024-09-20T19:05:45.601 INFO:tasks.workunit.client.1.smithi098.stdout:5/69: truncate d1/f9 245694 0 2024-09-20T19:05:45.602 INFO:tasks.workunit.client.0.smithi027.stdout:0/15: symlink d2/l5 0 2024-09-20T19:05:45.603 INFO:tasks.workunit.client.1.smithi098.stdout:2/158: dwrite d3/df/d13/f23 [0,4194304] 0 2024-09-20T19:05:45.606 INFO:tasks.workunit.client.0.smithi027.stdout:0/16: dread d2/f4 [0,4194304] 0 2024-09-20T19:05:45.606 INFO:tasks.workunit.client.0.smithi027.stdout:4/11: unlink f1 0 2024-09-20T19:05:45.608 INFO:tasks.workunit.client.0.smithi027.stdout:6/8: creat f1 x:0 0 0 2024-09-20T19:05:45.610 INFO:tasks.workunit.client.0.smithi027.stdout:5/4: symlink l0 0 2024-09-20T19:05:45.611 INFO:tasks.workunit.client.1.smithi098.stdout:6/51: creat d0/d7/dc/f11 x:0 0 0 2024-09-20T19:05:45.612 INFO:tasks.workunit.client.1.smithi098.stdout:6/52: stat d0/d7/dc 0 2024-09-20T19:05:45.613 INFO:tasks.workunit.client.0.smithi027.stdout:3/16: mknod d0/c3 0 2024-09-20T19:05:45.615 INFO:tasks.workunit.client.1.smithi098.stdout:5/70: unlink d1/l11 0 2024-09-20T19:05:45.616 INFO:tasks.workunit.client.0.smithi027.stdout:2/6: creat f2 x:0 0 0 2024-09-20T19:05:45.618 INFO:tasks.workunit.client.1.smithi098.stdout:2/159: unlink d3/d16/d1a/l22 0 2024-09-20T19:05:45.620 INFO:tasks.workunit.client.0.smithi027.stdout:8/2: getdents . 0 2024-09-20T19:05:45.620 INFO:tasks.workunit.client.0.smithi027.stdout:8/3: dwrite - no filename 2024-09-20T19:05:45.620 INFO:tasks.workunit.client.0.smithi027.stdout:8/4: link - no file 2024-09-20T19:05:45.620 INFO:tasks.workunit.client.1.smithi098.stdout:5/71: chown d1/c3 1 1 2024-09-20T19:05:45.622 INFO:tasks.workunit.client.1.smithi098.stdout:5/72: dread d1/ff [0,4194304] 0 2024-09-20T19:05:45.622 INFO:tasks.workunit.client.1.smithi098.stdout:2/160: mkdir d3/d16/d1d/d2b/d34 0 2024-09-20T19:05:45.622 INFO:tasks.workunit.client.1.smithi098.stdout:5/73: read d1/f6 [1482198,19562] 0 2024-09-20T19:05:45.624 INFO:tasks.workunit.client.1.smithi098.stdout:9/150: getdents d4/de/d24 0 2024-09-20T19:05:45.628 INFO:tasks.workunit.client.0.smithi027.stdout:0/17: mknod d2/c6 0 2024-09-20T19:05:45.629 INFO:tasks.workunit.client.0.smithi027.stdout:6/9: symlink l2 0 2024-09-20T19:05:45.630 INFO:tasks.workunit.client.1.smithi098.stdout:2/161: rmdir d3/d16/d1d 39 2024-09-20T19:05:45.631 INFO:tasks.workunit.client.0.smithi027.stdout:5/5: creat f1 x:0 0 0 2024-09-20T19:05:45.632 INFO:tasks.workunit.client.0.smithi027.stdout:5/6: chown l0 184707 1 2024-09-20T19:05:45.634 INFO:tasks.workunit.client.0.smithi027.stdout:9/12: mkdir d0 0 2024-09-20T19:05:45.634 INFO:tasks.workunit.client.0.smithi027.stdout:9/13: write - no filename 2024-09-20T19:05:45.635 INFO:tasks.workunit.client.0.smithi027.stdout:9/14: stat d0 0 2024-09-20T19:05:45.637 INFO:tasks.workunit.client.0.smithi027.stdout:1/15: symlink d2/l4 0 2024-09-20T19:05:45.640 INFO:tasks.workunit.client.0.smithi027.stdout:0/18: write d2/f4 [767159,50796] 0 2024-09-20T19:05:45.640 INFO:tasks.workunit.client.0.smithi027.stdout:0/19: dread - f1 zero size 2024-09-20T19:05:45.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/41: rmdir d4/d6 0 2024-09-20T19:05:45.642 INFO:tasks.workunit.client.1.smithi098.stdout:3/42: truncate d4/da/fb 761043 0 2024-09-20T19:05:45.643 INFO:tasks.workunit.client.1.smithi098.stdout:3/43: chown d4/da 156 1 2024-09-20T19:05:45.643 INFO:tasks.workunit.client.1.smithi098.stdout:3/44: chown d4 47645 1 2024-09-20T19:05:45.644 INFO:tasks.workunit.client.0.smithi027.stdout:6/10: unlink l2 0 2024-09-20T19:05:45.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/74: creat d1/d17/f19 x:0 0 0 2024-09-20T19:05:45.647 INFO:tasks.workunit.client.0.smithi027.stdout:5/7: rename f1 to f2 0 2024-09-20T19:05:45.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/151: creat d4/de/d27/f2e x:0 0 0 2024-09-20T19:05:45.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/45: dwrite f2 [0,4194304] 0 2024-09-20T19:05:45.650 INFO:tasks.workunit.client.0.smithi027.stdout:3/17: symlink d0/d1/l4 0 2024-09-20T19:05:45.652 INFO:tasks.workunit.client.0.smithi027.stdout:6/11: dwrite f1 [0,4194304] 0 2024-09-20T19:05:45.653 INFO:tasks.workunit.client.0.smithi027.stdout:8/5: getdents . 0 2024-09-20T19:05:45.654 INFO:tasks.workunit.client.0.smithi027.stdout:8/6: rmdir - no directory 2024-09-20T19:05:45.654 INFO:tasks.workunit.client.0.smithi027.stdout:8/7: fdatasync - no filename 2024-09-20T19:05:45.654 INFO:tasks.workunit.client.0.smithi027.stdout:8/8: dread - no filename 2024-09-20T19:05:45.654 INFO:tasks.workunit.client.0.smithi027.stdout:8/9: readlink - no filename 2024-09-20T19:05:45.654 INFO:tasks.workunit.client.1.smithi098.stdout:5/75: dwrite d1/fb [0,4194304] 0 2024-09-20T19:05:45.655 INFO:tasks.workunit.client.0.smithi027.stdout:1/16: symlink d2/l5 0 2024-09-20T19:05:45.656 INFO:tasks.workunit.client.1.smithi098.stdout:2/162: symlink d3/d16/d1d/d2b/d34/l35 0 2024-09-20T19:05:45.658 INFO:tasks.workunit.client.0.smithi027.stdout:1/17: write f1 [351516,128425] 0 2024-09-20T19:05:45.659 INFO:tasks.workunit.client.0.smithi027.stdout:0/20: mkdir d2/d7 0 2024-09-20T19:05:45.660 INFO:tasks.workunit.client.1.smithi098.stdout:3/46: dwrite d4/f7 [0,4194304] 0 2024-09-20T19:05:45.660 INFO:tasks.workunit.client.1.smithi098.stdout:9/152: rename d4/de/f1b to d4/de/d1c/f2f 0 2024-09-20T19:05:45.666 INFO:tasks.workunit.client.0.smithi027.stdout:3/18: creat d0/f5 x:0 0 0 2024-09-20T19:05:45.666 INFO:tasks.workunit.client.0.smithi027.stdout:9/15: getdents d0 0 2024-09-20T19:05:45.666 INFO:tasks.workunit.client.0.smithi027.stdout:9/16: write - no filename 2024-09-20T19:05:45.666 INFO:tasks.workunit.client.0.smithi027.stdout:9/17: write - no filename 2024-09-20T19:05:45.667 INFO:tasks.workunit.client.0.smithi027.stdout:9/18: write - no filename 2024-09-20T19:05:45.667 INFO:tasks.workunit.client.1.smithi098.stdout:5/76: dread d1/f6 [0,4194304] 0 2024-09-20T19:05:45.668 INFO:tasks.workunit.client.0.smithi027.stdout:1/18: symlink d2/l6 0 2024-09-20T19:05:45.669 INFO:tasks.workunit.client.0.smithi027.stdout:0/21: creat d2/f8 x:0 0 0 2024-09-20T19:05:45.671 INFO:tasks.workunit.client.1.smithi098.stdout:2/163: mknod d3/c36 0 2024-09-20T19:05:45.672 INFO:tasks.workunit.client.1.smithi098.stdout:2/164: chown d3/d16 14 1 2024-09-20T19:05:45.672 INFO:tasks.workunit.client.0.smithi027.stdout:8/10: symlink l0 0 2024-09-20T19:05:45.673 INFO:tasks.workunit.client.1.smithi098.stdout:5/77: unlink d1/f13 0 2024-09-20T19:05:45.674 INFO:tasks.workunit.client.1.smithi098.stdout:5/78: readlink d1/l16 0 2024-09-20T19:05:45.678 INFO:tasks.workunit.client.0.smithi027.stdout:1/19: unlink d2/l5 0 2024-09-20T19:05:45.679 INFO:tasks.workunit.client.0.smithi027.stdout:1/20: read f1 [431650,18991] 0 2024-09-20T19:05:45.680 INFO:tasks.workunit.client.0.smithi027.stdout:0/22: dwrite d2/f4 [0,4194304] 0 2024-09-20T19:05:45.683 INFO:tasks.workunit.client.0.smithi027.stdout:8/11: symlink l1 0 2024-09-20T19:05:45.683 INFO:tasks.workunit.client.0.smithi027.stdout:8/12: rmdir - no directory 2024-09-20T19:05:45.683 INFO:tasks.workunit.client.0.smithi027.stdout:8/13: fdatasync - no filename 2024-09-20T19:05:45.684 INFO:tasks.workunit.client.1.smithi098.stdout:5/79: creat d1/d17/f1a x:0 0 0 2024-09-20T19:05:45.685 INFO:tasks.workunit.client.0.smithi027.stdout:9/19: creat d0/f1 x:0 0 0 2024-09-20T19:05:45.686 INFO:tasks.workunit.client.0.smithi027.stdout:9/20: write d0/f1 [695255,35941] 0 2024-09-20T19:05:45.687 INFO:tasks.workunit.client.0.smithi027.stdout:9/21: write d0/f1 [551561,74732] 0 2024-09-20T19:05:45.689 INFO:tasks.workunit.client.1.smithi098.stdout:5/80: dread d1/fb [0,4194304] 0 2024-09-20T19:05:45.691 INFO:tasks.workunit.client.0.smithi027.stdout:1/21: unlink c0 0 2024-09-20T19:05:45.693 INFO:tasks.workunit.client.0.smithi027.stdout:0/23: creat d2/f9 x:0 0 0 2024-09-20T19:05:45.694 INFO:tasks.workunit.client.0.smithi027.stdout:0/24: rename d2/d7 to d2/d7/da 22 2024-09-20T19:05:45.694 INFO:tasks.workunit.client.1.smithi098.stdout:5/81: fdatasync d1/f6 0 2024-09-20T19:05:45.696 INFO:tasks.workunit.client.0.smithi027.stdout:8/14: mkdir d2 0 2024-09-20T19:05:45.696 INFO:tasks.workunit.client.0.smithi027.stdout:8/15: truncate - no filename 2024-09-20T19:05:45.696 INFO:tasks.workunit.client.0.smithi027.stdout:8/16: stat l1 0 2024-09-20T19:05:45.697 INFO:tasks.workunit.client.1.smithi098.stdout:3/47: dwrite d4/f7 [4194304,4194304] 0 2024-09-20T19:05:45.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/48: write d4/da/fb [1350689,111660] 0 2024-09-20T19:05:45.699 INFO:tasks.workunit.client.1.smithi098.stdout:9/153: truncate d4/f10 2083757 0 2024-09-20T19:05:45.703 INFO:tasks.workunit.client.0.smithi027.stdout:3/19: getdents d0 0 2024-09-20T19:05:45.703 INFO:tasks.workunit.client.1.smithi098.stdout:2/165: write d3/f12 [8545231,28728] 0 2024-09-20T19:05:45.704 INFO:tasks.workunit.client.1.smithi098.stdout:5/82: dread d1/fc [0,4194304] 0 2024-09-20T19:05:45.705 INFO:tasks.workunit.client.1.smithi098.stdout:9/154: dread d4/f15 [0,4194304] 0 2024-09-20T19:05:45.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/22: symlink d2/l7 0 2024-09-20T19:05:45.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/23: chown d2/l4 640606 1 2024-09-20T19:05:45.710 INFO:tasks.workunit.client.1.smithi098.stdout:3/49: dread d4/da/fb [0,4194304] 0 2024-09-20T19:05:45.712 INFO:tasks.workunit.client.0.smithi027.stdout:3/20: creat d0/f6 x:0 0 0 2024-09-20T19:05:45.713 INFO:tasks.workunit.client.1.smithi098.stdout:9/155: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:05:45.713 INFO:tasks.workunit.client.0.smithi027.stdout:3/21: read - d0/f2 zero size 2024-09-20T19:05:45.714 INFO:tasks.workunit.client.1.smithi098.stdout:2/166: creat d3/d16/d1a/f37 x:0 0 0 2024-09-20T19:05:45.714 INFO:tasks.workunit.client.0.smithi027.stdout:3/22: write d0/f5 [15384,37866] 0 2024-09-20T19:05:45.715 INFO:tasks.workunit.client.1.smithi098.stdout:2/167: read d3/f12 [8904096,69758] 0 2024-09-20T19:05:45.715 INFO:tasks.workunit.client.0.smithi027.stdout:3/23: dread - d0/f2 zero size 2024-09-20T19:05:45.715 INFO:tasks.workunit.client.1.smithi098.stdout:5/83: rmdir d1/d17 39 2024-09-20T19:05:45.717 INFO:tasks.workunit.client.1.smithi098.stdout:5/84: write d1/f9 [536635,70055] 0 2024-09-20T19:05:45.718 INFO:tasks.workunit.client.0.smithi027.stdout:1/24: dread f1 [0,4194304] 0 2024-09-20T19:05:45.718 INFO:tasks.workunit.client.0.smithi027.stdout:0/25: getdents d2/d7 0 2024-09-20T19:05:45.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/17: getdents d2 0 2024-09-20T19:05:45.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/18: write - no filename 2024-09-20T19:05:45.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/19: fsync - no filename 2024-09-20T19:05:45.720 INFO:tasks.workunit.client.1.smithi098.stdout:3/50: symlink d4/lc 0 2024-09-20T19:05:45.725 INFO:tasks.workunit.client.0.smithi027.stdout:9/22: getdents d0 0 2024-09-20T19:05:45.727 INFO:tasks.workunit.client.0.smithi027.stdout:0/26: dwrite d2/f9 [0,4194304] 0 2024-09-20T19:05:45.728 INFO:tasks.workunit.client.1.smithi098.stdout:3/51: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:45.728 INFO:tasks.workunit.client.0.smithi027.stdout:0/27: fsync f1 0 2024-09-20T19:05:45.729 INFO:tasks.workunit.client.0.smithi027.stdout:0/28: write d2/f4 [1530956,73808] 0 2024-09-20T19:05:45.729 INFO:tasks.workunit.client.1.smithi098.stdout:9/156: dwrite d4/f15 [0,4194304] 0 2024-09-20T19:05:45.729 INFO:tasks.workunit.client.0.smithi027.stdout:3/24: fsync d0/f6 0 2024-09-20T19:05:45.733 INFO:tasks.workunit.client.0.smithi027.stdout:9/23: mknod d0/c2 0 2024-09-20T19:05:45.736 INFO:tasks.workunit.client.0.smithi027.stdout:8/20: mkdir d2/d3 0 2024-09-20T19:05:45.738 INFO:tasks.workunit.client.0.smithi027.stdout:1/25: write f1 [970209,50432] 0 2024-09-20T19:05:45.738 INFO:tasks.workunit.client.1.smithi098.stdout:9/157: dwrite f3 [0,4194304] 0 2024-09-20T19:05:45.739 INFO:tasks.workunit.client.0.smithi027.stdout:1/26: read f1 [399389,58074] 0 2024-09-20T19:05:45.740 INFO:tasks.workunit.client.0.smithi027.stdout:0/29: symlink d2/lb 0 2024-09-20T19:05:45.740 INFO:tasks.workunit.client.1.smithi098.stdout:5/85: mkdir d1/d1b 0 2024-09-20T19:05:45.742 INFO:tasks.workunit.client.0.smithi027.stdout:3/25: mkdir d0/d1/d7 0 2024-09-20T19:05:45.742 INFO:tasks.workunit.client.0.smithi027.stdout:0/30: dread - f1 zero size 2024-09-20T19:05:45.745 INFO:tasks.workunit.client.0.smithi027.stdout:3/26: truncate d0/f2 726083 0 2024-09-20T19:05:45.746 INFO:tasks.workunit.client.0.smithi027.stdout:9/24: dwrite d0/f1 [0,4194304] 0 2024-09-20T19:05:45.746 INFO:tasks.workunit.client.0.smithi027.stdout:8/21: mknod d2/d3/c4 0 2024-09-20T19:05:45.747 INFO:tasks.workunit.client.0.smithi027.stdout:8/22: chown d2 4533146 1 2024-09-20T19:05:45.747 INFO:tasks.workunit.client.1.smithi098.stdout:5/86: rmdir d1 39 2024-09-20T19:05:45.748 INFO:tasks.workunit.client.0.smithi027.stdout:0/31: creat d2/fc x:0 0 0 2024-09-20T19:05:45.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/87: chown d1/c10 2656822 1 2024-09-20T19:05:45.751 INFO:tasks.workunit.client.1.smithi098.stdout:9/158: creat d4/d17/d21/d25/f30 x:0 0 0 2024-09-20T19:05:45.751 INFO:tasks.workunit.client.0.smithi027.stdout:8/23: rmdir d2 39 2024-09-20T19:05:45.751 INFO:tasks.workunit.client.0.smithi027.stdout:8/24: fsync - no filename 2024-09-20T19:05:45.752 INFO:tasks.workunit.client.0.smithi027.stdout:9/25: dread d0/f1 [0,4194304] 0 2024-09-20T19:05:45.752 INFO:tasks.workunit.client.1.smithi098.stdout:9/159: write d4/f8 [1710664,32034] 0 2024-09-20T19:05:45.753 INFO:tasks.workunit.client.0.smithi027.stdout:3/27: rename d0/d1/l4 to d0/l8 0 2024-09-20T19:05:45.754 INFO:tasks.workunit.client.1.smithi098.stdout:5/88: rename d1/f6 to d1/d1b/f1c 0 2024-09-20T19:05:45.754 INFO:tasks.workunit.client.0.smithi027.stdout:3/28: write d0/f2 [437850,2339] 0 2024-09-20T19:05:45.755 INFO:tasks.workunit.client.1.smithi098.stdout:5/89: chown d1/c10 81 1 2024-09-20T19:05:45.755 INFO:tasks.workunit.client.0.smithi027.stdout:3/29: truncate d0/f2 1703585 0 2024-09-20T19:05:45.756 INFO:tasks.workunit.client.0.smithi027.stdout:3/30: dread - d0/f6 zero size 2024-09-20T19:05:45.756 INFO:tasks.workunit.client.1.smithi098.stdout:9/160: mknod d4/d17/d21/d25/c31 0 2024-09-20T19:05:45.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/161: chown d4/d17/d21/d25/f30 1617 1 2024-09-20T19:05:45.758 INFO:tasks.workunit.client.0.smithi027.stdout:9/26: creat d0/f3 x:0 0 0 2024-09-20T19:05:45.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/162: fsync d4/de/f29 0 2024-09-20T19:05:45.760 INFO:tasks.workunit.client.0.smithi027.stdout:0/32: creat d2/d7/fd x:0 0 0 2024-09-20T19:05:45.761 INFO:tasks.workunit.client.0.smithi027.stdout:8/25: symlink d2/d3/l5 0 2024-09-20T19:05:45.761 INFO:tasks.workunit.client.0.smithi027.stdout:1/27: dread f1 [0,4194304] 0 2024-09-20T19:05:45.762 INFO:tasks.workunit.client.1.smithi098.stdout:9/163: creat d4/de/d1c/f32 x:0 0 0 2024-09-20T19:05:45.764 INFO:tasks.workunit.client.0.smithi027.stdout:9/27: creat d0/f4 x:0 0 0 2024-09-20T19:05:45.765 INFO:tasks.workunit.client.1.smithi098.stdout:5/90: dwrite d1/fd [0,4194304] 0 2024-09-20T19:05:45.765 INFO:tasks.workunit.client.0.smithi027.stdout:3/31: dwrite d0/f6 [0,4194304] 0 2024-09-20T19:05:45.768 INFO:tasks.workunit.client.1.smithi098.stdout:2/168: truncate d3/df/d13/f29 2216 0 2024-09-20T19:05:45.769 INFO:tasks.workunit.client.0.smithi027.stdout:1/28: write f1 [1955371,62533] 0 2024-09-20T19:05:45.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/91: fsync d1/ff 0 2024-09-20T19:05:45.771 INFO:tasks.workunit.client.0.smithi027.stdout:8/26: mkdir d2/d3/d6 0 2024-09-20T19:05:45.772 INFO:tasks.workunit.client.0.smithi027.stdout:8/27: chown d2/d3/l5 0 1 2024-09-20T19:05:45.773 INFO:tasks.workunit.client.0.smithi027.stdout:9/28: fdatasync d0/f1 0 2024-09-20T19:05:45.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/169: mkdir d3/d16/d1d/d2b/d34/d38 0 2024-09-20T19:05:45.777 INFO:tasks.workunit.client.0.smithi027.stdout:0/33: unlink d2/f4 0 2024-09-20T19:05:45.779 INFO:tasks.workunit.client.0.smithi027.stdout:3/32: rename d0/f6 to d0/d1/f9 0 2024-09-20T19:05:45.780 INFO:tasks.workunit.client.0.smithi027.stdout:1/29: mkdir d2/d8 0 2024-09-20T19:05:45.782 INFO:tasks.workunit.client.1.smithi098.stdout:2/170: unlink d3/f1e 0 2024-09-20T19:05:45.783 INFO:tasks.workunit.client.0.smithi027.stdout:8/28: creat d2/f7 x:0 0 0 2024-09-20T19:05:45.784 INFO:tasks.workunit.client.0.smithi027.stdout:8/29: read - d2/f7 zero size 2024-09-20T19:05:45.785 INFO:tasks.workunit.client.1.smithi098.stdout:9/164: getdents d4/de 0 2024-09-20T19:05:45.789 INFO:tasks.workunit.client.0.smithi027.stdout:0/34: creat d2/fe x:0 0 0 2024-09-20T19:05:45.789 INFO:tasks.workunit.client.0.smithi027.stdout:0/35: chown d2/l3 2611 1 2024-09-20T19:05:45.789 INFO:tasks.workunit.client.0.smithi027.stdout:0/36: chown d2 21988 1 2024-09-20T19:05:45.790 INFO:tasks.workunit.client.1.smithi098.stdout:2/171: creat d3/d16/d1d/f39 x:0 0 0 2024-09-20T19:05:45.790 INFO:tasks.workunit.client.0.smithi027.stdout:3/33: symlink d0/la 0 2024-09-20T19:05:45.793 INFO:tasks.workunit.client.1.smithi098.stdout:5/92: rename d1/c15 to d1/c1d 0 2024-09-20T19:05:45.794 INFO:tasks.workunit.client.0.smithi027.stdout:1/30: rename f1 to d2/d8/f9 0 2024-09-20T19:05:45.795 INFO:tasks.workunit.client.1.smithi098.stdout:9/165: unlink d4/de/c22 0 2024-09-20T19:05:45.798 INFO:tasks.workunit.client.1.smithi098.stdout:2/172: rename d3/df/d13/f23 to d3/df/d13/f3a 0 2024-09-20T19:05:45.799 INFO:tasks.workunit.client.1.smithi098.stdout:5/93: dread - d1/d17/f19 zero size 2024-09-20T19:05:45.801 INFO:tasks.workunit.client.1.smithi098.stdout:2/173: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:45.802 INFO:tasks.workunit.client.1.smithi098.stdout:9/166: rename d4/d17/d21/c2a to d4/de/c33 0 2024-09-20T19:05:45.803 INFO:tasks.workunit.client.1.smithi098.stdout:9/167: write f1 [879709,118117] 0 2024-09-20T19:05:45.808 INFO:tasks.workunit.client.1.smithi098.stdout:5/94: unlink d1/l18 0 2024-09-20T19:05:45.809 INFO:tasks.workunit.client.1.smithi098.stdout:2/174: truncate d3/f12 7885805 0 2024-09-20T19:05:45.812 INFO:tasks.workunit.client.1.smithi098.stdout:2/175: dread d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:45.812 INFO:tasks.workunit.client.1.smithi098.stdout:9/168: rename d4/de/d24/f2c to d4/de/f34 0 2024-09-20T19:05:45.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/169: chown d4/cf 45540 1 2024-09-20T19:05:45.814 INFO:tasks.workunit.client.1.smithi098.stdout:5/95: creat d1/d17/f1e x:0 0 0 2024-09-20T19:05:45.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/96: dread d1/fd [0,4194304] 0 2024-09-20T19:05:45.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/97: dread - d1/fe zero size 2024-09-20T19:05:45.819 INFO:tasks.workunit.client.1.smithi098.stdout:5/98: chown d1/f14 30169 1 2024-09-20T19:05:45.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/170: rename d4/de/d1c to d4/de/d24/d35 0 2024-09-20T19:05:45.825 INFO:tasks.workunit.client.1.smithi098.stdout:2/176: creat d3/d16/f3b x:0 0 0 2024-09-20T19:05:45.827 INFO:tasks.workunit.client.1.smithi098.stdout:9/171: link d4/de/f34 d4/d17/d21/f36 0 2024-09-20T19:05:45.832 INFO:tasks.workunit.client.1.smithi098.stdout:9/172: creat d4/d17/d21/d25/f37 x:0 0 0 2024-09-20T19:05:45.833 INFO:tasks.workunit.client.1.smithi098.stdout:2/177: dwrite d3/df/d13/f18 [0,4194304] 0 2024-09-20T19:05:45.834 INFO:tasks.workunit.client.1.smithi098.stdout:2/178: dread - d3/d16/d1a/f37 zero size 2024-09-20T19:05:45.836 INFO:tasks.workunit.client.1.smithi098.stdout:5/99: write d1/ff [1181735,115836] 0 2024-09-20T19:05:45.836 INFO:tasks.workunit.client.1.smithi098.stdout:5/100: readlink d1/l16 0 2024-09-20T19:05:45.838 INFO:tasks.workunit.client.1.smithi098.stdout:5/101: chown d1/ff 179786504 1 2024-09-20T19:05:45.842 INFO:tasks.workunit.client.1.smithi098.stdout:2/179: getdents d3/df/d13 0 2024-09-20T19:05:45.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/173: write d4/de/d24/d35/f2f [1885341,91820] 0 2024-09-20T19:05:45.849 INFO:tasks.workunit.client.1.smithi098.stdout:5/102: write d1/fc [202191,43489] 0 2024-09-20T19:05:45.849 INFO:tasks.workunit.client.1.smithi098.stdout:2/180: chown d3/f12 0 1 2024-09-20T19:05:45.851 INFO:tasks.workunit.client.1.smithi098.stdout:5/103: creat d1/d17/f1f x:0 0 0 2024-09-20T19:05:45.853 INFO:tasks.workunit.client.1.smithi098.stdout:5/104: symlink d1/d17/l20 0 2024-09-20T19:05:45.854 INFO:tasks.workunit.client.1.smithi098.stdout:9/174: dread d4/de/d24/d35/f2f [0,4194304] 0 2024-09-20T19:05:45.854 INFO:tasks.workunit.client.1.smithi098.stdout:2/181: rename d3/d16/f31 to d3/f3c 0 2024-09-20T19:05:45.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/105: rmdir d1/d17 39 2024-09-20T19:05:45.856 INFO:tasks.workunit.client.1.smithi098.stdout:9/175: creat d4/d17/f38 x:0 0 0 2024-09-20T19:05:45.857 INFO:tasks.workunit.client.1.smithi098.stdout:2/182: creat d3/df/f3d x:0 0 0 2024-09-20T19:05:45.858 INFO:tasks.workunit.client.1.smithi098.stdout:2/183: chown d3/df/c14 948 1 2024-09-20T19:05:45.859 INFO:tasks.workunit.client.1.smithi098.stdout:9/176: mkdir d4/de/d27/d39 0 2024-09-20T19:05:45.862 INFO:tasks.workunit.client.1.smithi098.stdout:2/184: dread d3/df/d13/f3a [0,4194304] 0 2024-09-20T19:05:45.865 INFO:tasks.workunit.client.1.smithi098.stdout:5/106: write d1/f2 [3610190,79443] 0 2024-09-20T19:05:45.865 INFO:tasks.workunit.client.1.smithi098.stdout:2/185: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:45.866 INFO:tasks.workunit.client.1.smithi098.stdout:5/107: chown d1/d1b/f1c 155361 1 2024-09-20T19:05:45.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/186: fdatasync d3/f15 0 2024-09-20T19:05:45.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/187: fdatasync d3/df/f3d 0 2024-09-20T19:05:45.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/108: dread - d1/d17/f1f zero size 2024-09-20T19:05:45.869 INFO:tasks.workunit.client.0.smithi027.stdout:8/30: rmdir d2 39 2024-09-20T19:05:45.869 INFO:tasks.workunit.client.0.smithi027.stdout:9/29: rename d0/f1 to d0/f5 0 2024-09-20T19:05:45.870 INFO:tasks.workunit.client.1.smithi098.stdout:5/109: symlink d1/d17/l21 0 2024-09-20T19:05:45.871 INFO:tasks.workunit.client.0.smithi027.stdout:9/30: truncate d0/f4 867156 0 2024-09-20T19:05:45.872 INFO:tasks.workunit.client.1.smithi098.stdout:9/177: dread d4/f8 [0,4194304] 0 2024-09-20T19:05:45.873 INFO:tasks.workunit.client.1.smithi098.stdout:9/178: chown d4/de/f29 331643228 1 2024-09-20T19:05:45.873 INFO:tasks.workunit.client.1.smithi098.stdout:9/179: fdatasync d4/de/d27/f2e 0 2024-09-20T19:05:45.874 INFO:tasks.workunit.client.0.smithi027.stdout:8/31: chown d2/d3/l5 31 1 2024-09-20T19:05:45.874 INFO:tasks.workunit.client.1.smithi098.stdout:5/110: unlink d1/d17/l20 0 2024-09-20T19:05:45.875 INFO:tasks.workunit.client.1.smithi098.stdout:5/111: write d1/fe [1033252,46372] 0 2024-09-20T19:05:45.875 INFO:tasks.workunit.client.0.smithi027.stdout:8/32: truncate d2/f7 782947 0 2024-09-20T19:05:45.876 INFO:tasks.workunit.client.1.smithi098.stdout:2/188: write d3/fd [326615,52252] 0 2024-09-20T19:05:45.878 INFO:tasks.workunit.client.1.smithi098.stdout:9/180: creat d4/de/f3a x:0 0 0 2024-09-20T19:05:45.879 INFO:tasks.workunit.client.1.smithi098.stdout:9/181: write d4/de/d24/d35/f32 [556041,17476] 0 2024-09-20T19:05:45.879 INFO:tasks.workunit.client.1.smithi098.stdout:2/189: creat d3/d16/d1d/d2b/d34/f3e x:0 0 0 2024-09-20T19:05:45.883 INFO:tasks.workunit.client.1.smithi098.stdout:2/190: symlink d3/d16/d1d/d2b/l3f 0 2024-09-20T19:05:45.886 INFO:tasks.workunit.client.1.smithi098.stdout:5/112: truncate d1/fd 8203510 0 2024-09-20T19:05:45.887 INFO:tasks.workunit.client.1.smithi098.stdout:7/81: sync 2024-09-20T19:05:45.889 INFO:tasks.workunit.client.1.smithi098.stdout:9/182: link d4/f10 d4/d17/f3b 0 2024-09-20T19:05:45.892 INFO:tasks.workunit.client.1.smithi098.stdout:2/191: dwrite d3/f15 [4194304,4194304] 0 2024-09-20T19:05:45.893 INFO:tasks.workunit.client.1.smithi098.stdout:7/82: dread d3/f8 [0,4194304] 0 2024-09-20T19:05:45.897 INFO:tasks.workunit.client.1.smithi098.stdout:7/83: mknod d3/c1e 0 2024-09-20T19:05:45.900 INFO:tasks.workunit.client.1.smithi098.stdout:9/183: rename d4/d17 to d4/de/d27/d3c 0 2024-09-20T19:05:45.900 INFO:tasks.workunit.client.1.smithi098.stdout:2/192: dwrite d3/fd [0,4194304] 0 2024-09-20T19:05:45.901 INFO:tasks.workunit.client.1.smithi098.stdout:2/193: chown d3/df/f11 1 1 2024-09-20T19:05:45.904 INFO:tasks.workunit.client.1.smithi098.stdout:5/113: fdatasync d1/fc 0 2024-09-20T19:05:45.904 INFO:tasks.workunit.client.1.smithi098.stdout:7/84: mkdir d3/d10/d16/d1a/d1f 0 2024-09-20T19:05:45.905 INFO:tasks.workunit.client.0.smithi027.stdout:1/31: link d2/l6 d2/d8/la 0 2024-09-20T19:05:45.905 INFO:tasks.workunit.client.1.smithi098.stdout:9/184: chown d4/de/d27/d3c/f3b 6793 1 2024-09-20T19:05:45.905 INFO:tasks.workunit.client.0.smithi027.stdout:3/34: dwrite d0/d1/f9 [0,4194304] 0 2024-09-20T19:05:45.906 INFO:tasks.workunit.client.1.smithi098.stdout:5/114: chown d1/d17/f19 259 1 2024-09-20T19:05:45.906 INFO:tasks.workunit.client.1.smithi098.stdout:2/194: fdatasync d3/df/d13/f3a 0 2024-09-20T19:05:45.906 INFO:tasks.workunit.client.1.smithi098.stdout:7/85: read d3/f11 [3496738,71268] 0 2024-09-20T19:05:45.907 INFO:tasks.workunit.client.0.smithi027.stdout:9/31: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.908 INFO:tasks.workunit.client.1.smithi098.stdout:2/195: readlink d3/d16/d1d/l28 0 2024-09-20T19:05:45.909 INFO:tasks.workunit.client.1.smithi098.stdout:9/185: creat d4/de/f3d x:0 0 0 2024-09-20T19:05:45.912 INFO:tasks.workunit.client.1.smithi098.stdout:5/115: symlink d1/l22 0 2024-09-20T19:05:45.913 INFO:tasks.workunit.client.0.smithi027.stdout:3/35: creat d0/d1/fb x:0 0 0 2024-09-20T19:05:45.914 INFO:tasks.workunit.client.0.smithi027.stdout:8/33: dwrite d2/f7 [0,4194304] 0 2024-09-20T19:05:45.915 INFO:tasks.workunit.client.0.smithi027.stdout:1/32: rename d2/l6 to d2/d8/lb 0 2024-09-20T19:05:45.917 INFO:tasks.workunit.client.0.smithi027.stdout:3/36: symlink d0/d1/lc 0 2024-09-20T19:05:45.918 INFO:tasks.workunit.client.1.smithi098.stdout:5/116: write d1/ff [1785506,61159] 0 2024-09-20T19:05:45.918 INFO:tasks.workunit.client.0.smithi027.stdout:3/37: rename d0 to d0/dd 22 2024-09-20T19:05:45.918 INFO:tasks.workunit.client.0.smithi027.stdout:3/38: stat d0 0 2024-09-20T19:05:45.919 INFO:tasks.workunit.client.0.smithi027.stdout:3/39: write d0/f2 [2185318,5429] 0 2024-09-20T19:05:45.919 INFO:tasks.workunit.client.0.smithi027.stdout:1/33: mknod d2/d8/cc 0 2024-09-20T19:05:45.920 INFO:tasks.workunit.client.0.smithi027.stdout:9/32: getdents d0 0 2024-09-20T19:05:45.921 INFO:tasks.workunit.client.1.smithi098.stdout:7/86: dwrite d3/f12 [4194304,4194304] 0 2024-09-20T19:05:45.923 INFO:tasks.workunit.client.0.smithi027.stdout:3/40: symlink d0/le 0 2024-09-20T19:05:45.923 INFO:tasks.workunit.client.0.smithi027.stdout:3/41: truncate d0/f5 571862 0 2024-09-20T19:05:45.924 INFO:tasks.workunit.client.0.smithi027.stdout:3/42: write d0/d1/f9 [2812379,22260] 0 2024-09-20T19:05:45.925 INFO:tasks.workunit.client.1.smithi098.stdout:2/196: dwrite d3/df/d13/f3a [0,4194304] 0 2024-09-20T19:05:45.925 INFO:tasks.workunit.client.0.smithi027.stdout:1/34: rename d2/d8/cc to d2/cd 0 2024-09-20T19:05:45.925 INFO:tasks.workunit.client.1.smithi098.stdout:2/197: stat d3/df/c14 0 2024-09-20T19:05:45.926 INFO:tasks.workunit.client.0.smithi027.stdout:9/33: mkdir d0/d6 0 2024-09-20T19:05:45.927 INFO:tasks.workunit.client.0.smithi027.stdout:9/34: chown d0/f3 60202 1 2024-09-20T19:05:45.928 INFO:tasks.workunit.client.0.smithi027.stdout:9/35: chown d0/c2 4445395 1 2024-09-20T19:05:45.929 INFO:tasks.workunit.client.0.smithi027.stdout:1/35: dread d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:45.929 INFO:tasks.workunit.client.0.smithi027.stdout:1/36: rename d2 to d2/de 22 2024-09-20T19:05:45.930 INFO:tasks.workunit.client.1.smithi098.stdout:7/87: rmdir d3/d10/d16/d1a 39 2024-09-20T19:05:45.931 INFO:tasks.workunit.client.0.smithi027.stdout:9/36: mkdir d0/d7 0 2024-09-20T19:05:45.932 INFO:tasks.workunit.client.0.smithi027.stdout:3/43: mknod d0/d1/d7/cf 0 2024-09-20T19:05:45.932 INFO:tasks.workunit.client.1.smithi098.stdout:9/186: dwrite d4/de/f29 [0,4194304] 0 2024-09-20T19:05:45.933 INFO:tasks.workunit.client.1.smithi098.stdout:7/88: write d3/f12 [6988924,67916] 0 2024-09-20T19:05:45.933 INFO:tasks.workunit.client.0.smithi027.stdout:1/37: dread d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:45.937 INFO:tasks.workunit.client.1.smithi098.stdout:5/117: dread d1/d1b/f1c [0,4194304] 0 2024-09-20T19:05:45.942 INFO:tasks.workunit.client.0.smithi027.stdout:9/37: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.942 INFO:tasks.workunit.client.1.smithi098.stdout:5/118: read - d1/d17/f1e zero size 2024-09-20T19:05:45.942 INFO:tasks.workunit.client.1.smithi098.stdout:2/198: dwrite d3/df/d13/f33 [0,4194304] 0 2024-09-20T19:05:45.942 INFO:tasks.workunit.client.1.smithi098.stdout:9/187: dread - d4/de/d27/d3c/d21/d25/f30 zero size 2024-09-20T19:05:45.942 INFO:tasks.workunit.client.1.smithi098.stdout:5/119: stat d1 0 2024-09-20T19:05:45.943 INFO:tasks.workunit.client.0.smithi027.stdout:3/44: dwrite d0/f2 [0,4194304] 0 2024-09-20T19:05:45.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/89: dread d3/f12 [4194304,4194304] 0 2024-09-20T19:05:45.946 INFO:tasks.workunit.client.1.smithi098.stdout:2/199: mknod d3/d16/d1d/d2b/d34/c40 0 2024-09-20T19:05:45.947 INFO:tasks.workunit.client.0.smithi027.stdout:3/45: write d0/d1/f9 [594181,95192] 0 2024-09-20T19:05:45.950 INFO:tasks.workunit.client.1.smithi098.stdout:5/120: symlink d1/l23 0 2024-09-20T19:05:45.953 INFO:tasks.workunit.client.0.smithi027.stdout:1/38: dwrite d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:45.956 INFO:tasks.workunit.client.1.smithi098.stdout:5/121: write d1/ff [2639604,122929] 0 2024-09-20T19:05:45.956 INFO:tasks.workunit.client.0.smithi027.stdout:9/38: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.958 INFO:tasks.workunit.client.0.smithi027.stdout:3/46: dread d0/f2 [0,4194304] 0 2024-09-20T19:05:45.958 INFO:tasks.workunit.client.1.smithi098.stdout:2/200: dread d3/df/d13/f33 [0,4194304] 0 2024-09-20T19:05:45.959 INFO:tasks.workunit.client.1.smithi098.stdout:7/90: dwrite d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:45.959 INFO:tasks.workunit.client.0.smithi027.stdout:8/34: truncate d2/f7 1893033 0 2024-09-20T19:05:45.959 INFO:tasks.workunit.client.1.smithi098.stdout:2/201: chown d3/d16/c17 0 1 2024-09-20T19:05:45.960 INFO:tasks.workunit.client.1.smithi098.stdout:2/202: chown d3/d16/d1a 36707 1 2024-09-20T19:05:45.961 INFO:tasks.workunit.client.1.smithi098.stdout:2/203: dread - d3/d16/d1d/f39 zero size 2024-09-20T19:05:45.961 INFO:tasks.workunit.client.1.smithi098.stdout:5/122: unlink d1/c10 0 2024-09-20T19:05:45.964 INFO:tasks.workunit.client.0.smithi027.stdout:1/39: dread d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:45.964 INFO:tasks.workunit.client.0.smithi027.stdout:1/40: chown d2/d8 13259807 1 2024-09-20T19:05:45.967 INFO:tasks.workunit.client.0.smithi027.stdout:3/47: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:45.967 INFO:tasks.workunit.client.0.smithi027.stdout:9/39: creat d0/d7/f8 x:0 0 0 2024-09-20T19:05:45.967 INFO:tasks.workunit.client.1.smithi098.stdout:5/123: dread d1/fb [0,4194304] 0 2024-09-20T19:05:45.968 INFO:tasks.workunit.client.1.smithi098.stdout:7/91: rename d3/d10/d18/c1b to d3/d10/d16/d1a/c20 0 2024-09-20T19:05:45.971 INFO:tasks.workunit.client.0.smithi027.stdout:8/35: creat d2/f8 x:0 0 0 2024-09-20T19:05:45.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/92: mkdir d3/d10/d18/d21 0 2024-09-20T19:05:45.975 INFO:tasks.workunit.client.1.smithi098.stdout:7/93: chown d3/d10/c14 1539914 1 2024-09-20T19:05:45.975 INFO:tasks.workunit.client.1.smithi098.stdout:7/94: stat d3/l7 0 2024-09-20T19:05:45.975 INFO:tasks.workunit.client.0.smithi027.stdout:1/41: symlink d2/d8/lf 0 2024-09-20T19:05:45.976 INFO:tasks.workunit.client.1.smithi098.stdout:9/188: write d4/de/d27/d3c/f3b [3031012,65801] 0 2024-09-20T19:05:45.976 INFO:tasks.workunit.client.1.smithi098.stdout:9/189: readlink d4/de/ld 0 2024-09-20T19:05:45.977 INFO:tasks.workunit.client.0.smithi027.stdout:3/48: creat d0/d1/d7/f10 x:0 0 0 2024-09-20T19:05:45.977 INFO:tasks.workunit.client.0.smithi027.stdout:3/49: stat d0/le 0 2024-09-20T19:05:45.977 INFO:tasks.workunit.client.0.smithi027.stdout:3/50: chown d0/d1/d7/cf 183 1 2024-09-20T19:05:45.978 INFO:tasks.workunit.client.0.smithi027.stdout:9/40: mkdir d0/d9 0 2024-09-20T19:05:45.978 INFO:tasks.workunit.client.0.smithi027.stdout:9/41: fsync d0/f3 0 2024-09-20T19:05:45.978 INFO:tasks.workunit.client.0.smithi027.stdout:9/42: readlink - no filename 2024-09-20T19:05:45.979 INFO:tasks.workunit.client.1.smithi098.stdout:7/95: rmdir d3/d10/d18 39 2024-09-20T19:05:45.979 INFO:tasks.workunit.client.0.smithi027.stdout:9/43: fdatasync d0/d7/f8 0 2024-09-20T19:05:45.980 INFO:tasks.workunit.client.0.smithi027.stdout:1/42: unlink d2/l4 0 2024-09-20T19:05:45.981 INFO:tasks.workunit.client.1.smithi098.stdout:9/190: symlink d4/de/d27/d3c/l3e 0 2024-09-20T19:05:45.982 INFO:tasks.workunit.client.0.smithi027.stdout:3/51: unlink d0/d1/f9 0 2024-09-20T19:05:45.982 INFO:tasks.workunit.client.1.smithi098.stdout:4/81: sync 2024-09-20T19:05:45.984 INFO:tasks.workunit.client.1.smithi098.stdout:9/191: creat d4/de/f3f x:0 0 0 2024-09-20T19:05:45.985 INFO:tasks.workunit.client.1.smithi098.stdout:5/124: fdatasync d1/ff 0 2024-09-20T19:05:45.986 INFO:tasks.workunit.client.0.smithi027.stdout:9/44: dwrite d0/f4 [0,4194304] 0 2024-09-20T19:05:45.986 INFO:tasks.workunit.client.1.smithi098.stdout:5/125: write d1/d17/f1e [267796,48429] 0 2024-09-20T19:05:45.987 INFO:tasks.workunit.client.0.smithi027.stdout:9/45: fdatasync d0/f3 0 2024-09-20T19:05:45.987 INFO:tasks.workunit.client.1.smithi098.stdout:4/82: dread d3/fc [0,4194304] 0 2024-09-20T19:05:45.987 INFO:tasks.workunit.client.1.smithi098.stdout:7/96: symlink d3/d10/d16/d1a/d1f/l22 0 2024-09-20T19:05:45.989 INFO:tasks.workunit.client.1.smithi098.stdout:9/192: creat d4/de/d19/f40 x:0 0 0 2024-09-20T19:05:45.991 INFO:tasks.workunit.client.1.smithi098.stdout:9/193: chown d4/de/d27/d39 2415871 1 2024-09-20T19:05:45.993 INFO:tasks.workunit.client.1.smithi098.stdout:2/204: truncate d3/f9 5653869 0 2024-09-20T19:05:45.996 INFO:tasks.workunit.client.1.smithi098.stdout:7/97: rename d3/d10/d18 to d3/d10/d18/d23 22 2024-09-20T19:05:45.997 INFO:tasks.workunit.client.1.smithi098.stdout:7/98: readlink d3/ld 0 2024-09-20T19:05:45.998 INFO:tasks.workunit.client.1.smithi098.stdout:7/99: chown d3/f8 303 1 2024-09-20T19:05:45.998 INFO:tasks.workunit.client.1.smithi098.stdout:5/126: dwrite d1/d17/f1e [0,4194304] 0 2024-09-20T19:05:45.999 INFO:tasks.workunit.client.0.smithi027.stdout:9/46: creat d0/fa x:0 0 0 2024-09-20T19:05:46.000 INFO:tasks.workunit.client.0.smithi027.stdout:9/47: write d0/d7/f8 [605887,25108] 0 2024-09-20T19:05:46.001 INFO:tasks.workunit.client.1.smithi098.stdout:9/194: dwrite d4/de/d24/d35/f32 [0,4194304] 0 2024-09-20T19:05:46.005 INFO:tasks.workunit.client.1.smithi098.stdout:2/205: mknod d3/d16/d1a/c41 0 2024-09-20T19:05:46.008 INFO:tasks.workunit.client.1.smithi098.stdout:4/83: mknod d3/d6/d11/d1e/c21 0 2024-09-20T19:05:46.010 INFO:tasks.workunit.client.1.smithi098.stdout:5/127: mkdir d1/d1b/d24 0 2024-09-20T19:05:46.014 INFO:tasks.workunit.client.0.smithi027.stdout:9/48: symlink d0/d9/lb 0 2024-09-20T19:05:46.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/84: write d3/d6/f10 [536424,118588] 0 2024-09-20T19:05:46.014 INFO:tasks.workunit.client.1.smithi098.stdout:7/100: symlink d3/d10/d16/d17/l24 0 2024-09-20T19:05:46.014 INFO:tasks.workunit.client.1.smithi098.stdout:9/195: dwrite d4/de/d27/d3c/f38 [0,4194304] 0 2024-09-20T19:05:46.016 INFO:tasks.workunit.client.1.smithi098.stdout:2/206: mknod d3/d16/d1d/d2b/d34/d38/c42 0 2024-09-20T19:05:46.016 INFO:tasks.workunit.client.1.smithi098.stdout:9/196: write d4/de/f3a [224800,42111] 0 2024-09-20T19:05:46.018 INFO:tasks.workunit.client.1.smithi098.stdout:5/128: rename d1/d1b/d24 to d1/d17/d25 0 2024-09-20T19:05:46.020 INFO:tasks.workunit.client.1.smithi098.stdout:5/129: write d1/f9 [127460,46395] 0 2024-09-20T19:05:46.021 INFO:tasks.workunit.client.1.smithi098.stdout:9/197: symlink d4/l41 0 2024-09-20T19:05:46.022 INFO:tasks.workunit.client.0.smithi027.stdout:9/49: dwrite d0/f4 [0,4194304] 0 2024-09-20T19:05:46.022 INFO:tasks.workunit.client.1.smithi098.stdout:2/207: mknod d3/c43 0 2024-09-20T19:05:46.026 INFO:tasks.workunit.client.0.smithi027.stdout:9/50: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:46.026 INFO:tasks.workunit.client.0.smithi027.stdout:9/51: chown d0 15789607 1 2024-09-20T19:05:46.027 INFO:tasks.workunit.client.1.smithi098.stdout:5/130: dread d1/fc [0,4194304] 0 2024-09-20T19:05:46.027 INFO:tasks.workunit.client.0.smithi027.stdout:9/52: write d0/fa [467509,40628] 0 2024-09-20T19:05:46.028 INFO:tasks.workunit.client.1.smithi098.stdout:5/131: dread - d1/f14 zero size 2024-09-20T19:05:46.029 INFO:tasks.workunit.client.1.smithi098.stdout:4/85: dwrite d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:46.032 INFO:tasks.workunit.client.1.smithi098.stdout:4/86: write d3/d6/f1d [197490,59060] 0 2024-09-20T19:05:46.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/198: creat d4/de/d24/d35/f42 x:0 0 0 2024-09-20T19:05:46.032 INFO:tasks.workunit.client.0.smithi027.stdout:1/43: truncate d2/d8/f9 1896621 0 2024-09-20T19:05:46.034 INFO:tasks.workunit.client.0.smithi027.stdout:9/53: rename d0/d7 to d0/d9/dc 0 2024-09-20T19:05:46.035 INFO:tasks.workunit.client.0.smithi027.stdout:9/54: write d0/f4 [2410030,10130] 0 2024-09-20T19:05:46.036 INFO:tasks.workunit.client.1.smithi098.stdout:2/208: creat d3/d16/d1d/d2b/d34/d38/f44 x:0 0 0 2024-09-20T19:05:46.037 INFO:tasks.workunit.client.0.smithi027.stdout:3/52: truncate d0/f2 1290582 0 2024-09-20T19:05:46.038 INFO:tasks.workunit.client.1.smithi098.stdout:2/209: stat d3/d16/d1d/d2b/d34/d38/f44 0 2024-09-20T19:05:46.039 INFO:tasks.workunit.client.0.smithi027.stdout:1/44: symlink d2/d8/l10 0 2024-09-20T19:05:46.039 INFO:tasks.workunit.client.0.smithi027.stdout:1/45: chown d2/d8/lf 234442803 1 2024-09-20T19:05:46.040 INFO:tasks.workunit.client.0.smithi027.stdout:1/46: readlink d2/l7 0 2024-09-20T19:05:46.040 INFO:tasks.workunit.client.0.smithi027.stdout:1/47: rename d2 to d2/d8/d11 22 2024-09-20T19:05:46.041 INFO:tasks.workunit.client.1.smithi098.stdout:4/87: dwrite d3/fc [0,4194304] 0 2024-09-20T19:05:46.043 INFO:tasks.workunit.client.1.smithi098.stdout:9/199: rename d4/de/d27/d3c/d21/d25/f37 to d4/de/d24/d35/f43 0 2024-09-20T19:05:46.048 INFO:tasks.workunit.client.1.smithi098.stdout:5/132: truncate d1/ff 2641703 0 2024-09-20T19:05:46.049 INFO:tasks.workunit.client.1.smithi098.stdout:5/133: truncate d1/f14 877666 0 2024-09-20T19:05:46.049 INFO:tasks.workunit.client.0.smithi027.stdout:9/55: mkdir d0/d6/dd 0 2024-09-20T19:05:46.050 INFO:tasks.workunit.client.1.smithi098.stdout:7/101: truncate d3/d10/f13 3260512 0 2024-09-20T19:05:46.051 INFO:tasks.workunit.client.1.smithi098.stdout:4/88: fdatasync d3/f7 0 2024-09-20T19:05:46.054 INFO:tasks.workunit.client.1.smithi098.stdout:5/134: dread d1/d1b/f1c [0,4194304] 0 2024-09-20T19:05:46.054 INFO:tasks.workunit.client.0.smithi027.stdout:1/48: read d2/d8/f9 [1625392,20093] 0 2024-09-20T19:05:46.056 INFO:tasks.workunit.client.0.smithi027.stdout:9/56: rename d0/f4 to d0/d9/fe 0 2024-09-20T19:05:46.057 INFO:tasks.workunit.client.1.smithi098.stdout:7/102: fsync d3/f12 0 2024-09-20T19:05:46.063 INFO:tasks.workunit.client.0.smithi027.stdout:1/49: unlink d2/d8/lf 0 2024-09-20T19:05:46.064 INFO:tasks.workunit.client.1.smithi098.stdout:2/210: creat d3/d16/f45 x:0 0 0 2024-09-20T19:05:46.064 INFO:tasks.workunit.client.1.smithi098.stdout:2/211: fsync d3/f7 0 2024-09-20T19:05:46.065 INFO:tasks.workunit.client.0.smithi027.stdout:9/57: mkdir d0/d9/df 0 2024-09-20T19:05:46.065 INFO:tasks.workunit.client.0.smithi027.stdout:3/53: write d0/f5 [284821,116465] 0 2024-09-20T19:05:46.066 INFO:tasks.workunit.client.1.smithi098.stdout:2/212: write d3/df/f3d [531799,21820] 0 2024-09-20T19:05:46.066 INFO:tasks.workunit.client.1.smithi098.stdout:5/135: creat d1/d1b/f26 x:0 0 0 2024-09-20T19:05:46.066 INFO:tasks.workunit.client.0.smithi027.stdout:3/54: chown d0/c3 186901953 1 2024-09-20T19:05:46.067 INFO:tasks.workunit.client.1.smithi098.stdout:5/136: truncate d1/f14 976565 0 2024-09-20T19:05:46.067 INFO:tasks.workunit.client.0.smithi027.stdout:3/55: write d0/d1/d7/f10 [389197,11288] 0 2024-09-20T19:05:46.068 INFO:tasks.workunit.client.0.smithi027.stdout:1/50: rename d2/d8/l10 to d2/l12 0 2024-09-20T19:05:46.068 INFO:tasks.workunit.client.1.smithi098.stdout:7/103: symlink d3/d10/d18/l25 0 2024-09-20T19:05:46.071 INFO:tasks.workunit.client.0.smithi027.stdout:9/58: unlink d0/f3 0 2024-09-20T19:05:46.074 INFO:tasks.workunit.client.0.smithi027.stdout:3/56: creat d0/f11 x:0 0 0 2024-09-20T19:05:46.074 INFO:tasks.workunit.client.1.smithi098.stdout:2/213: mkdir d3/d16/d1d/d2b/d46 0 2024-09-20T19:05:46.076 INFO:tasks.workunit.client.0.smithi027.stdout:1/51: creat d2/f13 x:0 0 0 2024-09-20T19:05:46.079 INFO:tasks.workunit.client.0.smithi027.stdout:3/57: chown d0/l8 6 1 2024-09-20T19:05:46.080 INFO:tasks.workunit.client.0.smithi027.stdout:3/58: read - d0/d1/fb zero size 2024-09-20T19:05:46.080 INFO:tasks.workunit.client.1.smithi098.stdout:7/104: creat d3/d10/d16/d1a/d1f/f26 x:0 0 0 2024-09-20T19:05:46.081 INFO:tasks.workunit.client.1.smithi098.stdout:7/105: readlink d3/d10/l1d 0 2024-09-20T19:05:46.081 INFO:tasks.workunit.client.0.smithi027.stdout:1/52: mkdir d2/d14 0 2024-09-20T19:05:46.082 INFO:tasks.workunit.client.1.smithi098.stdout:2/214: mknod d3/d16/d1d/d2b/d34/c47 0 2024-09-20T19:05:46.084 INFO:tasks.workunit.client.1.smithi098.stdout:7/106: dread d3/f8 [0,4194304] 0 2024-09-20T19:05:46.085 INFO:tasks.workunit.client.0.smithi027.stdout:9/59: getdents d0/d6/dd 0 2024-09-20T19:05:46.087 INFO:tasks.workunit.client.0.smithi027.stdout:3/59: creat d0/f12 x:0 0 0 2024-09-20T19:05:46.087 INFO:tasks.workunit.client.0.smithi027.stdout:3/60: fsync d0/f5 0 2024-09-20T19:05:46.088 INFO:tasks.workunit.client.1.smithi098.stdout:7/107: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:46.089 INFO:tasks.workunit.client.0.smithi027.stdout:9/60: write d0/f5 [3048567,86418] 0 2024-09-20T19:05:46.089 INFO:tasks.workunit.client.1.smithi098.stdout:7/108: write d3/f12 [3593497,100610] 0 2024-09-20T19:05:46.093 INFO:tasks.workunit.client.1.smithi098.stdout:4/89: getdents d3/d6/d11/d1e 0 2024-09-20T19:05:46.093 INFO:tasks.workunit.client.1.smithi098.stdout:5/137: link d1/l22 d1/d1b/l27 0 2024-09-20T19:05:46.094 INFO:tasks.workunit.client.1.smithi098.stdout:5/138: chown d1/d17/f1f 288 1 2024-09-20T19:05:46.095 INFO:tasks.workunit.client.1.smithi098.stdout:5/139: truncate d1/f14 1769973 0 2024-09-20T19:05:46.095 INFO:tasks.workunit.client.0.smithi027.stdout:3/61: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:46.096 INFO:tasks.workunit.client.1.smithi098.stdout:2/215: symlink d3/d16/d1d/d2b/d46/l48 0 2024-09-20T19:05:46.096 INFO:tasks.workunit.client.1.smithi098.stdout:7/109: creat d3/d10/d18/f27 x:0 0 0 2024-09-20T19:05:46.097 INFO:tasks.workunit.client.0.smithi027.stdout:9/61: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:46.099 INFO:tasks.workunit.client.0.smithi027.stdout:9/62: fsync d0/d9/dc/f8 0 2024-09-20T19:05:46.100 INFO:tasks.workunit.client.0.smithi027.stdout:9/63: chown d0/d9/dc/f8 2 1 2024-09-20T19:05:46.100 INFO:tasks.workunit.client.1.smithi098.stdout:5/140: dread d1/f14 [0,4194304] 0 2024-09-20T19:05:46.100 INFO:tasks.workunit.client.1.smithi098.stdout:7/110: write d3/d10/d18/f27 [962531,127688] 0 2024-09-20T19:05:46.102 INFO:tasks.workunit.client.1.smithi098.stdout:2/216: mkdir d3/d16/d1d/d2b/d49 0 2024-09-20T19:05:46.105 INFO:tasks.workunit.client.1.smithi098.stdout:4/90: dwrite d3/d6/f13 [0,4194304] 0 2024-09-20T19:05:46.106 INFO:tasks.workunit.client.1.smithi098.stdout:2/217: dread - d3/df/d13/f2c zero size 2024-09-20T19:05:46.106 INFO:tasks.workunit.client.0.smithi027.stdout:9/64: link d0/d9/fe d0/d6/dd/f10 0 2024-09-20T19:05:46.108 INFO:tasks.workunit.client.1.smithi098.stdout:7/111: mkdir d3/d10/d16/d1a/d1f/d28 0 2024-09-20T19:05:46.109 INFO:tasks.workunit.client.0.smithi027.stdout:9/65: symlink d0/d9/dc/l11 0 2024-09-20T19:05:46.112 INFO:tasks.workunit.client.1.smithi098.stdout:2/218: mknod d3/d16/d1a/c4a 0 2024-09-20T19:05:46.113 INFO:tasks.workunit.client.1.smithi098.stdout:4/91: dread d3/f16 [0,4194304] 0 2024-09-20T19:05:46.114 INFO:tasks.workunit.client.0.smithi027.stdout:9/66: creat d0/f12 x:0 0 0 2024-09-20T19:05:46.115 INFO:tasks.workunit.client.0.smithi027.stdout:9/67: truncate d0/d9/fe 5011571 0 2024-09-20T19:05:46.116 INFO:tasks.workunit.client.1.smithi098.stdout:7/112: fsync d3/d10/d16/d1a/d1f/f26 0 2024-09-20T19:05:46.117 INFO:tasks.workunit.client.1.smithi098.stdout:2/219: rmdir d3/d16/d1a 39 2024-09-20T19:05:46.118 INFO:tasks.workunit.client.1.smithi098.stdout:4/92: rename d3/d6/d11/c1a to d3/d6/d11/c22 0 2024-09-20T19:05:46.119 INFO:tasks.workunit.client.0.smithi027.stdout:9/68: creat d0/d6/f13 x:0 0 0 2024-09-20T19:05:46.120 INFO:tasks.workunit.client.0.smithi027.stdout:9/69: stat d0/d6 0 2024-09-20T19:05:46.122 INFO:tasks.workunit.client.1.smithi098.stdout:7/113: rename d3/d10/d16/d17/l24 to d3/d10/d16/d1a/d1f/l29 0 2024-09-20T19:05:46.123 INFO:tasks.workunit.client.1.smithi098.stdout:7/114: chown d3/d10/d16/d17 3842826 1 2024-09-20T19:05:46.124 INFO:tasks.workunit.client.1.smithi098.stdout:7/115: chown d3/d10/l1d 0 1 2024-09-20T19:05:46.125 INFO:tasks.workunit.client.0.smithi027.stdout:9/70: creat d0/d9/dc/f14 x:0 0 0 2024-09-20T19:05:46.126 INFO:tasks.workunit.client.1.smithi098.stdout:2/220: creat d3/d16/d1a/f4b x:0 0 0 2024-09-20T19:05:46.127 INFO:tasks.workunit.client.0.smithi027.stdout:9/71: unlink d0/d9/fe 0 2024-09-20T19:05:46.130 INFO:tasks.workunit.client.0.smithi027.stdout:9/72: creat d0/f15 x:0 0 0 2024-09-20T19:05:46.135 INFO:tasks.workunit.client.0.smithi027.stdout:9/73: mknod d0/d9/df/c16 0 2024-09-20T19:05:46.135 INFO:tasks.workunit.client.0.smithi027.stdout:9/74: read - d0/f12 zero size 2024-09-20T19:05:46.135 INFO:tasks.workunit.client.1.smithi098.stdout:2/221: link d3/d16/d1a/f27 d3/f4c 0 2024-09-20T19:05:46.136 INFO:tasks.workunit.client.0.smithi027.stdout:9/75: write d0/f12 [212323,17960] 0 2024-09-20T19:05:46.138 INFO:tasks.workunit.client.1.smithi098.stdout:5/141: truncate d1/d17/f1e 2575976 0 2024-09-20T19:05:46.139 INFO:tasks.workunit.client.0.smithi027.stdout:9/76: creat d0/d9/dc/f17 x:0 0 0 2024-09-20T19:05:46.143 INFO:tasks.workunit.client.1.smithi098.stdout:4/93: write f1 [2792859,130514] 0 2024-09-20T19:05:46.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/94: write d3/d6/f1d [831571,25279] 0 2024-09-20T19:05:46.145 INFO:tasks.workunit.client.1.smithi098.stdout:4/95: fdatasync d3/d6/f18 0 2024-09-20T19:05:46.149 INFO:tasks.workunit.client.1.smithi098.stdout:7/116: truncate d3/f12 5297514 0 2024-09-20T19:05:46.149 INFO:tasks.workunit.client.1.smithi098.stdout:4/96: creat d3/d6/f23 x:0 0 0 2024-09-20T19:05:46.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/97: chown d3/d6/f13 32333415 1 2024-09-20T19:05:46.151 INFO:tasks.workunit.client.1.smithi098.stdout:7/117: rmdir d3/d10/d16/d1a 39 2024-09-20T19:05:46.152 INFO:tasks.workunit.client.1.smithi098.stdout:4/98: mknod d3/d6/d11/c24 0 2024-09-20T19:05:46.153 INFO:tasks.workunit.client.1.smithi098.stdout:4/99: write d3/fc [3713490,97827] 0 2024-09-20T19:05:46.157 INFO:tasks.workunit.client.1.smithi098.stdout:7/118: write d3/d10/d16/d1a/d1f/f26 [552584,122676] 0 2024-09-20T19:05:46.158 INFO:tasks.workunit.client.1.smithi098.stdout:2/222: write d3/f4c [2250993,107498] 0 2024-09-20T19:05:46.158 INFO:tasks.workunit.client.0.smithi027.stdout:9/77: write d0/d6/dd/f10 [359249,66834] 0 2024-09-20T19:05:46.159 INFO:tasks.workunit.client.1.smithi098.stdout:4/100: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:46.160 INFO:tasks.workunit.client.1.smithi098.stdout:7/119: write d3/d10/d18/f27 [1173679,37816] 0 2024-09-20T19:05:46.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/223: write d3/f4c [2868487,12696] 0 2024-09-20T19:05:46.160 INFO:tasks.workunit.client.1.smithi098.stdout:4/101: chown d3/c20 418075 1 2024-09-20T19:05:46.163 INFO:tasks.workunit.client.1.smithi098.stdout:2/224: read d3/fd [1844849,46171] 0 2024-09-20T19:05:46.164 INFO:tasks.workunit.client.1.smithi098.stdout:4/102: mknod d3/c25 0 2024-09-20T19:05:46.165 INFO:tasks.workunit.client.1.smithi098.stdout:7/120: rmdir d3/d10 39 2024-09-20T19:05:46.166 INFO:tasks.workunit.client.0.smithi027.stdout:9/78: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:05:46.167 INFO:tasks.workunit.client.1.smithi098.stdout:4/103: readlink d3/d6/d11/l19 0 2024-09-20T19:05:46.167 INFO:tasks.workunit.client.1.smithi098.stdout:4/104: chown d3/d6/f13 7851 1 2024-09-20T19:05:46.168 INFO:tasks.workunit.client.1.smithi098.stdout:4/105: fsync d3/ff 0 2024-09-20T19:05:46.169 INFO:tasks.workunit.client.1.smithi098.stdout:4/106: write d3/fe [1175218,79628] 0 2024-09-20T19:05:46.169 INFO:tasks.workunit.client.0.smithi027.stdout:9/79: mknod d0/d9/dc/c18 0 2024-09-20T19:05:46.171 INFO:tasks.workunit.client.1.smithi098.stdout:2/225: creat d3/d16/d1d/d2b/d49/f4d x:0 0 0 2024-09-20T19:05:46.171 INFO:tasks.workunit.client.1.smithi098.stdout:7/121: read d3/d10/d18/f27 [831878,52180] 0 2024-09-20T19:05:46.175 INFO:tasks.workunit.client.1.smithi098.stdout:4/107: rename d3/d6/f1d to d3/d6/d11/d1e/f26 0 2024-09-20T19:05:46.176 INFO:tasks.workunit.client.1.smithi098.stdout:2/226: unlink d3/d16/c17 0 2024-09-20T19:05:46.176 INFO:tasks.workunit.client.1.smithi098.stdout:4/108: chown d3/d6/cb 11225549 1 2024-09-20T19:05:46.177 INFO:tasks.workunit.client.0.smithi027.stdout:9/80: dwrite d0/d6/f13 [0,4194304] 0 2024-09-20T19:05:46.178 INFO:tasks.workunit.client.1.smithi098.stdout:7/122: dwrite d3/f8 [0,4194304] 0 2024-09-20T19:05:46.178 INFO:tasks.workunit.client.0.smithi027.stdout:9/81: write d0/f5 [4404660,127948] 0 2024-09-20T19:05:46.179 INFO:tasks.workunit.client.1.smithi098.stdout:2/227: write d3/d16/f3b [416543,97481] 0 2024-09-20T19:05:46.180 INFO:tasks.workunit.client.1.smithi098.stdout:7/123: chown d3/d10/f19 21 1 2024-09-20T19:05:46.186 INFO:tasks.workunit.client.1.smithi098.stdout:2/228: write d3/f3c [300755,84946] 0 2024-09-20T19:05:46.190 INFO:tasks.workunit.client.1.smithi098.stdout:7/124: dwrite d3/d10/f19 [4194304,4194304] 0 2024-09-20T19:05:46.192 INFO:tasks.workunit.client.1.smithi098.stdout:2/229: creat d3/d16/d1d/f4e x:0 0 0 2024-09-20T19:05:46.193 INFO:tasks.workunit.client.1.smithi098.stdout:4/109: dwrite d3/fc [0,4194304] 0 2024-09-20T19:05:46.193 INFO:tasks.workunit.client.1.smithi098.stdout:7/125: chown d3/c1e 366390582 1 2024-09-20T19:05:46.194 INFO:tasks.workunit.client.0.smithi027.stdout:9/82: truncate d0/d6/dd/f10 4246731 0 2024-09-20T19:05:46.196 INFO:tasks.workunit.client.1.smithi098.stdout:2/230: truncate d3/df/d13/f2c 321354 0 2024-09-20T19:05:46.196 INFO:tasks.workunit.client.0.smithi027.stdout:9/83: write d0/f5 [3613355,62829] 0 2024-09-20T19:05:46.196 INFO:tasks.workunit.client.0.smithi027.stdout:9/84: chown d0/d9/df/c16 22834589 1 2024-09-20T19:05:46.198 INFO:tasks.workunit.client.1.smithi098.stdout:4/110: dread d3/fc [0,4194304] 0 2024-09-20T19:05:46.199 INFO:tasks.workunit.client.0.smithi027.stdout:9/85: rmdir d0/d9 39 2024-09-20T19:05:46.200 INFO:tasks.workunit.client.1.smithi098.stdout:2/231: truncate d3/df/d13/f29 602211 0 2024-09-20T19:05:46.202 INFO:tasks.workunit.client.1.smithi098.stdout:7/126: link d3/d10/d16/d1a/d1f/l29 d3/d10/d16/d1a/l2a 0 2024-09-20T19:05:46.203 INFO:tasks.workunit.client.1.smithi098.stdout:2/232: fsync d3/f9 0 2024-09-20T19:05:46.204 INFO:tasks.workunit.client.0.smithi027.stdout:9/86: mkdir d0/d6/dd/d19 0 2024-09-20T19:05:46.206 INFO:tasks.workunit.client.0.smithi027.stdout:9/87: rmdir d0/d6 39 2024-09-20T19:05:46.211 INFO:tasks.workunit.client.1.smithi098.stdout:4/111: dwrite d3/d6/d11/d1e/f26 [0,4194304] 0 2024-09-20T19:05:46.211 INFO:tasks.workunit.client.1.smithi098.stdout:2/233: mkdir d3/d16/d1d/d4f 0 2024-09-20T19:05:46.213 INFO:tasks.workunit.client.1.smithi098.stdout:7/127: dwrite d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:46.215 INFO:tasks.workunit.client.1.smithi098.stdout:4/112: truncate d3/d6/f23 1022224 0 2024-09-20T19:05:46.216 INFO:tasks.workunit.client.1.smithi098.stdout:2/234: truncate d3/f7 10040072 0 2024-09-20T19:05:46.220 INFO:tasks.workunit.client.1.smithi098.stdout:4/113: symlink d3/d6/d11/d1e/l27 0 2024-09-20T19:05:46.221 INFO:tasks.workunit.client.0.smithi027.stdout:9/88: rename d0/d6 to d0/d9/dc/d1a 0 2024-09-20T19:05:46.226 INFO:tasks.workunit.client.1.smithi098.stdout:7/128: dwrite d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:46.229 INFO:tasks.workunit.client.0.smithi027.stdout:9/89: dwrite d0/fa [0,4194304] 0 2024-09-20T19:05:46.229 INFO:tasks.workunit.client.1.smithi098.stdout:7/129: chown d3/f6 293402398 1 2024-09-20T19:05:46.230 INFO:tasks.workunit.client.0.smithi027.stdout:9/90: readlink d0/d9/dc/l11 0 2024-09-20T19:05:46.233 INFO:tasks.workunit.client.1.smithi098.stdout:2/235: dwrite d3/d16/d1d/d2b/d49/f4d [0,4194304] 0 2024-09-20T19:05:46.235 INFO:tasks.workunit.client.1.smithi098.stdout:4/114: dwrite d3/fe [4194304,4194304] 0 2024-09-20T19:05:46.236 INFO:tasks.workunit.client.0.smithi027.stdout:9/91: rename d0/d9/dc to d0/d9/df/d1b 0 2024-09-20T19:05:46.239 INFO:tasks.workunit.client.1.smithi098.stdout:2/236: chown d3/d16/l1f 6 1 2024-09-20T19:05:46.241 INFO:tasks.workunit.client.1.smithi098.stdout:4/115: fsync d3/ff 0 2024-09-20T19:05:46.242 INFO:tasks.workunit.client.0.smithi027.stdout:9/92: rename d0/d9/df/d1b/d1a/dd/d19 to d0/d9/df/d1c 0 2024-09-20T19:05:46.243 INFO:tasks.workunit.client.0.smithi027.stdout:9/93: read - d0/d9/df/d1b/f14 zero size 2024-09-20T19:05:46.244 INFO:tasks.workunit.client.0.smithi027.stdout:9/94: write d0/d9/df/d1b/f17 [823289,117394] 0 2024-09-20T19:05:46.244 INFO:tasks.workunit.client.1.smithi098.stdout:2/237: creat d3/d16/d1d/d2b/d46/f50 x:0 0 0 2024-09-20T19:05:46.245 INFO:tasks.workunit.client.1.smithi098.stdout:7/130: dwrite d3/d10/d16/d1a/d1f/f26 [0,4194304] 0 2024-09-20T19:05:46.251 INFO:tasks.workunit.client.1.smithi098.stdout:7/131: symlink d3/d10/d16/d17/l2b 0 2024-09-20T19:05:46.252 INFO:tasks.workunit.client.1.smithi098.stdout:4/116: truncate d3/f7 2145263 0 2024-09-20T19:05:46.253 INFO:tasks.workunit.client.1.smithi098.stdout:2/238: mkdir d3/d51 0 2024-09-20T19:05:46.254 INFO:tasks.workunit.client.0.smithi027.stdout:9/95: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T19:05:46.255 INFO:tasks.workunit.client.1.smithi098.stdout:2/239: unlink d3/df/d13/l19 0 2024-09-20T19:05:46.256 INFO:tasks.workunit.client.1.smithi098.stdout:7/132: dread d3/d10/f19 [4194304,4194304] 0 2024-09-20T19:05:46.257 INFO:tasks.workunit.client.1.smithi098.stdout:2/240: write d3/df/d13/f32 [184204,48586] 0 2024-09-20T19:05:46.257 INFO:tasks.workunit.client.1.smithi098.stdout:4/117: rename d3/d6/d11/c14 to d3/d6/d11/c28 0 2024-09-20T19:05:46.257 INFO:tasks.workunit.client.1.smithi098.stdout:2/241: readlink l0 0 2024-09-20T19:05:46.258 INFO:tasks.workunit.client.0.smithi027.stdout:9/96: creat d0/d9/df/f1d x:0 0 0 2024-09-20T19:05:46.261 INFO:tasks.workunit.client.1.smithi098.stdout:2/242: fsync d3/fd 0 2024-09-20T19:05:46.265 INFO:tasks.workunit.client.1.smithi098.stdout:7/133: creat d3/d10/d16/f2c x:0 0 0 2024-09-20T19:05:46.266 INFO:tasks.workunit.client.1.smithi098.stdout:2/243: symlink d3/d16/d1d/d2b/d49/l52 0 2024-09-20T19:05:46.273 INFO:tasks.workunit.client.1.smithi098.stdout:2/244: dwrite d3/d16/d1a/f37 [0,4194304] 0 2024-09-20T19:05:46.282 INFO:tasks.workunit.client.1.smithi098.stdout:2/245: dwrite d3/df/f3d [0,4194304] 0 2024-09-20T19:05:46.282 INFO:tasks.workunit.client.1.smithi098.stdout:2/246: chown d3/d51 252 1 2024-09-20T19:05:46.285 INFO:tasks.workunit.client.1.smithi098.stdout:2/247: symlink d3/d16/d1d/d4f/l53 0 2024-09-20T19:05:46.291 INFO:tasks.workunit.client.1.smithi098.stdout:2/248: dwrite d3/d16/d1a/f37 [0,4194304] 0 2024-09-20T19:05:46.291 INFO:tasks.workunit.client.1.smithi098.stdout:2/249: stat d3/d16/d1d/f4e 0 2024-09-20T19:05:46.310 INFO:tasks.workunit.client.1.smithi098.stdout:8/124: sync 2024-09-20T19:05:46.310 INFO:tasks.workunit.client.1.smithi098.stdout:1/57: sync 2024-09-20T19:05:46.310 INFO:tasks.workunit.client.1.smithi098.stdout:0/72: sync 2024-09-20T19:05:46.310 INFO:tasks.workunit.client.1.smithi098.stdout:6/53: sync 2024-09-20T19:05:46.310 INFO:tasks.workunit.client.1.smithi098.stdout:3/52: sync 2024-09-20T19:05:46.313 INFO:tasks.workunit.client.1.smithi098.stdout:1/58: fsync d1/d3/f9 0 2024-09-20T19:05:46.313 INFO:tasks.workunit.client.1.smithi098.stdout:1/59: fdatasync d1/d3/fd 0 2024-09-20T19:05:46.318 INFO:tasks.workunit.client.1.smithi098.stdout:2/250: mknod d3/d16/d1a/c54 0 2024-09-20T19:05:46.320 INFO:tasks.workunit.client.1.smithi098.stdout:6/54: readlink d0/d7/l9 0 2024-09-20T19:05:46.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:46 smithi027 ceph-mon[28196]: pgmap v258: 65 pgs: 65 active+clean; 352 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 343 op/s 2024-09-20T19:05:46.334 INFO:tasks.workunit.client.1.smithi098.stdout:4/118: write d3/d6/fd [377992,100499] 0 2024-09-20T19:05:46.342 INFO:tasks.workunit.client.1.smithi098.stdout:6/55: creat d0/de/f12 x:0 0 0 2024-09-20T19:05:46.343 INFO:tasks.workunit.client.1.smithi098.stdout:4/119: write d3/d6/f18 [5215283,54753] 0 2024-09-20T19:05:46.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/251: creat d3/f55 x:0 0 0 2024-09-20T19:05:46.348 INFO:tasks.workunit.client.1.smithi098.stdout:7/134: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:46.349 INFO:tasks.workunit.client.1.smithi098.stdout:6/56: rename d0/de/f12 to d0/d7/f13 0 2024-09-20T19:05:46.350 INFO:tasks.workunit.client.1.smithi098.stdout:4/120: dread d3/d6/d11/d1e/f26 [0,4194304] 0 2024-09-20T19:05:46.351 INFO:tasks.workunit.client.1.smithi098.stdout:6/57: write d0/d7/ff [776163,88503] 0 2024-09-20T19:05:46.353 INFO:tasks.workunit.client.1.smithi098.stdout:6/58: dread - d0/d7/f13 zero size 2024-09-20T19:05:46.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/59: fsync d0/d7/dc/fd 0 2024-09-20T19:05:46.360 INFO:tasks.workunit.client.1.smithi098.stdout:6/60: dwrite d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:46.361 INFO:tasks.workunit.client.1.smithi098.stdout:6/61: write d0/f5 [2788689,66104] 0 2024-09-20T19:05:46.362 INFO:tasks.workunit.client.1.smithi098.stdout:6/62: chown d0/d7/dc/l10 5898 1 2024-09-20T19:05:46.364 INFO:tasks.workunit.client.1.smithi098.stdout:6/63: truncate d0/d7/ff 1807309 0 2024-09-20T19:05:46.371 INFO:tasks.workunit.client.1.smithi098.stdout:6/64: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:46.372 INFO:tasks.workunit.client.1.smithi098.stdout:4/121: dread d3/d6/d11/d1e/f26 [0,4194304] 0 2024-09-20T19:05:46.375 INFO:tasks.workunit.client.1.smithi098.stdout:6/65: fdatasync d0/d7/f13 0 2024-09-20T19:05:46.378 INFO:tasks.workunit.client.1.smithi098.stdout:4/122: rename d3/d6/d11/c24 to d3/d6/c29 0 2024-09-20T19:05:46.378 INFO:tasks.workunit.client.1.smithi098.stdout:6/66: rename d0/d7 to d0/d7/dc/d14 22 2024-09-20T19:05:46.383 INFO:tasks.workunit.client.1.smithi098.stdout:4/123: mkdir d3/d6/d11/d1e/d2a 0 2024-09-20T19:05:46.383 INFO:tasks.workunit.client.1.smithi098.stdout:6/67: dread d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:46.384 INFO:tasks.workunit.client.1.smithi098.stdout:4/124: write d3/d6/f13 [3380938,44351] 0 2024-09-20T19:05:46.384 INFO:tasks.workunit.client.1.smithi098.stdout:6/68: write d0/f5 [2425516,66151] 0 2024-09-20T19:05:46.384 INFO:tasks.workunit.client.1.smithi098.stdout:4/125: chown d3/d6/l9 104 1 2024-09-20T19:05:46.390 INFO:tasks.workunit.client.1.smithi098.stdout:6/69: dwrite d0/d7/f13 [0,4194304] 0 2024-09-20T19:05:46.391 INFO:tasks.workunit.client.1.smithi098.stdout:6/70: readlink d0/l6 0 2024-09-20T19:05:46.403 INFO:tasks.workunit.client.1.smithi098.stdout:8/125: write d7/de/d11/f1b [821308,110064] 0 2024-09-20T19:05:46.403 INFO:tasks.workunit.client.1.smithi098.stdout:3/53: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:05:46.404 INFO:tasks.workunit.client.1.smithi098.stdout:3/54: readlink d4/lc 0 2024-09-20T19:05:46.409 INFO:tasks.workunit.client.1.smithi098.stdout:8/126: rename d7/de/d11/d1d/f23 to d7/de/f2c 0 2024-09-20T19:05:46.411 INFO:tasks.workunit.client.1.smithi098.stdout:1/60: truncate d1/fa 2327780 0 2024-09-20T19:05:46.411 INFO:tasks.workunit.client.1.smithi098.stdout:3/55: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:05:46.416 INFO:tasks.workunit.client.1.smithi098.stdout:8/127: unlink d7/de/d11/c16 0 2024-09-20T19:05:46.420 INFO:tasks.workunit.client.1.smithi098.stdout:3/56: unlink f2 0 2024-09-20T19:05:46.420 INFO:tasks.workunit.client.1.smithi098.stdout:3/57: chown d4/lc 9865190 1 2024-09-20T19:05:46.421 INFO:tasks.workunit.client.1.smithi098.stdout:3/58: truncate d4/da/fb 5032408 0 2024-09-20T19:05:46.422 INFO:tasks.workunit.client.1.smithi098.stdout:3/59: chown d4/f7 10 1 2024-09-20T19:05:46.424 INFO:tasks.workunit.client.1.smithi098.stdout:1/61: mkdir d1/d3/df 0 2024-09-20T19:05:46.426 INFO:tasks.workunit.client.1.smithi098.stdout:2/252: write d3/df/f3d [4344109,124723] 0 2024-09-20T19:05:46.428 INFO:tasks.workunit.client.1.smithi098.stdout:8/128: creat d7/de/d11/d19/f2d x:0 0 0 2024-09-20T19:05:46.429 INFO:tasks.workunit.client.1.smithi098.stdout:3/60: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:05:46.430 INFO:tasks.workunit.client.1.smithi098.stdout:3/61: chown c3 0 1 2024-09-20T19:05:46.434 INFO:tasks.workunit.client.1.smithi098.stdout:8/129: mknod d7/c2e 0 2024-09-20T19:05:46.435 INFO:tasks.workunit.client.1.smithi098.stdout:7/135: write d3/d10/f13 [758981,64291] 0 2024-09-20T19:05:46.435 INFO:tasks.workunit.client.1.smithi098.stdout:8/130: dread - d7/de/d11/f24 zero size 2024-09-20T19:05:46.436 INFO:tasks.workunit.client.1.smithi098.stdout:8/131: truncate d7/fd 978059 0 2024-09-20T19:05:46.442 INFO:tasks.workunit.client.1.smithi098.stdout:2/253: unlink d3/c4 0 2024-09-20T19:05:46.444 INFO:tasks.workunit.client.1.smithi098.stdout:8/132: creat d7/f2f x:0 0 0 2024-09-20T19:05:46.445 INFO:tasks.workunit.client.1.smithi098.stdout:8/133: write f1 [6432891,54003] 0 2024-09-20T19:05:46.448 INFO:tasks.workunit.client.1.smithi098.stdout:7/136: dread d3/f6 [0,4194304] 0 2024-09-20T19:05:46.449 INFO:tasks.workunit.client.1.smithi098.stdout:2/254: creat d3/d16/d1d/d2b/f56 x:0 0 0 2024-09-20T19:05:46.449 INFO:tasks.workunit.client.1.smithi098.stdout:7/137: read d3/f6 [1137382,113310] 0 2024-09-20T19:05:46.450 INFO:tasks.workunit.client.1.smithi098.stdout:2/255: write d3/df/d13/f18 [1826908,53755] 0 2024-09-20T19:05:46.451 INFO:tasks.workunit.client.1.smithi098.stdout:8/134: mkdir d7/de/d11/d19/d30 0 2024-09-20T19:05:46.454 INFO:tasks.workunit.client.1.smithi098.stdout:7/138: dread d3/d10/f19 [4194304,4194304] 0 2024-09-20T19:05:46.455 INFO:tasks.workunit.client.1.smithi098.stdout:2/256: creat d3/d16/d1d/d2b/d49/f57 x:0 0 0 2024-09-20T19:05:46.460 INFO:tasks.workunit.client.1.smithi098.stdout:7/139: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:46.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/257: mkdir d3/d16/d1d/d2b/d34/d38/d58 0 2024-09-20T19:05:46.461 INFO:tasks.workunit.client.1.smithi098.stdout:6/71: truncate d0/d7/ff 281949 0 2024-09-20T19:05:46.462 INFO:tasks.workunit.client.1.smithi098.stdout:6/72: fsync d0/d7/dc/f11 0 2024-09-20T19:05:46.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/258: write d3/f12 [3430510,3959] 0 2024-09-20T19:05:46.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/140: mkdir d3/d10/d16/d1a/d1f/d2d 0 2024-09-20T19:05:46.467 INFO:tasks.workunit.client.1.smithi098.stdout:2/259: dread d3/df/f11 [4194304,4194304] 0 2024-09-20T19:05:46.469 INFO:tasks.workunit.client.1.smithi098.stdout:6/73: creat d0/f15 x:0 0 0 2024-09-20T19:05:46.473 INFO:tasks.workunit.client.1.smithi098.stdout:2/260: symlink d3/d16/d1d/d2b/d34/d38/l59 0 2024-09-20T19:05:46.473 INFO:tasks.workunit.client.1.smithi098.stdout:8/135: fsync d7/de/f2c 0 2024-09-20T19:05:46.473 INFO:tasks.workunit.client.1.smithi098.stdout:7/141: dread d3/f11 [0,4194304] 0 2024-09-20T19:05:46.475 INFO:tasks.workunit.client.1.smithi098.stdout:8/136: write d7/fb [3749633,110090] 0 2024-09-20T19:05:46.476 INFO:tasks.workunit.client.1.smithi098.stdout:1/62: fsync d1/d3/f5 0 2024-09-20T19:05:46.481 INFO:tasks.workunit.client.1.smithi098.stdout:7/142: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:46.483 INFO:tasks.workunit.client.1.smithi098.stdout:8/137: dwrite d7/f2f [0,4194304] 0 2024-09-20T19:05:46.496 INFO:tasks.workunit.client.1.smithi098.stdout:8/138: creat d7/de/d11/d19/f31 x:0 0 0 2024-09-20T19:05:46.497 INFO:tasks.workunit.client.1.smithi098.stdout:3/62: write d4/f7 [4619761,2657] 0 2024-09-20T19:05:46.499 INFO:tasks.workunit.client.1.smithi098.stdout:8/139: dread d7/f10 [0,4194304] 0 2024-09-20T19:05:46.500 INFO:tasks.workunit.client.1.smithi098.stdout:2/261: rmdir d3/d16/d1d/d2b/d34/d38/d58 0 2024-09-20T19:05:46.501 INFO:tasks.workunit.client.1.smithi098.stdout:6/74: getdents d0/de 0 2024-09-20T19:05:46.501 INFO:tasks.workunit.client.1.smithi098.stdout:2/262: write d3/df/d13/f18 [3492622,87132] 0 2024-09-20T19:05:46.502 INFO:tasks.workunit.client.1.smithi098.stdout:6/75: write d0/f5 [924533,51279] 0 2024-09-20T19:05:46.503 INFO:tasks.workunit.client.1.smithi098.stdout:2/263: fdatasync d3/d16/f45 0 2024-09-20T19:05:46.503 INFO:tasks.workunit.client.1.smithi098.stdout:3/63: creat d4/fd x:0 0 0 2024-09-20T19:05:46.505 INFO:tasks.workunit.client.1.smithi098.stdout:7/143: rename d3/d10/d16/d1a/d1f/f26 to d3/f2e 0 2024-09-20T19:05:46.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/140: rename d7/la to d7/l32 0 2024-09-20T19:05:46.510 INFO:tasks.workunit.client.1.smithi098.stdout:3/64: creat d4/fe x:0 0 0 2024-09-20T19:05:46.511 INFO:tasks.workunit.client.1.smithi098.stdout:6/76: mknod d0/d7/c16 0 2024-09-20T19:05:46.512 INFO:tasks.workunit.client.1.smithi098.stdout:2/264: symlink d3/d16/d1d/d2b/d46/l5a 0 2024-09-20T19:05:46.513 INFO:tasks.workunit.client.1.smithi098.stdout:2/265: write d3/f3c [926443,52731] 0 2024-09-20T19:05:46.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/141: symlink d7/de/d11/d19/l33 0 2024-09-20T19:05:46.516 INFO:tasks.workunit.client.1.smithi098.stdout:3/65: symlink d4/lf 0 2024-09-20T19:05:46.519 INFO:tasks.workunit.client.1.smithi098.stdout:2/266: rmdir d3/d16/d1d/d2b/d34/d38 39 2024-09-20T19:05:46.522 INFO:tasks.workunit.client.1.smithi098.stdout:3/66: creat d4/f10 x:0 0 0 2024-09-20T19:05:46.525 INFO:tasks.workunit.client.1.smithi098.stdout:8/142: mknod d7/de/d11/d19/d30/c34 0 2024-09-20T19:05:46.525 INFO:tasks.workunit.client.1.smithi098.stdout:3/67: mknod d4/da/c11 0 2024-09-20T19:05:46.526 INFO:tasks.workunit.client.1.smithi098.stdout:3/68: dread - d4/fe zero size 2024-09-20T19:05:46.526 INFO:tasks.workunit.client.1.smithi098.stdout:3/69: chown d4/da 1379868 1 2024-09-20T19:05:46.528 INFO:tasks.workunit.client.1.smithi098.stdout:2/267: mknod d3/c5b 0 2024-09-20T19:05:46.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/143: mkdir d7/de/d35 0 2024-09-20T19:05:46.535 INFO:tasks.workunit.client.1.smithi098.stdout:8/144: rename d7/de/f2c to d7/de/d11/d19/f36 0 2024-09-20T19:05:46.536 INFO:tasks.workunit.client.1.smithi098.stdout:2/268: dwrite d3/df/d13/f2c [0,4194304] 0 2024-09-20T19:05:46.538 INFO:tasks.workunit.client.1.smithi098.stdout:1/63: dwrite d1/fa [0,4194304] 0 2024-09-20T19:05:46.546 INFO:tasks.workunit.client.0.smithi027.stdout:9/97: write d0/d9/df/d1b/d1a/dd/f10 [1991714,87420] 0 2024-09-20T19:05:46.547 INFO:tasks.workunit.client.1.smithi098.stdout:2/269: dwrite d3/f4c [0,4194304] 0 2024-09-20T19:05:46.549 INFO:tasks.workunit.client.1.smithi098.stdout:2/270: stat d3/fa 0 2024-09-20T19:05:46.550 INFO:tasks.workunit.client.1.smithi098.stdout:1/64: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-20T19:05:46.551 INFO:tasks.workunit.client.1.smithi098.stdout:2/271: dread - d3/d16/d1d/d2b/d34/f3e zero size 2024-09-20T19:05:46.554 INFO:tasks.workunit.client.0.smithi027.stdout:9/98: dwrite d0/d9/df/f1d [0,4194304] 0 2024-09-20T19:05:46.555 INFO:tasks.workunit.client.0.smithi027.stdout:9/99: fsync d0/f12 0 2024-09-20T19:05:46.557 INFO:tasks.workunit.client.1.smithi098.stdout:2/272: truncate d3/df/d13/f29 1316629 0 2024-09-20T19:05:46.560 INFO:tasks.workunit.client.0.smithi027.stdout:9/100: unlink d0/d9/df/d1b/l11 0 2024-09-20T19:05:46.563 INFO:tasks.workunit.client.1.smithi098.stdout:2/273: getdents d3/d51 0 2024-09-20T19:05:46.563 INFO:tasks.workunit.client.1.smithi098.stdout:6/77: read d0/d7/ff [28860,60491] 0 2024-09-20T19:05:46.563 INFO:tasks.workunit.client.1.smithi098.stdout:7/144: dwrite d3/f11 [0,4194304] 0 2024-09-20T19:05:46.565 INFO:tasks.workunit.client.1.smithi098.stdout:3/70: getdents d4 0 2024-09-20T19:05:46.571 INFO:tasks.workunit.client.1.smithi098.stdout:2/274: creat d3/d16/d1d/d2b/f5c x:0 0 0 2024-09-20T19:05:46.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/71: dwrite d4/fe [0,4194304] 0 2024-09-20T19:05:46.576 INFO:tasks.workunit.client.1.smithi098.stdout:2/275: readlink d3/d16/d1a/l24 0 2024-09-20T19:05:46.578 INFO:tasks.workunit.client.0.smithi027.stdout:9/101: getdents d0/d9 0 2024-09-20T19:05:46.579 INFO:tasks.workunit.client.1.smithi098.stdout:3/72: mknod d4/da/c12 0 2024-09-20T19:05:46.579 INFO:tasks.workunit.client.0.smithi027.stdout:9/102: chown d0/d9/df/c16 12959335 1 2024-09-20T19:05:46.580 INFO:tasks.workunit.client.1.smithi098.stdout:3/73: fdatasync d4/f7 0 2024-09-20T19:05:46.580 INFO:tasks.workunit.client.1.smithi098.stdout:3/74: fsync d4/fd 0 2024-09-20T19:05:46.580 INFO:tasks.workunit.client.1.smithi098.stdout:2/276: rmdir d3/d16/d1d/d2b/d46 39 2024-09-20T19:05:46.583 INFO:tasks.workunit.client.0.smithi027.stdout:9/103: fsync d0/d9/df/f1d 0 2024-09-20T19:05:46.585 INFO:tasks.workunit.client.1.smithi098.stdout:3/75: unlink d4/fe 0 2024-09-20T19:05:46.587 INFO:tasks.workunit.client.1.smithi098.stdout:8/145: dread d7/fb [0,4194304] 0 2024-09-20T19:05:46.590 INFO:tasks.workunit.client.1.smithi098.stdout:2/277: dwrite d3/df/d13/f2c [0,4194304] 0 2024-09-20T19:05:46.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/78: stat d0/d7/ff 0 2024-09-20T19:05:46.592 INFO:tasks.workunit.client.0.smithi027.stdout:9/104: rename d0/d9/df/d1b/d1a to d0/d9/df/d1b/d1a/dd/d1e 22 2024-09-20T19:05:46.594 INFO:tasks.workunit.client.1.smithi098.stdout:3/76: symlink d4/da/l13 0 2024-09-20T19:05:46.595 INFO:tasks.workunit.client.1.smithi098.stdout:3/77: dread - d4/f10 zero size 2024-09-20T19:05:46.597 INFO:tasks.workunit.client.0.smithi027.stdout:9/105: symlink d0/d9/df/d1b/d1a/l1f 0 2024-09-20T19:05:46.599 INFO:tasks.workunit.client.1.smithi098.stdout:8/146: dwrite d7/f1c [0,4194304] 0 2024-09-20T19:05:46.599 INFO:tasks.workunit.client.1.smithi098.stdout:2/278: dread - d3/d16/d1d/d2b/d46/f50 zero size 2024-09-20T19:05:46.601 INFO:tasks.workunit.client.1.smithi098.stdout:7/145: dwrite d3/d10/d18/f27 [0,4194304] 0 2024-09-20T19:05:46.601 INFO:tasks.workunit.client.1.smithi098.stdout:3/78: chown d4/da/fb 0 1 2024-09-20T19:05:46.604 INFO:tasks.workunit.client.0.smithi027.stdout:9/106: dwrite d0/f15 [0,4194304] 0 2024-09-20T19:05:46.610 INFO:tasks.workunit.client.0.smithi027.stdout:9/107: dread d0/d9/df/d1b/d1a/f13 [0,4194304] 0 2024-09-20T19:05:46.611 INFO:tasks.workunit.client.0.smithi027.stdout:9/108: fdatasync d0/d9/df/f1d 0 2024-09-20T19:05:46.612 INFO:tasks.workunit.client.1.smithi098.stdout:2/279: creat d3/d16/f5d x:0 0 0 2024-09-20T19:05:46.616 INFO:tasks.workunit.client.1.smithi098.stdout:8/147: dwrite d7/f10 [0,4194304] 0 2024-09-20T19:05:46.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/79: dwrite d0/d7/ff [0,4194304] 0 2024-09-20T19:05:46.622 INFO:tasks.workunit.client.1.smithi098.stdout:3/79: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:05:46.622 INFO:tasks.workunit.client.0.smithi027.stdout:9/109: link d0/d9/df/d1b/d1a/l1f d0/d9/l20 0 2024-09-20T19:05:46.623 INFO:tasks.workunit.client.0.smithi027.stdout:9/110: chown d0/d9/df/d1b/f14 76315502 1 2024-09-20T19:05:46.625 INFO:tasks.workunit.client.1.smithi098.stdout:3/80: dread - d4/fd zero size 2024-09-20T19:05:46.626 INFO:tasks.workunit.client.0.smithi027.stdout:9/111: creat d0/d9/df/f21 x:0 0 0 2024-09-20T19:05:46.627 INFO:tasks.workunit.client.0.smithi027.stdout:9/112: dread - d0/d9/df/f21 zero size 2024-09-20T19:05:46.627 INFO:tasks.workunit.client.1.smithi098.stdout:8/148: dread d7/fd [0,4194304] 0 2024-09-20T19:05:46.627 INFO:tasks.workunit.client.1.smithi098.stdout:6/80: mknod d0/de/c17 0 2024-09-20T19:05:46.630 INFO:tasks.workunit.client.1.smithi098.stdout:8/149: write d7/f1c [2688815,83044] 0 2024-09-20T19:05:46.630 INFO:tasks.workunit.client.0.smithi027.stdout:9/113: symlink d0/d9/l22 0 2024-09-20T19:05:46.632 INFO:tasks.workunit.client.1.smithi098.stdout:8/150: dread - d7/de/d11/d19/f2d zero size 2024-09-20T19:05:46.632 INFO:tasks.workunit.client.1.smithi098.stdout:2/280: rename d3/d16/d1d/d4f/l53 to d3/l5e 0 2024-09-20T19:05:46.634 INFO:tasks.workunit.client.1.smithi098.stdout:3/81: link d4/f7 d4/da/f14 0 2024-09-20T19:05:46.635 INFO:tasks.workunit.client.1.smithi098.stdout:8/151: truncate d7/de/d11/d1f/f2a 651124 0 2024-09-20T19:05:46.637 INFO:tasks.workunit.client.1.smithi098.stdout:2/281: rename d3/df/d13/l2e to d3/d16/d1d/d4f/l5f 0 2024-09-20T19:05:46.638 INFO:tasks.workunit.client.0.smithi027.stdout:9/114: dread d0/d9/df/d1b/f8 [0,4194304] 0 2024-09-20T19:05:46.638 INFO:tasks.workunit.client.1.smithi098.stdout:7/146: dread d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:46.638 INFO:tasks.workunit.client.1.smithi098.stdout:2/282: fdatasync d3/f7 0 2024-09-20T19:05:46.639 INFO:tasks.workunit.client.1.smithi098.stdout:8/152: symlink d7/de/d11/l37 0 2024-09-20T19:05:46.639 INFO:tasks.workunit.client.1.smithi098.stdout:6/81: dread d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:46.641 INFO:tasks.workunit.client.1.smithi098.stdout:7/147: chown d3/d10/d16/d1a/d1f/d2d 884 1 2024-09-20T19:05:46.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/82: link d4/da/c11 d4/c15 0 2024-09-20T19:05:46.643 INFO:tasks.workunit.client.1.smithi098.stdout:6/82: creat d0/de/f18 x:0 0 0 2024-09-20T19:05:46.646 INFO:tasks.workunit.client.0.smithi027.stdout:9/115: dwrite d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:05:46.646 INFO:tasks.workunit.client.1.smithi098.stdout:3/83: write d4/da/f14 [5186766,55383] 0 2024-09-20T19:05:46.646 INFO:tasks.workunit.client.1.smithi098.stdout:2/283: dread d3/df/d13/f2c [0,4194304] 0 2024-09-20T19:05:46.646 INFO:tasks.workunit.client.0.smithi027.stdout:9/116: chown d0/d9/df/d1b 46181115 1 2024-09-20T19:05:46.647 INFO:tasks.workunit.client.0.smithi027.stdout:9/117: write d0/d9/df/f1d [531085,120098] 0 2024-09-20T19:05:46.649 INFO:tasks.workunit.client.1.smithi098.stdout:6/83: creat d0/d7/dc/f19 x:0 0 0 2024-09-20T19:05:46.650 INFO:tasks.workunit.client.1.smithi098.stdout:2/284: dread - d3/d16/d1d/f39 zero size 2024-09-20T19:05:46.651 INFO:tasks.workunit.client.1.smithi098.stdout:3/84: write d4/da/f14 [1637130,79110] 0 2024-09-20T19:05:46.651 INFO:tasks.workunit.client.1.smithi098.stdout:8/153: dwrite d7/de/d11/d1f/f2a [0,4194304] 0 2024-09-20T19:05:46.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/148: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:46.656 INFO:tasks.workunit.client.0.smithi027.stdout:9/118: rename d0/f15 to d0/d9/df/d1b/f23 0 2024-09-20T19:05:46.656 INFO:tasks.workunit.client.1.smithi098.stdout:2/285: write d3/f55 [920588,75889] 0 2024-09-20T19:05:46.657 INFO:tasks.workunit.client.1.smithi098.stdout:6/84: write d0/d7/dc/f11 [644517,84590] 0 2024-09-20T19:05:46.657 INFO:tasks.workunit.client.1.smithi098.stdout:8/154: symlink d7/l38 0 2024-09-20T19:05:46.659 INFO:tasks.workunit.client.1.smithi098.stdout:2/286: write d3/d16/f3b [384136,65141] 0 2024-09-20T19:05:46.660 INFO:tasks.workunit.client.0.smithi027.stdout:9/119: dread d0/d9/df/d1b/f23 [0,4194304] 0 2024-09-20T19:05:46.660 INFO:tasks.workunit.client.1.smithi098.stdout:3/85: creat d4/f16 x:0 0 0 2024-09-20T19:05:46.661 INFO:tasks.workunit.client.0.smithi027.stdout:9/120: read d0/f12 [845817,50855] 0 2024-09-20T19:05:46.663 INFO:tasks.workunit.client.1.smithi098.stdout:6/85: creat d0/d7/dc/f1a x:0 0 0 2024-09-20T19:05:46.664 INFO:tasks.workunit.client.1.smithi098.stdout:6/86: read d0/d7/dc/fd [953993,65815] 0 2024-09-20T19:05:46.665 INFO:tasks.workunit.client.0.smithi027.stdout:9/121: creat d0/d9/df/f24 x:0 0 0 2024-09-20T19:05:46.666 INFO:tasks.workunit.client.1.smithi098.stdout:2/287: mkdir d3/d51/d60 0 2024-09-20T19:05:46.667 INFO:tasks.workunit.client.1.smithi098.stdout:2/288: write d3/df/d13/f3a [1385155,112587] 0 2024-09-20T19:05:46.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/289: fsync d3/d16/f5d 0 2024-09-20T19:05:46.675 INFO:tasks.workunit.client.1.smithi098.stdout:2/290: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:46.678 INFO:tasks.workunit.client.1.smithi098.stdout:2/291: dread - d3/d16/d1d/f4e zero size 2024-09-20T19:05:46.678 INFO:tasks.workunit.client.1.smithi098.stdout:8/155: link d7/de/d11/d1d/l27 d7/de/d11/l39 0 2024-09-20T19:05:46.679 INFO:tasks.workunit.client.1.smithi098.stdout:2/292: write d3/d16/d1a/f37 [2544255,174] 0 2024-09-20T19:05:46.679 INFO:tasks.workunit.client.1.smithi098.stdout:3/86: getdents d4/da 0 2024-09-20T19:05:46.679 INFO:tasks.workunit.client.1.smithi098.stdout:8/156: fdatasync d7/de/d11/f24 0 2024-09-20T19:05:46.681 INFO:tasks.workunit.client.1.smithi098.stdout:3/87: mkdir d4/d17 0 2024-09-20T19:05:46.683 INFO:tasks.workunit.client.1.smithi098.stdout:8/157: creat d7/f3a x:0 0 0 2024-09-20T19:05:46.685 INFO:tasks.workunit.client.1.smithi098.stdout:8/158: write d7/de/d11/d1f/f25 [820941,65637] 0 2024-09-20T19:05:46.686 INFO:tasks.workunit.client.1.smithi098.stdout:2/293: creat d3/d16/d1d/d2b/d46/f61 x:0 0 0 2024-09-20T19:05:46.687 INFO:tasks.workunit.client.1.smithi098.stdout:2/294: chown d3/d16/d1d 235 1 2024-09-20T19:05:46.688 INFO:tasks.workunit.client.1.smithi098.stdout:7/149: write d3/f6 [115435,68838] 0 2024-09-20T19:05:46.690 INFO:tasks.workunit.client.1.smithi098.stdout:8/159: creat d7/de/f3b x:0 0 0 2024-09-20T19:05:46.691 INFO:tasks.workunit.client.1.smithi098.stdout:6/87: dread d0/f8 [4194304,4194304] 0 2024-09-20T19:05:46.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/88: rmdir d4/d17 0 2024-09-20T19:05:46.697 INFO:tasks.workunit.client.1.smithi098.stdout:3/89: unlink d4/f7 0 2024-09-20T19:05:46.701 INFO:tasks.workunit.client.1.smithi098.stdout:3/90: creat d4/f18 x:0 0 0 2024-09-20T19:05:46.703 INFO:tasks.workunit.client.1.smithi098.stdout:7/150: dwrite d3/d10/d18/f27 [0,4194304] 0 2024-09-20T19:05:46.704 INFO:tasks.workunit.client.1.smithi098.stdout:9/200: sync 2024-09-20T19:05:46.705 INFO:tasks.workunit.client.1.smithi098.stdout:8/160: getdents d7 0 2024-09-20T19:05:46.705 INFO:tasks.workunit.client.1.smithi098.stdout:2/295: dwrite d3/d16/d1d/d2b/d49/f57 [0,4194304] 0 2024-09-20T19:05:46.707 INFO:tasks.workunit.client.1.smithi098.stdout:9/201: fdatasync d4/de/f3f 0 2024-09-20T19:05:46.707 INFO:tasks.workunit.client.1.smithi098.stdout:6/88: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:05:46.711 INFO:tasks.workunit.client.1.smithi098.stdout:8/161: symlink d7/de/d11/d19/l3c 0 2024-09-20T19:05:46.713 INFO:tasks.workunit.client.1.smithi098.stdout:9/202: unlink f1 0 2024-09-20T19:05:46.717 INFO:tasks.workunit.client.1.smithi098.stdout:3/91: unlink d4/da/c11 0 2024-09-20T19:05:46.719 INFO:tasks.workunit.client.1.smithi098.stdout:2/296: unlink d3/d16/d1d/d4f/l5f 0 2024-09-20T19:05:46.721 INFO:tasks.workunit.client.1.smithi098.stdout:7/151: dwrite d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:46.722 INFO:tasks.workunit.client.1.smithi098.stdout:6/89: getdents d0/de 0 2024-09-20T19:05:46.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:46 smithi098 ceph-mon[35737]: pgmap v258: 65 pgs: 65 active+clean; 352 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 343 op/s 2024-09-20T19:05:46.727 INFO:tasks.workunit.client.1.smithi098.stdout:6/90: mkdir d0/de/d1b 0 2024-09-20T19:05:46.728 INFO:tasks.workunit.client.1.smithi098.stdout:2/297: dread - d3/d16/d1d/d2b/d34/d38/f44 zero size 2024-09-20T19:05:46.730 INFO:tasks.workunit.client.1.smithi098.stdout:8/162: dwrite d7/de/d11/d19/f31 [0,4194304] 0 2024-09-20T19:05:46.733 INFO:tasks.workunit.client.1.smithi098.stdout:3/92: dwrite d4/fd [0,4194304] 0 2024-09-20T19:05:46.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/152: dread d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:46.736 INFO:tasks.workunit.client.1.smithi098.stdout:2/298: unlink d3/f7 0 2024-09-20T19:05:46.736 INFO:tasks.workunit.client.1.smithi098.stdout:8/163: read d7/de/d11/d1f/f25 [142987,46180] 0 2024-09-20T19:05:46.736 INFO:tasks.workunit.client.1.smithi098.stdout:7/153: write d3/f8 [3177028,62798] 0 2024-09-20T19:05:46.739 INFO:tasks.workunit.client.1.smithi098.stdout:8/164: dread - d7/de/d11/f12 zero size 2024-09-20T19:05:46.740 INFO:tasks.workunit.client.1.smithi098.stdout:7/154: truncate d3/f12 5481463 0 2024-09-20T19:05:46.741 INFO:tasks.workunit.client.1.smithi098.stdout:8/165: readlink d7/de/d11/d19/l3c 0 2024-09-20T19:05:46.745 INFO:tasks.workunit.client.1.smithi098.stdout:7/155: unlink d3/l5 0 2024-09-20T19:05:46.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/166: mknod d7/c3d 0 2024-09-20T19:05:46.748 INFO:tasks.workunit.client.1.smithi098.stdout:8/167: dread d7/fd [0,4194304] 0 2024-09-20T19:05:46.750 INFO:tasks.workunit.client.1.smithi098.stdout:7/156: dread d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:46.751 INFO:tasks.workunit.client.1.smithi098.stdout:8/168: rmdir d7/de/d11/d19 39 2024-09-20T19:05:46.752 INFO:tasks.workunit.client.1.smithi098.stdout:2/299: link d3/d16/d1d/d2b/d34/f3e d3/d16/d1d/d2b/d34/f62 0 2024-09-20T19:05:46.754 INFO:tasks.workunit.client.1.smithi098.stdout:8/169: rename d7/de/d11/d1f/f25 to d7/de/d11/d1d/f3e 0 2024-09-20T19:05:46.755 INFO:tasks.workunit.client.1.smithi098.stdout:2/300: symlink d3/d16/d1d/l63 0 2024-09-20T19:05:46.755 INFO:tasks.workunit.client.1.smithi098.stdout:7/157: getdents d3/d10/d18/d21 0 2024-09-20T19:05:46.758 INFO:tasks.workunit.client.1.smithi098.stdout:2/301: symlink d3/d51/l64 0 2024-09-20T19:05:46.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/93: getdents d4 0 2024-09-20T19:05:46.761 INFO:tasks.workunit.client.1.smithi098.stdout:3/94: fsync d4/f18 0 2024-09-20T19:05:46.761 INFO:tasks.workunit.client.1.smithi098.stdout:8/170: creat d7/de/d35/f3f x:0 0 0 2024-09-20T19:05:46.763 INFO:tasks.workunit.client.1.smithi098.stdout:3/95: mkdir d4/d19 0 2024-09-20T19:05:46.764 INFO:tasks.workunit.client.1.smithi098.stdout:8/171: symlink d7/de/d11/d1f/l40 0 2024-09-20T19:05:46.764 INFO:tasks.workunit.client.1.smithi098.stdout:7/158: link d3/l7 d3/d10/d16/d17/l2f 0 2024-09-20T19:05:46.766 INFO:tasks.workunit.client.1.smithi098.stdout:8/172: creat d7/f41 x:0 0 0 2024-09-20T19:05:46.766 INFO:tasks.workunit.client.1.smithi098.stdout:2/302: getdents d3/d16/d1d/d4f 0 2024-09-20T19:05:46.767 INFO:tasks.workunit.client.1.smithi098.stdout:7/159: mknod d3/d10/d16/d1a/d1f/c30 0 2024-09-20T19:05:46.768 INFO:tasks.workunit.client.1.smithi098.stdout:2/303: write d3/d16/d1d/d2b/d34/d38/f44 [28814,127821] 0 2024-09-20T19:05:46.770 INFO:tasks.workunit.client.1.smithi098.stdout:3/96: symlink d4/da/l1a 0 2024-09-20T19:05:46.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/304: dread d3/f3c [0,4194304] 0 2024-09-20T19:05:46.774 INFO:tasks.workunit.client.1.smithi098.stdout:3/97: write d4/f18 [475608,106668] 0 2024-09-20T19:05:46.778 INFO:tasks.workunit.client.1.smithi098.stdout:7/160: dwrite d3/f11 [4194304,4194304] 0 2024-09-20T19:05:46.779 INFO:tasks.workunit.client.1.smithi098.stdout:8/173: dwrite d7/de/d11/d1d/f3e [0,4194304] 0 2024-09-20T19:05:46.782 INFO:tasks.workunit.client.1.smithi098.stdout:8/174: dread - d7/de/d11/f24 zero size 2024-09-20T19:05:46.784 INFO:tasks.workunit.client.1.smithi098.stdout:7/161: creat d3/d10/d16/d1a/d1f/d2d/f31 x:0 0 0 2024-09-20T19:05:46.786 INFO:tasks.workunit.client.1.smithi098.stdout:2/305: dwrite d3/df/d13/f32 [0,4194304] 0 2024-09-20T19:05:46.786 INFO:tasks.workunit.client.1.smithi098.stdout:8/175: mknod d7/c42 0 2024-09-20T19:05:46.790 INFO:tasks.workunit.client.1.smithi098.stdout:2/306: truncate d3/f9 182608 0 2024-09-20T19:05:46.795 INFO:tasks.workunit.client.1.smithi098.stdout:2/307: fsync d3/d16/d1d/d2b/d49/f57 0 2024-09-20T19:05:46.797 INFO:tasks.workunit.client.1.smithi098.stdout:8/176: dread d7/de/d11/d1f/f2a [0,4194304] 0 2024-09-20T19:05:46.798 INFO:tasks.workunit.client.1.smithi098.stdout:2/308: write d3/d16/d1d/f39 [330805,130419] 0 2024-09-20T19:05:46.798 INFO:tasks.workunit.client.1.smithi098.stdout:7/162: dwrite d3/f6 [0,4194304] 0 2024-09-20T19:05:46.805 INFO:tasks.workunit.client.1.smithi098.stdout:7/163: mkdir d3/d10/d16/d1a/d1f/d2d/d32 0 2024-09-20T19:05:46.808 INFO:tasks.workunit.client.1.smithi098.stdout:7/164: rmdir d3/d10/d16/d1a/d1f/d2d 39 2024-09-20T19:05:46.808 INFO:tasks.workunit.client.1.smithi098.stdout:8/177: link d7/de/l18 d7/de/l43 0 2024-09-20T19:05:46.811 INFO:tasks.workunit.client.1.smithi098.stdout:2/309: dwrite d3/d16/d1d/d2b/d46/f50 [0,4194304] 0 2024-09-20T19:05:46.812 INFO:tasks.workunit.client.1.smithi098.stdout:8/178: mknod d7/de/d11/d19/c44 0 2024-09-20T19:05:46.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/165: getdents d3/d10/d16/d1a 0 2024-09-20T19:05:46.814 INFO:tasks.workunit.client.1.smithi098.stdout:7/166: read d3/f12 [3900732,93005] 0 2024-09-20T19:05:46.816 INFO:tasks.workunit.client.1.smithi098.stdout:8/179: write d7/de/d11/d19/f36 [2546084,15100] 0 2024-09-20T19:05:46.817 INFO:tasks.workunit.client.1.smithi098.stdout:2/310: link d3/d16/d1d/d2b/d34/d38/f44 d3/d16/d1d/d2b/d46/f65 0 2024-09-20T19:05:46.821 INFO:tasks.workunit.client.1.smithi098.stdout:8/180: link d7/de/d11/c21 d7/c45 0 2024-09-20T19:05:46.823 INFO:tasks.workunit.client.1.smithi098.stdout:2/311: dread d3/d16/d1d/d2b/d46/f50 [0,4194304] 0 2024-09-20T19:05:46.824 INFO:tasks.workunit.client.1.smithi098.stdout:8/181: mknod d7/de/c46 0 2024-09-20T19:05:46.826 INFO:tasks.workunit.client.1.smithi098.stdout:8/182: mkdir d7/de/d11/d19/d47 0 2024-09-20T19:05:46.828 INFO:tasks.workunit.client.1.smithi098.stdout:8/183: read d7/de/d11/d1d/f3e [3873478,77805] 0 2024-09-20T19:05:46.829 INFO:tasks.workunit.client.1.smithi098.stdout:7/167: rename d3/d10/d16/d1a to d3/d10/d16/d17/d33 0 2024-09-20T19:05:46.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/184: chown d7/de 244750 1 2024-09-20T19:05:46.830 INFO:tasks.workunit.client.1.smithi098.stdout:8/185: dread - d7/f41 zero size 2024-09-20T19:05:46.831 INFO:tasks.workunit.client.1.smithi098.stdout:2/312: dwrite d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:46.832 INFO:tasks.workunit.client.1.smithi098.stdout:8/186: fdatasync d7/de/d11/d19/f36 0 2024-09-20T19:05:46.833 INFO:tasks.workunit.client.1.smithi098.stdout:2/313: chown d3/d16/d1d/d2b/c2d 1041288087 1 2024-09-20T19:05:46.835 INFO:tasks.workunit.client.1.smithi098.stdout:2/314: unlink d3/d16/f5d 0 2024-09-20T19:05:46.837 INFO:tasks.workunit.client.1.smithi098.stdout:7/168: creat d3/d10/d16/f34 x:0 0 0 2024-09-20T19:05:46.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/187: dwrite d7/de/d11/d19/f36 [0,4194304] 0 2024-09-20T19:05:46.840 INFO:tasks.workunit.client.1.smithi098.stdout:2/315: unlink d3/d16/d1d/d2b/d46/f61 0 2024-09-20T19:05:46.846 INFO:tasks.workunit.client.1.smithi098.stdout:7/169: dread d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:46.848 INFO:tasks.workunit.client.1.smithi098.stdout:2/316: rename d3/d51/l64 to d3/d16/d1d/d2b/d34/l66 0 2024-09-20T19:05:46.849 INFO:tasks.workunit.client.1.smithi098.stdout:7/170: mknod d3/d10/d16/d17/d33/c35 0 2024-09-20T19:05:46.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/188: dwrite d7/f10 [4194304,4194304] 0 2024-09-20T19:05:46.853 INFO:tasks.workunit.client.1.smithi098.stdout:7/171: symlink d3/d10/d16/d17/l36 0 2024-09-20T19:05:46.854 INFO:tasks.workunit.client.1.smithi098.stdout:7/172: chown d3/d10/d18/l25 198784506 1 2024-09-20T19:05:46.856 INFO:tasks.workunit.client.1.smithi098.stdout:8/189: creat d7/de/f48 x:0 0 0 2024-09-20T19:05:46.856 INFO:tasks.workunit.client.1.smithi098.stdout:8/190: chown d7/de/d11/d1d/f3e 10 1 2024-09-20T19:05:46.857 INFO:tasks.workunit.client.1.smithi098.stdout:2/317: rename d3/d16/d1d/d2b/d46/f65 to d3/d16/d1d/d2b/d34/f67 0 2024-09-20T19:05:46.857 INFO:tasks.workunit.client.1.smithi098.stdout:8/191: chown d7/de/d11/d19/f2d 355469253 1 2024-09-20T19:05:46.861 INFO:tasks.workunit.client.1.smithi098.stdout:8/192: mknod d7/de/c49 0 2024-09-20T19:05:46.862 INFO:tasks.workunit.client.1.smithi098.stdout:2/318: dread d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:46.863 INFO:tasks.workunit.client.1.smithi098.stdout:7/173: rename d3/d10/d16/d17/d33/d1f/d2d/d32 to d3/d10/d16/d17/d33/d37 0 2024-09-20T19:05:46.863 INFO:tasks.workunit.client.1.smithi098.stdout:2/319: stat d3/d16/d1d/d2b/d46/l48 0 2024-09-20T19:05:46.864 INFO:tasks.workunit.client.1.smithi098.stdout:7/174: chown d3/f2e 265327 1 2024-09-20T19:05:46.865 INFO:tasks.workunit.client.1.smithi098.stdout:2/320: unlink d3/d16/d1d/d2b/c2d 0 2024-09-20T19:05:46.866 INFO:tasks.workunit.client.1.smithi098.stdout:2/321: truncate d3/d16/d1d/f39 1227812 0 2024-09-20T19:05:46.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/322: truncate d3/d16/d1a/f27 5146304 0 2024-09-20T19:05:46.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/323: chown d3/d16/d1d/d2b/d46/f50 0 1 2024-09-20T19:05:46.872 INFO:tasks.workunit.client.1.smithi098.stdout:2/324: dwrite d3/df/d13/f33 [0,4194304] 0 2024-09-20T19:05:46.873 INFO:tasks.workunit.client.1.smithi098.stdout:2/325: fsync d3/d16/d1d/d2b/d49/f4d 0 2024-09-20T19:05:46.874 INFO:tasks.workunit.client.1.smithi098.stdout:2/326: read d3/d16/d1d/d2b/d49/f57 [1616327,40] 0 2024-09-20T19:05:46.878 INFO:tasks.workunit.client.1.smithi098.stdout:8/193: dread f1 [4194304,4194304] 0 2024-09-20T19:05:46.879 INFO:tasks.workunit.client.1.smithi098.stdout:2/327: unlink d3/d16/d1a/l24 0 2024-09-20T19:05:46.882 INFO:tasks.workunit.client.1.smithi098.stdout:2/328: rename d3/d51/d60 to d3/d51/d68 0 2024-09-20T19:05:46.885 INFO:tasks.workunit.client.1.smithi098.stdout:8/194: dwrite d7/de/d11/f12 [0,4194304] 0 2024-09-20T19:05:46.886 INFO:tasks.workunit.client.1.smithi098.stdout:2/329: mkdir d3/d16/d1d/d2b/d49/d69 0 2024-09-20T19:05:46.887 INFO:tasks.workunit.client.1.smithi098.stdout:2/330: write d3/d16/d1d/d2b/d49/f57 [1255281,96211] 0 2024-09-20T19:05:46.887 INFO:tasks.workunit.client.1.smithi098.stdout:8/195: creat d7/de/d11/d19/f4a x:0 0 0 2024-09-20T19:05:46.888 INFO:tasks.workunit.client.1.smithi098.stdout:8/196: read d7/f1c [845910,109125] 0 2024-09-20T19:05:46.893 INFO:tasks.workunit.client.1.smithi098.stdout:2/331: creat d3/d16/d1d/d2b/d49/f6a x:0 0 0 2024-09-20T19:05:46.894 INFO:tasks.workunit.client.1.smithi098.stdout:2/332: dread - d3/d16/d1d/d2b/f56 zero size 2024-09-20T19:05:46.896 INFO:tasks.workunit.client.1.smithi098.stdout:8/197: rename d7/de/d11/f12 to d7/de/d11/d1f/f4b 0 2024-09-20T19:05:46.900 INFO:tasks.workunit.client.1.smithi098.stdout:8/198: readlink d7/de/d11/l39 0 2024-09-20T19:05:46.903 INFO:tasks.workunit.client.1.smithi098.stdout:8/199: rename d7/de/d35/f3f to d7/de/d11/d19/f4c 0 2024-09-20T19:05:46.904 INFO:tasks.workunit.client.1.smithi098.stdout:8/200: fsync d7/f8 0 2024-09-20T19:05:46.905 INFO:tasks.workunit.client.1.smithi098.stdout:8/201: write d7/de/d11/f24 [745197,81977] 0 2024-09-20T19:05:46.907 INFO:tasks.workunit.client.1.smithi098.stdout:2/333: truncate d3/f15 3023937 0 2024-09-20T19:05:46.908 INFO:tasks.workunit.client.1.smithi098.stdout:8/202: rename d7/de/d11/d19/f31 to d7/de/d11/d1f/f4d 0 2024-09-20T19:05:46.911 INFO:tasks.workunit.client.1.smithi098.stdout:2/334: mknod d3/c6b 0 2024-09-20T19:05:46.913 INFO:tasks.workunit.client.1.smithi098.stdout:2/335: write d3/d16/d1d/d2b/f56 [426085,28429] 0 2024-09-20T19:05:46.917 INFO:tasks.workunit.client.1.smithi098.stdout:8/203: dwrite d7/f8 [0,4194304] 0 2024-09-20T19:05:46.918 INFO:tasks.workunit.client.1.smithi098.stdout:2/336: dread d3/d16/d1d/d2b/d34/d38/f44 [0,4194304] 0 2024-09-20T19:05:46.922 INFO:tasks.workunit.client.1.smithi098.stdout:2/337: creat d3/d16/d1d/d2b/d46/f6c x:0 0 0 2024-09-20T19:05:46.924 INFO:tasks.workunit.client.1.smithi098.stdout:8/204: dread d7/de/d11/f24 [0,4194304] 0 2024-09-20T19:05:46.925 INFO:tasks.workunit.client.1.smithi098.stdout:2/338: write d3/d16/d1a/f27 [4455280,107284] 0 2024-09-20T19:05:46.927 INFO:tasks.workunit.client.1.smithi098.stdout:8/205: creat d7/de/d11/d19/f4e x:0 0 0 2024-09-20T19:05:46.928 INFO:tasks.workunit.client.1.smithi098.stdout:8/206: write d7/f41 [684113,92541] 0 2024-09-20T19:05:46.928 INFO:tasks.workunit.client.1.smithi098.stdout:2/339: creat d3/f6d x:0 0 0 2024-09-20T19:05:46.929 INFO:tasks.workunit.client.1.smithi098.stdout:8/207: chown d7/de/d11/d19/f4a 6118 1 2024-09-20T19:05:46.930 INFO:tasks.workunit.client.1.smithi098.stdout:2/340: read d3/d16/d1d/d2b/d34/f67 [109946,75260] 0 2024-09-20T19:05:46.930 INFO:tasks.workunit.client.1.smithi098.stdout:8/208: chown d7/de/d11/d1f/c22 5423 1 2024-09-20T19:05:46.930 INFO:tasks.workunit.client.1.smithi098.stdout:8/209: readlink d7/de/d11/l37 0 2024-09-20T19:05:46.934 INFO:tasks.workunit.client.1.smithi098.stdout:2/341: creat d3/d16/d1d/d2b/d34/f6e x:0 0 0 2024-09-20T19:05:46.935 INFO:tasks.workunit.client.1.smithi098.stdout:2/342: write d3/d16/d1d/d2b/d49/f4d [2890685,5202] 0 2024-09-20T19:05:46.937 INFO:tasks.workunit.client.1.smithi098.stdout:2/343: chown d3/d16/d1d/d2b/d34/d38/c42 23649 1 2024-09-20T19:05:46.940 INFO:tasks.workunit.client.1.smithi098.stdout:2/344: mkdir d3/d16/d1d/d2b/d34/d38/d6f 0 2024-09-20T19:05:46.941 INFO:tasks.workunit.client.1.smithi098.stdout:8/210: dwrite d7/fd [0,4194304] 0 2024-09-20T19:05:46.941 INFO:tasks.workunit.client.1.smithi098.stdout:2/345: fsync d3/df/d13/f18 0 2024-09-20T19:05:46.948 INFO:tasks.workunit.client.1.smithi098.stdout:2/346: creat d3/d16/f70 x:0 0 0 2024-09-20T19:05:46.950 INFO:tasks.workunit.client.1.smithi098.stdout:2/347: rename d3/d16/d1d/d2b/d34/f6e to d3/d16/d1d/d4f/f71 0 2024-09-20T19:05:46.952 INFO:tasks.workunit.client.1.smithi098.stdout:2/348: truncate d3/d16/d1d/d2b/d34/f67 1055149 0 2024-09-20T19:05:46.954 INFO:tasks.workunit.client.1.smithi098.stdout:8/211: truncate d7/de/d11/d1f/f4b 2110208 0 2024-09-20T19:05:46.958 INFO:tasks.workunit.client.1.smithi098.stdout:2/349: dwrite d3/d16/d1a/f4b [0,4194304] 0 2024-09-20T19:05:46.960 INFO:tasks.workunit.client.1.smithi098.stdout:2/350: readlink d3/le 0 2024-09-20T19:05:46.963 INFO:tasks.workunit.client.1.smithi098.stdout:2/351: rename d3/c6b to d3/d16/d1d/d2b/d49/d69/c72 0 2024-09-20T19:05:46.967 INFO:tasks.workunit.client.1.smithi098.stdout:2/352: dread d3/d16/d1d/d2b/d46/f50 [0,4194304] 0 2024-09-20T19:05:46.969 INFO:tasks.workunit.client.1.smithi098.stdout:2/353: symlink d3/d16/d1d/l73 0 2024-09-20T19:05:46.971 INFO:tasks.workunit.client.1.smithi098.stdout:2/354: write d3/d16/d1d/d2b/d46/f50 [314937,13974] 0 2024-09-20T19:05:46.972 INFO:tasks.workunit.client.1.smithi098.stdout:2/355: dread - d3/f6d zero size 2024-09-20T19:05:46.973 INFO:tasks.workunit.client.1.smithi098.stdout:2/356: chown d3/d16/d1d 87296 1 2024-09-20T19:05:46.982 INFO:tasks.workunit.client.1.smithi098.stdout:2/357: write d3/df/d13/f29 [1811032,22376] 0 2024-09-20T19:05:46.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/358: write d3/d16/d1a/f27 [3959137,93128] 0 2024-09-20T19:05:46.986 INFO:tasks.workunit.client.1.smithi098.stdout:2/359: getdents d3 0 2024-09-20T19:05:46.986 INFO:tasks.workunit.client.1.smithi098.stdout:2/360: write d3/df/d13/f29 [1802109,75868] 0 2024-09-20T19:05:46.991 INFO:tasks.workunit.client.1.smithi098.stdout:2/361: write d3/d16/d1d/d2b/d34/f3e [955728,53782] 0 2024-09-20T19:05:46.992 INFO:tasks.workunit.client.1.smithi098.stdout:2/362: mkdir d3/d16/d1d/d2b/d46/d74 0 2024-09-20T19:05:46.994 INFO:tasks.workunit.client.1.smithi098.stdout:2/363: creat d3/d16/d1d/d2b/d49/f75 x:0 0 0 2024-09-20T19:05:46.995 INFO:tasks.workunit.client.1.smithi098.stdout:2/364: symlink d3/d16/d1d/d2b/d49/l76 0 2024-09-20T19:05:46.999 INFO:tasks.workunit.client.1.smithi098.stdout:2/365: dread d3/f55 [0,4194304] 0 2024-09-20T19:05:47.000 INFO:tasks.workunit.client.1.smithi098.stdout:2/366: unlink d3/df/f3d 0 2024-09-20T19:05:47.002 INFO:tasks.workunit.client.1.smithi098.stdout:2/367: chown d3/d16/d1d/d2b/d34/l66 3163 1 2024-09-20T19:05:47.005 INFO:tasks.workunit.client.1.smithi098.stdout:2/368: dread d3/d16/d1d/d2b/d46/f50 [0,4194304] 0 2024-09-20T19:05:47.006 INFO:tasks.workunit.client.1.smithi098.stdout:2/369: symlink d3/df/d13/l77 0 2024-09-20T19:05:47.009 INFO:tasks.workunit.client.1.smithi098.stdout:2/370: getdents d3 0 2024-09-20T19:05:47.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/371: write d3/d16/d1d/d2b/d46/f50 [3592805,76171] 0 2024-09-20T19:05:47.012 INFO:tasks.workunit.client.1.smithi098.stdout:2/372: creat d3/d51/d68/f78 x:0 0 0 2024-09-20T19:05:47.013 INFO:tasks.workunit.client.1.smithi098.stdout:2/373: symlink d3/d16/d1d/d2b/l79 0 2024-09-20T19:05:47.014 INFO:tasks.workunit.client.1.smithi098.stdout:2/374: write d3/fd [918397,54473] 0 2024-09-20T19:05:47.016 INFO:tasks.workunit.client.1.smithi098.stdout:2/375: creat d3/df/f7a x:0 0 0 2024-09-20T19:05:47.021 INFO:tasks.workunit.client.1.smithi098.stdout:2/376: dwrite d3/df/d13/f2c [4194304,4194304] 0 2024-09-20T19:05:47.025 INFO:tasks.workunit.client.1.smithi098.stdout:2/377: mkdir d3/d16/d1d/d2b/d46/d74/d7b 0 2024-09-20T19:05:47.028 INFO:tasks.workunit.client.1.smithi098.stdout:2/378: creat d3/d16/d1a/f7c x:0 0 0 2024-09-20T19:05:47.030 INFO:tasks.workunit.client.1.smithi098.stdout:2/379: chown d3/d16/d1d/d2b/d34/f67 5 1 2024-09-20T19:05:47.031 INFO:tasks.workunit.client.1.smithi098.stdout:2/380: truncate d3/f55 1429870 0 2024-09-20T19:05:47.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/381: creat d3/d16/d1d/d2b/d46/d74/f7d x:0 0 0 2024-09-20T19:05:47.035 INFO:tasks.workunit.client.1.smithi098.stdout:2/382: creat d3/d16/d1d/d2b/d34/f7e x:0 0 0 2024-09-20T19:05:47.036 INFO:tasks.workunit.client.1.smithi098.stdout:2/383: chown d3/d16/d1a/c41 46 1 2024-09-20T19:05:47.036 INFO:tasks.workunit.client.1.smithi098.stdout:2/384: chown d3/d16/d1d/d2b/d49/f57 51313347 1 2024-09-20T19:05:47.039 INFO:tasks.workunit.client.1.smithi098.stdout:2/385: getdents d3/d16/d1d/d2b/d49 0 2024-09-20T19:05:47.039 INFO:tasks.workunit.client.1.smithi098.stdout:2/386: readlink d3/d16/d1d/d2b/d49/l76 0 2024-09-20T19:05:47.045 INFO:tasks.workunit.client.1.smithi098.stdout:2/387: dwrite d3/d16/d1d/d4f/f71 [0,4194304] 0 2024-09-20T19:05:47.133 INFO:tasks.workunit.client.0.smithi027.stdout:7/0: sync 2024-09-20T19:05:47.133 INFO:tasks.workunit.client.0.smithi027.stdout:7/1: dread - no filename 2024-09-20T19:05:47.134 INFO:tasks.workunit.client.0.smithi027.stdout:7/2: fdatasync - no filename 2024-09-20T19:05:47.134 INFO:tasks.workunit.client.0.smithi027.stdout:7/3: unlink - no file 2024-09-20T19:05:47.135 INFO:tasks.workunit.client.0.smithi027.stdout:7/4: creat f0 x:0 0 0 2024-09-20T19:05:47.136 INFO:tasks.workunit.client.0.smithi027.stdout:7/5: creat f1 x:0 0 0 2024-09-20T19:05:47.142 INFO:tasks.workunit.client.0.smithi027.stdout:7/6: dwrite f1 [0,4194304] 0 2024-09-20T19:05:47.145 INFO:tasks.workunit.client.0.smithi027.stdout:7/7: link f1 f2 0 2024-09-20T19:05:47.147 INFO:tasks.workunit.client.0.smithi027.stdout:7/8: mkdir d3 0 2024-09-20T19:05:47.147 INFO:tasks.workunit.client.0.smithi027.stdout:7/9: fsync f0 0 2024-09-20T19:05:47.149 INFO:tasks.workunit.client.0.smithi027.stdout:7/10: getdents d3 0 2024-09-20T19:05:47.151 INFO:tasks.workunit.client.0.smithi027.stdout:7/11: symlink d3/l4 0 2024-09-20T19:05:47.153 INFO:tasks.workunit.client.0.smithi027.stdout:7/12: link f0 d3/f5 0 2024-09-20T19:05:47.154 INFO:tasks.workunit.client.0.smithi027.stdout:7/13: write d3/f5 [557355,5759] 0 2024-09-20T19:05:47.156 INFO:tasks.workunit.client.0.smithi027.stdout:7/14: mknod d3/c6 0 2024-09-20T19:05:47.159 INFO:tasks.workunit.client.0.smithi027.stdout:7/15: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:47.159 INFO:tasks.workunit.client.0.smithi027.stdout:7/16: chown d3/l4 327154179 1 2024-09-20T19:05:47.162 INFO:tasks.workunit.client.0.smithi027.stdout:7/17: link d3/l4 d3/l7 0 2024-09-20T19:05:47.163 INFO:tasks.workunit.client.0.smithi027.stdout:7/18: write f1 [1708231,24276] 0 2024-09-20T19:05:47.164 INFO:tasks.workunit.client.0.smithi027.stdout:7/19: rmdir d3 39 2024-09-20T19:05:47.166 INFO:tasks.workunit.client.0.smithi027.stdout:7/20: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:47.167 INFO:tasks.workunit.client.0.smithi027.stdout:7/21: write d3/f5 [159695,16074] 0 2024-09-20T19:05:47.168 INFO:tasks.workunit.client.0.smithi027.stdout:7/22: mkdir d3/d8 0 2024-09-20T19:05:47.170 INFO:tasks.workunit.client.0.smithi027.stdout:7/23: getdents d3/d8 0 2024-09-20T19:05:47.171 INFO:tasks.workunit.client.0.smithi027.stdout:7/24: creat d3/f9 x:0 0 0 2024-09-20T19:05:47.178 INFO:tasks.workunit.client.0.smithi027.stdout:7/25: dwrite d3/f5 [0,4194304] 0 2024-09-20T19:05:47.180 INFO:tasks.workunit.client.0.smithi027.stdout:7/26: mkdir d3/d8/da 0 2024-09-20T19:05:47.185 INFO:tasks.workunit.client.0.smithi027.stdout:7/27: write d3/f5 [4970039,44405] 0 2024-09-20T19:05:47.185 INFO:tasks.workunit.client.0.smithi027.stdout:7/28: dread - d3/f9 zero size 2024-09-20T19:05:47.187 INFO:tasks.workunit.client.0.smithi027.stdout:7/29: creat d3/d8/fb x:0 0 0 2024-09-20T19:05:47.188 INFO:tasks.workunit.client.0.smithi027.stdout:7/30: write f0 [3640657,13824] 0 2024-09-20T19:05:47.189 INFO:tasks.workunit.client.0.smithi027.stdout:7/31: write f0 [2444475,24157] 0 2024-09-20T19:05:47.190 INFO:tasks.workunit.client.0.smithi027.stdout:7/32: unlink d3/c6 0 2024-09-20T19:05:47.191 INFO:tasks.workunit.client.0.smithi027.stdout:7/33: chown f2 1083003273 1 2024-09-20T19:05:47.227 INFO:tasks.workunit.client.1.smithi098.stdout:5/142: sync 2024-09-20T19:05:47.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/73: sync 2024-09-20T19:05:47.229 INFO:tasks.workunit.client.1.smithi098.stdout:0/74: symlink d0/db/l18 0 2024-09-20T19:05:47.230 INFO:tasks.workunit.client.1.smithi098.stdout:0/75: write d0/d6/f12 [120787,91423] 0 2024-09-20T19:05:47.230 INFO:tasks.workunit.client.1.smithi098.stdout:5/143: mknod d1/d17/d25/c28 0 2024-09-20T19:05:47.231 INFO:tasks.workunit.client.1.smithi098.stdout:0/76: chown d0/f2 653 1 2024-09-20T19:05:47.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/77: rename d0/d6/dc to d0/d6/d19 0 2024-09-20T19:05:47.236 INFO:tasks.workunit.client.1.smithi098.stdout:5/144: dwrite d1/fc [0,4194304] 0 2024-09-20T19:05:47.238 INFO:tasks.workunit.client.1.smithi098.stdout:5/145: symlink d1/d17/d25/l29 0 2024-09-20T19:05:47.239 INFO:tasks.workunit.client.1.smithi098.stdout:0/78: mknod d0/d15/c1a 0 2024-09-20T19:05:47.239 INFO:tasks.workunit.client.1.smithi098.stdout:5/146: write d1/f9 [1483847,24763] 0 2024-09-20T19:05:47.241 INFO:tasks.workunit.client.1.smithi098.stdout:0/79: dread d0/db/fd [0,4194304] 0 2024-09-20T19:05:47.241 INFO:tasks.workunit.client.1.smithi098.stdout:0/80: stat d0/fa 0 2024-09-20T19:05:47.243 INFO:tasks.workunit.client.1.smithi098.stdout:5/147: chown d1/d17/f1e 157329 1 2024-09-20T19:05:47.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/81: dread d0/db/f14 [0,4194304] 0 2024-09-20T19:05:47.245 INFO:tasks.workunit.client.1.smithi098.stdout:5/148: rename d1/d17/f1f to d1/d17/f2a 0 2024-09-20T19:05:47.246 INFO:tasks.workunit.client.1.smithi098.stdout:0/82: symlink d0/d15/l1b 0 2024-09-20T19:05:47.248 INFO:tasks.workunit.client.1.smithi098.stdout:0/83: unlink d0/db/f11 0 2024-09-20T19:05:47.250 INFO:tasks.workunit.client.1.smithi098.stdout:5/149: rename d1/ff to d1/d17/d25/f2b 0 2024-09-20T19:05:47.250 INFO:tasks.workunit.client.0.smithi027.stdout:6/12: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:8/36: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:1/53: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:3/62: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:5/8: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:2/7: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:4/12: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:4/13: fsync - no filename 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:0/37: sync 2024-09-20T19:05:47.251 INFO:tasks.workunit.client.0.smithi027.stdout:9/122: sync 2024-09-20T19:05:47.252 INFO:tasks.workunit.client.0.smithi027.stdout:3/63: dread - d0/f11 zero size 2024-09-20T19:05:47.253 INFO:tasks.workunit.client.0.smithi027.stdout:2/8: write f2 [289769,91562] 0 2024-09-20T19:05:47.253 INFO:tasks.workunit.client.0.smithi027.stdout:2/9: rmdir - no directory 2024-09-20T19:05:47.258 INFO:tasks.workunit.client.0.smithi027.stdout:0/38: dwrite d2/fe [0,4194304] 0 2024-09-20T19:05:47.272 INFO:tasks.workunit.client.1.smithi098.stdout:0/84: fdatasync d0/fa 0 2024-09-20T19:05:47.274 INFO:tasks.workunit.client.0.smithi027.stdout:7/34: sync 2024-09-20T19:05:47.277 INFO:tasks.workunit.client.0.smithi027.stdout:7/35: chown d3/d8 6896 1 2024-09-20T19:05:47.279 INFO:tasks.workunit.client.0.smithi027.stdout:6/13: creat f3 x:0 0 0 2024-09-20T19:05:47.281 INFO:tasks.workunit.client.0.smithi027.stdout:6/14: truncate f0 566146 0 2024-09-20T19:05:47.284 INFO:tasks.workunit.client.0.smithi027.stdout:4/14: rename l0 to l2 0 2024-09-20T19:05:47.284 INFO:tasks.workunit.client.0.smithi027.stdout:4/15: dread - no filename 2024-09-20T19:05:47.287 INFO:tasks.workunit.client.1.smithi098.stdout:0/85: dwrite d0/db/f14 [0,4194304] 0 2024-09-20T19:05:47.288 INFO:tasks.workunit.client.0.smithi027.stdout:1/54: mkdir d2/d15 0 2024-09-20T19:05:47.289 INFO:tasks.workunit.client.1.smithi098.stdout:0/86: fdatasync d0/f5 0 2024-09-20T19:05:47.290 INFO:tasks.workunit.client.0.smithi027.stdout:5/9: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.291 INFO:tasks.workunit.client.0.smithi027.stdout:7/36: dwrite f2 [4194304,4194304] 0 2024-09-20T19:05:47.293 INFO:tasks.workunit.client.0.smithi027.stdout:8/37: creat d2/d3/f9 x:0 0 0 2024-09-20T19:05:47.294 INFO:tasks.workunit.client.1.smithi098.stdout:0/87: dread d0/db/f14 [0,4194304] 0 2024-09-20T19:05:47.295 INFO:tasks.workunit.client.1.smithi098.stdout:0/88: dread - d0/d6/d19/f10 zero size 2024-09-20T19:05:47.298 INFO:tasks.workunit.client.0.smithi027.stdout:5/10: write f2 [1731737,87711] 0 2024-09-20T19:05:47.298 INFO:tasks.workunit.client.0.smithi027.stdout:6/15: dwrite f0 [0,4194304] 0 2024-09-20T19:05:47.299 INFO:tasks.workunit.client.1.smithi098.stdout:0/89: read d0/d6/f12 [97465,68624] 0 2024-09-20T19:05:47.300 INFO:tasks.workunit.client.0.smithi027.stdout:9/123: write d0/d9/df/d1b/f23 [699902,115832] 0 2024-09-20T19:05:47.301 INFO:tasks.workunit.client.0.smithi027.stdout:3/64: mkdir d0/d1/d13 0 2024-09-20T19:05:47.302 INFO:tasks.workunit.client.0.smithi027.stdout:6/16: write f3 [853850,102176] 0 2024-09-20T19:05:47.303 INFO:tasks.workunit.client.0.smithi027.stdout:8/38: truncate d2/d3/f9 642017 0 2024-09-20T19:05:47.305 INFO:tasks.workunit.client.0.smithi027.stdout:2/10: chown c0 6 1 2024-09-20T19:05:47.310 INFO:tasks.workunit.client.0.smithi027.stdout:8/39: dwrite d2/f8 [0,4194304] 0 2024-09-20T19:05:47.311 INFO:tasks.workunit.client.0.smithi027.stdout:0/39: rename d2/l5 to d2/d7/lf 0 2024-09-20T19:05:47.315 INFO:tasks.workunit.client.1.smithi098.stdout:5/150: link d1/fd d1/f2c 0 2024-09-20T19:05:47.316 INFO:tasks.workunit.client.1.smithi098.stdout:5/151: truncate d1/d17/f1a 466223 0 2024-09-20T19:05:47.322 INFO:tasks.workunit.client.0.smithi027.stdout:6/17: dread f3 [0,4194304] 0 2024-09-20T19:05:47.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/152: symlink d1/l2d 0 2024-09-20T19:05:47.324 INFO:tasks.workunit.client.1.smithi098.stdout:5/153: chown d1/d1b/f26 0 1 2024-09-20T19:05:47.324 INFO:tasks.workunit.client.1.smithi098.stdout:5/154: dread - d1/d17/f2a zero size 2024-09-20T19:05:47.325 INFO:tasks.workunit.client.1.smithi098.stdout:5/155: stat d1/d1b 0 2024-09-20T19:05:47.328 INFO:tasks.workunit.client.0.smithi027.stdout:6/18: dwrite f0 [0,4194304] 0 2024-09-20T19:05:47.329 INFO:tasks.workunit.client.1.smithi098.stdout:5/156: mkdir d1/d17/d2e 0 2024-09-20T19:05:47.337 INFO:tasks.workunit.client.1.smithi098.stdout:4/126: sync 2024-09-20T19:05:47.342 INFO:tasks.workunit.client.1.smithi098.stdout:5/157: rmdir d1/d17 39 2024-09-20T19:05:47.349 INFO:tasks.workunit.client.0.smithi027.stdout:6/19: fsync f0 0 2024-09-20T19:05:47.349 INFO:tasks.workunit.client.1.smithi098.stdout:5/158: chown d1/d17/d25/f2b 77 1 2024-09-20T19:05:47.349 INFO:tasks.workunit.client.1.smithi098.stdout:5/159: dread - d1/d1b/f26 zero size 2024-09-20T19:05:47.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/160: chown d1/d17/f1e 146952145 1 2024-09-20T19:05:47.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/161: readlink d1/l16 0 2024-09-20T19:05:47.354 INFO:tasks.workunit.client.1.smithi098.stdout:5/162: creat d1/d17/d2e/f2f x:0 0 0 2024-09-20T19:05:47.354 INFO:tasks.workunit.client.1.smithi098.stdout:5/163: chown d1/d17 6 1 2024-09-20T19:05:47.369 INFO:tasks.workunit.client.1.smithi098.stdout:4/127: rename f1 to d3/d6/d11/f2b 0 2024-09-20T19:05:47.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/128: readlink d3/d6/d11/d1e/l27 0 2024-09-20T19:05:47.455 INFO:tasks.workunit.client.1.smithi098.stdout:5/164: rename d1/l16 to d1/d1b/l30 0 2024-09-20T19:05:47.455 INFO:tasks.workunit.client.1.smithi098.stdout:0/90: rmdir d0/d6 39 2024-09-20T19:05:47.455 INFO:tasks.workunit.client.1.smithi098.stdout:4/129: write d3/d6/f18 [1490055,28363] 0 2024-09-20T19:05:47.456 INFO:tasks.workunit.client.1.smithi098.stdout:5/165: dread - d1/d17/f19 zero size 2024-09-20T19:05:47.459 INFO:tasks.workunit.client.1.smithi098.stdout:4/130: symlink d3/d6/d11/l2c 0 2024-09-20T19:05:47.463 INFO:tasks.workunit.client.0.smithi027.stdout:5/11: symlink l3 0 2024-09-20T19:05:47.466 INFO:tasks.workunit.client.1.smithi098.stdout:0/91: dwrite d0/d6/d19/f10 [0,4194304] 0 2024-09-20T19:05:47.467 INFO:tasks.workunit.client.0.smithi027.stdout:5/12: dread f2 [0,4194304] 0 2024-09-20T19:05:47.468 INFO:tasks.workunit.client.0.smithi027.stdout:2/11: mkdir d3 0 2024-09-20T19:05:47.469 INFO:tasks.workunit.client.0.smithi027.stdout:2/12: chown f2 26861 1 2024-09-20T19:05:47.469 INFO:tasks.workunit.client.0.smithi027.stdout:2/13: chown f2 0 1 2024-09-20T19:05:47.469 INFO:tasks.workunit.client.0.smithi027.stdout:2/14: write f2 [1422239,94754] 0 2024-09-20T19:05:47.470 INFO:tasks.workunit.client.0.smithi027.stdout:2/15: chown c1 1293 1 2024-09-20T19:05:47.471 INFO:tasks.workunit.client.1.smithi098.stdout:0/92: creat d0/d6/d19/f1c x:0 0 0 2024-09-20T19:05:47.473 INFO:tasks.workunit.client.1.smithi098.stdout:4/131: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:47.474 INFO:tasks.workunit.client.0.smithi027.stdout:0/40: creat d2/f10 x:0 0 0 2024-09-20T19:05:47.474 INFO:tasks.workunit.client.0.smithi027.stdout:0/41: readlink l0 0 2024-09-20T19:05:47.475 INFO:tasks.workunit.client.1.smithi098.stdout:0/93: mkdir d0/db/d1d 0 2024-09-20T19:05:47.477 INFO:tasks.workunit.client.0.smithi027.stdout:2/16: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.479 INFO:tasks.workunit.client.0.smithi027.stdout:6/20: mkdir d4 0 2024-09-20T19:05:47.480 INFO:tasks.workunit.client.1.smithi098.stdout:0/94: creat d0/d15/f1e x:0 0 0 2024-09-20T19:05:47.481 INFO:tasks.workunit.client.1.smithi098.stdout:0/95: fdatasync d0/d6/d19/f1c 0 2024-09-20T19:05:47.481 INFO:tasks.workunit.client.1.smithi098.stdout:4/132: creat d3/d6/d11/d1e/d2a/f2d x:0 0 0 2024-09-20T19:05:47.482 INFO:tasks.workunit.client.1.smithi098.stdout:0/96: read d0/f2 [1245792,8519] 0 2024-09-20T19:05:47.482 INFO:tasks.workunit.client.1.smithi098.stdout:4/133: stat d3/d6/d11/f15 0 2024-09-20T19:05:47.483 INFO:tasks.workunit.client.1.smithi098.stdout:4/134: stat d3/d6/d11/d1e/l27 0 2024-09-20T19:05:47.484 INFO:tasks.workunit.client.0.smithi027.stdout:1/55: creat d2/d15/f16 x:0 0 0 2024-09-20T19:05:47.484 INFO:tasks.workunit.client.1.smithi098.stdout:0/97: truncate d0/d6/f16 153738 0 2024-09-20T19:05:47.484 INFO:tasks.workunit.client.0.smithi027.stdout:7/37: mkdir d3/d8/da/dc 0 2024-09-20T19:05:47.486 INFO:tasks.workunit.client.1.smithi098.stdout:4/135: mkdir d3/d2e 0 2024-09-20T19:05:47.487 INFO:tasks.workunit.client.1.smithi098.stdout:4/136: write d3/d6/f13 [434277,95977] 0 2024-09-20T19:05:47.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/166: readlink d1/d1b/l30 0 2024-09-20T19:05:47.492 INFO:tasks.workunit.client.1.smithi098.stdout:0/98: symlink d0/d6/l1f 0 2024-09-20T19:05:47.494 INFO:tasks.workunit.client.0.smithi027.stdout:5/13: mkdir d4 0 2024-09-20T19:05:47.499 INFO:tasks.workunit.client.0.smithi027.stdout:8/40: creat d2/d3/d6/fa x:0 0 0 2024-09-20T19:05:47.501 INFO:tasks.workunit.client.1.smithi098.stdout:5/167: symlink d1/l31 0 2024-09-20T19:05:47.502 INFO:tasks.workunit.client.1.smithi098.stdout:5/168: write d1/f9 [1003688,40292] 0 2024-09-20T19:05:47.502 INFO:tasks.workunit.client.1.smithi098.stdout:0/99: dread d0/f2 [0,4194304] 0 2024-09-20T19:05:47.503 INFO:tasks.workunit.client.0.smithi027.stdout:0/42: unlink d2/l3 0 2024-09-20T19:05:47.503 INFO:tasks.workunit.client.1.smithi098.stdout:5/169: fdatasync d1/d17/f1a 0 2024-09-20T19:05:47.505 INFO:tasks.workunit.client.0.smithi027.stdout:6/21: unlink f3 0 2024-09-20T19:05:47.506 INFO:tasks.workunit.client.0.smithi027.stdout:6/22: chown d4 338 1 2024-09-20T19:05:47.506 INFO:tasks.workunit.client.0.smithi027.stdout:6/23: read f0 [794324,6789] 0 2024-09-20T19:05:47.507 INFO:tasks.workunit.client.1.smithi098.stdout:5/170: creat d1/d17/d2e/f32 x:0 0 0 2024-09-20T19:05:47.509 INFO:tasks.workunit.client.0.smithi027.stdout:7/38: creat d3/d8/fd x:0 0 0 2024-09-20T19:05:47.511 INFO:tasks.workunit.client.0.smithi027.stdout:9/124: creat d0/d9/df/d1b/d1a/dd/f25 x:0 0 0 2024-09-20T19:05:47.512 INFO:tasks.workunit.client.0.smithi027.stdout:6/24: dwrite f0 [0,4194304] 0 2024-09-20T19:05:47.513 INFO:tasks.workunit.client.0.smithi027.stdout:8/41: symlink d2/lb 0 2024-09-20T19:05:47.514 INFO:tasks.workunit.client.0.smithi027.stdout:2/17: mknod d3/c4 0 2024-09-20T19:05:47.514 INFO:tasks.workunit.client.1.smithi098.stdout:5/171: creat d1/f33 x:0 0 0 2024-09-20T19:05:47.515 INFO:tasks.workunit.client.0.smithi027.stdout:2/18: fsync f2 0 2024-09-20T19:05:47.515 INFO:tasks.workunit.client.0.smithi027.stdout:9/125: truncate d0/d9/df/d1b/f14 609622 0 2024-09-20T19:05:47.515 INFO:tasks.workunit.client.1.smithi098.stdout:5/172: fsync d1/d1b/f26 0 2024-09-20T19:05:47.516 INFO:tasks.workunit.client.0.smithi027.stdout:0/43: symlink d2/d7/l11 0 2024-09-20T19:05:47.516 INFO:tasks.workunit.client.0.smithi027.stdout:2/19: fsync f2 0 2024-09-20T19:05:47.516 INFO:tasks.workunit.client.0.smithi027.stdout:4/16: getdents . 0 2024-09-20T19:05:47.517 INFO:tasks.workunit.client.0.smithi027.stdout:9/126: readlink d0/d9/lb 0 2024-09-20T19:05:47.517 INFO:tasks.workunit.client.0.smithi027.stdout:1/56: symlink d2/d14/l17 0 2024-09-20T19:05:47.517 INFO:tasks.workunit.client.1.smithi098.stdout:1/65: sync 2024-09-20T19:05:47.518 INFO:tasks.workunit.client.0.smithi027.stdout:4/17: chown l2 0 1 2024-09-20T19:05:47.520 INFO:tasks.workunit.client.0.smithi027.stdout:5/14: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.521 INFO:tasks.workunit.client.0.smithi027.stdout:7/39: mknod d3/ce 0 2024-09-20T19:05:47.521 INFO:tasks.workunit.client.0.smithi027.stdout:9/127: dread - d0/d9/df/d1b/d1a/dd/f25 zero size 2024-09-20T19:05:47.522 INFO:tasks.workunit.client.0.smithi027.stdout:5/15: readlink l3 0 2024-09-20T19:05:47.524 INFO:tasks.workunit.client.1.smithi098.stdout:1/66: dwrite d1/fa [4194304,4194304] 0 2024-09-20T19:05:47.526 INFO:tasks.workunit.client.1.smithi098.stdout:5/173: rename d1/fd to d1/d17/d2e/f34 0 2024-09-20T19:05:47.527 INFO:tasks.workunit.client.0.smithi027.stdout:2/20: dread f2 [0,4194304] 0 2024-09-20T19:05:47.527 INFO:tasks.workunit.client.1.smithi098.stdout:5/174: stat d1/f9 0 2024-09-20T19:05:47.528 INFO:tasks.workunit.client.1.smithi098.stdout:5/175: read - d1/d17/f2a zero size 2024-09-20T19:05:47.529 INFO:tasks.workunit.client.0.smithi027.stdout:0/44: dwrite d2/f9 [4194304,4194304] 0 2024-09-20T19:05:47.538 INFO:tasks.workunit.client.0.smithi027.stdout:8/42: dread d2/f7 [0,4194304] 0 2024-09-20T19:05:47.538 INFO:tasks.workunit.client.0.smithi027.stdout:1/57: creat d2/d14/f18 x:0 0 0 2024-09-20T19:05:47.538 INFO:tasks.workunit.client.0.smithi027.stdout:7/40: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:47.539 INFO:tasks.workunit.client.0.smithi027.stdout:5/16: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.539 INFO:tasks.workunit.client.0.smithi027.stdout:4/18: rename l2 to l3 0 2024-09-20T19:05:47.541 INFO:tasks.workunit.client.1.smithi098.stdout:5/176: dread d1/fe [0,4194304] 0 2024-09-20T19:05:47.542 INFO:tasks.workunit.client.0.smithi027.stdout:9/128: mknod d0/d9/df/d1c/c26 0 2024-09-20T19:05:47.542 INFO:tasks.workunit.client.0.smithi027.stdout:8/43: read - d2/d3/d6/fa zero size 2024-09-20T19:05:47.542 INFO:tasks.workunit.client.0.smithi027.stdout:5/17: read f2 [2039420,38023] 0 2024-09-20T19:05:47.543 INFO:tasks.workunit.client.0.smithi027.stdout:2/21: creat d3/f5 x:0 0 0 2024-09-20T19:05:47.545 INFO:tasks.workunit.client.0.smithi027.stdout:7/41: readlink d3/l7 0 2024-09-20T19:05:47.545 INFO:tasks.workunit.client.1.smithi098.stdout:5/177: truncate d1/d17/d25/f2b 285610 0 2024-09-20T19:05:47.546 INFO:tasks.workunit.client.0.smithi027.stdout:7/42: stat d3/d8 0 2024-09-20T19:05:47.547 INFO:tasks.workunit.client.1.smithi098.stdout:5/178: write d1/d17/d2e/f32 [377691,10633] 0 2024-09-20T19:05:47.549 INFO:tasks.workunit.client.0.smithi027.stdout:1/58: unlink d2/d14/f18 0 2024-09-20T19:05:47.550 INFO:tasks.workunit.client.0.smithi027.stdout:0/45: dwrite d2/d7/fd [0,4194304] 0 2024-09-20T19:05:47.553 INFO:tasks.workunit.client.0.smithi027.stdout:0/46: write d2/f10 [324756,47785] 0 2024-09-20T19:05:47.554 INFO:tasks.workunit.client.0.smithi027.stdout:2/22: symlink d3/l6 0 2024-09-20T19:05:47.558 INFO:tasks.workunit.client.0.smithi027.stdout:2/23: write d3/f5 [660484,105529] 0 2024-09-20T19:05:47.558 INFO:tasks.workunit.client.0.smithi027.stdout:0/47: dread - d2/f8 zero size 2024-09-20T19:05:47.558 INFO:tasks.workunit.client.0.smithi027.stdout:7/43: symlink d3/d8/lf 0 2024-09-20T19:05:47.559 INFO:tasks.workunit.client.0.smithi027.stdout:8/44: dread d2/f8 [0,4194304] 0 2024-09-20T19:05:47.559 INFO:tasks.workunit.client.0.smithi027.stdout:5/18: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.560 INFO:tasks.workunit.client.0.smithi027.stdout:9/129: mknod d0/d9/df/d1b/d1a/dd/c27 0 2024-09-20T19:05:47.561 INFO:tasks.workunit.client.0.smithi027.stdout:0/48: creat d2/f12 x:0 0 0 2024-09-20T19:05:47.563 INFO:tasks.workunit.client.0.smithi027.stdout:8/45: truncate d2/d3/d6/fa 1006161 0 2024-09-20T19:05:47.563 INFO:tasks.workunit.client.1.smithi098.stdout:1/67: fsync d1/d3/f5 0 2024-09-20T19:05:47.564 INFO:tasks.workunit.client.0.smithi027.stdout:7/44: dread f2 [0,4194304] 0 2024-09-20T19:05:47.565 INFO:tasks.workunit.client.1.smithi098.stdout:1/68: write d1/fa [2994145,114024] 0 2024-09-20T19:05:47.565 INFO:tasks.workunit.client.1.smithi098.stdout:1/69: stat d1 0 2024-09-20T19:05:47.565 INFO:tasks.workunit.client.0.smithi027.stdout:5/19: unlink l0 0 2024-09-20T19:05:47.566 INFO:tasks.workunit.client.1.smithi098.stdout:5/179: dread d1/f9 [0,4194304] 0 2024-09-20T19:05:47.568 INFO:tasks.workunit.client.0.smithi027.stdout:5/20: dread f2 [0,4194304] 0 2024-09-20T19:05:47.569 INFO:tasks.workunit.client.0.smithi027.stdout:9/130: creat d0/d9/f28 x:0 0 0 2024-09-20T19:05:47.570 INFO:tasks.workunit.client.0.smithi027.stdout:0/49: rename l0 to d2/l13 0 2024-09-20T19:05:47.571 INFO:tasks.workunit.client.1.smithi098.stdout:1/70: chown d1/d3/l8 1783 1 2024-09-20T19:05:47.573 INFO:tasks.workunit.client.1.smithi098.stdout:5/180: mkdir d1/d17/d35 0 2024-09-20T19:05:47.574 INFO:tasks.workunit.client.1.smithi098.stdout:5/181: dread - d1/d17/f19 zero size 2024-09-20T19:05:47.575 INFO:tasks.workunit.client.0.smithi027.stdout:5/21: dread f2 [0,4194304] 0 2024-09-20T19:05:47.575 INFO:tasks.workunit.client.1.smithi098.stdout:5/182: chown d1/f2 90090 1 2024-09-20T19:05:47.576 INFO:tasks.workunit.client.0.smithi027.stdout:9/131: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:05:47.576 INFO:tasks.workunit.client.0.smithi027.stdout:5/22: write f2 [1548401,43018] 0 2024-09-20T19:05:47.577 INFO:tasks.workunit.client.1.smithi098.stdout:1/71: creat d1/f10 x:0 0 0 2024-09-20T19:05:47.577 INFO:tasks.workunit.client.1.smithi098.stdout:5/183: fdatasync d1/d17/d2e/f2f 0 2024-09-20T19:05:47.577 INFO:tasks.workunit.client.1.smithi098.stdout:1/72: readlink d1/d3/l8 0 2024-09-20T19:05:47.577 INFO:tasks.workunit.client.0.smithi027.stdout:9/132: write d0/fa [3590786,61580] 0 2024-09-20T19:05:47.579 INFO:tasks.workunit.client.0.smithi027.stdout:1/59: getdents d2 0 2024-09-20T19:05:47.581 INFO:tasks.workunit.client.0.smithi027.stdout:0/50: mkdir d2/d14 0 2024-09-20T19:05:47.582 INFO:tasks.workunit.client.0.smithi027.stdout:8/46: link d2/d3/f9 d2/d3/d6/fc 0 2024-09-20T19:05:47.583 INFO:tasks.workunit.client.0.smithi027.stdout:0/51: write d2/fc [14065,24520] 0 2024-09-20T19:05:47.588 INFO:tasks.workunit.client.0.smithi027.stdout:0/52: creat d2/d7/f15 x:0 0 0 2024-09-20T19:05:47.588 INFO:tasks.workunit.client.0.smithi027.stdout:7/45: dwrite f1 [0,4194304] 0 2024-09-20T19:05:47.591 INFO:tasks.workunit.client.0.smithi027.stdout:9/133: creat d0/d9/df/d1b/d1a/dd/f29 x:0 0 0 2024-09-20T19:05:47.591 INFO:tasks.workunit.client.0.smithi027.stdout:7/46: chown f0 10771195 1 2024-09-20T19:05:47.592 INFO:tasks.workunit.client.0.smithi027.stdout:1/60: dwrite d2/f13 [0,4194304] 0 2024-09-20T19:05:47.595 INFO:tasks.workunit.client.0.smithi027.stdout:1/61: mknod d2/d14/c19 0 2024-09-20T19:05:47.596 INFO:tasks.workunit.client.0.smithi027.stdout:7/47: creat d3/d8/da/dc/f10 x:0 0 0 2024-09-20T19:05:47.597 INFO:tasks.workunit.client.0.smithi027.stdout:1/62: write d2/d15/f16 [822700,113139] 0 2024-09-20T19:05:47.597 INFO:tasks.workunit.client.0.smithi027.stdout:9/134: dread d0/d9/df/d1b/d1a/f13 [0,4194304] 0 2024-09-20T19:05:47.598 INFO:tasks.workunit.client.0.smithi027.stdout:9/135: readlink d0/d9/lb 0 2024-09-20T19:05:47.602 INFO:tasks.workunit.client.0.smithi027.stdout:7/48: dread f1 [4194304,4194304] 0 2024-09-20T19:05:47.603 INFO:tasks.workunit.client.0.smithi027.stdout:1/63: link d2/cd d2/d8/c1a 0 2024-09-20T19:05:47.603 INFO:tasks.workunit.client.0.smithi027.stdout:9/136: dread d0/f12 [0,4194304] 0 2024-09-20T19:05:47.605 INFO:tasks.workunit.client.0.smithi027.stdout:7/49: creat d3/d8/da/f11 x:0 0 0 2024-09-20T19:05:47.608 INFO:tasks.workunit.client.0.smithi027.stdout:7/50: write f2 [3574464,106831] 0 2024-09-20T19:05:47.612 INFO:tasks.workunit.client.0.smithi027.stdout:9/137: dwrite d0/d9/df/d1b/f14 [0,4194304] 0 2024-09-20T19:05:47.621 INFO:tasks.workunit.client.0.smithi027.stdout:9/138: dwrite d0/d9/df/d1b/f23 [4194304,4194304] 0 2024-09-20T19:05:47.626 INFO:tasks.workunit.client.0.smithi027.stdout:9/139: dread d0/f12 [0,4194304] 0 2024-09-20T19:05:47.628 INFO:tasks.workunit.client.0.smithi027.stdout:9/140: unlink d0/d9/df/f1d 0 2024-09-20T19:05:47.629 INFO:tasks.workunit.client.0.smithi027.stdout:5/23: write f2 [4345852,70586] 0 2024-09-20T19:05:47.632 INFO:tasks.workunit.client.0.smithi027.stdout:5/24: creat d4/f5 x:0 0 0 2024-09-20T19:05:47.633 INFO:tasks.workunit.client.0.smithi027.stdout:5/25: dread - d4/f5 zero size 2024-09-20T19:05:47.635 INFO:tasks.workunit.client.0.smithi027.stdout:9/141: truncate d0/d9/df/d1b/f8 473952 0 2024-09-20T19:05:47.635 INFO:tasks.workunit.client.0.smithi027.stdout:5/26: write f2 [4835625,66330] 0 2024-09-20T19:05:47.636 INFO:tasks.workunit.client.0.smithi027.stdout:6/25: dwrite f0 [4194304,4194304] 0 2024-09-20T19:05:47.637 INFO:tasks.workunit.client.0.smithi027.stdout:6/26: chown d4 1 1 2024-09-20T19:05:47.637 INFO:tasks.workunit.client.0.smithi027.stdout:5/27: write d4/f5 [750346,84286] 0 2024-09-20T19:05:47.639 INFO:tasks.workunit.client.0.smithi027.stdout:9/142: creat d0/d9/df/f2a x:0 0 0 2024-09-20T19:05:47.643 INFO:tasks.workunit.client.0.smithi027.stdout:6/27: dread f0 [0,4194304] 0 2024-09-20T19:05:47.643 INFO:tasks.workunit.client.0.smithi027.stdout:3/65: truncate d0/d1/d7/f10 43668 0 2024-09-20T19:05:47.647 INFO:tasks.workunit.client.1.smithi098.stdout:4/137: truncate d3/d6/d11/f15 607990 0 2024-09-20T19:05:47.648 INFO:tasks.workunit.client.0.smithi027.stdout:6/28: symlink d4/l5 0 2024-09-20T19:05:47.650 INFO:tasks.workunit.client.0.smithi027.stdout:6/29: mkdir d4/d6 0 2024-09-20T19:05:47.652 INFO:tasks.workunit.client.0.smithi027.stdout:3/66: getdents d0/d1/d7 0 2024-09-20T19:05:47.653 INFO:tasks.workunit.client.1.smithi098.stdout:4/138: dwrite d3/f16 [0,4194304] 0 2024-09-20T19:05:47.655 INFO:tasks.workunit.client.0.smithi027.stdout:3/67: rename d0/la to d0/d1/l14 0 2024-09-20T19:05:47.655 INFO:tasks.workunit.client.1.smithi098.stdout:4/139: write d3/d6/f23 [790175,118248] 0 2024-09-20T19:05:47.660 INFO:tasks.workunit.client.0.smithi027.stdout:3/68: mkdir d0/d1/d13/d15 0 2024-09-20T19:05:47.660 INFO:tasks.workunit.client.0.smithi027.stdout:3/69: read - d0/d1/fb zero size 2024-09-20T19:05:47.661 INFO:tasks.workunit.client.0.smithi027.stdout:3/70: dread - d0/f11 zero size 2024-09-20T19:05:47.662 INFO:tasks.workunit.client.0.smithi027.stdout:8/47: getdents d2 0 2024-09-20T19:05:47.662 INFO:tasks.workunit.client.1.smithi098.stdout:4/140: dwrite d3/d6/f18 [0,4194304] 0 2024-09-20T19:05:47.668 INFO:tasks.workunit.client.1.smithi098.stdout:4/141: mkdir d3/d6/d11/d2f 0 2024-09-20T19:05:47.668 INFO:tasks.workunit.client.0.smithi027.stdout:8/48: write d2/d3/d6/fc [1239796,88787] 0 2024-09-20T19:05:47.673 INFO:tasks.workunit.client.0.smithi027.stdout:2/24: truncate f2 694453 0 2024-09-20T19:05:47.673 INFO:tasks.workunit.client.1.smithi098.stdout:4/142: creat d3/d6/d11/d1e/f30 x:0 0 0 2024-09-20T19:05:47.676 INFO:tasks.workunit.client.1.smithi098.stdout:4/143: rename d3/d6/la to d3/d6/d11/l31 0 2024-09-20T19:05:47.676 INFO:tasks.workunit.client.1.smithi098.stdout:4/144: readlink d3/l1f 0 2024-09-20T19:05:47.676 INFO:tasks.workunit.client.1.smithi098.stdout:4/145: read - d3/d6/d11/d1e/f30 zero size 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.1.smithi098.stdout:4/146: read - d3/d6/d11/d1e/d2a/f2d zero size 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.1.smithi098.stdout:4/147: write d3/fc [5219611,125254] 0 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.1.smithi098.stdout:4/148: stat d3/d6/d11/d1e/d2a 0 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.0.smithi027.stdout:2/25: rename d3/f5 to d3/f7 0 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.0.smithi027.stdout:2/26: chown d3 7 1 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.0.smithi027.stdout:2/27: chown f2 4175447 1 2024-09-20T19:05:47.679 INFO:tasks.workunit.client.0.smithi027.stdout:8/49: link l1 d2/ld 0 2024-09-20T19:05:47.681 INFO:tasks.workunit.client.0.smithi027.stdout:4/19: stat l3 0 2024-09-20T19:05:47.681 INFO:tasks.workunit.client.0.smithi027.stdout:4/20: dwrite - no filename 2024-09-20T19:05:47.681 INFO:tasks.workunit.client.0.smithi027.stdout:2/28: unlink c0 0 2024-09-20T19:05:47.683 INFO:tasks.workunit.client.1.smithi098.stdout:4/149: creat d3/d6/f32 x:0 0 0 2024-09-20T19:05:47.683 INFO:tasks.workunit.client.0.smithi027.stdout:8/50: creat d2/d3/fe x:0 0 0 2024-09-20T19:05:47.684 INFO:tasks.workunit.client.1.smithi098.stdout:4/150: chown d3/d6/d11/l19 365399 1 2024-09-20T19:05:47.684 INFO:tasks.workunit.client.0.smithi027.stdout:4/21: creat f4 x:0 0 0 2024-09-20T19:05:47.684 INFO:tasks.workunit.client.1.smithi098.stdout:4/151: write d3/d6/f18 [4000543,49571] 0 2024-09-20T19:05:47.685 INFO:tasks.workunit.client.0.smithi027.stdout:4/22: truncate f4 326975 0 2024-09-20T19:05:47.685 INFO:tasks.workunit.client.1.smithi098.stdout:4/152: dread - d3/d6/f32 zero size 2024-09-20T19:05:47.686 INFO:tasks.workunit.client.0.smithi027.stdout:2/29: creat d3/f8 x:0 0 0 2024-09-20T19:05:47.687 INFO:tasks.workunit.client.0.smithi027.stdout:8/51: creat d2/d3/d6/ff x:0 0 0 2024-09-20T19:05:47.690 INFO:tasks.workunit.client.1.smithi098.stdout:4/153: mkdir d3/d6/d33 0 2024-09-20T19:05:47.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/154: fsync d3/d6/d11/d1e/d2a/f2d 0 2024-09-20T19:05:47.692 INFO:tasks.workunit.client.0.smithi027.stdout:2/30: unlink d3/f8 0 2024-09-20T19:05:47.693 INFO:tasks.workunit.client.0.smithi027.stdout:8/52: mkdir d2/d3/d10 0 2024-09-20T19:05:47.697 INFO:tasks.workunit.client.0.smithi027.stdout:0/53: fsync d2/f12 0 2024-09-20T19:05:47.697 INFO:tasks.workunit.client.1.smithi098.stdout:4/155: dwrite d3/d6/d11/d1e/f30 [0,4194304] 0 2024-09-20T19:05:47.699 INFO:tasks.workunit.client.0.smithi027.stdout:8/53: link d2/d3/d6/ff d2/d3/f11 0 2024-09-20T19:05:47.699 INFO:tasks.workunit.client.0.smithi027.stdout:0/54: rmdir d2/d7 39 2024-09-20T19:05:47.704 INFO:tasks.workunit.client.0.smithi027.stdout:8/54: rmdir d2/d3 39 2024-09-20T19:05:47.706 INFO:tasks.workunit.client.0.smithi027.stdout:0/55: rename d2/f8 to d2/d14/f16 0 2024-09-20T19:05:47.708 INFO:tasks.workunit.client.0.smithi027.stdout:0/56: write d2/d14/f16 [130837,34114] 0 2024-09-20T19:05:47.711 INFO:tasks.workunit.client.0.smithi027.stdout:0/57: write d2/d7/fd [5167543,109294] 0 2024-09-20T19:05:47.713 INFO:tasks.workunit.client.0.smithi027.stdout:8/55: rename l1 to d2/l12 0 2024-09-20T19:05:47.714 INFO:tasks.workunit.client.1.smithi098.stdout:4/156: dread d3/d6/d11/f2b [0,4194304] 0 2024-09-20T19:05:47.715 INFO:tasks.workunit.client.1.smithi098.stdout:4/157: write d3/d6/d11/d1e/d2a/f2d [931339,39615] 0 2024-09-20T19:05:47.718 INFO:tasks.workunit.client.0.smithi027.stdout:0/58: dwrite d2/f10 [0,4194304] 0 2024-09-20T19:05:47.718 INFO:tasks.workunit.client.1.smithi098.stdout:9/203: sync 2024-09-20T19:05:47.719 INFO:tasks.workunit.client.1.smithi098.stdout:6/91: sync 2024-09-20T19:05:47.719 INFO:tasks.workunit.client.0.smithi027.stdout:0/59: write d2/d7/f15 [56690,123684] 0 2024-09-20T19:05:47.720 INFO:tasks.workunit.client.1.smithi098.stdout:6/92: readlink d0/d7/dc/l10 0 2024-09-20T19:05:47.720 INFO:tasks.workunit.client.1.smithi098.stdout:4/158: link d3/ff d3/d6/f34 0 2024-09-20T19:05:47.722 INFO:tasks.workunit.client.0.smithi027.stdout:8/56: dread d2/d3/d6/fc [0,4194304] 0 2024-09-20T19:05:47.723 INFO:tasks.workunit.client.0.smithi027.stdout:1/64: write d2/d8/f9 [2369216,112974] 0 2024-09-20T19:05:47.723 INFO:tasks.workunit.client.0.smithi027.stdout:0/60: symlink d2/d14/l17 0 2024-09-20T19:05:47.727 INFO:tasks.workunit.client.1.smithi098.stdout:6/93: rename d0/d7/dc/f19 to d0/de/d1b/f1c 0 2024-09-20T19:05:47.728 INFO:tasks.workunit.client.0.smithi027.stdout:7/51: truncate f1 4374298 0 2024-09-20T19:05:47.730 INFO:tasks.workunit.client.0.smithi027.stdout:1/65: mkdir d2/d1b 0 2024-09-20T19:05:47.732 INFO:tasks.workunit.client.0.smithi027.stdout:0/61: symlink d2/d7/l18 0 2024-09-20T19:05:47.732 INFO:tasks.workunit.client.1.smithi098.stdout:9/204: write d4/de/d24/d35/f42 [48704,38923] 0 2024-09-20T19:05:47.733 INFO:tasks.workunit.client.0.smithi027.stdout:1/66: dread d2/f13 [0,4194304] 0 2024-09-20T19:05:47.734 INFO:tasks.workunit.client.0.smithi027.stdout:8/57: mkdir d2/d3/d10/d13 0 2024-09-20T19:05:47.736 INFO:tasks.workunit.client.1.smithi098.stdout:4/159: dwrite d3/ff [4194304,4194304] 0 2024-09-20T19:05:47.736 INFO:tasks.workunit.client.0.smithi027.stdout:7/52: rmdir d3/d8 39 2024-09-20T19:05:47.740 INFO:tasks.workunit.client.1.smithi098.stdout:9/205: mknod d4/de/d24/d35/c44 0 2024-09-20T19:05:47.743 INFO:tasks.workunit.client.0.smithi027.stdout:9/143: truncate d0/d9/df/d1b/f14 479470 0 2024-09-20T19:05:47.744 INFO:tasks.workunit.client.0.smithi027.stdout:1/67: chown d2/d8/la 53250 1 2024-09-20T19:05:47.745 INFO:tasks.workunit.client.0.smithi027.stdout:1/68: rename d2/d8 to d2/d8/d1c 22 2024-09-20T19:05:47.747 INFO:tasks.workunit.client.1.smithi098.stdout:9/206: dwrite d4/de/f1d [0,4194304] 0 2024-09-20T19:05:47.748 INFO:tasks.workunit.client.1.smithi098.stdout:4/160: symlink d3/d6/d11/d1e/d2a/l35 0 2024-09-20T19:05:47.750 INFO:tasks.workunit.client.0.smithi027.stdout:8/58: write d2/f8 [2989761,61912] 0 2024-09-20T19:05:47.752 INFO:tasks.workunit.client.0.smithi027.stdout:3/71: getdents d0/d1 0 2024-09-20T19:05:47.760 INFO:tasks.workunit.client.0.smithi027.stdout:2/31: dread f2 [0,4194304] 0 2024-09-20T19:05:47.761 INFO:tasks.workunit.client.0.smithi027.stdout:9/144: symlink d0/d9/l2b 0 2024-09-20T19:05:47.762 INFO:tasks.workunit.client.0.smithi027.stdout:9/145: chown d0/d9/df/d1b/d1a 6970886 1 2024-09-20T19:05:47.765 INFO:tasks.workunit.client.0.smithi027.stdout:8/59: rmdir d2 39 2024-09-20T19:05:47.768 INFO:tasks.workunit.client.1.smithi098.stdout:9/207: link d4/de/l18 d4/de/d27/d3c/l45 0 2024-09-20T19:05:47.769 INFO:tasks.workunit.client.0.smithi027.stdout:4/23: fsync f4 0 2024-09-20T19:05:47.770 INFO:tasks.workunit.client.0.smithi027.stdout:3/72: creat d0/d1/d13/f16 x:0 0 0 2024-09-20T19:05:47.773 INFO:tasks.workunit.client.1.smithi098.stdout:9/208: write d4/de/d24/d35/f43 [199030,13782] 0 2024-09-20T19:05:47.773 INFO:tasks.workunit.client.0.smithi027.stdout:0/62: creat d2/f19 x:0 0 0 2024-09-20T19:05:47.774 INFO:tasks.workunit.client.1.smithi098.stdout:4/161: dread d3/fe [4194304,4194304] 0 2024-09-20T19:05:47.777 INFO:tasks.workunit.client.1.smithi098.stdout:9/209: creat d4/de/d27/d3c/d21/f46 x:0 0 0 2024-09-20T19:05:47.778 INFO:tasks.workunit.client.1.smithi098.stdout:4/162: fsync d3/d6/d11/f2b 0 2024-09-20T19:05:47.779 INFO:tasks.workunit.client.1.smithi098.stdout:4/163: fsync d3/d6/f10 0 2024-09-20T19:05:47.784 INFO:tasks.workunit.client.0.smithi027.stdout:2/32: rmdir d3 39 2024-09-20T19:05:47.784 INFO:tasks.workunit.client.0.smithi027.stdout:6/30: sync 2024-09-20T19:05:47.785 INFO:tasks.workunit.client.0.smithi027.stdout:5/28: sync 2024-09-20T19:05:47.785 INFO:tasks.workunit.client.0.smithi027.stdout:6/31: chown d4 5866141 1 2024-09-20T19:05:47.785 INFO:tasks.workunit.client.1.smithi098.stdout:4/164: dwrite d3/d6/f18 [4194304,4194304] 0 2024-09-20T19:05:47.787 INFO:tasks.workunit.client.0.smithi027.stdout:4/24: mkdir d5 0 2024-09-20T19:05:47.789 INFO:tasks.workunit.client.0.smithi027.stdout:3/73: symlink d0/d1/d13/l17 0 2024-09-20T19:05:47.790 INFO:tasks.workunit.client.0.smithi027.stdout:0/63: mknod d2/d7/c1a 0 2024-09-20T19:05:47.791 INFO:tasks.workunit.client.1.smithi098.stdout:4/165: creat d3/f36 x:0 0 0 2024-09-20T19:05:47.793 INFO:tasks.workunit.client.0.smithi027.stdout:6/32: dwrite f1 [0,4194304] 0 2024-09-20T19:05:47.795 INFO:tasks.workunit.client.1.smithi098.stdout:9/210: creat d4/f47 x:0 0 0 2024-09-20T19:05:47.796 INFO:tasks.workunit.client.0.smithi027.stdout:0/64: dread d2/d7/f15 [0,4194304] 0 2024-09-20T19:05:47.797 INFO:tasks.workunit.client.1.smithi098.stdout:6/94: getdents d0/d7/dc 0 2024-09-20T19:05:47.798 INFO:tasks.workunit.client.0.smithi027.stdout:4/25: dwrite f4 [0,4194304] 0 2024-09-20T19:05:47.800 INFO:tasks.workunit.client.1.smithi098.stdout:9/211: readlink d4/l11 0 2024-09-20T19:05:47.801 INFO:tasks.workunit.client.0.smithi027.stdout:0/65: chown d2/d14/l17 1 1 2024-09-20T19:05:47.803 INFO:tasks.workunit.client.0.smithi027.stdout:7/53: rename d3/d8/fb to d3/f12 0 2024-09-20T19:05:47.804 INFO:tasks.workunit.client.1.smithi098.stdout:4/166: symlink d3/d2e/l37 0 2024-09-20T19:05:47.805 INFO:tasks.workunit.client.1.smithi098.stdout:6/95: dwrite d0/f15 [0,4194304] 0 2024-09-20T19:05:47.805 INFO:tasks.workunit.client.0.smithi027.stdout:7/54: dread - d3/d8/da/f11 zero size 2024-09-20T19:05:47.806 INFO:tasks.workunit.client.0.smithi027.stdout:7/55: readlink d3/l4 0 2024-09-20T19:05:47.807 INFO:tasks.workunit.client.0.smithi027.stdout:7/56: stat d3/l7 0 2024-09-20T19:05:47.808 INFO:tasks.workunit.client.0.smithi027.stdout:5/29: unlink l3 0 2024-09-20T19:05:47.811 INFO:tasks.workunit.client.1.smithi098.stdout:9/212: read d4/f15 [3913247,88131] 0 2024-09-20T19:05:47.811 INFO:tasks.workunit.client.0.smithi027.stdout:0/66: dwrite d2/d7/f15 [0,4194304] 0 2024-09-20T19:05:47.817 INFO:tasks.workunit.client.1.smithi098.stdout:6/96: dread d0/d7/dc/f11 [0,4194304] 0 2024-09-20T19:05:47.818 INFO:tasks.workunit.client.1.smithi098.stdout:4/167: symlink d3/d6/d33/l38 0 2024-09-20T19:05:47.818 INFO:tasks.workunit.client.0.smithi027.stdout:1/69: getdents d2 0 2024-09-20T19:05:47.819 INFO:tasks.workunit.client.0.smithi027.stdout:5/30: dwrite f2 [4194304,4194304] 0 2024-09-20T19:05:47.821 INFO:tasks.workunit.client.0.smithi027.stdout:9/146: link d0/d9/df/d1b/d1a/dd/c27 d0/d9/df/d1b/c2c 0 2024-09-20T19:05:47.821 INFO:tasks.workunit.client.1.smithi098.stdout:9/213: dwrite d4/de/d27/d3c/d21/d25/f30 [0,4194304] 0 2024-09-20T19:05:47.822 INFO:tasks.workunit.client.0.smithi027.stdout:9/147: write d0/d9/f28 [993273,107852] 0 2024-09-20T19:05:47.823 INFO:tasks.workunit.client.0.smithi027.stdout:9/148: stat d0/f12 0 2024-09-20T19:05:47.824 INFO:tasks.workunit.client.0.smithi027.stdout:9/149: chown d0/c2 113249 1 2024-09-20T19:05:47.824 INFO:tasks.workunit.client.0.smithi027.stdout:5/31: dread f2 [0,4194304] 0 2024-09-20T19:05:47.825 INFO:tasks.workunit.client.0.smithi027.stdout:5/32: chown f2 53797212 1 2024-09-20T19:05:47.825 INFO:tasks.workunit.client.0.smithi027.stdout:9/150: chown d0/d9/df/d1b/d1a/dd/f25 394821407 1 2024-09-20T19:05:47.826 INFO:tasks.workunit.client.0.smithi027.stdout:5/33: write f2 [7663417,127331] 0 2024-09-20T19:05:47.827 INFO:tasks.workunit.client.0.smithi027.stdout:5/34: truncate d4/f5 1335311 0 2024-09-20T19:05:47.828 INFO:tasks.workunit.client.0.smithi027.stdout:8/60: unlink d2/l12 0 2024-09-20T19:05:47.834 INFO:tasks.workunit.client.1.smithi098.stdout:3/98: sync 2024-09-20T19:05:47.834 INFO:tasks.workunit.client.0.smithi027.stdout:3/74: rename d0/d1/d13/l17 to d0/d1/l18 0 2024-09-20T19:05:47.835 INFO:tasks.workunit.client.0.smithi027.stdout:9/151: dwrite d0/d9/df/f21 [0,4194304] 0 2024-09-20T19:05:47.836 INFO:tasks.workunit.client.1.smithi098.stdout:6/97: dwrite d0/f8 [0,4194304] 0 2024-09-20T19:05:47.836 INFO:tasks.workunit.client.1.smithi098.stdout:9/214: unlink d4/de/d24/d35/f2f 0 2024-09-20T19:05:47.837 INFO:tasks.workunit.client.1.smithi098.stdout:4/168: dwrite d3/fe [4194304,4194304] 0 2024-09-20T19:05:47.838 INFO:tasks.workunit.client.0.smithi027.stdout:7/57: creat d3/d8/da/f13 x:0 0 0 2024-09-20T19:05:47.838 INFO:tasks.workunit.client.1.smithi098.stdout:9/215: write d4/de/d19/f40 [677254,60580] 0 2024-09-20T19:05:47.840 INFO:tasks.workunit.client.1.smithi098.stdout:9/216: chown f0 0 1 2024-09-20T19:05:47.841 INFO:tasks.workunit.client.1.smithi098.stdout:3/99: write d4/fd [5220544,62211] 0 2024-09-20T19:05:47.843 INFO:tasks.workunit.client.1.smithi098.stdout:6/98: symlink d0/l1d 0 2024-09-20T19:05:47.845 INFO:tasks.workunit.client.0.smithi027.stdout:9/152: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T19:05:47.847 INFO:tasks.workunit.client.1.smithi098.stdout:4/169: rename d3/c1c to d3/d6/d33/c39 0 2024-09-20T19:05:47.847 INFO:tasks.workunit.client.0.smithi027.stdout:9/153: write d0/d9/df/d1b/f23 [5393069,71833] 0 2024-09-20T19:05:47.848 INFO:tasks.workunit.client.1.smithi098.stdout:6/99: dread d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:47.853 INFO:tasks.workunit.client.1.smithi098.stdout:9/217: mkdir d4/de/d48 0 2024-09-20T19:05:47.855 INFO:tasks.workunit.client.1.smithi098.stdout:9/218: chown d4/de/d24/d35/f42 266407 1 2024-09-20T19:05:47.858 INFO:tasks.workunit.client.1.smithi098.stdout:6/100: dwrite d0/d7/dc/f1a [0,4194304] 0 2024-09-20T19:05:47.863 INFO:tasks.workunit.client.0.smithi027.stdout:5/35: creat d4/f6 x:0 0 0 2024-09-20T19:05:47.863 INFO:tasks.workunit.client.0.smithi027.stdout:5/36: chown f2 0 1 2024-09-20T19:05:47.864 INFO:tasks.workunit.client.0.smithi027.stdout:5/37: chown d4/f5 196868743 1 2024-09-20T19:05:47.870 INFO:tasks.workunit.client.1.smithi098.stdout:9/219: dwrite d4/f10 [0,4194304] 0 2024-09-20T19:05:47.870 INFO:tasks.workunit.client.1.smithi098.stdout:3/100: creat d4/f1b x:0 0 0 2024-09-20T19:05:47.871 INFO:tasks.workunit.client.1.smithi098.stdout:9/220: fdatasync d4/de/d19/f40 0 2024-09-20T19:05:47.874 INFO:tasks.workunit.client.1.smithi098.stdout:3/101: readlink d4/da/l13 0 2024-09-20T19:05:47.875 INFO:tasks.workunit.client.0.smithi027.stdout:9/154: rename d0/c2 to d0/d9/c2d 0 2024-09-20T19:05:47.877 INFO:tasks.workunit.client.0.smithi027.stdout:4/26: link l3 d5/l6 0 2024-09-20T19:05:47.878 INFO:tasks.workunit.client.1.smithi098.stdout:9/221: creat d4/de/d24/d35/d2d/f49 x:0 0 0 2024-09-20T19:05:47.878 INFO:tasks.workunit.client.0.smithi027.stdout:4/27: write f4 [3695860,109220] 0 2024-09-20T19:05:47.878 INFO:tasks.workunit.client.1.smithi098.stdout:9/222: dread - d4/de/f34 zero size 2024-09-20T19:05:47.879 INFO:tasks.workunit.client.1.smithi098.stdout:9/223: stat d4/de/d24/d35/f32 0 2024-09-20T19:05:47.880 INFO:tasks.workunit.client.0.smithi027.stdout:5/38: rmdir d4 39 2024-09-20T19:05:47.880 INFO:tasks.workunit.client.0.smithi027.stdout:8/61: chown d2/ld 1324594 1 2024-09-20T19:05:47.884 INFO:tasks.workunit.client.1.smithi098.stdout:9/224: fdatasync d4/fb 0 2024-09-20T19:05:47.885 INFO:tasks.workunit.client.0.smithi027.stdout:5/39: chown d4/f5 2737 1 2024-09-20T19:05:47.885 INFO:tasks.workunit.client.0.smithi027.stdout:5/40: readlink - no filename 2024-09-20T19:05:47.886 INFO:tasks.workunit.client.0.smithi027.stdout:9/155: mkdir d0/d2e 0 2024-09-20T19:05:47.887 INFO:tasks.workunit.client.1.smithi098.stdout:9/225: rename d4/de/d27/d3c to d4/de/d27/d4a 0 2024-09-20T19:05:47.887 INFO:tasks.workunit.client.0.smithi027.stdout:1/70: getdents d2/d15 0 2024-09-20T19:05:47.888 INFO:tasks.workunit.client.0.smithi027.stdout:4/28: symlink d5/l7 0 2024-09-20T19:05:47.889 INFO:tasks.workunit.client.0.smithi027.stdout:4/29: chown d5/l7 12 1 2024-09-20T19:05:47.890 INFO:tasks.workunit.client.0.smithi027.stdout:5/41: rename d4/f5 to d4/f7 0 2024-09-20T19:05:47.892 INFO:tasks.workunit.client.1.smithi098.stdout:9/226: creat d4/de/d27/d4a/f4b x:0 0 0 2024-09-20T19:05:47.895 INFO:tasks.workunit.client.1.smithi098.stdout:9/227: dread d4/de/d27/d4a/f3b [0,4194304] 0 2024-09-20T19:05:47.895 INFO:tasks.workunit.client.0.smithi027.stdout:5/42: mknod d4/c8 0 2024-09-20T19:05:47.895 INFO:tasks.workunit.client.0.smithi027.stdout:4/30: dwrite f4 [4194304,4194304] 0 2024-09-20T19:05:47.896 INFO:tasks.workunit.client.1.smithi098.stdout:9/228: stat d4/de/d27/d39 0 2024-09-20T19:05:47.898 INFO:tasks.workunit.client.1.smithi098.stdout:9/229: unlink d4/de/d19/f40 0 2024-09-20T19:05:47.900 INFO:tasks.workunit.client.0.smithi027.stdout:4/31: dread f4 [0,4194304] 0 2024-09-20T19:05:47.900 INFO:tasks.workunit.client.0.smithi027.stdout:9/156: link d0/d9/df/c16 d0/c2f 0 2024-09-20T19:05:47.900 INFO:tasks.workunit.client.0.smithi027.stdout:5/43: dread f2 [4194304,4194304] 0 2024-09-20T19:05:47.901 INFO:tasks.workunit.client.0.smithi027.stdout:9/157: dread - d0/d9/df/d1b/d1a/dd/f29 zero size 2024-09-20T19:05:47.902 INFO:tasks.workunit.client.0.smithi027.stdout:9/158: chown d0/fa 61 1 2024-09-20T19:05:47.902 INFO:tasks.workunit.client.0.smithi027.stdout:9/159: read d0/fa [1555239,126180] 0 2024-09-20T19:05:47.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/230: rename d4/de/d24/d35/c44 to d4/de/d27/d4a/d21/c4c 0 2024-09-20T19:05:47.904 INFO:tasks.workunit.client.0.smithi027.stdout:5/44: mkdir d4/d9 0 2024-09-20T19:05:47.907 INFO:tasks.workunit.client.1.smithi098.stdout:9/231: creat d4/de/d48/f4d x:0 0 0 2024-09-20T19:05:47.908 INFO:tasks.workunit.client.1.smithi098.stdout:9/232: dread - d4/de/f34 zero size 2024-09-20T19:05:47.909 INFO:tasks.workunit.client.0.smithi027.stdout:5/45: rename d4/d9 to d4/da 0 2024-09-20T19:05:47.910 INFO:tasks.workunit.client.0.smithi027.stdout:9/160: rename d0/d9/df/d1b/d1a/dd/c27 to d0/d9/df/d1b/c30 0 2024-09-20T19:05:47.911 INFO:tasks.workunit.client.0.smithi027.stdout:9/161: readlink d0/d9/lb 0 2024-09-20T19:05:47.911 INFO:tasks.workunit.client.1.smithi098.stdout:9/233: write d4/f16 [3818257,122717] 0 2024-09-20T19:05:47.912 INFO:tasks.workunit.client.0.smithi027.stdout:9/162: read - d0/d9/df/f2a zero size 2024-09-20T19:05:47.920 INFO:tasks.workunit.client.0.smithi027.stdout:9/163: dwrite d0/d9/df/d1b/f23 [4194304,4194304] 0 2024-09-20T19:05:47.922 INFO:tasks.workunit.client.0.smithi027.stdout:9/164: symlink d0/d2e/l31 0 2024-09-20T19:05:47.927 INFO:tasks.workunit.client.0.smithi027.stdout:9/165: dread d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:05:47.928 INFO:tasks.workunit.client.0.smithi027.stdout:9/166: mknod d0/d9/df/d1b/c32 0 2024-09-20T19:05:47.930 INFO:tasks.workunit.client.0.smithi027.stdout:9/167: mknod d0/d9/c33 0 2024-09-20T19:05:47.930 INFO:tasks.workunit.client.0.smithi027.stdout:9/168: write d0/d9/df/f2a [146784,49563] 0 2024-09-20T19:05:47.934 INFO:tasks.workunit.client.0.smithi027.stdout:9/169: link d0/d9/df/f21 d0/d2e/f34 0 2024-09-20T19:05:47.934 INFO:tasks.workunit.client.0.smithi027.stdout:9/170: stat d0/d9/lb 0 2024-09-20T19:05:47.935 INFO:tasks.workunit.client.0.smithi027.stdout:9/171: readlink d0/d9/l20 0 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:7/175: sync 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:2/388: sync 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:1/73: sync 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:8/212: sync 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:0/100: sync 2024-09-20T19:05:47.944 INFO:tasks.workunit.client.1.smithi098.stdout:5/184: sync 2024-09-20T19:05:47.947 INFO:tasks.workunit.client.1.smithi098.stdout:1/74: chown d1/fa 25890921 1 2024-09-20T19:05:47.949 INFO:tasks.workunit.client.1.smithi098.stdout:2/389: truncate d3/d16/d1d/d2b/d46/f6c 504530 0 2024-09-20T19:05:47.950 INFO:tasks.workunit.client.1.smithi098.stdout:2/390: truncate d3/d16/f70 445375 0 2024-09-20T19:05:47.952 INFO:tasks.workunit.client.1.smithi098.stdout:2/391: dread - d3/d16/d1d/d2b/d49/f75 zero size 2024-09-20T19:05:47.953 INFO:tasks.workunit.client.1.smithi098.stdout:0/101: read d0/db/fd [388843,101641] 0 2024-09-20T19:05:47.954 INFO:tasks.workunit.client.1.smithi098.stdout:2/392: readlink d3/d16/d1a/l26 0 2024-09-20T19:05:47.957 INFO:tasks.workunit.client.1.smithi098.stdout:7/176: creat d3/d10/d16/d17/d33/d1f/d2d/f38 x:0 0 0 2024-09-20T19:05:47.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/213: dwrite d7/de/d11/d19/f4c [0,4194304] 0 2024-09-20T19:05:47.960 INFO:tasks.workunit.client.1.smithi098.stdout:7/177: truncate d3/d10/d16/f34 25679 0 2024-09-20T19:05:47.961 INFO:tasks.workunit.client.1.smithi098.stdout:7/178: readlink d3/d10/l1d 0 2024-09-20T19:05:47.964 INFO:tasks.workunit.client.0.smithi027.stdout:0/67: write d2/d7/f15 [4564740,57728] 0 2024-09-20T19:05:47.965 INFO:tasks.workunit.client.0.smithi027.stdout:0/68: write f1 [777138,25696] 0 2024-09-20T19:05:47.968 INFO:tasks.workunit.client.0.smithi027.stdout:3/75: dread d0/d1/d7/f10 [0,4194304] 0 2024-09-20T19:05:47.970 INFO:tasks.workunit.client.1.smithi098.stdout:5/185: mknod d1/c36 0 2024-09-20T19:05:47.971 INFO:tasks.workunit.client.0.smithi027.stdout:0/69: rmdir d2 39 2024-09-20T19:05:47.973 INFO:tasks.workunit.client.1.smithi098.stdout:1/75: symlink d1/d3/l11 0 2024-09-20T19:05:47.975 INFO:tasks.workunit.client.1.smithi098.stdout:8/214: dread d7/fb [0,4194304] 0 2024-09-20T19:05:47.975 INFO:tasks.workunit.client.1.smithi098.stdout:1/76: chown d1/d3/fe 264532 1 2024-09-20T19:05:47.975 INFO:tasks.workunit.client.1.smithi098.stdout:2/393: write d3/f55 [346193,29344] 0 2024-09-20T19:05:47.977 INFO:tasks.workunit.client.0.smithi027.stdout:7/58: write d3/f5 [1204229,21967] 0 2024-09-20T19:05:47.979 INFO:tasks.workunit.client.0.smithi027.stdout:7/59: fdatasync d3/f5 0 2024-09-20T19:05:47.980 INFO:tasks.workunit.client.0.smithi027.stdout:2/33: dwrite f2 [0,4194304] 0 2024-09-20T19:05:47.981 INFO:tasks.workunit.client.0.smithi027.stdout:7/60: chown d3/d8/da 36354338 1 2024-09-20T19:05:47.981 INFO:tasks.workunit.client.0.smithi027.stdout:0/70: write d2/f19 [590642,123017] 0 2024-09-20T19:05:47.982 INFO:tasks.workunit.client.1.smithi098.stdout:3/102: write d4/da/f14 [1307365,19243] 0 2024-09-20T19:05:47.986 INFO:tasks.workunit.client.0.smithi027.stdout:2/34: dread f2 [0,4194304] 0 2024-09-20T19:05:47.987 INFO:tasks.workunit.client.1.smithi098.stdout:2/394: creat d3/d51/f7f x:0 0 0 2024-09-20T19:05:47.987 INFO:tasks.workunit.client.1.smithi098.stdout:1/77: dread d1/d3/f6 [4194304,4194304] 0 2024-09-20T19:05:47.990 INFO:tasks.workunit.client.0.smithi027.stdout:7/61: symlink d3/d8/da/dc/l14 0 2024-09-20T19:05:47.991 INFO:tasks.workunit.client.1.smithi098.stdout:5/186: creat d1/d17/d35/f37 x:0 0 0 2024-09-20T19:05:47.992 INFO:tasks.workunit.client.0.smithi027.stdout:0/71: unlink d2/d14/f16 0 2024-09-20T19:05:47.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/103: dread - d4/f16 zero size 2024-09-20T19:05:47.996 INFO:tasks.workunit.client.1.smithi098.stdout:8/215: symlink d7/de/d11/d19/d47/l4f 0 2024-09-20T19:05:47.997 INFO:tasks.workunit.client.0.smithi027.stdout:7/62: dwrite d3/d8/da/f13 [0,4194304] 0 2024-09-20T19:05:47.997 INFO:tasks.workunit.client.1.smithi098.stdout:2/395: mknod d3/d16/d1d/d4f/c80 0 2024-09-20T19:05:47.998 INFO:tasks.workunit.client.0.smithi027.stdout:7/63: truncate d3/f9 955269 0 2024-09-20T19:05:48.000 INFO:tasks.workunit.client.1.smithi098.stdout:7/179: link d3/d10/d16/f2c d3/d10/d16/f39 0 2024-09-20T19:05:48.004 INFO:tasks.workunit.client.1.smithi098.stdout:3/104: truncate d4/da/fb 5329675 0 2024-09-20T19:05:48.005 INFO:tasks.workunit.client.0.smithi027.stdout:2/35: unlink d3/c4 0 2024-09-20T19:05:48.008 INFO:tasks.workunit.client.0.smithi027.stdout:7/64: rename d3/d8/lf to d3/d8/da/dc/l15 0 2024-09-20T19:05:48.009 INFO:tasks.workunit.client.1.smithi098.stdout:8/216: unlink d7/de/c49 0 2024-09-20T19:05:48.010 INFO:tasks.workunit.client.0.smithi027.stdout:0/72: unlink d2/l13 0 2024-09-20T19:05:48.011 INFO:tasks.workunit.client.1.smithi098.stdout:7/180: stat d3/d10/d16/d17/l2f 0 2024-09-20T19:05:48.014 INFO:tasks.workunit.client.1.smithi098.stdout:5/187: rename d1/l2d to d1/l38 0 2024-09-20T19:05:48.016 INFO:tasks.workunit.client.0.smithi027.stdout:7/65: dwrite d3/d8/da/f11 [0,4194304] 0 2024-09-20T19:05:48.016 INFO:tasks.workunit.client.0.smithi027.stdout:7/66: stat d3/f9 0 2024-09-20T19:05:48.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/181: symlink d3/d10/d16/d17/d33/d37/l3a 0 2024-09-20T19:05:48.021 INFO:tasks.workunit.client.1.smithi098.stdout:7/182: truncate d3/d10/d16/d17/d33/d1f/d2d/f38 608397 0 2024-09-20T19:05:48.021 INFO:tasks.workunit.client.1.smithi098.stdout:2/396: link d3/l2a d3/d16/d1d/d2b/d34/d38/l81 0 2024-09-20T19:05:48.024 INFO:tasks.workunit.client.1.smithi098.stdout:5/188: stat d1/d17/d2e/f34 0 2024-09-20T19:05:48.025 INFO:tasks.workunit.client.1.smithi098.stdout:3/105: creat d4/f1c x:0 0 0 2024-09-20T19:05:48.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/106: truncate d4/f16 588367 0 2024-09-20T19:05:48.026 INFO:tasks.workunit.client.0.smithi027.stdout:7/67: mkdir d3/d16 0 2024-09-20T19:05:48.027 INFO:tasks.workunit.client.1.smithi098.stdout:8/217: link d7/de/d11/d19/c44 d7/de/d11/d19/d47/c50 0 2024-09-20T19:05:48.028 INFO:tasks.workunit.client.0.smithi027.stdout:7/68: dread d3/f5 [4194304,4194304] 0 2024-09-20T19:05:48.030 INFO:tasks.workunit.client.1.smithi098.stdout:7/183: creat d3/d10/d16/d17/d33/d1f/d2d/f3b x:0 0 0 2024-09-20T19:05:48.030 INFO:tasks.workunit.client.1.smithi098.stdout:8/218: truncate d7/de/d11/f1b 1112573 0 2024-09-20T19:05:48.030 INFO:tasks.workunit.client.1.smithi098.stdout:5/189: chown d1/d1b/l27 430285 1 2024-09-20T19:05:48.032 INFO:tasks.workunit.client.0.smithi027.stdout:5/46: getdents d4 0 2024-09-20T19:05:48.033 INFO:tasks.workunit.client.0.smithi027.stdout:7/69: mknod d3/d16/c17 0 2024-09-20T19:05:48.043 INFO:tasks.workunit.client.0.smithi027.stdout:9/172: write d0/d9/df/d1b/f14 [1518659,56680] 0 2024-09-20T19:05:48.048 INFO:tasks.workunit.client.0.smithi027.stdout:9/173: getdents d0 0 2024-09-20T19:05:48.049 INFO:tasks.workunit.client.0.smithi027.stdout:3/76: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T19:05:48.057 INFO:tasks.workunit.client.0.smithi027.stdout:0/73: truncate d2/f10 332141 0 2024-09-20T19:05:48.059 INFO:tasks.workunit.client.0.smithi027.stdout:0/74: mkdir d2/d14/d1b 0 2024-09-20T19:05:48.059 INFO:tasks.workunit.client.0.smithi027.stdout:0/75: dread - d2/f12 zero size 2024-09-20T19:05:48.060 INFO:tasks.workunit.client.0.smithi027.stdout:5/47: write f2 [7539418,75699] 0 2024-09-20T19:05:48.066 INFO:tasks.workunit.client.0.smithi027.stdout:5/48: dwrite f2 [4194304,4194304] 0 2024-09-20T19:05:48.084 INFO:tasks.workunit.client.0.smithi027.stdout:5/49: read d4/f7 [984191,78003] 0 2024-09-20T19:05:48.085 INFO:tasks.workunit.client.1.smithi098.stdout:9/234: rmdir d4/de/d19 0 2024-09-20T19:05:48.086 INFO:tasks.workunit.client.0.smithi027.stdout:3/77: write d0/d1/d7/f10 [74603,74868] 0 2024-09-20T19:05:48.087 INFO:tasks.workunit.client.1.smithi098.stdout:7/184: readlink d3/d10/d16/d17/d33/l2a 0 2024-09-20T19:05:48.087 INFO:tasks.workunit.client.1.smithi098.stdout:3/107: dwrite d4/fd [4194304,4194304] 0 2024-09-20T19:05:48.087 INFO:tasks.workunit.client.0.smithi027.stdout:9/174: truncate d0/d9/df/d1b/f23 7884215 0 2024-09-20T19:05:48.088 INFO:tasks.workunit.client.0.smithi027.stdout:9/175: dread - d0/d9/df/f24 zero size 2024-09-20T19:05:48.089 INFO:tasks.workunit.client.1.smithi098.stdout:4/170: write d3/d6/d11/f15 [974094,54843] 0 2024-09-20T19:05:48.090 INFO:tasks.workunit.client.0.smithi027.stdout:3/78: unlink d0/d1/d13/f16 0 2024-09-20T19:05:48.090 INFO:tasks.workunit.client.1.smithi098.stdout:3/108: readlink d4/da/l13 0 2024-09-20T19:05:48.091 INFO:tasks.workunit.client.0.smithi027.stdout:9/176: chown d0/d9/df/d1b/c2c 900 1 2024-09-20T19:05:48.092 INFO:tasks.workunit.client.1.smithi098.stdout:2/397: truncate d3/d16/d1d/f39 801273 0 2024-09-20T19:05:48.092 INFO:tasks.workunit.client.0.smithi027.stdout:9/177: chown d0/d9/df/d1b 1677969 1 2024-09-20T19:05:48.093 INFO:tasks.workunit.client.0.smithi027.stdout:9/178: read d0/d9/df/d1b/f14 [293813,566] 0 2024-09-20T19:05:48.095 INFO:tasks.workunit.client.0.smithi027.stdout:3/79: mkdir d0/d19 0 2024-09-20T19:05:48.095 INFO:tasks.workunit.client.1.smithi098.stdout:9/235: unlink d4/de/d27/d4a/f38 0 2024-09-20T19:05:48.096 INFO:tasks.workunit.client.0.smithi027.stdout:3/80: chown d0/f11 73 1 2024-09-20T19:05:48.096 INFO:tasks.workunit.client.1.smithi098.stdout:7/185: rmdir d3/d10/d16/d17 39 2024-09-20T19:05:48.099 INFO:tasks.workunit.client.1.smithi098.stdout:5/190: dwrite d1/d1b/f26 [0,4194304] 0 2024-09-20T19:05:48.100 INFO:tasks.workunit.client.1.smithi098.stdout:9/236: write d4/de/f3d [725724,51587] 0 2024-09-20T19:05:48.103 INFO:tasks.workunit.client.1.smithi098.stdout:8/219: link d7/cf d7/de/d11/d19/d30/c51 0 2024-09-20T19:05:48.104 INFO:tasks.workunit.client.0.smithi027.stdout:3/81: link d0/d1/d7/f10 d0/d19/f1a 0 2024-09-20T19:05:48.105 INFO:tasks.workunit.client.1.smithi098.stdout:3/109: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:05:48.108 INFO:tasks.workunit.client.1.smithi098.stdout:2/398: mkdir d3/d16/d1d/d2b/d46/d74/d82 0 2024-09-20T19:05:48.108 INFO:tasks.workunit.client.0.smithi027.stdout:3/82: mknod d0/d1/d7/c1b 0 2024-09-20T19:05:48.110 INFO:tasks.workunit.client.0.smithi027.stdout:3/83: dread d0/d19/f1a [0,4194304] 0 2024-09-20T19:05:48.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/110: write d4/fd [428546,45081] 0 2024-09-20T19:05:48.111 INFO:tasks.workunit.client.1.smithi098.stdout:5/191: rename d1/d17/f2a to d1/d17/f39 0 2024-09-20T19:05:48.112 INFO:tasks.workunit.client.1.smithi098.stdout:3/111: chown c3 7624 1 2024-09-20T19:05:48.113 INFO:tasks.workunit.client.1.smithi098.stdout:3/112: chown d4/fd 180604 1 2024-09-20T19:05:48.114 INFO:tasks.workunit.client.0.smithi027.stdout:3/84: creat d0/d1/d13/f1c x:0 0 0 2024-09-20T19:05:48.120 INFO:tasks.workunit.client.1.smithi098.stdout:2/399: truncate d3/f9 845707 0 2024-09-20T19:05:48.120 INFO:tasks.workunit.client.1.smithi098.stdout:8/220: dwrite d7/de/d11/f1b [0,4194304] 0 2024-09-20T19:05:48.122 INFO:tasks.workunit.client.1.smithi098.stdout:7/186: creat d3/d10/d16/d17/d33/d1f/f3c x:0 0 0 2024-09-20T19:05:48.123 INFO:tasks.workunit.client.0.smithi027.stdout:6/33: sync 2024-09-20T19:05:48.124 INFO:tasks.workunit.client.1.smithi098.stdout:7/187: stat d3/d10/d16 0 2024-09-20T19:05:48.125 INFO:tasks.workunit.client.1.smithi098.stdout:2/400: fsync d3/f12 0 2024-09-20T19:05:48.127 INFO:tasks.workunit.client.1.smithi098.stdout:9/237: dwrite d4/f8 [0,4194304] 0 2024-09-20T19:05:48.128 INFO:tasks.workunit.client.1.smithi098.stdout:8/221: symlink d7/de/d11/d19/l52 0 2024-09-20T19:05:48.130 INFO:tasks.workunit.client.0.smithi027.stdout:6/34: rename f1 to d4/f7 0 2024-09-20T19:05:48.130 INFO:tasks.workunit.client.1.smithi098.stdout:4/171: dread d3/fe [0,4194304] 0 2024-09-20T19:05:48.137 INFO:tasks.workunit.client.1.smithi098.stdout:7/188: write d3/f12 [2069665,25732] 0 2024-09-20T19:05:48.138 INFO:tasks.workunit.client.1.smithi098.stdout:7/189: write d3/f11 [3643520,124120] 0 2024-09-20T19:05:48.140 INFO:tasks.workunit.client.1.smithi098.stdout:7/190: chown d3/d10/d16/d17/d33/d1f/d2d/f38 5 1 2024-09-20T19:05:48.140 INFO:tasks.workunit.client.1.smithi098.stdout:7/191: chown d3/ld 2144 1 2024-09-20T19:05:48.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/238: creat d4/de/d27/d4a/d21/f4e x:0 0 0 2024-09-20T19:05:48.142 INFO:tasks.workunit.client.0.smithi027.stdout:6/35: dwrite d4/f7 [0,4194304] 0 2024-09-20T19:05:48.143 INFO:tasks.workunit.client.1.smithi098.stdout:8/222: creat d7/de/d11/d19/f53 x:0 0 0 2024-09-20T19:05:48.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/172: symlink d3/d6/l3a 0 2024-09-20T19:05:48.146 INFO:tasks.workunit.client.1.smithi098.stdout:7/192: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:48.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/193: dread - d3/d10/d16/f2c zero size 2024-09-20T19:05:48.148 INFO:tasks.workunit.client.1.smithi098.stdout:9/239: mknod d4/de/d27/d4a/d21/c4f 0 2024-09-20T19:05:48.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/223: creat d7/de/f54 x:0 0 0 2024-09-20T19:05:48.150 INFO:tasks.workunit.client.1.smithi098.stdout:9/240: write d4/de/d24/d35/f43 [1245124,126125] 0 2024-09-20T19:05:48.152 INFO:tasks.workunit.client.1.smithi098.stdout:8/224: write d7/de/d11/d19/f2d [422868,20004] 0 2024-09-20T19:05:48.152 INFO:tasks.workunit.client.1.smithi098.stdout:4/173: unlink d3/d6/l9 0 2024-09-20T19:05:48.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/241: stat d4/de/d27/d4a/d21/d25 0 2024-09-20T19:05:48.154 INFO:tasks.workunit.client.1.smithi098.stdout:2/401: creat d3/d16/f83 x:0 0 0 2024-09-20T19:05:48.155 INFO:tasks.workunit.client.1.smithi098.stdout:4/174: write d3/d6/d11/d1e/f30 [4892488,88170] 0 2024-09-20T19:05:48.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/225: read d7/de/d11/d19/f4c [2203039,89785] 0 2024-09-20T19:05:48.155 INFO:tasks.workunit.client.0.smithi027.stdout:9/179: truncate d0/f12 1096358 0 2024-09-20T19:05:48.155 INFO:tasks.workunit.client.0.smithi027.stdout:9/180: chown d0/d9 23 1 2024-09-20T19:05:48.156 INFO:tasks.workunit.client.1.smithi098.stdout:2/402: truncate d3/d16/f45 276937 0 2024-09-20T19:05:48.157 INFO:tasks.workunit.client.1.smithi098.stdout:8/226: read d7/de/d11/d19/f4c [685165,50177] 0 2024-09-20T19:05:48.158 INFO:tasks.workunit.client.1.smithi098.stdout:2/403: chown d3/d16/d1a/c54 54 1 2024-09-20T19:05:48.158 INFO:tasks.workunit.client.0.smithi027.stdout:3/85: getdents d0/d19 0 2024-09-20T19:05:48.159 INFO:tasks.workunit.client.0.smithi027.stdout:3/86: write d0/f12 [580886,115131] 0 2024-09-20T19:05:48.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/194: creat d3/d10/d16/d17/f3d x:0 0 0 2024-09-20T19:05:48.162 INFO:tasks.workunit.client.0.smithi027.stdout:9/181: rename d0/d9/df/d1b/c30 to d0/d9/df/d1b/d1a/c35 0 2024-09-20T19:05:48.162 INFO:tasks.workunit.client.0.smithi027.stdout:9/182: chown d0/d9/df/f24 882497597 1 2024-09-20T19:05:48.163 INFO:tasks.workunit.client.1.smithi098.stdout:9/242: unlink d4/f15 0 2024-09-20T19:05:48.164 INFO:tasks.workunit.client.0.smithi027.stdout:3/87: mkdir d0/d1/d7/d1d 0 2024-09-20T19:05:48.164 INFO:tasks.workunit.client.1.smithi098.stdout:9/243: read f3 [4124547,2918] 0 2024-09-20T19:05:48.166 INFO:tasks.workunit.client.1.smithi098.stdout:5/192: write d1/d17/d25/f2b [710359,100298] 0 2024-09-20T19:05:48.168 INFO:tasks.workunit.client.0.smithi027.stdout:3/88: creat d0/d1/d7/f1e x:0 0 0 2024-09-20T19:05:48.170 INFO:tasks.workunit.client.1.smithi098.stdout:4/175: mknod d3/d6/d33/c3b 0 2024-09-20T19:05:48.171 INFO:tasks.workunit.client.1.smithi098.stdout:3/113: truncate d4/fd 1808588 0 2024-09-20T19:05:48.172 INFO:tasks.workunit.client.1.smithi098.stdout:3/114: write d4/da/f14 [7960542,32472] 0 2024-09-20T19:05:48.175 INFO:tasks.workunit.client.1.smithi098.stdout:7/195: fsync d3/d10/f19 0 2024-09-20T19:05:48.176 INFO:tasks.workunit.client.0.smithi027.stdout:3/89: creat d0/d1/d7/d1d/f1f x:0 0 0 2024-09-20T19:05:48.177 INFO:tasks.workunit.client.0.smithi027.stdout:3/90: read d0/f5 [871628,102527] 0 2024-09-20T19:05:48.180 INFO:tasks.workunit.client.1.smithi098.stdout:9/244: creat d4/de/d27/d4a/d21/f50 x:0 0 0 2024-09-20T19:05:48.183 INFO:tasks.workunit.client.0.smithi027.stdout:3/91: symlink d0/d1/d13/l20 0 2024-09-20T19:05:48.183 INFO:tasks.workunit.client.1.smithi098.stdout:7/196: dwrite d3/d10/d16/d17/d33/d1f/d2d/f31 [0,4194304] 0 2024-09-20T19:05:48.185 INFO:tasks.workunit.client.1.smithi098.stdout:5/193: rename d1/d17/d2e/f32 to d1/d17/d25/f3a 0 2024-09-20T19:05:48.186 INFO:tasks.workunit.client.1.smithi098.stdout:4/176: mkdir d3/d6/d33/d3c 0 2024-09-20T19:05:48.191 INFO:tasks.workunit.client.0.smithi027.stdout:3/92: dwrite d0/d1/d7/f1e [0,4194304] 0 2024-09-20T19:05:48.196 INFO:tasks.workunit.client.0.smithi027.stdout:9/183: dwrite d0/d9/df/d1b/f23 [0,4194304] 0 2024-09-20T19:05:48.198 INFO:tasks.workunit.client.0.smithi027.stdout:9/184: stat d0/d9/df/d1b 0 2024-09-20T19:05:48.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/245: mkdir d4/de/d27/d4a/d21/d25/d51 0 2024-09-20T19:05:48.198 INFO:tasks.workunit.client.0.smithi027.stdout:9/185: chown d0/d2e/l31 138 1 2024-09-20T19:05:48.199 INFO:tasks.workunit.client.1.smithi098.stdout:9/246: dread - d4/de/d27/d4a/d21/f4e zero size 2024-09-20T19:05:48.199 INFO:tasks.workunit.client.0.smithi027.stdout:9/186: chown d0 25 1 2024-09-20T19:05:48.199 INFO:tasks.workunit.client.0.smithi027.stdout:3/93: dread d0/f5 [4194304,4194304] 0 2024-09-20T19:05:48.202 INFO:tasks.workunit.client.1.smithi098.stdout:3/115: mkdir d4/d19/d1d 0 2024-09-20T19:05:48.204 INFO:tasks.workunit.client.1.smithi098.stdout:8/227: write d7/de/d11/d1d/f3e [2932340,93718] 0 2024-09-20T19:05:48.205 INFO:tasks.workunit.client.1.smithi098.stdout:2/404: creat d3/d16/f84 x:0 0 0 2024-09-20T19:05:48.207 INFO:tasks.workunit.client.1.smithi098.stdout:7/197: mknod d3/d10/c3e 0 2024-09-20T19:05:48.209 INFO:tasks.workunit.client.0.smithi027.stdout:3/94: link d0/f12 d0/d1/d7/d1d/f21 0 2024-09-20T19:05:48.213 INFO:tasks.workunit.client.1.smithi098.stdout:9/247: symlink d4/de/d27/l52 0 2024-09-20T19:05:48.214 INFO:tasks.workunit.client.0.smithi027.stdout:3/95: creat d0/d1/d13/f22 x:0 0 0 2024-09-20T19:05:48.216 INFO:tasks.workunit.client.1.smithi098.stdout:8/228: mkdir d7/de/d11/d19/d30/d55 0 2024-09-20T19:05:48.218 INFO:tasks.workunit.client.0.smithi027.stdout:3/96: symlink d0/d1/d7/d1d/l23 0 2024-09-20T19:05:48.219 INFO:tasks.workunit.client.1.smithi098.stdout:2/405: write d3/f3c [1126465,16676] 0 2024-09-20T19:05:48.223 INFO:tasks.workunit.client.1.smithi098.stdout:8/229: dwrite d7/de/d11/d19/f4e [0,4194304] 0 2024-09-20T19:05:48.224 INFO:tasks.workunit.client.0.smithi027.stdout:3/97: symlink d0/d1/d13/d15/l24 0 2024-09-20T19:05:48.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/116: symlink d4/l1e 0 2024-09-20T19:05:48.227 INFO:tasks.workunit.client.0.smithi027.stdout:8/62: sync 2024-09-20T19:05:48.227 INFO:tasks.workunit.client.1.smithi098.stdout:7/198: creat d3/d10/d18/d21/f3f x:0 0 0 2024-09-20T19:05:48.227 INFO:tasks.workunit.client.1.smithi098.stdout:2/406: dread d3/d16/f3b [0,4194304] 0 2024-09-20T19:05:48.230 INFO:tasks.workunit.client.1.smithi098.stdout:7/199: write d3/d10/d16/d17/d33/d1f/d2d/f3b [647467,66708] 0 2024-09-20T19:05:48.231 INFO:tasks.workunit.client.1.smithi098.stdout:7/200: dread - d3/d10/d16/f39 zero size 2024-09-20T19:05:48.234 INFO:tasks.workunit.client.1.smithi098.stdout:5/194: getdents d1 0 2024-09-20T19:05:48.235 INFO:tasks.workunit.client.0.smithi027.stdout:8/63: fsync d2/d3/fe 0 2024-09-20T19:05:48.236 INFO:tasks.workunit.client.1.smithi098.stdout:8/230: creat d7/de/d11/d1d/f56 x:0 0 0 2024-09-20T19:05:48.237 INFO:tasks.workunit.client.1.smithi098.stdout:8/231: readlink d7/de/d11/d19/d47/l4f 0 2024-09-20T19:05:48.238 INFO:tasks.workunit.client.1.smithi098.stdout:3/117: truncate d4/f10 372934 0 2024-09-20T19:05:48.243 INFO:tasks.workunit.client.1.smithi098.stdout:8/232: dwrite d7/de/f48 [0,4194304] 0 2024-09-20T19:05:48.245 INFO:tasks.workunit.client.0.smithi027.stdout:8/64: rename d2/d3/d10 to d2/d14 0 2024-09-20T19:05:48.246 INFO:tasks.workunit.client.0.smithi027.stdout:8/65: read - d2/d3/fe zero size 2024-09-20T19:05:48.247 INFO:tasks.workunit.client.1.smithi098.stdout:5/195: fsync d1/f14 0 2024-09-20T19:05:48.247 INFO:tasks.workunit.client.0.smithi027.stdout:8/66: write d2/d3/d6/fa [882538,18188] 0 2024-09-20T19:05:48.248 INFO:tasks.workunit.client.1.smithi098.stdout:5/196: dread - d1/d17/f39 zero size 2024-09-20T19:05:48.249 INFO:tasks.workunit.client.1.smithi098.stdout:5/197: readlink d1/d17/d25/l29 0 2024-09-20T19:05:48.250 INFO:tasks.workunit.client.1.smithi098.stdout:3/118: creat d4/d19/f1f x:0 0 0 2024-09-20T19:05:48.251 INFO:tasks.workunit.client.0.smithi027.stdout:3/98: write d0/d19/f1a [1073650,130005] 0 2024-09-20T19:05:48.251 INFO:tasks.workunit.client.1.smithi098.stdout:3/119: write d4/f1c [210018,44136] 0 2024-09-20T19:05:48.254 INFO:tasks.workunit.client.1.smithi098.stdout:7/201: symlink d3/d10/d16/l40 0 2024-09-20T19:05:48.257 INFO:tasks.workunit.client.1.smithi098.stdout:8/233: mkdir d7/de/d11/d1f/d57 0 2024-09-20T19:05:48.257 INFO:tasks.workunit.client.0.smithi027.stdout:3/99: dread d0/d1/d7/f10 [0,4194304] 0 2024-09-20T19:05:48.258 INFO:tasks.workunit.client.0.smithi027.stdout:8/67: mkdir d2/d15 0 2024-09-20T19:05:48.260 INFO:tasks.workunit.client.1.smithi098.stdout:9/248: rmdir d4/de/d27/d4a/d21 39 2024-09-20T19:05:48.261 INFO:tasks.workunit.client.0.smithi027.stdout:3/100: mknod d0/d1/d13/d15/c25 0 2024-09-20T19:05:48.261 INFO:tasks.workunit.client.1.smithi098.stdout:7/202: dwrite d3/d10/d16/f34 [0,4194304] 0 2024-09-20T19:05:48.262 INFO:tasks.workunit.client.1.smithi098.stdout:7/203: chown d3/d10/f19 11 1 2024-09-20T19:05:48.262 INFO:tasks.workunit.client.1.smithi098.stdout:7/204: write d3/f6 [4922935,123694] 0 2024-09-20T19:05:48.264 INFO:tasks.workunit.client.1.smithi098.stdout:2/407: rename d3/d16/d1d/d2b/d34/d38/c42 to d3/d16/d1d/d2b/c85 0 2024-09-20T19:05:48.264 INFO:tasks.workunit.client.0.smithi027.stdout:8/68: dread d2/f7 [0,4194304] 0 2024-09-20T19:05:48.265 INFO:tasks.workunit.client.1.smithi098.stdout:2/408: dread - d3/d16/d1a/f7c zero size 2024-09-20T19:05:48.265 INFO:tasks.workunit.client.0.smithi027.stdout:3/101: creat d0/d1/f26 x:0 0 0 2024-09-20T19:05:48.266 INFO:tasks.workunit.client.1.smithi098.stdout:2/409: chown d3/df/c10 31379 1 2024-09-20T19:05:48.267 INFO:tasks.workunit.client.0.smithi027.stdout:8/69: dread d2/f7 [0,4194304] 0 2024-09-20T19:05:48.269 INFO:tasks.workunit.client.1.smithi098.stdout:5/198: link d1/d17/d35/f37 d1/d17/d25/f3b 0 2024-09-20T19:05:48.272 INFO:tasks.workunit.client.0.smithi027.stdout:8/70: mknod d2/d3/c16 0 2024-09-20T19:05:48.272 INFO:tasks.workunit.client.1.smithi098.stdout:7/205: rmdir d3 39 2024-09-20T19:05:48.273 INFO:tasks.workunit.client.0.smithi027.stdout:8/71: chown d2/d3/l5 1889007 1 2024-09-20T19:05:48.274 INFO:tasks.workunit.client.0.smithi027.stdout:8/72: stat d2/d14/d13 0 2024-09-20T19:05:48.274 INFO:tasks.workunit.client.0.smithi027.stdout:3/102: dwrite d0/f11 [0,4194304] 0 2024-09-20T19:05:48.275 INFO:tasks.workunit.client.0.smithi027.stdout:3/103: chown d0/d1/d13/f1c 106013 1 2024-09-20T19:05:48.276 INFO:tasks.workunit.client.1.smithi098.stdout:2/410: creat d3/d16/d1d/d2b/d46/d74/f86 x:0 0 0 2024-09-20T19:05:48.284 INFO:tasks.workunit.client.1.smithi098.stdout:5/199: dread d1/f2c [4194304,4194304] 0 2024-09-20T19:05:48.286 INFO:tasks.workunit.client.1.smithi098.stdout:8/234: creat d7/de/d11/f58 x:0 0 0 2024-09-20T19:05:48.288 INFO:tasks.workunit.client.1.smithi098.stdout:3/120: dread d4/da/f14 [4194304,4194304] 0 2024-09-20T19:05:48.288 INFO:tasks.workunit.client.1.smithi098.stdout:8/235: write d7/f41 [138909,59178] 0 2024-09-20T19:05:48.289 INFO:tasks.workunit.client.1.smithi098.stdout:7/206: symlink d3/d10/d16/d17/d33/d1f/d2d/l41 0 2024-09-20T19:05:48.290 INFO:tasks.workunit.client.1.smithi098.stdout:5/200: mknod d1/c3c 0 2024-09-20T19:05:48.293 INFO:tasks.workunit.client.0.smithi027.stdout:8/73: mknod d2/d14/c17 0 2024-09-20T19:05:48.295 INFO:tasks.workunit.client.1.smithi098.stdout:8/236: rmdir d7/de/d11/d1f 39 2024-09-20T19:05:48.296 INFO:tasks.workunit.client.1.smithi098.stdout:8/237: write d7/f3a [265883,114206] 0 2024-09-20T19:05:48.296 INFO:tasks.workunit.client.1.smithi098.stdout:7/207: mknod d3/d10/d16/d17/c42 0 2024-09-20T19:05:48.299 INFO:tasks.workunit.client.0.smithi027.stdout:3/104: dwrite d0/d1/d7/d1d/f21 [0,4194304] 0 2024-09-20T19:05:48.299 INFO:tasks.workunit.client.0.smithi027.stdout:3/105: chown d0/d1/d7/f1e 29525095 1 2024-09-20T19:05:48.300 INFO:tasks.workunit.client.1.smithi098.stdout:8/238: mkdir d7/de/d11/d19/d30/d59 0 2024-09-20T19:05:48.304 INFO:tasks.workunit.client.1.smithi098.stdout:2/411: dread d3/fd [0,4194304] 0 2024-09-20T19:05:48.306 INFO:tasks.workunit.client.1.smithi098.stdout:7/208: creat d3/d10/d16/d17/d33/d1f/f43 x:0 0 0 2024-09-20T19:05:48.307 INFO:tasks.workunit.client.1.smithi098.stdout:7/209: read d3/f12 [287152,77674] 0 2024-09-20T19:05:48.308 INFO:tasks.workunit.client.0.smithi027.stdout:1/71: sync 2024-09-20T19:05:48.309 INFO:tasks.workunit.client.1.smithi098.stdout:7/210: write d3/d10/d16/d17/d33/d1f/d2d/f3b [393429,23309] 0 2024-09-20T19:05:48.309 INFO:tasks.workunit.client.1.smithi098.stdout:8/239: link d7/de/d11/d19/f4e d7/de/d35/f5a 0 2024-09-20T19:05:48.312 INFO:tasks.workunit.client.1.smithi098.stdout:2/412: mknod d3/d16/d1d/d2b/d46/c87 0 2024-09-20T19:05:48.314 INFO:tasks.workunit.client.1.smithi098.stdout:2/413: truncate d3/d16/d1d/f4e 478354 0 2024-09-20T19:05:48.315 INFO:tasks.workunit.client.1.smithi098.stdout:7/211: dwrite d3/f6 [0,4194304] 0 2024-09-20T19:05:48.316 INFO:tasks.workunit.client.1.smithi098.stdout:5/201: dread d1/f14 [0,4194304] 0 2024-09-20T19:05:48.317 INFO:tasks.workunit.client.1.smithi098.stdout:2/414: write d3/d16/d1d/d2b/d46/d74/f7d [801905,52399] 0 2024-09-20T19:05:48.319 INFO:tasks.workunit.client.1.smithi098.stdout:8/240: chown d7/de/d11/d19/d30/c51 426603812 1 2024-09-20T19:05:48.324 INFO:tasks.workunit.client.1.smithi098.stdout:2/415: truncate d3/df/d13/f3a 4206011 0 2024-09-20T19:05:48.326 INFO:tasks.workunit.client.1.smithi098.stdout:7/212: dwrite d3/d10/d16/d17/d33/d1f/d2d/f31 [4194304,4194304] 0 2024-09-20T19:05:48.327 INFO:tasks.workunit.client.1.smithi098.stdout:5/202: rename d1/d17/d35/f37 to d1/d17/d25/f3d 0 2024-09-20T19:05:48.328 INFO:tasks.workunit.client.1.smithi098.stdout:2/416: mkdir d3/d16/d1d/d2b/d49/d69/d88 0 2024-09-20T19:05:48.333 INFO:tasks.workunit.client.1.smithi098.stdout:7/213: dwrite d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:48.334 INFO:tasks.workunit.client.1.smithi098.stdout:7/214: dread - d3/d10/d16/d17/f3d zero size 2024-09-20T19:05:48.349 INFO:tasks.workunit.client.1.smithi098.stdout:8/241: rename d7/de/d11/d19/l3c to d7/de/d11/d1f/d57/l5b 0 2024-09-20T19:05:48.350 INFO:tasks.workunit.client.0.smithi027.stdout:4/32: sync 2024-09-20T19:05:48.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/203: write d1/d1b/f1c [3539539,78536] 0 2024-09-20T19:05:48.353 INFO:tasks.workunit.client.1.smithi098.stdout:5/204: truncate d1/d17/d2e/f2f 297547 0 2024-09-20T19:05:48.354 INFO:tasks.workunit.client.0.smithi027.stdout:4/33: dread f4 [0,4194304] 0 2024-09-20T19:05:48.354 INFO:tasks.workunit.client.1.smithi098.stdout:7/215: chown d3/d10/c15 8070735 1 2024-09-20T19:05:48.358 INFO:tasks.workunit.client.1.smithi098.stdout:8/242: mknod d7/de/d11/d19/d47/c5c 0 2024-09-20T19:05:48.359 INFO:tasks.workunit.client.1.smithi098.stdout:5/205: creat d1/d17/d35/f3e x:0 0 0 2024-09-20T19:05:48.360 INFO:tasks.workunit.client.1.smithi098.stdout:5/206: fdatasync d1/d17/d35/f3e 0 2024-09-20T19:05:48.364 INFO:tasks.workunit.client.1.smithi098.stdout:5/207: stat d1/c1d 0 2024-09-20T19:05:48.366 INFO:tasks.workunit.client.1.smithi098.stdout:2/417: rename d3/d16/d1d/d4f/f71 to d3/d16/f89 0 2024-09-20T19:05:48.366 INFO:tasks.workunit.client.1.smithi098.stdout:2/418: stat d3/d16/d1a/f37 0 2024-09-20T19:05:48.367 INFO:tasks.workunit.client.1.smithi098.stdout:2/419: chown d3/d16/d1d/d2b/d46/d74/f86 6188413 1 2024-09-20T19:05:48.367 INFO:tasks.workunit.client.1.smithi098.stdout:2/420: chown d3/d16/d1d/d2b/l79 344 1 2024-09-20T19:05:48.384 INFO:tasks.workunit.client.1.smithi098.stdout:8/243: link d7/de/d11/d1f/f4d d7/de/d35/f5d 0 2024-09-20T19:05:48.386 INFO:tasks.workunit.client.1.smithi098.stdout:7/216: creat d3/d10/d16/d17/d33/d1f/f44 x:0 0 0 2024-09-20T19:05:48.390 INFO:tasks.workunit.client.1.smithi098.stdout:2/421: unlink d3/d16/d1d/d2b/d34/l35 0 2024-09-20T19:05:48.391 INFO:tasks.workunit.client.1.smithi098.stdout:8/244: dwrite d7/de/d11/d19/f53 [0,4194304] 0 2024-09-20T19:05:48.397 INFO:tasks.workunit.client.1.smithi098.stdout:7/217: truncate d3/d10/d16/f2c 912840 0 2024-09-20T19:05:48.398 INFO:tasks.workunit.client.1.smithi098.stdout:5/208: dwrite d1/f9 [0,4194304] 0 2024-09-20T19:05:48.399 INFO:tasks.workunit.client.1.smithi098.stdout:7/218: truncate d3/d10/f13 5199662 0 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:7/70: sync 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:0/76: sync 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:6/36: sync 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:9/187: sync 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:5/50: sync 2024-09-20T19:05:48.400 INFO:tasks.workunit.client.0.smithi027.stdout:2/36: sync 2024-09-20T19:05:48.401 INFO:tasks.workunit.client.0.smithi027.stdout:0/77: stat d2/d14/l17 0 2024-09-20T19:05:48.402 INFO:tasks.workunit.client.0.smithi027.stdout:5/51: write d4/f6 [843119,94465] 0 2024-09-20T19:05:48.403 INFO:tasks.workunit.client.1.smithi098.stdout:8/245: mknod d7/de/d11/d1d/c5e 0 2024-09-20T19:05:48.404 INFO:tasks.workunit.client.0.smithi027.stdout:0/78: truncate d2/f19 769734 0 2024-09-20T19:05:48.404 INFO:tasks.workunit.client.1.smithi098.stdout:8/246: chown d7/de/d11/d1d/f56 0 1 2024-09-20T19:05:48.407 INFO:tasks.workunit.client.1.smithi098.stdout:2/422: mkdir d3/d16/d1d/d2b/d49/d69/d88/d8a 0 2024-09-20T19:05:48.407 INFO:tasks.workunit.client.0.smithi027.stdout:7/71: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:48.408 INFO:tasks.workunit.client.0.smithi027.stdout:0/79: dread f1 [0,4194304] 0 2024-09-20T19:05:48.409 INFO:tasks.workunit.client.0.smithi027.stdout:5/52: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:48.415 INFO:tasks.workunit.client.0.smithi027.stdout:5/53: dwrite d4/f6 [0,4194304] 0 2024-09-20T19:05:48.417 INFO:tasks.workunit.client.0.smithi027.stdout:5/54: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:48.424 INFO:tasks.workunit.client.1.smithi098.stdout:2/423: dread d3/d16/d1d/d2b/d49/f4d [0,4194304] 0 2024-09-20T19:05:48.424 INFO:tasks.workunit.client.1.smithi098.stdout:2/424: stat d3/d16/d1a/f27 0 2024-09-20T19:05:48.425 INFO:tasks.workunit.client.1.smithi098.stdout:2/425: truncate d3/f6d 329737 0 2024-09-20T19:05:48.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/426: rename d3/d16/d1d/d2b/d34 to d3/d16/d1d/d4f/d8b 0 2024-09-20T19:05:48.434 INFO:tasks.workunit.client.1.smithi098.stdout:2/427: dwrite d3/d16/f70 [0,4194304] 0 2024-09-20T19:05:48.436 INFO:tasks.workunit.client.1.smithi098.stdout:7/219: truncate d3/d10/d16/d17/d33/d1f/d2d/f31 1387929 0 2024-09-20T19:05:48.438 INFO:tasks.workunit.client.1.smithi098.stdout:8/247: truncate d7/de/d11/d1d/f1e 845863 0 2024-09-20T19:05:48.439 INFO:tasks.workunit.client.1.smithi098.stdout:2/428: dread d3/d16/d1d/d4f/d8b/f3e [0,4194304] 0 2024-09-20T19:05:48.444 INFO:tasks.workunit.client.1.smithi098.stdout:8/248: rename d7/de/d11/d19/d47/c5c to d7/de/d11/d19/d30/d59/c5f 0 2024-09-20T19:05:48.446 INFO:tasks.workunit.client.1.smithi098.stdout:2/429: mknod d3/d16/d1d/d2b/d49/d69/c8c 0 2024-09-20T19:05:48.448 INFO:tasks.workunit.client.1.smithi098.stdout:8/249: write d7/de/d11/d1f/f2a [3532790,75565] 0 2024-09-20T19:05:48.450 INFO:tasks.workunit.client.1.smithi098.stdout:2/430: creat d3/d16/d1d/d2b/d46/f8d x:0 0 0 2024-09-20T19:05:48.451 INFO:tasks.workunit.client.1.smithi098.stdout:2/431: write d3/df/d13/f29 [1619258,64195] 0 2024-09-20T19:05:48.456 INFO:tasks.workunit.client.1.smithi098.stdout:2/432: mknod d3/df/c8e 0 2024-09-20T19:05:48.456 INFO:tasks.workunit.client.1.smithi098.stdout:2/433: stat d3/d16/d1d/d2b 0 2024-09-20T19:05:48.457 INFO:tasks.workunit.client.1.smithi098.stdout:8/250: creat d7/de/d11/f60 x:0 0 0 2024-09-20T19:05:48.458 INFO:tasks.workunit.client.1.smithi098.stdout:2/434: unlink d3/d51/d68/f78 0 2024-09-20T19:05:48.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/435: dwrite d3/d16/d1d/d2b/d46/f8d [0,4194304] 0 2024-09-20T19:05:48.466 INFO:tasks.workunit.client.1.smithi098.stdout:2/436: readlink d3/d16/d1d/d4f/d8b/l66 0 2024-09-20T19:05:48.467 INFO:tasks.workunit.client.1.smithi098.stdout:2/437: fdatasync d3/d16/d1d/d2b/d49/f75 0 2024-09-20T19:05:48.472 INFO:tasks.workunit.client.1.smithi098.stdout:2/438: mknod d3/d51/c8f 0 2024-09-20T19:05:48.476 INFO:tasks.workunit.client.1.smithi098.stdout:2/439: rmdir d3/d16/d1d/d2b 39 2024-09-20T19:05:48.480 INFO:tasks.workunit.client.1.smithi098.stdout:2/440: dread d3/d16/d1d/d2b/d46/f6c [0,4194304] 0 2024-09-20T19:05:48.480 INFO:tasks.workunit.client.1.smithi098.stdout:2/441: chown d3/c43 102 1 2024-09-20T19:05:48.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/442: mknod d3/d16/d1d/d4f/d8b/d38/c90 0 2024-09-20T19:05:48.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/443: creat d3/d16/d1d/d2b/d46/d74/d7b/f91 x:0 0 0 2024-09-20T19:05:48.501 INFO:tasks.workunit.client.1.smithi098.stdout:8/251: dwrite d7/de/d11/d1f/f4b [0,4194304] 0 2024-09-20T19:05:48.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/252: link d7/f3a d7/f61 0 2024-09-20T19:05:48.511 INFO:tasks.workunit.client.1.smithi098.stdout:8/253: dread d7/de/d11/d19/f4c [0,4194304] 0 2024-09-20T19:05:48.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/254: creat d7/de/d11/d19/d30/f62 x:0 0 0 2024-09-20T19:05:48.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:48 smithi027 ceph-mon[28196]: pgmap v259: 65 pgs: 65 active+clean; 478 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 44 MiB/s wr, 295 op/s 2024-09-20T19:05:48.593 INFO:tasks.workunit.client.0.smithi027.stdout:3/106: creat d0/d1/d13/f27 x:0 0 0 2024-09-20T19:05:48.594 INFO:tasks.workunit.client.0.smithi027.stdout:1/72: symlink d2/l1d 0 2024-09-20T19:05:48.595 INFO:tasks.workunit.client.0.smithi027.stdout:4/34: creat d5/f8 x:0 0 0 2024-09-20T19:05:48.596 INFO:tasks.workunit.client.0.smithi027.stdout:2/37: unlink f2 0 2024-09-20T19:05:48.597 INFO:tasks.workunit.client.0.smithi027.stdout:1/73: write d2/d15/f16 [1656498,43549] 0 2024-09-20T19:05:48.597 INFO:tasks.workunit.client.0.smithi027.stdout:6/37: unlink d4/l5 0 2024-09-20T19:05:48.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/188: creat d0/d9/df/d1b/d1a/f36 x:0 0 0 2024-09-20T19:05:48.599 INFO:tasks.workunit.client.0.smithi027.stdout:8/74: dwrite d2/d3/f9 [0,4194304] 0 2024-09-20T19:05:48.602 INFO:tasks.workunit.client.0.smithi027.stdout:8/75: dread d2/f7 [0,4194304] 0 2024-09-20T19:05:48.607 INFO:tasks.workunit.client.0.smithi027.stdout:4/35: rename d5/f8 to d5/f9 0 2024-09-20T19:05:48.607 INFO:tasks.workunit.client.0.smithi027.stdout:5/55: dwrite d4/f7 [0,4194304] 0 2024-09-20T19:05:48.607 INFO:tasks.workunit.client.0.smithi027.stdout:5/56: readlink - no filename 2024-09-20T19:05:48.608 INFO:tasks.workunit.client.0.smithi027.stdout:5/57: write d4/f6 [3219765,38041] 0 2024-09-20T19:05:48.609 INFO:tasks.workunit.client.0.smithi027.stdout:2/38: creat d3/f9 x:0 0 0 2024-09-20T19:05:48.610 INFO:tasks.workunit.client.0.smithi027.stdout:6/38: symlink d4/l8 0 2024-09-20T19:05:48.610 INFO:tasks.workunit.client.0.smithi027.stdout:2/39: write d3/f9 [300319,80408] 0 2024-09-20T19:05:48.613 INFO:tasks.workunit.client.0.smithi027.stdout:9/189: creat d0/d2e/f37 x:0 0 0 2024-09-20T19:05:48.619 INFO:tasks.workunit.client.1.smithi098.stdout:8/255: dwrite d7/de/d11/d1d/f1e [0,4194304] 0 2024-09-20T19:05:48.720 INFO:tasks.workunit.client.0.smithi027.stdout:4/36: creat d5/fa x:0 0 0 2024-09-20T19:05:48.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:48 smithi098 ceph-mon[35737]: pgmap v259: 65 pgs: 65 active+clean; 478 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 44 MiB/s wr, 295 op/s 2024-09-20T19:05:48.725 INFO:tasks.workunit.client.0.smithi027.stdout:5/58: rename d4/f7 to d4/da/fb 0 2024-09-20T19:05:48.725 INFO:tasks.workunit.client.0.smithi027.stdout:2/40: chown c1 3 1 2024-09-20T19:05:48.726 INFO:tasks.workunit.client.0.smithi027.stdout:6/39: creat d4/f9 x:0 0 0 2024-09-20T19:05:48.727 INFO:tasks.workunit.client.0.smithi027.stdout:6/40: readlink d4/l8 0 2024-09-20T19:05:48.729 INFO:tasks.workunit.client.1.smithi098.stdout:8/256: getdents d7/de/d11/d1d 0 2024-09-20T19:05:48.731 INFO:tasks.workunit.client.0.smithi027.stdout:8/76: link d2/d3/fe d2/d15/f18 0 2024-09-20T19:05:48.732 INFO:tasks.workunit.client.0.smithi027.stdout:8/77: fsync d2/d3/d6/fc 0 2024-09-20T19:05:48.733 INFO:tasks.workunit.client.1.smithi098.stdout:8/257: dread d7/de/d11/d19/f2d [0,4194304] 0 2024-09-20T19:05:48.734 INFO:tasks.workunit.client.0.smithi027.stdout:5/59: creat d4/da/fc x:0 0 0 2024-09-20T19:05:48.737 INFO:tasks.workunit.client.0.smithi027.stdout:7/72: getdents d3/d8/da/dc 0 2024-09-20T19:05:48.738 INFO:tasks.workunit.client.0.smithi027.stdout:0/80: getdents d2/d14 0 2024-09-20T19:05:48.739 INFO:tasks.workunit.client.1.smithi098.stdout:8/258: dwrite d7/de/d11/f60 [0,4194304] 0 2024-09-20T19:05:48.739 INFO:tasks.workunit.client.0.smithi027.stdout:3/107: getdents d0/d1/d7 0 2024-09-20T19:05:48.742 INFO:tasks.workunit.client.0.smithi027.stdout:4/37: unlink l3 0 2024-09-20T19:05:48.742 INFO:tasks.workunit.client.0.smithi027.stdout:3/108: truncate d0/d1/fb 31017 0 2024-09-20T19:05:48.743 INFO:tasks.workunit.client.0.smithi027.stdout:2/41: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:48.746 INFO:tasks.workunit.client.0.smithi027.stdout:5/60: creat d4/fd x:0 0 0 2024-09-20T19:05:48.747 INFO:tasks.workunit.client.0.smithi027.stdout:5/61: fdatasync d4/f6 0 2024-09-20T19:05:48.748 INFO:tasks.workunit.client.0.smithi027.stdout:6/41: creat d4/d6/fa x:0 0 0 2024-09-20T19:05:48.750 INFO:tasks.workunit.client.0.smithi027.stdout:7/73: rename d3/d16/c17 to d3/d8/da/dc/c18 0 2024-09-20T19:05:48.752 INFO:tasks.workunit.client.0.smithi027.stdout:3/109: dwrite d0/d1/d7/d1d/f21 [0,4194304] 0 2024-09-20T19:05:48.754 INFO:tasks.workunit.client.1.smithi098.stdout:8/259: getdents d7/de/d11/d1f/d57 0 2024-09-20T19:05:48.758 INFO:tasks.workunit.client.1.smithi098.stdout:8/260: dread d7/de/d11/f60 [0,4194304] 0 2024-09-20T19:05:48.761 INFO:tasks.workunit.client.1.smithi098.stdout:8/261: rmdir d7/de/d11/d19 39 2024-09-20T19:05:48.764 INFO:tasks.workunit.client.1.smithi098.stdout:8/262: unlink d7/de/d11/c14 0 2024-09-20T19:05:48.765 INFO:tasks.workunit.client.0.smithi027.stdout:4/38: mknod d5/cb 0 2024-09-20T19:05:48.766 INFO:tasks.workunit.client.0.smithi027.stdout:8/78: symlink d2/d14/d13/l19 0 2024-09-20T19:05:48.768 INFO:tasks.workunit.client.0.smithi027.stdout:5/62: mkdir d4/da/de 0 2024-09-20T19:05:48.772 INFO:tasks.workunit.client.0.smithi027.stdout:6/42: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:48.772 INFO:tasks.workunit.client.0.smithi027.stdout:5/63: stat d4/da 0 2024-09-20T19:05:48.774 INFO:tasks.workunit.client.0.smithi027.stdout:4/39: mkdir d5/dc 0 2024-09-20T19:05:48.775 INFO:tasks.workunit.client.0.smithi027.stdout:0/81: dwrite f1 [0,4194304] 0 2024-09-20T19:05:48.779 INFO:tasks.workunit.client.0.smithi027.stdout:3/110: rename d0/le to d0/d1/d7/l28 0 2024-09-20T19:05:48.780 INFO:tasks.workunit.client.0.smithi027.stdout:7/74: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:48.781 INFO:tasks.workunit.client.0.smithi027.stdout:0/82: rename d2 to d2/d7/d1c 22 2024-09-20T19:05:48.783 INFO:tasks.workunit.client.0.smithi027.stdout:6/43: write d4/f7 [52346,102924] 0 2024-09-20T19:05:48.783 INFO:tasks.workunit.client.0.smithi027.stdout:3/111: stat d0/d1/d13/d15/l24 0 2024-09-20T19:05:48.785 INFO:tasks.workunit.client.0.smithi027.stdout:1/74: write d2/f13 [1143971,31252] 0 2024-09-20T19:05:48.785 INFO:tasks.workunit.client.0.smithi027.stdout:9/190: fsync d0/d2e/f37 0 2024-09-20T19:05:48.789 INFO:tasks.workunit.client.0.smithi027.stdout:1/75: chown d2/l7 551 1 2024-09-20T19:05:48.789 INFO:tasks.workunit.client.0.smithi027.stdout:0/83: mkdir d2/d14/d1d 0 2024-09-20T19:05:48.790 INFO:tasks.workunit.client.0.smithi027.stdout:5/64: dwrite d4/da/fc [0,4194304] 0 2024-09-20T19:05:48.792 INFO:tasks.workunit.client.0.smithi027.stdout:4/40: rmdir d5/dc 0 2024-09-20T19:05:48.794 INFO:tasks.workunit.client.0.smithi027.stdout:3/112: creat d0/d1/d13/d15/f29 x:0 0 0 2024-09-20T19:05:48.798 INFO:tasks.workunit.client.0.smithi027.stdout:6/44: link d4/f7 d4/d6/fb 0 2024-09-20T19:05:48.798 INFO:tasks.workunit.client.0.smithi027.stdout:4/41: symlink d5/ld 0 2024-09-20T19:05:48.800 INFO:tasks.workunit.client.0.smithi027.stdout:1/76: dwrite d2/d15/f16 [0,4194304] 0 2024-09-20T19:05:48.800 INFO:tasks.workunit.client.0.smithi027.stdout:4/42: dread - d5/f9 zero size 2024-09-20T19:05:48.800 INFO:tasks.workunit.client.0.smithi027.stdout:0/84: fdatasync d2/f10 0 2024-09-20T19:05:48.802 INFO:tasks.workunit.client.0.smithi027.stdout:0/85: readlink d2/d7/l11 0 2024-09-20T19:05:48.805 INFO:tasks.workunit.client.0.smithi027.stdout:6/45: symlink d4/lc 0 2024-09-20T19:05:48.807 INFO:tasks.workunit.client.0.smithi027.stdout:3/113: truncate d0/f2 1452934 0 2024-09-20T19:05:48.808 INFO:tasks.workunit.client.0.smithi027.stdout:4/43: write f4 [3638574,60007] 0 2024-09-20T19:05:48.809 INFO:tasks.workunit.client.0.smithi027.stdout:1/77: dread d2/d15/f16 [0,4194304] 0 2024-09-20T19:05:48.809 INFO:tasks.workunit.client.0.smithi027.stdout:3/114: dread - d0/d1/d13/f27 zero size 2024-09-20T19:05:48.811 INFO:tasks.workunit.client.0.smithi027.stdout:9/191: creat d0/d9/df/d1b/d1a/dd/f38 x:0 0 0 2024-09-20T19:05:48.811 INFO:tasks.workunit.client.0.smithi027.stdout:0/86: dread d2/f19 [0,4194304] 0 2024-09-20T19:05:48.811 INFO:tasks.workunit.client.0.smithi027.stdout:3/115: chown d0/d1/d7/c1b 219792125 1 2024-09-20T19:05:48.812 INFO:tasks.workunit.client.0.smithi027.stdout:6/46: fdatasync d4/f7 0 2024-09-20T19:05:48.814 INFO:tasks.workunit.client.0.smithi027.stdout:9/192: write d0/d9/df/d1b/d1a/dd/f10 [5249466,29753] 0 2024-09-20T19:05:48.814 INFO:tasks.workunit.client.0.smithi027.stdout:6/47: dread - d4/f9 zero size 2024-09-20T19:05:48.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/263: write d7/de/d11/d19/f4e [3607049,126423] 0 2024-09-20T19:05:48.816 INFO:tasks.workunit.client.0.smithi027.stdout:7/75: rmdir d3/d16 0 2024-09-20T19:05:48.821 INFO:tasks.workunit.client.1.smithi098.stdout:8/264: link d7/de/d11/d1f/f4b d7/de/d11/d19/d47/f63 0 2024-09-20T19:05:48.822 INFO:tasks.workunit.client.0.smithi027.stdout:1/78: dwrite d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:48.823 INFO:tasks.workunit.client.1.smithi098.stdout:8/265: write d7/de/d11/d19/d30/f62 [933774,26573] 0 2024-09-20T19:05:48.824 INFO:tasks.workunit.client.0.smithi027.stdout:3/116: mknod d0/d1/c2a 0 2024-09-20T19:05:48.825 INFO:tasks.workunit.client.1.smithi098.stdout:8/266: symlink d7/de/d11/d19/l64 0 2024-09-20T19:05:48.827 INFO:tasks.workunit.client.0.smithi027.stdout:8/79: dwrite d2/f7 [0,4194304] 0 2024-09-20T19:05:48.834 INFO:tasks.workunit.client.0.smithi027.stdout:8/80: creat d2/d3/d6/f1a x:0 0 0 2024-09-20T19:05:48.835 INFO:tasks.workunit.client.0.smithi027.stdout:3/117: fdatasync d0/f2 0 2024-09-20T19:05:48.836 INFO:tasks.workunit.client.0.smithi027.stdout:3/118: readlink d0/l8 0 2024-09-20T19:05:48.837 INFO:tasks.workunit.client.0.smithi027.stdout:7/76: dwrite f1 [0,4194304] 0 2024-09-20T19:05:48.838 INFO:tasks.workunit.client.0.smithi027.stdout:3/119: fsync d0/f12 0 2024-09-20T19:05:48.838 INFO:tasks.workunit.client.0.smithi027.stdout:9/193: getdents d0/d2e 0 2024-09-20T19:05:48.839 INFO:tasks.workunit.client.0.smithi027.stdout:8/81: mkdir d2/d3/d1b 0 2024-09-20T19:05:48.840 INFO:tasks.workunit.client.0.smithi027.stdout:0/87: write f1 [5223277,36595] 0 2024-09-20T19:05:48.841 INFO:tasks.workunit.client.0.smithi027.stdout:3/120: dread - d0/d1/d13/f27 zero size 2024-09-20T19:05:48.842 INFO:tasks.workunit.client.0.smithi027.stdout:9/194: dread - d0/d9/df/d1b/d1a/dd/f29 zero size 2024-09-20T19:05:48.842 INFO:tasks.workunit.client.0.smithi027.stdout:8/82: unlink d2/d3/c16 0 2024-09-20T19:05:48.843 INFO:tasks.workunit.client.0.smithi027.stdout:0/88: dread d2/f10 [0,4194304] 0 2024-09-20T19:05:48.846 INFO:tasks.workunit.client.0.smithi027.stdout:3/121: dread d0/d1/d7/f10 [0,4194304] 0 2024-09-20T19:05:48.850 INFO:tasks.workunit.client.0.smithi027.stdout:8/83: dread d2/f7 [0,4194304] 0 2024-09-20T19:05:48.850 INFO:tasks.workunit.client.0.smithi027.stdout:9/195: dread d0/d9/df/f21 [0,4194304] 0 2024-09-20T19:05:48.851 INFO:tasks.workunit.client.0.smithi027.stdout:3/122: creat d0/d1/d13/d15/f2b x:0 0 0 2024-09-20T19:05:48.851 INFO:tasks.workunit.client.1.smithi098.stdout:6/101: sync 2024-09-20T19:05:48.852 INFO:tasks.workunit.client.1.smithi098.stdout:0/102: sync 2024-09-20T19:05:48.852 INFO:tasks.workunit.client.0.smithi027.stdout:0/89: mknod d2/d14/d1d/c1e 0 2024-09-20T19:05:48.852 INFO:tasks.workunit.client.0.smithi027.stdout:0/90: fdatasync d2/d7/f15 0 2024-09-20T19:05:48.853 INFO:tasks.workunit.client.1.smithi098.stdout:6/102: read d0/d7/dc/f11 [539180,20156] 0 2024-09-20T19:05:48.853 INFO:tasks.workunit.client.0.smithi027.stdout:0/91: fdatasync d2/f12 0 2024-09-20T19:05:48.853 INFO:tasks.workunit.client.0.smithi027.stdout:4/44: unlink d5/l7 0 2024-09-20T19:05:48.854 INFO:tasks.workunit.client.1.smithi098.stdout:6/103: write d0/f8 [5678210,88558] 0 2024-09-20T19:05:48.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/103: creat d0/db/f20 x:0 0 0 2024-09-20T19:05:48.856 INFO:tasks.workunit.client.1.smithi098.stdout:0/104: truncate d0/d15/f1e 402658 0 2024-09-20T19:05:48.859 INFO:tasks.workunit.client.0.smithi027.stdout:7/77: truncate d3/d8/da/f11 2453833 0 2024-09-20T19:05:48.859 INFO:tasks.workunit.client.1.smithi098.stdout:6/104: truncate d0/d7/dc/fd 524316 0 2024-09-20T19:05:48.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/105: fsync d0/f5 0 2024-09-20T19:05:48.861 INFO:tasks.workunit.client.1.smithi098.stdout:0/105: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:48.861 INFO:tasks.workunit.client.0.smithi027.stdout:0/92: symlink d2/d14/l1f 0 2024-09-20T19:05:48.861 INFO:tasks.workunit.client.0.smithi027.stdout:3/123: dwrite d0/d1/d13/f1c [0,4194304] 0 2024-09-20T19:05:48.862 INFO:tasks.workunit.client.0.smithi027.stdout:0/93: read d2/f9 [7832804,115663] 0 2024-09-20T19:05:48.862 INFO:tasks.workunit.client.1.smithi098.stdout:0/106: dread - d0/db/f17 zero size 2024-09-20T19:05:48.862 INFO:tasks.workunit.client.1.smithi098.stdout:8/267: dread d7/f1c [0,4194304] 0 2024-09-20T19:05:48.864 INFO:tasks.workunit.client.1.smithi098.stdout:8/268: fdatasync d7/de/d11/d19/f4e 0 2024-09-20T19:05:48.867 INFO:tasks.workunit.client.1.smithi098.stdout:0/107: truncate d0/db/fd 805577 0 2024-09-20T19:05:48.869 INFO:tasks.workunit.client.1.smithi098.stdout:0/108: write d0/d6/d19/f10 [2403948,105283] 0 2024-09-20T19:05:48.870 INFO:tasks.workunit.client.1.smithi098.stdout:0/109: write d0/f3 [2211254,40020] 0 2024-09-20T19:05:48.874 INFO:tasks.workunit.client.0.smithi027.stdout:7/78: mknod d3/c19 0 2024-09-20T19:05:48.878 INFO:tasks.workunit.client.0.smithi027.stdout:3/124: dwrite d0/d19/f1a [0,4194304] 0 2024-09-20T19:05:48.879 INFO:tasks.workunit.client.1.smithi098.stdout:8/269: mkdir d7/de/d11/d65 0 2024-09-20T19:05:48.881 INFO:tasks.workunit.client.0.smithi027.stdout:0/94: mkdir d2/d20 0 2024-09-20T19:05:48.883 INFO:tasks.workunit.client.1.smithi098.stdout:6/106: dread d0/d7/f13 [0,4194304] 0 2024-09-20T19:05:48.884 INFO:tasks.workunit.client.1.smithi098.stdout:6/107: chown d0/f15 21460455 1 2024-09-20T19:05:48.885 INFO:tasks.workunit.client.0.smithi027.stdout:9/196: truncate d0/d9/df/d1b/f17 3407405 0 2024-09-20T19:05:48.886 INFO:tasks.workunit.client.1.smithi098.stdout:8/270: creat d7/de/d11/d19/d30/d55/f66 x:0 0 0 2024-09-20T19:05:48.887 INFO:tasks.workunit.client.0.smithi027.stdout:3/125: creat d0/d1/d7/f2c x:0 0 0 2024-09-20T19:05:48.887 INFO:tasks.workunit.client.0.smithi027.stdout:4/45: truncate f4 3921790 0 2024-09-20T19:05:48.887 INFO:tasks.workunit.client.0.smithi027.stdout:9/197: write d0/f5 [1463239,80847] 0 2024-09-20T19:05:48.888 INFO:tasks.workunit.client.0.smithi027.stdout:2/42: sync 2024-09-20T19:05:48.889 INFO:tasks.workunit.client.0.smithi027.stdout:3/126: write d0/f11 [4335063,46014] 0 2024-09-20T19:05:48.889 INFO:tasks.workunit.client.0.smithi027.stdout:7/79: mkdir d3/d1a 0 2024-09-20T19:05:48.890 INFO:tasks.workunit.client.0.smithi027.stdout:0/95: dread d2/f19 [0,4194304] 0 2024-09-20T19:05:48.890 INFO:tasks.workunit.client.1.smithi098.stdout:6/108: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:48.891 INFO:tasks.workunit.client.0.smithi027.stdout:9/198: read - d0/d9/df/d1b/d1a/f36 zero size 2024-09-20T19:05:48.891 INFO:tasks.workunit.client.1.smithi098.stdout:6/109: stat d0/d7/cb 0 2024-09-20T19:05:48.893 INFO:tasks.workunit.client.1.smithi098.stdout:6/110: write d0/de/f18 [2372045,37856] 0 2024-09-20T19:05:48.895 INFO:tasks.workunit.client.1.smithi098.stdout:6/111: write d0/d7/dc/f1a [4948371,50592] 0 2024-09-20T19:05:48.896 INFO:tasks.workunit.client.1.smithi098.stdout:6/112: write d0/de/f18 [1774187,54390] 0 2024-09-20T19:05:48.897 INFO:tasks.workunit.client.1.smithi098.stdout:6/113: chown d0/d7 162034 1 2024-09-20T19:05:48.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/114: truncate d0/d7/ff 4583183 0 2024-09-20T19:05:48.900 INFO:tasks.workunit.client.0.smithi027.stdout:2/43: creat d3/fa x:0 0 0 2024-09-20T19:05:48.904 INFO:tasks.workunit.client.0.smithi027.stdout:3/127: symlink d0/d1/l2d 0 2024-09-20T19:05:48.906 INFO:tasks.workunit.client.0.smithi027.stdout:7/80: unlink d3/d8/fd 0 2024-09-20T19:05:48.910 INFO:tasks.workunit.client.0.smithi027.stdout:9/199: creat d0/f39 x:0 0 0 2024-09-20T19:05:48.910 INFO:tasks.workunit.client.0.smithi027.stdout:2/44: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:48.913 INFO:tasks.workunit.client.0.smithi027.stdout:2/45: rename d3 to d3/db 22 2024-09-20T19:05:48.915 INFO:tasks.workunit.client.0.smithi027.stdout:3/128: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:48.915 INFO:tasks.workunit.client.0.smithi027.stdout:2/46: truncate d3/fa 372909 0 2024-09-20T19:05:48.916 INFO:tasks.workunit.client.0.smithi027.stdout:0/96: symlink d2/d14/l21 0 2024-09-20T19:05:48.917 INFO:tasks.workunit.client.0.smithi027.stdout:3/129: fdatasync d0/d1/d13/f1c 0 2024-09-20T19:05:48.920 INFO:tasks.workunit.client.0.smithi027.stdout:2/47: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:48.921 INFO:tasks.workunit.client.0.smithi027.stdout:2/48: dread d3/fa [0,4194304] 0 2024-09-20T19:05:48.922 INFO:tasks.workunit.client.1.smithi098.stdout:8/271: dread d7/de/d11/d19/f36 [0,4194304] 0 2024-09-20T19:05:48.925 INFO:tasks.workunit.client.1.smithi098.stdout:8/272: truncate d7/f61 983377 0 2024-09-20T19:05:48.928 INFO:tasks.workunit.client.1.smithi098.stdout:8/273: mknod d7/de/d11/d19/d30/d59/c67 0 2024-09-20T19:05:48.931 INFO:tasks.workunit.client.1.smithi098.stdout:6/115: dread d0/d7/ff [0,4194304] 0 2024-09-20T19:05:48.932 INFO:tasks.workunit.client.0.smithi027.stdout:4/46: creat d5/fe x:0 0 0 2024-09-20T19:05:48.932 INFO:tasks.workunit.client.1.smithi098.stdout:8/274: mkdir d7/de/d11/d19/d30/d68 0 2024-09-20T19:05:48.933 INFO:tasks.workunit.client.1.smithi098.stdout:8/275: chown d7/de/d11/l17 27 1 2024-09-20T19:05:48.934 INFO:tasks.workunit.client.0.smithi027.stdout:3/130: unlink d0/l8 0 2024-09-20T19:05:48.937 INFO:tasks.workunit.client.0.smithi027.stdout:2/49: mkdir d3/dc 0 2024-09-20T19:05:48.937 INFO:tasks.workunit.client.1.smithi098.stdout:8/276: creat d7/de/d11/d19/d30/d55/f69 x:0 0 0 2024-09-20T19:05:48.938 INFO:tasks.workunit.client.0.smithi027.stdout:9/200: mknod d0/d9/df/d1b/d1a/dd/c3a 0 2024-09-20T19:05:48.939 INFO:tasks.workunit.client.0.smithi027.stdout:3/131: dread d0/d1/d7/d1d/f21 [0,4194304] 0 2024-09-20T19:05:48.940 INFO:tasks.workunit.client.0.smithi027.stdout:4/47: dread - d5/f9 zero size 2024-09-20T19:05:48.940 INFO:tasks.workunit.client.0.smithi027.stdout:3/132: write d0/d1/d13/d15/f29 [97420,32392] 0 2024-09-20T19:05:48.942 INFO:tasks.workunit.client.0.smithi027.stdout:3/133: truncate d0/d1/d7/f1e 5197664 0 2024-09-20T19:05:48.943 INFO:tasks.workunit.client.0.smithi027.stdout:3/134: fsync d0/d1/d13/f22 0 2024-09-20T19:05:48.944 INFO:tasks.workunit.client.0.smithi027.stdout:9/201: mknod d0/d9/df/c3b 0 2024-09-20T19:05:48.945 INFO:tasks.workunit.client.0.smithi027.stdout:9/202: stat d0/d9/f28 0 2024-09-20T19:05:48.946 INFO:tasks.workunit.client.0.smithi027.stdout:3/135: creat d0/d1/f2e x:0 0 0 2024-09-20T19:05:48.946 INFO:tasks.workunit.client.0.smithi027.stdout:4/48: symlink d5/lf 0 2024-09-20T19:05:48.949 INFO:tasks.workunit.client.0.smithi027.stdout:3/136: mknod d0/d19/c2f 0 2024-09-20T19:05:48.949 INFO:tasks.workunit.client.0.smithi027.stdout:2/50: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:48.950 INFO:tasks.workunit.client.0.smithi027.stdout:3/137: dread d0/d1/fb [0,4194304] 0 2024-09-20T19:05:48.951 INFO:tasks.workunit.client.0.smithi027.stdout:2/51: dread d3/fa [0,4194304] 0 2024-09-20T19:05:48.953 INFO:tasks.workunit.client.1.smithi098.stdout:8/277: dread d7/fd [0,4194304] 0 2024-09-20T19:05:48.954 INFO:tasks.workunit.client.0.smithi027.stdout:7/81: dread d3/d8/da/f11 [0,4194304] 0 2024-09-20T19:05:48.955 INFO:tasks.workunit.client.0.smithi027.stdout:4/49: rename d5/f9 to d5/f10 0 2024-09-20T19:05:48.956 INFO:tasks.workunit.client.0.smithi027.stdout:4/50: dread - d5/f10 zero size 2024-09-20T19:05:48.957 INFO:tasks.workunit.client.0.smithi027.stdout:4/51: dread - d5/f10 zero size 2024-09-20T19:05:48.958 INFO:tasks.workunit.client.0.smithi027.stdout:7/82: dread d3/d8/da/f11 [0,4194304] 0 2024-09-20T19:05:48.959 INFO:tasks.workunit.client.0.smithi027.stdout:3/138: creat d0/d1/f30 x:0 0 0 2024-09-20T19:05:48.959 INFO:tasks.workunit.client.1.smithi098.stdout:8/278: creat d7/de/d11/d19/d30/d68/f6a x:0 0 0 2024-09-20T19:05:48.961 INFO:tasks.workunit.client.0.smithi027.stdout:9/203: link d0/d9/df/d1c/c26 d0/d9/df/d1b/d1a/c3c 0 2024-09-20T19:05:48.963 INFO:tasks.workunit.client.0.smithi027.stdout:7/83: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:48.964 INFO:tasks.workunit.client.0.smithi027.stdout:4/52: fsync d5/fa 0 2024-09-20T19:05:48.965 INFO:tasks.workunit.client.0.smithi027.stdout:3/139: symlink d0/d1/d7/d1d/l31 0 2024-09-20T19:05:48.965 INFO:tasks.workunit.client.0.smithi027.stdout:4/53: truncate d5/f10 107520 0 2024-09-20T19:05:48.966 INFO:tasks.workunit.client.0.smithi027.stdout:4/54: dread - d5/fe zero size 2024-09-20T19:05:48.966 INFO:tasks.workunit.client.0.smithi027.stdout:4/55: dread - d5/fa zero size 2024-09-20T19:05:48.967 INFO:tasks.workunit.client.1.smithi098.stdout:8/279: creat d7/de/d11/f6b x:0 0 0 2024-09-20T19:05:48.967 INFO:tasks.workunit.client.1.smithi098.stdout:8/280: write d7/de/d35/f5a [3756635,67084] 0 2024-09-20T19:05:48.969 INFO:tasks.workunit.client.0.smithi027.stdout:2/52: rmdir d3/dc 0 2024-09-20T19:05:48.972 INFO:tasks.workunit.client.0.smithi027.stdout:7/84: getdents d3/d1a 0 2024-09-20T19:05:48.973 INFO:tasks.workunit.client.0.smithi027.stdout:2/53: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:48.974 INFO:tasks.workunit.client.0.smithi027.stdout:7/85: write d3/d8/da/f13 [2958928,55360] 0 2024-09-20T19:05:48.976 INFO:tasks.workunit.client.0.smithi027.stdout:2/54: rmdir d3 39 2024-09-20T19:05:48.977 INFO:tasks.workunit.client.0.smithi027.stdout:7/86: mkdir d3/d8/d1b 0 2024-09-20T19:05:48.985 INFO:tasks.workunit.client.1.smithi098.stdout:8/281: dwrite d7/f3a [0,4194304] 0 2024-09-20T19:05:48.987 INFO:tasks.workunit.client.1.smithi098.stdout:8/282: getdents d7/de/d11/d1f/d57 0 2024-09-20T19:05:48.988 INFO:tasks.workunit.client.1.smithi098.stdout:8/283: dread - d7/de/d11/d19/d30/d55/f69 zero size 2024-09-20T19:05:48.991 INFO:tasks.workunit.client.1.smithi098.stdout:8/284: creat d7/de/d11/d19/d30/d68/f6c x:0 0 0 2024-09-20T19:05:48.993 INFO:tasks.workunit.client.1.smithi098.stdout:1/78: sync 2024-09-20T19:05:48.993 INFO:tasks.workunit.client.1.smithi098.stdout:4/177: sync 2024-09-20T19:05:48.993 INFO:tasks.workunit.client.1.smithi098.stdout:9/249: sync 2024-09-20T19:05:48.993 INFO:tasks.workunit.client.1.smithi098.stdout:8/285: getdents d7/de/d11/d65 0 2024-09-20T19:05:48.994 INFO:tasks.workunit.client.1.smithi098.stdout:1/79: mknod d1/c12 0 2024-09-20T19:05:48.995 INFO:tasks.workunit.client.1.smithi098.stdout:1/80: stat d1/d3 0 2024-09-20T19:05:48.995 INFO:tasks.workunit.client.1.smithi098.stdout:1/81: dread - d1/d3/fd zero size 2024-09-20T19:05:48.997 INFO:tasks.workunit.client.1.smithi098.stdout:9/250: creat d4/de/d27/d39/f53 x:0 0 0 2024-09-20T19:05:48.998 INFO:tasks.workunit.client.1.smithi098.stdout:4/178: mknod d3/d6/d33/d3c/c3d 0 2024-09-20T19:05:48.999 INFO:tasks.workunit.client.1.smithi098.stdout:1/82: rename d1/d3/l8 to d1/l13 0 2024-09-20T19:05:48.999 INFO:tasks.workunit.client.1.smithi098.stdout:1/83: chown d1/f10 39188 1 2024-09-20T19:05:49.000 INFO:tasks.workunit.client.1.smithi098.stdout:9/251: stat d4/de/c33 0 2024-09-20T19:05:49.003 INFO:tasks.workunit.client.1.smithi098.stdout:9/252: symlink d4/de/d24/d35/d2d/l54 0 2024-09-20T19:05:49.005 INFO:tasks.workunit.client.1.smithi098.stdout:8/286: dwrite d7/de/d11/d1f/f4d [4194304,4194304] 0 2024-09-20T19:05:49.006 INFO:tasks.workunit.client.1.smithi098.stdout:9/253: dread - d4/de/d27/d4a/d21/f36 zero size 2024-09-20T19:05:49.011 INFO:tasks.workunit.client.1.smithi098.stdout:9/254: fsync d4/de/d27/d4a/d21/f36 0 2024-09-20T19:05:49.012 INFO:tasks.workunit.client.1.smithi098.stdout:9/255: chown d4/f10 83430559 1 2024-09-20T19:05:49.014 INFO:tasks.workunit.client.1.smithi098.stdout:8/287: dwrite d7/de/d11/d1d/f3e [0,4194304] 0 2024-09-20T19:05:49.015 INFO:tasks.workunit.client.1.smithi098.stdout:8/288: fsync d7/de/d11/d19/d30/d68/f6a 0 2024-09-20T19:05:49.016 INFO:tasks.workunit.client.1.smithi098.stdout:9/256: creat d4/de/d27/d4a/d21/d25/d51/f55 x:0 0 0 2024-09-20T19:05:49.019 INFO:tasks.workunit.client.1.smithi098.stdout:8/289: symlink d7/de/d11/d1f/l6d 0 2024-09-20T19:05:49.027 INFO:tasks.workunit.client.1.smithi098.stdout:4/179: dread d3/d6/f10 [0,4194304] 0 2024-09-20T19:05:49.028 INFO:tasks.workunit.client.0.smithi027.stdout:5/65: sync 2024-09-20T19:05:49.029 INFO:tasks.workunit.client.1.smithi098.stdout:8/290: dwrite d7/de/f54 [0,4194304] 0 2024-09-20T19:05:49.030 INFO:tasks.workunit.client.1.smithi098.stdout:4/180: read - d3/f36 zero size 2024-09-20T19:05:49.034 INFO:tasks.workunit.client.1.smithi098.stdout:9/257: dread d4/de/d27/d4a/d21/d25/f26 [0,4194304] 0 2024-09-20T19:05:49.035 INFO:tasks.workunit.client.1.smithi098.stdout:4/181: rename d3/d6/d33 to d3/d6/d3e 0 2024-09-20T19:05:49.035 INFO:tasks.workunit.client.1.smithi098.stdout:9/258: chown d4/de/d24/d35/c20 15 1 2024-09-20T19:05:49.039 INFO:tasks.workunit.client.1.smithi098.stdout:9/259: symlink d4/de/d24/l56 0 2024-09-20T19:05:49.041 INFO:tasks.workunit.client.1.smithi098.stdout:9/260: mknod d4/de/d24/d35/c57 0 2024-09-20T19:05:49.042 INFO:tasks.workunit.client.1.smithi098.stdout:9/261: dread - d4/de/d27/d4a/d21/f46 zero size 2024-09-20T19:05:49.043 INFO:tasks.workunit.client.1.smithi098.stdout:9/262: chown d4/f47 72897652 1 2024-09-20T19:05:49.044 INFO:tasks.workunit.client.1.smithi098.stdout:8/291: truncate d7/de/f54 4182621 0 2024-09-20T19:05:49.046 INFO:tasks.workunit.client.1.smithi098.stdout:9/263: mkdir d4/de/d27/d4a/d58 0 2024-09-20T19:05:49.050 INFO:tasks.workunit.client.1.smithi098.stdout:9/264: rename d4/de/f3a to d4/de/d27/d4a/d21/d25/f59 0 2024-09-20T19:05:49.053 INFO:tasks.workunit.client.1.smithi098.stdout:8/292: truncate d7/de/d11/d19/f4e 2011229 0 2024-09-20T19:05:49.055 INFO:tasks.workunit.client.1.smithi098.stdout:8/293: write d7/de/d11/d19/d30/d55/f69 [825076,62371] 0 2024-09-20T19:05:49.055 INFO:tasks.workunit.client.1.smithi098.stdout:9/265: rmdir d4/de/d24 39 2024-09-20T19:05:49.057 INFO:tasks.workunit.client.1.smithi098.stdout:8/294: creat d7/f6e x:0 0 0 2024-09-20T19:05:49.060 INFO:tasks.workunit.client.1.smithi098.stdout:8/295: unlink d7/f41 0 2024-09-20T19:05:49.061 INFO:tasks.workunit.client.1.smithi098.stdout:8/296: write d7/de/d11/d1d/f56 [844420,49771] 0 2024-09-20T19:05:49.062 INFO:tasks.workunit.client.1.smithi098.stdout:9/266: creat d4/de/d27/d39/f5a x:0 0 0 2024-09-20T19:05:49.063 INFO:tasks.workunit.client.1.smithi098.stdout:8/297: rmdir d7/de/d11/d19 39 2024-09-20T19:05:49.066 INFO:tasks.workunit.client.0.smithi027.stdout:9/204: write d0/fa [1668954,120259] 0 2024-09-20T19:05:49.067 INFO:tasks.workunit.client.0.smithi027.stdout:7/87: readlink d3/d8/da/dc/l15 0 2024-09-20T19:05:49.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/298: creat d7/de/d11/d19/d30/f6f x:0 0 0 2024-09-20T19:05:49.069 INFO:tasks.workunit.client.1.smithi098.stdout:9/267: dwrite d4/de/d27/d4a/d21/d25/d51/f55 [0,4194304] 0 2024-09-20T19:05:49.072 INFO:tasks.workunit.client.1.smithi098.stdout:9/268: fsync d4/de/f29 0 2024-09-20T19:05:49.073 INFO:tasks.workunit.client.0.smithi027.stdout:5/66: symlink d4/da/de/lf 0 2024-09-20T19:05:49.076 INFO:tasks.workunit.client.0.smithi027.stdout:9/205: dwrite d0/fa [0,4194304] 0 2024-09-20T19:05:49.076 INFO:tasks.workunit.client.1.smithi098.stdout:8/299: rename d7/de/d11/d1f/f4b to d7/de/d11/d19/d30/f70 0 2024-09-20T19:05:49.077 INFO:tasks.workunit.client.1.smithi098.stdout:8/300: chown d7/de/d11/d19 128559648 1 2024-09-20T19:05:49.080 INFO:tasks.workunit.client.0.smithi027.stdout:7/88: getdents d3/d8/d1b 0 2024-09-20T19:05:49.081 INFO:tasks.workunit.client.1.smithi098.stdout:9/269: unlink d4/de/d27/d4a/f3b 0 2024-09-20T19:05:49.083 INFO:tasks.workunit.client.0.smithi027.stdout:5/67: creat d4/f10 x:0 0 0 2024-09-20T19:05:49.084 INFO:tasks.workunit.client.0.smithi027.stdout:5/68: stat d4/da/de 0 2024-09-20T19:05:49.084 INFO:tasks.workunit.client.0.smithi027.stdout:4/56: write f4 [29037,93441] 0 2024-09-20T19:05:49.085 INFO:tasks.workunit.client.0.smithi027.stdout:2/55: link d3/l6 d3/ld 0 2024-09-20T19:05:49.085 INFO:tasks.workunit.client.0.smithi027.stdout:5/69: stat d4/da/de 0 2024-09-20T19:05:49.088 INFO:tasks.workunit.client.0.smithi027.stdout:9/206: unlink d0/d9/df/d1b/d1a/dd/f25 0 2024-09-20T19:05:49.089 INFO:tasks.workunit.client.0.smithi027.stdout:2/56: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:49.090 INFO:tasks.workunit.client.0.smithi027.stdout:7/89: unlink f1 0 2024-09-20T19:05:49.093 INFO:tasks.workunit.client.1.smithi098.stdout:9/270: mkdir d4/de/d27/d4a/d58/d5b 0 2024-09-20T19:05:49.095 INFO:tasks.workunit.client.1.smithi098.stdout:8/301: rename d7/de/d11/d19/f53 to d7/de/d11/f71 0 2024-09-20T19:05:49.097 INFO:tasks.workunit.client.0.smithi027.stdout:5/70: creat d4/f11 x:0 0 0 2024-09-20T19:05:49.100 INFO:tasks.workunit.client.0.smithi027.stdout:9/207: mkdir d0/d9/d3d 0 2024-09-20T19:05:49.103 INFO:tasks.workunit.client.1.smithi098.stdout:8/302: mkdir d7/de/d11/d1f/d57/d72 0 2024-09-20T19:05:49.104 INFO:tasks.workunit.client.0.smithi027.stdout:2/57: fsync d3/fa 0 2024-09-20T19:05:49.106 INFO:tasks.workunit.client.0.smithi027.stdout:7/90: mkdir d3/d8/d1c 0 2024-09-20T19:05:49.107 INFO:tasks.workunit.client.1.smithi098.stdout:8/303: creat d7/de/d11/d19/d47/f73 x:0 0 0 2024-09-20T19:05:49.108 INFO:tasks.workunit.client.0.smithi027.stdout:4/57: mkdir d5/d11 0 2024-09-20T19:05:49.111 INFO:tasks.workunit.client.1.smithi098.stdout:8/304: symlink d7/de/d11/d1f/l74 0 2024-09-20T19:05:49.113 INFO:tasks.workunit.client.0.smithi027.stdout:5/71: unlink d4/f6 0 2024-09-20T19:05:49.113 INFO:tasks.workunit.client.1.smithi098.stdout:9/271: link f3 d4/de/d24/d35/f5c 0 2024-09-20T19:05:49.116 INFO:tasks.workunit.client.1.smithi098.stdout:8/305: rename d7/de/f48 to d7/de/d11/d1f/d57/d72/f75 0 2024-09-20T19:05:49.118 INFO:tasks.workunit.client.1.smithi098.stdout:9/272: symlink d4/de/d24/d35/d2d/l5d 0 2024-09-20T19:05:49.124 INFO:tasks.workunit.client.1.smithi098.stdout:8/306: dread d7/de/d11/d19/f4e [0,4194304] 0 2024-09-20T19:05:49.124 INFO:tasks.workunit.client.0.smithi027.stdout:2/58: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:49.125 INFO:tasks.workunit.client.0.smithi027.stdout:5/72: fdatasync d4/da/fb 0 2024-09-20T19:05:49.127 INFO:tasks.workunit.client.0.smithi027.stdout:7/91: dwrite d3/f5 [4194304,4194304] 0 2024-09-20T19:05:49.129 INFO:tasks.workunit.client.1.smithi098.stdout:8/307: rmdir d7/de/d11/d19/d30/d68 39 2024-09-20T19:05:49.133 INFO:tasks.workunit.client.0.smithi027.stdout:4/58: mknod d5/c12 0 2024-09-20T19:05:49.135 INFO:tasks.workunit.client.1.smithi098.stdout:8/308: write d7/de/d11/d19/f36 [2103223,74660] 0 2024-09-20T19:05:49.135 INFO:tasks.workunit.client.0.smithi027.stdout:2/59: write d3/fa [391935,18639] 0 2024-09-20T19:05:49.138 INFO:tasks.workunit.client.0.smithi027.stdout:7/92: creat d3/d8/da/dc/f1d x:0 0 0 2024-09-20T19:05:49.138 INFO:tasks.workunit.client.1.smithi098.stdout:9/273: truncate d4/f10 82841 0 2024-09-20T19:05:49.140 INFO:tasks.workunit.client.0.smithi027.stdout:2/60: mkdir d3/de 0 2024-09-20T19:05:49.142 INFO:tasks.workunit.client.1.smithi098.stdout:8/309: rename d7/de/d11/d19/d30/c34 to d7/de/d11/d1f/c76 0 2024-09-20T19:05:49.143 INFO:tasks.workunit.client.0.smithi027.stdout:6/48: sync 2024-09-20T19:05:49.143 INFO:tasks.workunit.client.1.smithi098.stdout:9/274: mknod d4/de/d24/d35/c5e 0 2024-09-20T19:05:49.145 INFO:tasks.workunit.client.0.smithi027.stdout:9/208: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:05:49.153 INFO:tasks.workunit.client.0.smithi027.stdout:4/59: dwrite d5/f10 [0,4194304] 0 2024-09-20T19:05:49.165 INFO:tasks.workunit.client.0.smithi027.stdout:6/49: dwrite d4/d6/fb [0,4194304] 0 2024-09-20T19:05:49.169 INFO:tasks.workunit.client.0.smithi027.stdout:4/60: dwrite d5/fe [0,4194304] 0 2024-09-20T19:05:49.194 INFO:tasks.workunit.client.0.smithi027.stdout:8/84: sync 2024-09-20T19:05:49.194 INFO:tasks.workunit.client.0.smithi027.stdout:1/79: sync 2024-09-20T19:05:49.194 INFO:tasks.workunit.client.0.smithi027.stdout:0/97: sync 2024-09-20T19:05:49.194 INFO:tasks.workunit.client.0.smithi027.stdout:3/140: sync 2024-09-20T19:05:49.201 INFO:tasks.workunit.client.0.smithi027.stdout:1/80: dread d2/d8/f9 [0,4194304] 0 2024-09-20T19:05:49.202 INFO:tasks.workunit.client.0.smithi027.stdout:3/141: dwrite d0/f11 [0,4194304] 0 2024-09-20T19:05:49.204 INFO:tasks.workunit.client.1.smithi098.stdout:7/220: sync 2024-09-20T19:05:49.204 INFO:tasks.workunit.client.1.smithi098.stdout:5/209: sync 2024-09-20T19:05:49.204 INFO:tasks.workunit.client.1.smithi098.stdout:2/444: sync 2024-09-20T19:05:49.204 INFO:tasks.workunit.client.1.smithi098.stdout:0/110: sync 2024-09-20T19:05:49.204 INFO:tasks.workunit.client.1.smithi098.stdout:3/121: sync 2024-09-20T19:05:49.205 INFO:tasks.workunit.client.1.smithi098.stdout:0/111: chown d0/d6/d19 3 1 2024-09-20T19:05:49.225 INFO:tasks.workunit.client.0.smithi027.stdout:7/93: rename d3/d8/d1b to d3/d8/da/dc/d1e 0 2024-09-20T19:05:49.226 INFO:tasks.workunit.client.0.smithi027.stdout:7/94: chown d3/d8/da 63222332 1 2024-09-20T19:05:49.226 INFO:tasks.workunit.client.0.smithi027.stdout:7/95: fdatasync d3/f9 0 2024-09-20T19:05:49.228 INFO:tasks.workunit.client.0.smithi027.stdout:2/61: write d3/f9 [3249832,116428] 0 2024-09-20T19:05:49.229 INFO:tasks.workunit.client.0.smithi027.stdout:2/62: write d3/fa [1393753,79210] 0 2024-09-20T19:05:49.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/122: write d4/fd [839127,126159] 0 2024-09-20T19:05:49.235 INFO:tasks.workunit.client.0.smithi027.stdout:6/50: rmdir d4/d6 39 2024-09-20T19:05:49.235 INFO:tasks.workunit.client.0.smithi027.stdout:2/63: fsync d3/f9 0 2024-09-20T19:05:49.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/112: rename d0/f2 to d0/db/d1d/f21 0 2024-09-20T19:05:49.238 INFO:tasks.workunit.client.1.smithi098.stdout:5/210: dwrite d1/fc [4194304,4194304] 0 2024-09-20T19:05:49.239 INFO:tasks.workunit.client.1.smithi098.stdout:7/221: mknod d3/d10/c45 0 2024-09-20T19:05:49.240 INFO:tasks.workunit.client.1.smithi098.stdout:3/123: rmdir d4/d19 39 2024-09-20T19:05:49.241 INFO:tasks.workunit.client.0.smithi027.stdout:8/85: rmdir d2/d14 39 2024-09-20T19:05:49.242 INFO:tasks.workunit.client.1.smithi098.stdout:3/124: chown d4/f10 144089350 1 2024-09-20T19:05:49.244 INFO:tasks.workunit.client.1.smithi098.stdout:7/222: dread d3/d10/d16/f34 [0,4194304] 0 2024-09-20T19:05:49.245 INFO:tasks.workunit.client.0.smithi027.stdout:3/142: mknod d0/c32 0 2024-09-20T19:05:49.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/445: mknod d3/d16/d1d/c92 0 2024-09-20T19:05:49.250 INFO:tasks.workunit.client.0.smithi027.stdout:0/98: rename d2/d14/d1d/c1e to d2/d7/c22 0 2024-09-20T19:05:49.250 INFO:tasks.workunit.client.1.smithi098.stdout:2/446: read d3/df/d13/f3a [4160640,50139] 0 2024-09-20T19:05:49.252 INFO:tasks.workunit.client.1.smithi098.stdout:5/211: chown d1/l22 643 1 2024-09-20T19:05:49.252 INFO:tasks.workunit.client.1.smithi098.stdout:7/223: dwrite d3/f8 [0,4194304] 0 2024-09-20T19:05:49.260 INFO:tasks.workunit.client.0.smithi027.stdout:5/73: getdents d4 0 2024-09-20T19:05:49.261 INFO:tasks.workunit.client.0.smithi027.stdout:5/74: write d4/f10 [778979,43479] 0 2024-09-20T19:05:49.264 INFO:tasks.workunit.client.1.smithi098.stdout:8/310: dwrite d7/de/d11/d19/f4e [0,4194304] 0 2024-09-20T19:05:49.264 INFO:tasks.workunit.client.1.smithi098.stdout:9/275: dwrite f0 [0,4194304] 0 2024-09-20T19:05:49.268 INFO:tasks.workunit.client.1.smithi098.stdout:7/224: write d3/f2e [1171224,77160] 0 2024-09-20T19:05:49.270 INFO:tasks.workunit.client.1.smithi098.stdout:5/212: fsync d1/d17/d25/f3d 0 2024-09-20T19:05:49.272 INFO:tasks.workunit.client.0.smithi027.stdout:6/51: truncate d4/d6/fb 4876775 0 2024-09-20T19:05:49.272 INFO:tasks.workunit.client.0.smithi027.stdout:6/52: chown d4 3007 1 2024-09-20T19:05:49.272 INFO:tasks.workunit.client.0.smithi027.stdout:4/61: mkdir d5/d13 0 2024-09-20T19:05:49.273 INFO:tasks.workunit.client.0.smithi027.stdout:4/62: fdatasync d5/fe 0 2024-09-20T19:05:49.278 INFO:tasks.workunit.client.1.smithi098.stdout:2/447: rename d3/d16/d1d/d4f/d8b/f62 to d3/d16/d1d/d2b/d46/d74/d82/f93 0 2024-09-20T19:05:49.282 INFO:tasks.workunit.client.0.smithi027.stdout:2/64: truncate d3/f7 2723685 0 2024-09-20T19:05:49.285 INFO:tasks.workunit.client.0.smithi027.stdout:1/81: creat d2/d1b/f1e x:0 0 0 2024-09-20T19:05:49.289 INFO:tasks.workunit.client.0.smithi027.stdout:3/143: mkdir d0/d1/d33 0 2024-09-20T19:05:49.290 INFO:tasks.workunit.client.0.smithi027.stdout:7/96: mknod d3/d1a/c1f 0 2024-09-20T19:05:49.292 INFO:tasks.workunit.client.1.smithi098.stdout:3/125: creat d4/d19/f20 x:0 0 0 2024-09-20T19:05:49.296 INFO:tasks.workunit.client.1.smithi098.stdout:0/113: truncate d0/d6/d19/f10 3480646 0 2024-09-20T19:05:49.297 INFO:tasks.workunit.client.1.smithi098.stdout:9/276: mknod d4/de/d27/d4a/d21/c5f 0 2024-09-20T19:05:49.304 INFO:tasks.workunit.client.1.smithi098.stdout:9/277: dwrite d4/de/f29 [0,4194304] 0 2024-09-20T19:05:49.305 INFO:tasks.workunit.client.1.smithi098.stdout:7/225: creat d3/d10/d18/f46 x:0 0 0 2024-09-20T19:05:49.309 INFO:tasks.workunit.client.1.smithi098.stdout:5/213: stat d1/f2c 0 2024-09-20T19:05:49.314 INFO:tasks.workunit.client.1.smithi098.stdout:2/448: symlink d3/l94 0 2024-09-20T19:05:49.316 INFO:tasks.workunit.client.1.smithi098.stdout:2/449: write d3/d16/d1d/f4e [129439,90089] 0 2024-09-20T19:05:49.316 INFO:tasks.workunit.client.0.smithi027.stdout:5/75: symlink d4/da/l12 0 2024-09-20T19:05:49.316 INFO:tasks.workunit.client.0.smithi027.stdout:9/209: link d0/d9/df/d1b/f14 d0/d9/df/d1b/f3e 0 2024-09-20T19:05:49.317 INFO:tasks.workunit.client.1.smithi098.stdout:2/450: chown d3/f4c 394 1 2024-09-20T19:05:49.318 INFO:tasks.workunit.client.0.smithi027.stdout:6/53: unlink d4/d6/fb 0 2024-09-20T19:05:49.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/114: rename d0/db/l18 to d0/db/l22 0 2024-09-20T19:05:49.319 INFO:tasks.workunit.client.0.smithi027.stdout:9/210: chown d0/d9/df/c3b 17595455 1 2024-09-20T19:05:49.319 INFO:tasks.workunit.client.0.smithi027.stdout:5/76: rename d4/da to d4/da/de/d13 22 2024-09-20T19:05:49.319 INFO:tasks.workunit.client.1.smithi098.stdout:8/311: getdents d7/de/d11/d1d 0 2024-09-20T19:05:49.321 INFO:tasks.workunit.client.0.smithi027.stdout:5/77: read f2 [2220578,101115] 0 2024-09-20T19:05:49.321 INFO:tasks.workunit.client.0.smithi027.stdout:3/144: symlink d0/d1/d7/l34 0 2024-09-20T19:05:49.322 INFO:tasks.workunit.client.0.smithi027.stdout:1/82: chown d2/cd 3 1 2024-09-20T19:05:49.322 INFO:tasks.workunit.client.1.smithi098.stdout:9/278: dread - d4/de/f34 zero size 2024-09-20T19:05:49.323 INFO:tasks.workunit.client.0.smithi027.stdout:1/83: readlink d2/d14/l17 0 2024-09-20T19:05:49.324 INFO:tasks.workunit.client.0.smithi027.stdout:8/86: dwrite d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:49.327 INFO:tasks.workunit.client.1.smithi098.stdout:7/226: symlink d3/d10/d16/l47 0 2024-09-20T19:05:49.328 INFO:tasks.workunit.client.1.smithi098.stdout:8/312: dwrite d7/f6e [0,4194304] 0 2024-09-20T19:05:49.330 INFO:tasks.workunit.client.1.smithi098.stdout:7/227: dread - d3/d10/d16/d17/d33/d1f/f44 zero size 2024-09-20T19:05:49.330 INFO:tasks.workunit.client.0.smithi027.stdout:5/78: dwrite d4/da/fb [4194304,4194304] 0 2024-09-20T19:05:49.331 INFO:tasks.workunit.client.0.smithi027.stdout:5/79: write f2 [5277346,120496] 0 2024-09-20T19:05:49.331 INFO:tasks.workunit.client.1.smithi098.stdout:3/126: creat d4/da/f21 x:0 0 0 2024-09-20T19:05:49.340 INFO:tasks.workunit.client.0.smithi027.stdout:0/99: sync 2024-09-20T19:05:49.340 INFO:tasks.workunit.client.0.smithi027.stdout:0/100: chown d2/f12 43045431 1 2024-09-20T19:05:49.342 INFO:tasks.workunit.client.0.smithi027.stdout:0/101: dread d2/f10 [0,4194304] 0 2024-09-20T19:05:49.343 INFO:tasks.workunit.client.1.smithi098.stdout:3/127: dread d4/fd [0,4194304] 0 2024-09-20T19:05:49.344 INFO:tasks.workunit.client.1.smithi098.stdout:3/128: chown d4/d19 222 1 2024-09-20T19:05:49.344 INFO:tasks.workunit.client.1.smithi098.stdout:8/313: chown d7/de/d11/d1f/c76 913469 1 2024-09-20T19:05:49.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/451: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:49.347 INFO:tasks.workunit.client.1.smithi098.stdout:7/228: rmdir d3/d10/d16/d17/d33/d1f 39 2024-09-20T19:05:49.352 INFO:tasks.workunit.client.1.smithi098.stdout:9/279: rename d4/de/ld to d4/de/d27/d4a/d21/l60 0 2024-09-20T19:05:49.353 INFO:tasks.workunit.client.1.smithi098.stdout:9/280: dread - d4/f47 zero size 2024-09-20T19:05:49.354 INFO:tasks.workunit.client.1.smithi098.stdout:2/452: dwrite d3/d16/d1d/d2b/d46/d74/f86 [0,4194304] 0 2024-09-20T19:05:49.354 INFO:tasks.workunit.client.1.smithi098.stdout:3/129: write d4/da/f14 [4214654,49851] 0 2024-09-20T19:05:49.356 INFO:tasks.workunit.client.1.smithi098.stdout:2/453: stat d3/d16/d1d/d4f/c80 0 2024-09-20T19:05:49.359 INFO:tasks.workunit.client.1.smithi098.stdout:2/454: write d3/d16/d1d/d4f/d8b/f7e [872406,118740] 0 2024-09-20T19:05:49.360 INFO:tasks.workunit.client.1.smithi098.stdout:2/455: write d3/f6d [622181,124306] 0 2024-09-20T19:05:49.361 INFO:tasks.workunit.client.1.smithi098.stdout:0/115: truncate d0/f3 6558321 0 2024-09-20T19:05:49.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/116: write d0/d6/fe [1527174,100684] 0 2024-09-20T19:05:49.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/117: fsync d0/fa 0 2024-09-20T19:05:49.370 INFO:tasks.workunit.client.1.smithi098.stdout:7/229: symlink d3/d10/d16/l48 0 2024-09-20T19:05:49.373 INFO:tasks.workunit.client.1.smithi098.stdout:2/456: creat d3/d16/d1d/d4f/d8b/d38/f95 x:0 0 0 2024-09-20T19:05:49.374 INFO:tasks.workunit.client.1.smithi098.stdout:9/281: dwrite d4/de/d27/d4a/d21/d25/f59 [0,4194304] 0 2024-09-20T19:05:49.377 INFO:tasks.workunit.client.1.smithi098.stdout:2/457: read d3/d16/d1a/f27 [704543,36427] 0 2024-09-20T19:05:49.380 INFO:tasks.workunit.client.1.smithi098.stdout:2/458: chown d3/d16/d1d/d2b/l79 13171 1 2024-09-20T19:05:49.382 INFO:tasks.workunit.client.1.smithi098.stdout:7/230: dwrite d3/f2e [0,4194304] 0 2024-09-20T19:05:49.386 INFO:tasks.workunit.client.1.smithi098.stdout:3/130: mkdir d4/d19/d1d/d22 0 2024-09-20T19:05:49.394 INFO:tasks.workunit.client.1.smithi098.stdout:0/118: truncate d0/db/fd 1827490 0 2024-09-20T19:05:49.395 INFO:tasks.workunit.client.1.smithi098.stdout:0/119: dread d0/f5 [0,4194304] 0 2024-09-20T19:05:49.396 INFO:tasks.workunit.client.1.smithi098.stdout:8/314: getdents d7/de/d11/d19/d30/d55 0 2024-09-20T19:05:49.397 INFO:tasks.workunit.client.1.smithi098.stdout:0/120: truncate d0/db/f17 584465 0 2024-09-20T19:05:49.398 INFO:tasks.workunit.client.1.smithi098.stdout:7/231: dread - d3/d10/d16/d17/d33/d1f/f3c zero size 2024-09-20T19:05:49.398 INFO:tasks.workunit.client.1.smithi098.stdout:7/232: chown d3/d10/f19 112451219 1 2024-09-20T19:05:49.402 INFO:tasks.workunit.client.1.smithi098.stdout:9/282: rename d4/cf to d4/de/d24/d35/d2d/c61 0 2024-09-20T19:05:49.404 INFO:tasks.workunit.client.1.smithi098.stdout:2/459: mkdir d3/d16/d96 0 2024-09-20T19:05:49.406 INFO:tasks.workunit.client.1.smithi098.stdout:8/315: mkdir d7/de/d11/d1f/d77 0 2024-09-20T19:05:49.407 INFO:tasks.workunit.client.1.smithi098.stdout:0/121: mknod d0/d6/d19/c23 0 2024-09-20T19:05:49.411 INFO:tasks.workunit.client.1.smithi098.stdout:9/283: mknod d4/de/d27/d4a/d58/c62 0 2024-09-20T19:05:49.412 INFO:tasks.workunit.client.1.smithi098.stdout:9/284: read - d4/de/f34 zero size 2024-09-20T19:05:49.414 INFO:tasks.workunit.client.1.smithi098.stdout:8/316: stat d7/de/l43 0 2024-09-20T19:05:49.416 INFO:tasks.workunit.client.1.smithi098.stdout:0/122: rename d0/d6/l1f to d0/d15/l24 0 2024-09-20T19:05:49.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/131: creat d4/da/f23 x:0 0 0 2024-09-20T19:05:49.418 INFO:tasks.workunit.client.1.smithi098.stdout:3/132: chown d4/da/f21 190 1 2024-09-20T19:05:49.418 INFO:tasks.workunit.client.1.smithi098.stdout:3/133: fsync d4/da/fb 0 2024-09-20T19:05:49.424 INFO:tasks.workunit.client.1.smithi098.stdout:7/233: link d3/d10/d16/d17/d33/d37/l3a d3/d10/d16/d17/d33/d1f/d28/l49 0 2024-09-20T19:05:49.426 INFO:tasks.workunit.client.1.smithi098.stdout:3/134: rename d4/da/f21 to d4/d19/d1d/d22/f24 0 2024-09-20T19:05:49.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/460: rmdir d3/d16/d1d/d4f/d8b/d38/d6f 0 2024-09-20T19:05:49.431 INFO:tasks.workunit.client.1.smithi098.stdout:1/84: sync 2024-09-20T19:05:49.431 INFO:tasks.workunit.client.1.smithi098.stdout:6/116: sync 2024-09-20T19:05:49.431 INFO:tasks.workunit.client.1.smithi098.stdout:7/234: dwrite d3/d10/f19 [4194304,4194304] 0 2024-09-20T19:05:49.431 INFO:tasks.workunit.client.1.smithi098.stdout:8/317: mkdir d7/de/d11/d19/d30/d68/d78 0 2024-09-20T19:05:49.432 INFO:tasks.workunit.client.1.smithi098.stdout:1/85: dread - d1/f10 zero size 2024-09-20T19:05:49.432 INFO:tasks.workunit.client.1.smithi098.stdout:0/123: mknod d0/c25 0 2024-09-20T19:05:49.440 INFO:tasks.workunit.client.1.smithi098.stdout:1/86: dwrite d1/f10 [0,4194304] 0 2024-09-20T19:05:49.441 INFO:tasks.workunit.client.1.smithi098.stdout:8/318: dread d7/de/d11/d19/d30/d55/f69 [0,4194304] 0 2024-09-20T19:05:49.445 INFO:tasks.workunit.client.1.smithi098.stdout:6/117: symlink d0/l1e 0 2024-09-20T19:05:49.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/118: chown d0/d7/dc/f1a 2278003 1 2024-09-20T19:05:49.449 INFO:tasks.workunit.client.1.smithi098.stdout:0/124: creat d0/db/d1d/f26 x:0 0 0 2024-09-20T19:05:49.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/135: mkdir d4/d25 0 2024-09-20T19:05:49.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/136: write d4/da/f14 [6921807,128423] 0 2024-09-20T19:05:49.459 INFO:tasks.workunit.client.1.smithi098.stdout:3/137: chown d4/l1e 72305959 1 2024-09-20T19:05:49.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/461: mknod d3/d16/d1d/c97 0 2024-09-20T19:05:49.463 INFO:tasks.workunit.client.1.smithi098.stdout:8/319: rmdir d7/de/d11/d19/d47 39 2024-09-20T19:05:49.467 INFO:tasks.workunit.client.1.smithi098.stdout:4/182: sync 2024-09-20T19:05:49.467 INFO:tasks.workunit.client.1.smithi098.stdout:5/214: sync 2024-09-20T19:05:49.469 INFO:tasks.workunit.client.1.smithi098.stdout:8/320: dwrite d7/de/d11/d1f/f2a [4194304,4194304] 0 2024-09-20T19:05:49.481 INFO:tasks.workunit.client.1.smithi098.stdout:9/285: dwrite d4/f10 [0,4194304] 0 2024-09-20T19:05:49.482 INFO:tasks.workunit.client.1.smithi098.stdout:9/286: fdatasync d4/de/d27/d39/f53 0 2024-09-20T19:05:49.483 INFO:tasks.workunit.client.1.smithi098.stdout:6/119: link d0/f5 d0/de/d1b/f1f 0 2024-09-20T19:05:49.485 INFO:tasks.workunit.client.1.smithi098.stdout:0/125: fdatasync d0/db/d1d/f21 0 2024-09-20T19:05:49.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/215: dread - d1/d17/d25/f3b zero size 2024-09-20T19:05:49.490 INFO:tasks.workunit.client.1.smithi098.stdout:4/183: dread d3/d6/f34 [4194304,4194304] 0 2024-09-20T19:05:49.492 INFO:tasks.workunit.client.1.smithi098.stdout:8/321: creat d7/de/d11/d1f/d57/d72/f79 x:0 0 0 2024-09-20T19:05:49.499 INFO:tasks.workunit.client.1.smithi098.stdout:6/120: unlink d0/de/c17 0 2024-09-20T19:05:49.505 INFO:tasks.workunit.client.1.smithi098.stdout:5/216: creat d1/d17/d35/f3f x:0 0 0 2024-09-20T19:05:49.507 INFO:tasks.workunit.client.1.smithi098.stdout:5/217: write d1/d17/f1a [542908,9798] 0 2024-09-20T19:05:49.507 INFO:tasks.workunit.client.1.smithi098.stdout:4/184: rename d3/d6/d3e/d3c/c3d to d3/d6/d11/c3f 0 2024-09-20T19:05:49.508 INFO:tasks.workunit.client.1.smithi098.stdout:1/87: dwrite d1/d3/f5 [8388608,4194304] 0 2024-09-20T19:05:49.511 INFO:tasks.workunit.client.1.smithi098.stdout:9/287: mknod d4/c63 0 2024-09-20T19:05:49.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/235: write d3/d10/d16/d17/d33/d1f/d2d/f31 [350063,45037] 0 2024-09-20T19:05:49.512 INFO:tasks.workunit.client.1.smithi098.stdout:7/236: write d3/f11 [6747065,93403] 0 2024-09-20T19:05:49.513 INFO:tasks.workunit.client.1.smithi098.stdout:6/121: symlink d0/de/d1b/l20 0 2024-09-20T19:05:49.514 INFO:tasks.workunit.client.1.smithi098.stdout:7/237: dread - d3/d10/d18/f46 zero size 2024-09-20T19:05:49.518 INFO:tasks.workunit.client.1.smithi098.stdout:0/126: truncate d0/fa 3461144 0 2024-09-20T19:05:49.523 INFO:tasks.workunit.client.1.smithi098.stdout:5/218: mkdir d1/d1b/d40 0 2024-09-20T19:05:49.525 INFO:tasks.workunit.client.1.smithi098.stdout:5/219: write d1/d1b/f1c [2243261,79058] 0 2024-09-20T19:05:49.526 INFO:tasks.workunit.client.1.smithi098.stdout:0/127: dwrite d0/d15/f1e [0,4194304] 0 2024-09-20T19:05:49.534 INFO:tasks.workunit.client.1.smithi098.stdout:1/88: dread d1/d3/f6 [4194304,4194304] 0 2024-09-20T19:05:49.534 INFO:tasks.workunit.client.1.smithi098.stdout:0/128: dwrite d0/d6/d19/f1c [0,4194304] 0 2024-09-20T19:05:49.543 INFO:tasks.workunit.client.1.smithi098.stdout:8/322: creat d7/de/d11/f7a x:0 0 0 2024-09-20T19:05:49.543 INFO:tasks.workunit.client.1.smithi098.stdout:8/323: fdatasync d7/de/d35/f5d 0 2024-09-20T19:05:49.549 INFO:tasks.workunit.client.1.smithi098.stdout:5/220: rename d1/d17/f39 to d1/d17/d35/f41 0 2024-09-20T19:05:49.549 INFO:tasks.workunit.client.1.smithi098.stdout:5/221: stat d1/d17/d35/f41 0 2024-09-20T19:05:49.550 INFO:tasks.workunit.client.1.smithi098.stdout:5/222: stat d1/f14 0 2024-09-20T19:05:49.551 INFO:tasks.workunit.client.1.smithi098.stdout:4/185: link d3/fe d3/d6/d11/d1e/f40 0 2024-09-20T19:05:49.560 INFO:tasks.workunit.client.1.smithi098.stdout:1/89: creat d1/f14 x:0 0 0 2024-09-20T19:05:49.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/129: rmdir d0/db/d1d 39 2024-09-20T19:05:49.568 INFO:tasks.workunit.client.1.smithi098.stdout:5/223: chown d1/c36 11690368 1 2024-09-20T19:05:49.571 INFO:tasks.workunit.client.1.smithi098.stdout:4/186: symlink d3/d2e/l41 0 2024-09-20T19:05:49.573 INFO:tasks.workunit.client.1.smithi098.stdout:9/288: link d4/de/d27/d4a/d21/c28 d4/de/d27/d4a/d21/d25/c64 0 2024-09-20T19:05:49.575 INFO:tasks.workunit.client.1.smithi098.stdout:0/130: write d0/db/f14 [1117853,84794] 0 2024-09-20T19:05:49.576 INFO:tasks.workunit.client.1.smithi098.stdout:0/131: write d0/d15/f1e [1046799,105296] 0 2024-09-20T19:05:49.578 INFO:tasks.workunit.client.1.smithi098.stdout:6/122: truncate d0/f8 294057 0 2024-09-20T19:05:49.582 INFO:tasks.workunit.client.1.smithi098.stdout:7/238: truncate d3/d10/d18/f27 3973642 0 2024-09-20T19:05:49.584 INFO:tasks.workunit.client.1.smithi098.stdout:9/289: rename d4/de/d27/d4a/d21/d25/c31 to d4/de/d24/d35/c65 0 2024-09-20T19:05:49.587 INFO:tasks.workunit.client.1.smithi098.stdout:4/187: dwrite d3/ff [4194304,4194304] 0 2024-09-20T19:05:49.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/123: fsync d0/de/d1b/f1c 0 2024-09-20T19:05:49.591 INFO:tasks.workunit.client.1.smithi098.stdout:6/124: chown d0/de/d1b/f1c 237 1 2024-09-20T19:05:49.592 INFO:tasks.workunit.client.1.smithi098.stdout:9/290: stat d4/l41 0 2024-09-20T19:05:49.593 INFO:tasks.workunit.client.1.smithi098.stdout:8/324: dwrite d7/de/d11/d19/f4c [0,4194304] 0 2024-09-20T19:05:49.594 INFO:tasks.workunit.client.1.smithi098.stdout:8/325: read d7/de/d11/d1f/f4d [4213443,127930] 0 2024-09-20T19:05:49.601 INFO:tasks.workunit.client.1.smithi098.stdout:6/125: unlink d0/f5 0 2024-09-20T19:05:49.603 INFO:tasks.workunit.client.1.smithi098.stdout:5/224: dread d1/fb [0,4194304] 0 2024-09-20T19:05:49.604 INFO:tasks.workunit.client.1.smithi098.stdout:9/291: write d4/de/f3f [185754,28432] 0 2024-09-20T19:05:49.607 INFO:tasks.workunit.client.1.smithi098.stdout:7/239: creat d3/d10/d16/d17/d33/d1f/d28/f4a x:0 0 0 2024-09-20T19:05:49.612 INFO:tasks.workunit.client.1.smithi098.stdout:4/188: rename d3/d6/d3e/c39 to d3/d6/d11/d2f/c42 0 2024-09-20T19:05:49.617 INFO:tasks.workunit.client.1.smithi098.stdout:4/189: dread d3/d6/f23 [0,4194304] 0 2024-09-20T19:05:49.618 INFO:tasks.workunit.client.1.smithi098.stdout:0/132: getdents d0/d6/d19 0 2024-09-20T19:05:49.619 INFO:tasks.workunit.client.1.smithi098.stdout:7/240: dread d3/d10/d16/f2c [0,4194304] 0 2024-09-20T19:05:49.620 INFO:tasks.workunit.client.1.smithi098.stdout:4/190: write d3/f36 [174775,122144] 0 2024-09-20T19:05:49.621 INFO:tasks.workunit.client.1.smithi098.stdout:5/225: dwrite d1/d17/d35/f41 [0,4194304] 0 2024-09-20T19:05:49.622 INFO:tasks.workunit.client.1.smithi098.stdout:7/241: dread - d3/d10/d16/d17/d33/d1f/f43 zero size 2024-09-20T19:05:49.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/226: truncate d1/d17/f19 367613 0 2024-09-20T19:05:49.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/227: chown d1/c36 56 1 2024-09-20T19:05:49.625 INFO:tasks.workunit.client.1.smithi098.stdout:6/126: rename d0/l1e to d0/d7/dc/l21 0 2024-09-20T19:05:49.633 INFO:tasks.workunit.client.1.smithi098.stdout:4/191: creat d3/d6/d11/f43 x:0 0 0 2024-09-20T19:05:49.635 INFO:tasks.workunit.client.1.smithi098.stdout:8/326: rmdir d7/de/d11/d65 0 2024-09-20T19:05:49.635 INFO:tasks.workunit.client.1.smithi098.stdout:8/327: stat d7/de/d11/d1d/f3e 0 2024-09-20T19:05:49.638 INFO:tasks.workunit.client.1.smithi098.stdout:5/228: mknod d1/d17/c42 0 2024-09-20T19:05:49.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/229: stat d1/c36 0 2024-09-20T19:05:49.642 INFO:tasks.workunit.client.1.smithi098.stdout:4/192: mknod d3/d2e/c44 0 2024-09-20T19:05:49.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/328: rmdir d7/de/d11/d19/d30/d59 39 2024-09-20T19:05:49.645 INFO:tasks.workunit.client.1.smithi098.stdout:7/242: mkdir d3/d10/d16/d17/d33/d4b 0 2024-09-20T19:05:49.646 INFO:tasks.workunit.client.1.smithi098.stdout:8/329: write d7/de/d11/d19/d30/f62 [137399,95295] 0 2024-09-20T19:05:49.649 INFO:tasks.workunit.client.1.smithi098.stdout:4/193: dwrite d3/d6/fd [0,4194304] 0 2024-09-20T19:05:49.659 INFO:tasks.workunit.client.1.smithi098.stdout:0/133: rename d0/d15/c1a to d0/c27 0 2024-09-20T19:05:49.659 INFO:tasks.workunit.client.1.smithi098.stdout:7/243: dwrite d3/d10/f13 [4194304,4194304] 0 2024-09-20T19:05:49.660 INFO:tasks.workunit.client.1.smithi098.stdout:7/244: chown d3/f12 340087 1 2024-09-20T19:05:49.661 INFO:tasks.workunit.client.1.smithi098.stdout:8/330: creat d7/de/d11/d19/d30/d68/f7b x:0 0 0 2024-09-20T19:05:49.661 INFO:tasks.workunit.client.1.smithi098.stdout:7/245: write d3/f8 [1599225,13436] 0 2024-09-20T19:05:49.663 INFO:tasks.workunit.client.1.smithi098.stdout:4/194: mkdir d3/d6/d11/d1e/d2a/d45 0 2024-09-20T19:05:49.664 INFO:tasks.workunit.client.1.smithi098.stdout:8/331: dread d7/de/d11/d19/f2d [0,4194304] 0 2024-09-20T19:05:49.670 INFO:tasks.workunit.client.1.smithi098.stdout:4/195: mkdir d3/d6/d11/d46 0 2024-09-20T19:05:49.672 INFO:tasks.workunit.client.1.smithi098.stdout:0/134: mkdir d0/d6/d28 0 2024-09-20T19:05:49.673 INFO:tasks.workunit.client.1.smithi098.stdout:7/246: mkdir d3/d4c 0 2024-09-20T19:05:49.676 INFO:tasks.workunit.client.1.smithi098.stdout:8/332: link d7/de/f54 d7/de/d11/d1d/f7c 0 2024-09-20T19:05:49.679 INFO:tasks.workunit.client.1.smithi098.stdout:4/196: rename d3/d6/d11/l19 to d3/d6/d11/l47 0 2024-09-20T19:05:49.681 INFO:tasks.workunit.client.1.smithi098.stdout:0/135: symlink d0/d6/d19/l29 0 2024-09-20T19:05:49.683 INFO:tasks.workunit.client.1.smithi098.stdout:0/136: write d0/db/f14 [3263733,41060] 0 2024-09-20T19:05:49.683 INFO:tasks.workunit.client.1.smithi098.stdout:7/247: truncate d3/d10/d16/f39 606019 0 2024-09-20T19:05:49.685 INFO:tasks.workunit.client.1.smithi098.stdout:4/197: dwrite d3/d6/d11/d1e/f30 [0,4194304] 0 2024-09-20T19:05:49.690 INFO:tasks.workunit.client.1.smithi098.stdout:7/248: creat d3/d10/d18/f4d x:0 0 0 2024-09-20T19:05:49.695 INFO:tasks.workunit.client.1.smithi098.stdout:0/137: creat d0/db/d1d/f2a x:0 0 0 2024-09-20T19:05:49.700 INFO:tasks.workunit.client.1.smithi098.stdout:7/249: mkdir d3/d10/d16/d4e 0 2024-09-20T19:05:49.703 INFO:tasks.workunit.client.1.smithi098.stdout:0/138: fdatasync d0/db/fd 0 2024-09-20T19:05:49.704 INFO:tasks.workunit.client.1.smithi098.stdout:0/139: chown d0/d15/l1b 845 1 2024-09-20T19:05:49.705 INFO:tasks.workunit.client.1.smithi098.stdout:4/198: dread d3/d6/d11/d1e/f40 [0,4194304] 0 2024-09-20T19:05:49.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/250: mknod d3/d10/d18/d21/c4f 0 2024-09-20T19:05:49.707 INFO:tasks.workunit.client.1.smithi098.stdout:5/230: truncate d1/f2 3260133 0 2024-09-20T19:05:49.708 INFO:tasks.workunit.client.1.smithi098.stdout:7/251: chown d3/d10/l1d 0 1 2024-09-20T19:05:49.712 INFO:tasks.workunit.client.1.smithi098.stdout:0/140: dwrite d0/db/f20 [0,4194304] 0 2024-09-20T19:05:49.714 INFO:tasks.workunit.client.1.smithi098.stdout:5/231: creat d1/d17/d25/f43 x:0 0 0 2024-09-20T19:05:49.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/199: rename d3/d6/d11/c22 to d3/d6/d3e/d3c/c48 0 2024-09-20T19:05:49.722 INFO:tasks.workunit.client.1.smithi098.stdout:4/200: write d3/ff [944715,85723] 0 2024-09-20T19:05:49.731 INFO:tasks.workunit.client.1.smithi098.stdout:4/201: symlink d3/d6/l49 0 2024-09-20T19:05:49.733 INFO:tasks.workunit.client.1.smithi098.stdout:4/202: read d3/d6/f34 [3408811,82265] 0 2024-09-20T19:05:49.733 INFO:tasks.workunit.client.1.smithi098.stdout:0/141: mknod d0/db/c2b 0 2024-09-20T19:05:49.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/232: symlink d1/d1b/d40/l44 0 2024-09-20T19:05:49.736 INFO:tasks.workunit.client.1.smithi098.stdout:5/233: write d1/f9 [2425515,111462] 0 2024-09-20T19:05:49.737 INFO:tasks.workunit.client.1.smithi098.stdout:7/252: rmdir d3/d10/d16/d4e 0 2024-09-20T19:05:49.741 INFO:tasks.workunit.client.1.smithi098.stdout:0/142: rmdir d0/d6/d19 39 2024-09-20T19:05:49.743 INFO:tasks.workunit.client.1.smithi098.stdout:5/234: dwrite d1/d1b/f26 [4194304,4194304] 0 2024-09-20T19:05:49.744 INFO:tasks.workunit.client.1.smithi098.stdout:4/203: symlink d3/d6/d11/l4a 0 2024-09-20T19:05:49.745 INFO:tasks.workunit.client.1.smithi098.stdout:4/204: fdatasync d3/d6/f32 0 2024-09-20T19:05:49.754 INFO:tasks.workunit.client.1.smithi098.stdout:5/235: stat d1/l23 0 2024-09-20T19:05:49.770 INFO:tasks.workunit.client.1.smithi098.stdout:5/236: getdents d1/d17/d2e 0 2024-09-20T19:05:49.772 INFO:tasks.workunit.client.1.smithi098.stdout:4/205: dread d3/ff [0,4194304] 0 2024-09-20T19:05:49.784 INFO:tasks.workunit.client.1.smithi098.stdout:7/253: truncate d3/f8 2494622 0 2024-09-20T19:05:49.787 INFO:tasks.workunit.client.1.smithi098.stdout:7/254: symlink d3/d10/d16/d17/d33/d1f/d28/l50 0 2024-09-20T19:05:49.789 INFO:tasks.workunit.client.1.smithi098.stdout:7/255: fsync d3/d10/d16/d17/d33/d1f/d2d/f31 0 2024-09-20T19:05:49.791 INFO:tasks.workunit.client.1.smithi098.stdout:0/143: dwrite d0/d6/d19/f10 [0,4194304] 0 2024-09-20T19:05:49.791 INFO:tasks.workunit.client.1.smithi098.stdout:7/256: write d3/d10/f13 [7453474,54203] 0 2024-09-20T19:05:49.799 INFO:tasks.workunit.client.1.smithi098.stdout:0/144: dwrite d0/d6/fe [0,4194304] 0 2024-09-20T19:05:49.801 INFO:tasks.workunit.client.1.smithi098.stdout:7/257: creat d3/d10/d18/f51 x:0 0 0 2024-09-20T19:05:49.804 INFO:tasks.workunit.client.1.smithi098.stdout:7/258: write d3/f2e [3773090,72095] 0 2024-09-20T19:05:49.806 INFO:tasks.workunit.client.1.smithi098.stdout:4/206: dwrite d3/d6/f34 [0,4194304] 0 2024-09-20T19:05:49.808 INFO:tasks.workunit.client.1.smithi098.stdout:4/207: readlink d3/d6/l12 0 2024-09-20T19:05:49.809 INFO:tasks.workunit.client.1.smithi098.stdout:0/145: dwrite d0/db/f14 [0,4194304] 0 2024-09-20T19:05:49.818 INFO:tasks.workunit.client.1.smithi098.stdout:0/146: dwrite d0/d6/d19/f1c [0,4194304] 0 2024-09-20T19:05:49.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:49.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:49.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:05:49.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:05:49.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr fail", "who": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: Activating manager daemon smithi098.wrcvbg 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "mgr fail", "who": "smithi027.tlgpqo"}]': finished 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: osdmap e48: 6 total, 6 up, 6 in 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: mgrmap e21: smithi098.wrcvbg(active, starting, since 0.0104195s) 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:05:49.821 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:05:49.822 INFO:tasks.workunit.client.1.smithi098.stdout:0/147: write d0/d6/f7 [3657353,2754] 0 2024-09-20T19:05:49.822 INFO:tasks.workunit.client.1.smithi098.stdout:0/148: stat d0/db/d1d/f21 0 2024-09-20T19:05:49.822 INFO:tasks.workunit.client.1.smithi098.stdout:0/149: dread - d0/db/d1d/f2a zero size 2024-09-20T19:05:49.823 INFO:tasks.workunit.client.1.smithi098.stdout:0/150: write d0/db/f20 [2712398,62033] 0 2024-09-20T19:05:49.835 INFO:tasks.workunit.client.1.smithi098.stdout:0/151: mknod d0/db/d1d/c2c 0 2024-09-20T19:05:49.839 INFO:tasks.workunit.client.1.smithi098.stdout:0/152: dread d0/d6/d19/f10 [0,4194304] 0 2024-09-20T19:05:49.844 INFO:tasks.workunit.client.1.smithi098.stdout:0/153: symlink d0/d6/d28/l2d 0 2024-09-20T19:05:49.846 INFO:tasks.workunit.client.1.smithi098.stdout:7/259: truncate d3/f2e 2906601 0 2024-09-20T19:05:49.852 INFO:tasks.workunit.client.1.smithi098.stdout:4/208: truncate d3/d6/d11/d1e/f30 2038689 0 2024-09-20T19:05:49.856 INFO:tasks.workunit.client.1.smithi098.stdout:4/209: unlink d3/l1f 0 2024-09-20T19:05:49.859 INFO:tasks.workunit.client.1.smithi098.stdout:4/210: mknod d3/d6/c4b 0 2024-09-20T19:05:49.861 INFO:tasks.workunit.client.1.smithi098.stdout:4/211: creat d3/d6/d11/d2f/f4c x:0 0 0 2024-09-20T19:05:49.864 INFO:tasks.workunit.client.1.smithi098.stdout:0/154: getdents d0/d6/d28 0 2024-09-20T19:05:49.865 INFO:tasks.workunit.client.1.smithi098.stdout:0/155: fdatasync d0/db/f17 0 2024-09-20T19:05:49.871 INFO:tasks.workunit.client.1.smithi098.stdout:4/212: link d3/d6/d11/d1e/f40 d3/d6/d11/d1e/d2a/d45/f4d 0 2024-09-20T19:05:49.874 INFO:tasks.workunit.client.1.smithi098.stdout:0/156: mkdir d0/db/d2e 0 2024-09-20T19:05:49.877 INFO:tasks.workunit.client.1.smithi098.stdout:7/260: truncate d3/f8 860417 0 2024-09-20T19:05:49.891 INFO:tasks.workunit.client.1.smithi098.stdout:7/261: dread d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:49.903 INFO:tasks.workunit.client.1.smithi098.stdout:4/213: rename d3/d6/d11/d1e/f30 to d3/d6/f4e 0 2024-09-20T19:05:49.904 INFO:tasks.workunit.client.1.smithi098.stdout:0/157: write d0/db/fd [1885905,57156] 0 2024-09-20T19:05:49.908 INFO:tasks.workunit.client.1.smithi098.stdout:4/214: mkdir d3/d4f 0 2024-09-20T19:05:49.913 INFO:tasks.workunit.client.0.smithi027.stdout:4/63: mknod d5/d11/c14 0 2024-09-20T19:05:49.914 INFO:tasks.workunit.client.1.smithi098.stdout:4/215: mkdir d3/d6/d11/d2f/d50 0 2024-09-20T19:05:49.915 INFO:tasks.workunit.client.1.smithi098.stdout:4/216: readlink d3/d6/d11/d1e/d2a/l35 0 2024-09-20T19:05:49.920 INFO:tasks.workunit.client.1.smithi098.stdout:4/217: mknod d3/d6/d3e/d3c/c51 0 2024-09-20T19:05:49.922 INFO:tasks.workunit.client.0.smithi027.stdout:7/97: link d3/d8/da/dc/f10 d3/d8/f20 0 2024-09-20T19:05:49.923 INFO:tasks.workunit.client.1.smithi098.stdout:0/158: getdents d0/db/d1d 0 2024-09-20T19:05:49.924 INFO:tasks.workunit.client.0.smithi027.stdout:1/84: symlink d2/d1b/l1f 0 2024-09-20T19:05:49.925 INFO:tasks.workunit.client.0.smithi027.stdout:1/85: read d2/d8/f9 [3243945,82145] 0 2024-09-20T19:05:49.926 INFO:tasks.workunit.client.1.smithi098.stdout:4/218: unlink d3/d6/f10 0 2024-09-20T19:05:49.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/159: rmdir d0/db/d1d 39 2024-09-20T19:05:49.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/160: fdatasync d0/d6/f7 0 2024-09-20T19:05:49.928 INFO:tasks.workunit.client.1.smithi098.stdout:0/161: chown d0/c25 312570 1 2024-09-20T19:05:49.930 INFO:tasks.workunit.client.0.smithi027.stdout:5/80: symlink d4/da/de/l14 0 2024-09-20T19:05:49.930 INFO:tasks.workunit.client.0.smithi027.stdout:5/81: dread - d4/fd zero size 2024-09-20T19:05:49.930 INFO:tasks.workunit.client.1.smithi098.stdout:4/219: creat d3/d2e/f52 x:0 0 0 2024-09-20T19:05:49.931 INFO:tasks.workunit.client.1.smithi098.stdout:4/220: chown d3/d6/cb 0 1 2024-09-20T19:05:49.932 INFO:tasks.workunit.client.1.smithi098.stdout:4/221: chown d3/d6/d3e 2 1 2024-09-20T19:05:49.934 INFO:tasks.workunit.client.0.smithi027.stdout:0/102: mkdir d2/d7/d23 0 2024-09-20T19:05:49.934 INFO:tasks.workunit.client.0.smithi027.stdout:0/103: truncate f1 5533387 0 2024-09-20T19:05:49.936 INFO:tasks.workunit.client.1.smithi098.stdout:3/138: sync 2024-09-20T19:05:49.938 INFO:tasks.workunit.client.1.smithi098.stdout:0/162: rename d0/l13 to d0/db/d1d/l2f 0 2024-09-20T19:05:49.938 INFO:tasks.workunit.client.1.smithi098.stdout:0/163: chown d0/f5 3206312 1 2024-09-20T19:05:49.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/222: creat d3/d6/d11/d2f/d50/f53 x:0 0 0 2024-09-20T19:05:49.941 INFO:tasks.workunit.client.1.smithi098.stdout:4/223: truncate d3/d6/d11/f43 683808 0 2024-09-20T19:05:49.941 INFO:tasks.workunit.client.1.smithi098.stdout:7/262: link d3/f8 d3/d10/d16/d17/d33/f52 0 2024-09-20T19:05:49.942 INFO:tasks.workunit.client.1.smithi098.stdout:3/139: stat d4/lc 0 2024-09-20T19:05:49.943 INFO:tasks.workunit.client.0.smithi027.stdout:6/54: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:49.943 INFO:tasks.workunit.client.1.smithi098.stdout:7/263: write d3/d10/d16/d17/d33/d1f/f3c [1010249,16483] 0 2024-09-20T19:05:49.944 INFO:tasks.workunit.client.1.smithi098.stdout:0/164: readlink d0/d15/l24 0 2024-09-20T19:05:49.945 INFO:tasks.workunit.client.0.smithi027.stdout:7/98: write f0 [4133183,123556] 0 2024-09-20T19:05:49.946 INFO:tasks.workunit.client.1.smithi098.stdout:4/224: rename d3/d6/d11/d1e/d2a/f2d to d3/d6/d11/d1e/f54 0 2024-09-20T19:05:49.948 INFO:tasks.workunit.client.0.smithi027.stdout:9/211: write d0/d9/df/f21 [3187390,49663] 0 2024-09-20T19:05:49.950 INFO:tasks.workunit.client.0.smithi027.stdout:3/145: truncate d0/f2 572651 0 2024-09-20T19:05:49.951 INFO:tasks.workunit.client.0.smithi027.stdout:3/146: dread - d0/d1/f30 zero size 2024-09-20T19:05:49.951 INFO:tasks.workunit.client.0.smithi027.stdout:3/147: dread - d0/d1/f30 zero size 2024-09-20T19:05:49.952 INFO:tasks.workunit.client.0.smithi027.stdout:1/86: creat d2/d8/f20 x:0 0 0 2024-09-20T19:05:49.953 INFO:tasks.workunit.client.0.smithi027.stdout:1/87: write d2/d8/f20 [71495,95193] 0 2024-09-20T19:05:49.954 INFO:tasks.workunit.client.1.smithi098.stdout:7/264: creat d3/d10/d16/d17/d33/d1f/d2d/f53 x:0 0 0 2024-09-20T19:05:49.955 INFO:tasks.workunit.client.1.smithi098.stdout:7/265: read - d3/d10/d16/d17/d33/d1f/d28/f4a zero size 2024-09-20T19:05:49.956 INFO:tasks.workunit.client.0.smithi027.stdout:1/88: write d2/d1b/f1e [1025030,106740] 0 2024-09-20T19:05:49.956 INFO:tasks.workunit.client.0.smithi027.stdout:8/87: creat d2/d14/d13/f1c x:0 0 0 2024-09-20T19:05:49.957 INFO:tasks.workunit.client.0.smithi027.stdout:5/82: mknod d4/c15 0 2024-09-20T19:05:49.960 INFO:tasks.workunit.client.1.smithi098.stdout:0/165: truncate d0/fa 1039802 0 2024-09-20T19:05:49.961 INFO:tasks.workunit.client.0.smithi027.stdout:3/148: dwrite d0/d1/d7/f10 [0,4194304] 0 2024-09-20T19:05:49.962 INFO:tasks.workunit.client.1.smithi098.stdout:7/266: dwrite d3/d10/d16/d17/d33/d1f/f3c [0,4194304] 0 2024-09-20T19:05:49.966 INFO:tasks.workunit.client.1.smithi098.stdout:3/140: link d4/da/l1a d4/d19/d1d/l26 0 2024-09-20T19:05:49.966 INFO:tasks.workunit.client.0.smithi027.stdout:4/64: truncate d5/fe 1034246 0 2024-09-20T19:05:49.967 INFO:tasks.workunit.client.0.smithi027.stdout:8/88: dread d2/d3/d6/fa [0,4194304] 0 2024-09-20T19:05:49.967 INFO:tasks.workunit.client.0.smithi027.stdout:1/89: dwrite d2/f13 [0,4194304] 0 2024-09-20T19:05:49.970 INFO:tasks.workunit.client.0.smithi027.stdout:1/90: fsync d2/d1b/f1e 0 2024-09-20T19:05:49.970 INFO:tasks.workunit.client.0.smithi027.stdout:2/65: write d3/f7 [2928181,1483] 0 2024-09-20T19:05:49.972 INFO:tasks.workunit.client.1.smithi098.stdout:7/267: creat d3/d10/d18/d21/f54 x:0 0 0 2024-09-20T19:05:49.976 INFO:tasks.workunit.client.0.smithi027.stdout:3/149: dwrite d0/d1/d7/f2c [0,4194304] 0 2024-09-20T19:05:49.977 INFO:tasks.workunit.client.0.smithi027.stdout:7/99: fdatasync d3/d8/da/f11 0 2024-09-20T19:05:49.979 INFO:tasks.workunit.client.0.smithi027.stdout:1/91: dread d2/f13 [0,4194304] 0 2024-09-20T19:05:49.980 INFO:tasks.workunit.client.0.smithi027.stdout:9/212: rmdir d0/d9/df/d1c 39 2024-09-20T19:05:49.987 INFO:tasks.workunit.client.1.smithi098.stdout:0/166: write d0/db/d1d/f21 [2474996,85370] 0 2024-09-20T19:05:49.989 INFO:tasks.workunit.client.1.smithi098.stdout:7/268: truncate d3/d10/d16/f2c 574698 0 2024-09-20T19:05:49.989 INFO:tasks.workunit.client.0.smithi027.stdout:5/83: creat d4/f16 x:0 0 0 2024-09-20T19:05:49.991 INFO:tasks.workunit.client.0.smithi027.stdout:0/104: creat d2/d14/d1b/f24 x:0 0 0 2024-09-20T19:05:49.992 INFO:tasks.workunit.client.1.smithi098.stdout:3/141: write d4/fd [2452694,71704] 0 2024-09-20T19:05:49.992 INFO:tasks.workunit.client.1.smithi098.stdout:0/167: dread d0/d6/d19/f1c [0,4194304] 0 2024-09-20T19:05:49.993 INFO:tasks.workunit.client.0.smithi027.stdout:0/105: dread - d2/d14/d1b/f24 zero size 2024-09-20T19:05:49.997 INFO:tasks.workunit.client.0.smithi027.stdout:8/89: unlink d2/d3/fe 0 2024-09-20T19:05:49.997 INFO:tasks.workunit.client.0.smithi027.stdout:5/84: dwrite d4/da/fc [0,4194304] 0 2024-09-20T19:05:49.998 INFO:tasks.workunit.client.0.smithi027.stdout:8/90: fdatasync d2/d3/d6/ff 0 2024-09-20T19:05:49.999 INFO:tasks.workunit.client.1.smithi098.stdout:3/142: dwrite d4/f18 [0,4194304] 0 2024-09-20T19:05:50.001 INFO:tasks.workunit.client.0.smithi027.stdout:2/66: creat d3/ff x:0 0 0 2024-09-20T19:05:50.002 INFO:tasks.workunit.client.0.smithi027.stdout:6/55: mknod d4/cd 0 2024-09-20T19:05:50.003 INFO:tasks.workunit.client.0.smithi027.stdout:2/67: fsync d3/fa 0 2024-09-20T19:05:50.003 INFO:tasks.workunit.client.1.smithi098.stdout:3/143: symlink d4/l27 0 2024-09-20T19:05:50.004 INFO:tasks.workunit.client.1.smithi098.stdout:3/144: write d4/f10 [654727,52962] 0 2024-09-20T19:05:50.005 INFO:tasks.workunit.client.0.smithi027.stdout:5/85: dread d4/da/fb [4194304,4194304] 0 2024-09-20T19:05:50.006 INFO:tasks.workunit.client.0.smithi027.stdout:5/86: rename d4/da to d4/da/de/d17 22 2024-09-20T19:05:50.007 INFO:tasks.workunit.client.0.smithi027.stdout:5/87: read - d4/fd zero size 2024-09-20T19:05:50.040 INFO:tasks.workunit.client.0.smithi027.stdout:1/92: mkdir d2/d14/d21 0 2024-09-20T19:05:50.042 INFO:tasks.workunit.client.1.smithi098.stdout:3/145: symlink d4/d19/d1d/l28 0 2024-09-20T19:05:50.047 INFO:tasks.workunit.client.0.smithi027.stdout:1/93: dwrite d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:50.060 INFO:tasks.workunit.client.1.smithi098.stdout:2/462: sync 2024-09-20T19:05:50.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:05:50.114 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T19:05:50.115 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:49 smithi027 ceph-mon[28196]: Manager daemon smithi098.wrcvbg is now available 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/146: truncate d4/da/fb 3127733 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/463: link d3/df/d13/f18 d3/d16/d1d/d2b/d49/d69/d88/f98 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/147: mknod d4/d19/c29 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/148: symlink d4/d19/d1d/d22/l2a 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/464: mkdir d3/d16/d1d/d2b/d99 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/465: chown d3/d16/f89 112 1 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/269: dwrite d3/d10/d16/f2c [0,4194304] 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/466: creat d3/d51/d68/f9a x:0 0 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/149: creat d4/d25/f2b x:0 0 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/150: dread d4/f10 [0,4194304] 0 2024-09-20T19:05:50.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/467: creat d3/df/d13/f9b x:0 0 0 2024-09-20T19:05:50.119 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:50.119 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:50.119 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:05:50.119 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:05:50.119 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr fail", "who": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: Activating manager daemon smithi098.wrcvbg 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14221 172.21.15.27:0/1600528696' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "mgr fail", "who": "smithi027.tlgpqo"}]': finished 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: osdmap e48: 6 total, 6 up, 6 in 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: mgrmap e21: smithi098.wrcvbg(active, starting, since 0.0104195s) 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:05:50.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T19:05:50.121 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:49 smithi098 ceph-mon[35737]: Manager daemon smithi098.wrcvbg is now available 2024-09-20T19:05:50.122 INFO:tasks.workunit.client.1.smithi098.stdout:7/270: creat d3/d10/d16/d17/d33/d4b/f55 x:0 0 0 2024-09-20T19:05:50.122 INFO:tasks.workunit.client.1.smithi098.stdout:3/151: creat d4/d19/d1d/d22/f2c x:0 0 0 2024-09-20T19:05:50.122 INFO:tasks.workunit.client.1.smithi098.stdout:2/468: creat d3/d16/d1d/d2b/d46/d74/d7b/f9c x:0 0 0 2024-09-20T19:05:50.122 INFO:tasks.workunit.client.1.smithi098.stdout:3/152: mknod d4/d19/d1d/c2d 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/100: write d3/d8/f20 [360361,117655] 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:8/91: unlink d2/d3/d6/fa 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/101: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:2/68: symlink d3/l10 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:2/69: write d3/f7 [1368380,67009] 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:2/70: write d3/f7 [1929708,79913] 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:5/88: symlink d4/l18 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:9/213: symlink d0/d9/df/d1c/l3f 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:0/106: mknod d2/d20/c25 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:8/92: fdatasync d2/f7 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:6/56: symlink d4/le 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/102: rename d3/d8/da/dc/f10 to d3/d8/da/dc/f21 0 2024-09-20T19:05:50.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/103: fsync f0 0 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:7/104: chown d3/d8/da 1203 1 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:5/89: symlink d4/da/l19 0 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:5/90: read - d4/fd zero size 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:9/214: creat d0/d9/df/d1b/d1a/f40 x:0 0 0 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:4/65: getdents d5 0 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:8/93: rmdir d2 39 2024-09-20T19:05:50.124 INFO:tasks.workunit.client.0.smithi027.stdout:7/105: mknod d3/d8/da/dc/c22 0 2024-09-20T19:05:50.125 INFO:tasks.workunit.client.1.smithi098.stdout:2/469: creat d3/d16/d1d/d2b/d99/f9d x:0 0 0 2024-09-20T19:05:50.125 INFO:tasks.workunit.client.1.smithi098.stdout:2/470: chown d3/d16/d1a 422 1 2024-09-20T19:05:50.125 INFO:tasks.workunit.client.1.smithi098.stdout:7/271: rename d3/d10/d16/l40 to d3/d10/d16/d17/d33/l56 0 2024-09-20T19:05:50.126 INFO:tasks.workunit.client.0.smithi027.stdout:2/71: rename d3/l6 to d3/de/l11 0 2024-09-20T19:05:50.126 INFO:tasks.workunit.client.0.smithi027.stdout:6/57: rename d4/d6 to d4/d6/df 22 2024-09-20T19:05:50.128 INFO:tasks.workunit.client.1.smithi098.stdout:2/471: rmdir d3/d16/d1d/d4f 39 2024-09-20T19:05:50.129 INFO:tasks.workunit.client.0.smithi027.stdout:4/66: unlink d5/d11/c14 0 2024-09-20T19:05:50.130 INFO:tasks.workunit.client.0.smithi027.stdout:5/91: dread f2 [4194304,4194304] 0 2024-09-20T19:05:50.131 INFO:tasks.workunit.client.1.smithi098.stdout:2/472: mknod d3/d16/d1d/d2b/d46/d74/d7b/c9e 0 2024-09-20T19:05:50.132 INFO:tasks.workunit.client.0.smithi027.stdout:7/106: rmdir d3/d8/da 39 2024-09-20T19:05:50.133 INFO:tasks.workunit.client.1.smithi098.stdout:2/473: mkdir d3/d51/d9f 0 2024-09-20T19:05:50.135 INFO:tasks.workunit.client.0.smithi027.stdout:0/107: rmdir d2/d7/d23 0 2024-09-20T19:05:50.136 INFO:tasks.workunit.client.0.smithi027.stdout:4/67: dwrite f4 [0,4194304] 0 2024-09-20T19:05:50.136 INFO:tasks.workunit.client.1.smithi098.stdout:2/474: symlink d3/d16/d1d/d2b/d46/la0 0 2024-09-20T19:05:50.137 INFO:tasks.workunit.client.0.smithi027.stdout:4/68: write d5/fa [977046,17240] 0 2024-09-20T19:05:50.137 INFO:tasks.workunit.client.0.smithi027.stdout:5/92: mkdir d4/da/d1a 0 2024-09-20T19:05:50.138 INFO:tasks.workunit.client.0.smithi027.stdout:4/69: write d5/fa [791469,23137] 0 2024-09-20T19:05:50.139 INFO:tasks.workunit.client.1.smithi098.stdout:2/475: rmdir d3/d16/d1d/d2b/d49/d69 39 2024-09-20T19:05:50.140 INFO:tasks.workunit.client.0.smithi027.stdout:4/70: write f4 [4988360,53486] 0 2024-09-20T19:05:50.142 INFO:tasks.workunit.client.0.smithi027.stdout:0/108: creat d2/d7/f26 x:0 0 0 2024-09-20T19:05:50.145 INFO:tasks.workunit.client.0.smithi027.stdout:5/93: dread f2 [0,4194304] 0 2024-09-20T19:05:50.145 INFO:tasks.workunit.client.0.smithi027.stdout:5/94: stat d4/f16 0 2024-09-20T19:05:50.146 INFO:tasks.workunit.client.1.smithi098.stdout:2/476: dwrite d3/d16/f83 [0,4194304] 0 2024-09-20T19:05:50.146 INFO:tasks.workunit.client.0.smithi027.stdout:5/95: write d4/fd [604617,25135] 0 2024-09-20T19:05:50.147 INFO:tasks.workunit.client.0.smithi027.stdout:5/96: write d4/f10 [969325,119403] 0 2024-09-20T19:05:50.151 INFO:tasks.workunit.client.1.smithi098.stdout:3/153: truncate d4/f18 727416 0 2024-09-20T19:05:50.154 INFO:tasks.workunit.client.1.smithi098.stdout:3/154: write d4/d19/d1d/d22/f2c [513344,129177] 0 2024-09-20T19:05:50.154 INFO:tasks.workunit.client.0.smithi027.stdout:0/109: symlink d2/d20/l27 0 2024-09-20T19:05:50.155 INFO:tasks.workunit.client.1.smithi098.stdout:3/155: fdatasync d4/fd 0 2024-09-20T19:05:50.156 INFO:tasks.workunit.client.0.smithi027.stdout:0/110: dread d2/f10 [0,4194304] 0 2024-09-20T19:05:50.156 INFO:tasks.workunit.client.0.smithi027.stdout:7/107: creat d3/f23 x:0 0 0 2024-09-20T19:05:50.156 INFO:tasks.workunit.client.1.smithi098.stdout:3/156: truncate d4/da/f23 618129 0 2024-09-20T19:05:50.163 INFO:tasks.workunit.client.1.smithi098.stdout:2/477: dwrite d3/d16/d1d/d4f/d8b/f3e [0,4194304] 0 2024-09-20T19:05:50.163 INFO:tasks.workunit.client.0.smithi027.stdout:5/97: read d4/da/fb [6701638,81937] 0 2024-09-20T19:05:50.163 INFO:tasks.workunit.client.0.smithi027.stdout:5/98: readlink d4/l18 0 2024-09-20T19:05:50.164 INFO:tasks.workunit.client.0.smithi027.stdout:5/99: read d4/da/fb [3957180,43668] 0 2024-09-20T19:05:50.164 INFO:tasks.workunit.client.1.smithi098.stdout:2/478: write d3/df/f7a [636955,108904] 0 2024-09-20T19:05:50.165 INFO:tasks.workunit.client.0.smithi027.stdout:5/100: read f2 [7592903,60835] 0 2024-09-20T19:05:50.165 INFO:tasks.workunit.client.0.smithi027.stdout:5/101: chown d4/f10 109669925 1 2024-09-20T19:05:50.166 INFO:tasks.workunit.client.0.smithi027.stdout:5/102: chown d4/da/de/lf 0 1 2024-09-20T19:05:50.166 INFO:tasks.workunit.client.1.smithi098.stdout:3/157: symlink d4/d19/l2e 0 2024-09-20T19:05:50.167 INFO:tasks.workunit.client.0.smithi027.stdout:4/71: symlink d5/d13/l15 0 2024-09-20T19:05:50.170 INFO:tasks.workunit.client.0.smithi027.stdout:8/94: getdents d2 0 2024-09-20T19:05:50.171 INFO:tasks.workunit.client.1.smithi098.stdout:3/158: mkdir d4/d19/d1d/d2f 0 2024-09-20T19:05:50.172 INFO:tasks.workunit.client.1.smithi098.stdout:2/479: dwrite d3/d51/d68/f9a [0,4194304] 0 2024-09-20T19:05:50.175 INFO:tasks.workunit.client.1.smithi098.stdout:2/480: stat d3/d16/d1d/l28 0 2024-09-20T19:05:50.176 INFO:tasks.workunit.client.0.smithi027.stdout:4/72: dwrite d5/fa [0,4194304] 0 2024-09-20T19:05:50.176 INFO:tasks.workunit.client.1.smithi098.stdout:2/481: chown d3/d16/d1d/d2b/d46/d74/d7b 13235 1 2024-09-20T19:05:50.180 INFO:tasks.workunit.client.1.smithi098.stdout:3/159: symlink d4/d19/d1d/d22/l30 0 2024-09-20T19:05:50.185 INFO:tasks.workunit.client.0.smithi027.stdout:4/73: dwrite f4 [0,4194304] 0 2024-09-20T19:05:50.186 INFO:tasks.workunit.client.0.smithi027.stdout:7/108: mkdir d3/d24 0 2024-09-20T19:05:50.187 INFO:tasks.workunit.client.0.smithi027.stdout:3/150: sync 2024-09-20T19:05:50.188 INFO:tasks.workunit.client.0.smithi027.stdout:5/103: creat d4/da/d1a/f1b x:0 0 0 2024-09-20T19:05:50.189 INFO:tasks.workunit.client.0.smithi027.stdout:0/111: link d2/d7/l18 d2/d20/l28 0 2024-09-20T19:05:50.193 INFO:tasks.workunit.client.1.smithi098.stdout:2/482: fdatasync d3/d51/d68/f9a 0 2024-09-20T19:05:50.195 INFO:tasks.workunit.client.0.smithi027.stdout:4/74: dread d5/f10 [0,4194304] 0 2024-09-20T19:05:50.196 INFO:tasks.workunit.client.0.smithi027.stdout:3/151: link d0/d1/d13/d15/f2b d0/d1/f35 0 2024-09-20T19:05:50.198 INFO:tasks.workunit.client.0.smithi027.stdout:5/104: dread d4/da/fb [0,4194304] 0 2024-09-20T19:05:50.199 INFO:tasks.workunit.client.1.smithi098.stdout:2/483: link d3/d16/d1d/d4f/d8b/f7e d3/d16/d1d/d2b/d46/fa1 0 2024-09-20T19:05:50.200 INFO:tasks.workunit.client.0.smithi027.stdout:0/112: dwrite d2/f12 [0,4194304] 0 2024-09-20T19:05:50.201 INFO:tasks.workunit.client.0.smithi027.stdout:4/75: mkdir d5/d13/d16 0 2024-09-20T19:05:50.202 INFO:tasks.workunit.client.0.smithi027.stdout:5/105: creat d4/f1c x:0 0 0 2024-09-20T19:05:50.203 INFO:tasks.workunit.client.0.smithi027.stdout:0/113: write d2/fc [508033,53787] 0 2024-09-20T19:05:50.205 INFO:tasks.workunit.client.1.smithi098.stdout:2/484: mkdir d3/d16/d1d/d2b/d99/da2 0 2024-09-20T19:05:50.206 INFO:tasks.workunit.client.0.smithi027.stdout:3/152: dwrite d0/d1/f2e [0,4194304] 0 2024-09-20T19:05:50.208 INFO:tasks.workunit.client.0.smithi027.stdout:7/109: write d3/d8/da/f11 [454154,59636] 0 2024-09-20T19:05:50.212 INFO:tasks.workunit.client.0.smithi027.stdout:0/114: mkdir d2/d7/d29 0 2024-09-20T19:05:50.214 INFO:tasks.workunit.client.1.smithi098.stdout:2/485: mknod d3/d16/d1d/d2b/d49/d69/ca3 0 2024-09-20T19:05:50.215 INFO:tasks.workunit.client.0.smithi027.stdout:3/153: dread d0/d1/f2e [0,4194304] 0 2024-09-20T19:05:50.215 INFO:tasks.workunit.client.0.smithi027.stdout:4/76: dwrite d5/f10 [0,4194304] 0 2024-09-20T19:05:50.218 INFO:tasks.workunit.client.0.smithi027.stdout:5/106: rename d4/l18 to d4/da/d1a/l1d 0 2024-09-20T19:05:50.219 INFO:tasks.workunit.client.0.smithi027.stdout:0/115: dread d2/fe [0,4194304] 0 2024-09-20T19:05:50.220 INFO:tasks.workunit.client.0.smithi027.stdout:0/116: chown d2/d7/l11 30 1 2024-09-20T19:05:50.222 INFO:tasks.workunit.client.1.smithi098.stdout:3/160: write d4/f18 [1346659,109678] 0 2024-09-20T19:05:50.223 INFO:tasks.workunit.client.0.smithi027.stdout:4/77: mkdir d5/d11/d17 0 2024-09-20T19:05:50.223 INFO:tasks.workunit.client.1.smithi098.stdout:2/486: dread d3/d16/d1d/d2b/d49/f4d [0,4194304] 0 2024-09-20T19:05:50.225 INFO:tasks.workunit.client.1.smithi098.stdout:2/487: stat d3/d16/d1d/d2b/d46/d74/d7b/f91 0 2024-09-20T19:05:50.225 INFO:tasks.workunit.client.0.smithi027.stdout:5/107: mkdir d4/da/de/d1e 0 2024-09-20T19:05:50.226 INFO:tasks.workunit.client.1.smithi098.stdout:3/161: mknod d4/d25/c31 0 2024-09-20T19:05:50.231 INFO:tasks.workunit.client.0.smithi027.stdout:0/117: rename d2/d20/l27 to d2/d7/d29/l2a 0 2024-09-20T19:05:50.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/162: dwrite d4/fd [0,4194304] 0 2024-09-20T19:05:50.232 INFO:tasks.workunit.client.0.smithi027.stdout:0/118: write d2/d7/fd [3835257,78023] 0 2024-09-20T19:05:50.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/163: readlink d4/d19/d1d/d22/l2a 0 2024-09-20T19:05:50.234 INFO:tasks.workunit.client.0.smithi027.stdout:5/108: mkdir d4/d1f 0 2024-09-20T19:05:50.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/164: stat d4/d19/c29 0 2024-09-20T19:05:50.234 INFO:tasks.workunit.client.0.smithi027.stdout:7/110: link d3/d1a/c1f d3/d8/d1c/c25 0 2024-09-20T19:05:50.237 INFO:tasks.workunit.client.1.smithi098.stdout:2/488: write d3/f9 [261469,16695] 0 2024-09-20T19:05:50.238 INFO:tasks.workunit.client.1.smithi098.stdout:2/489: readlink d3/d16/d1d/d2b/d46/la0 0 2024-09-20T19:05:50.239 INFO:tasks.workunit.client.0.smithi027.stdout:0/119: unlink d2/d20/c25 0 2024-09-20T19:05:50.240 INFO:tasks.workunit.client.1.smithi098.stdout:2/490: symlink d3/la4 0 2024-09-20T19:05:50.241 INFO:tasks.workunit.client.1.smithi098.stdout:3/165: creat d4/da/f32 x:0 0 0 2024-09-20T19:05:50.243 INFO:tasks.workunit.client.0.smithi027.stdout:3/154: getdents d0/d1/d7 0 2024-09-20T19:05:50.243 INFO:tasks.workunit.client.0.smithi027.stdout:5/109: getdents d4/d1f 0 2024-09-20T19:05:50.244 INFO:tasks.workunit.client.1.smithi098.stdout:3/166: rmdir d4/d19/d1d/d22 39 2024-09-20T19:05:50.244 INFO:tasks.workunit.client.1.smithi098.stdout:3/167: chown d4 18 1 2024-09-20T19:05:50.244 INFO:tasks.workunit.client.1.smithi098.stdout:3/168: chown d4/d25/f2b 45349 1 2024-09-20T19:05:50.245 INFO:tasks.workunit.client.1.smithi098.stdout:3/169: dread - d4/d25/f2b zero size 2024-09-20T19:05:50.245 INFO:tasks.workunit.client.0.smithi027.stdout:0/120: creat d2/d14/d1b/f2b x:0 0 0 2024-09-20T19:05:50.246 INFO:tasks.workunit.client.0.smithi027.stdout:0/121: write d2/d14/d1b/f24 [1003460,62200] 0 2024-09-20T19:05:50.247 INFO:tasks.workunit.client.0.smithi027.stdout:7/111: truncate d3/f5 4151484 0 2024-09-20T19:05:50.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/170: chown d4/d19/d1d/d22/f2c 17177925 1 2024-09-20T19:05:50.249 INFO:tasks.workunit.client.0.smithi027.stdout:3/155: mkdir d0/d1/d36 0 2024-09-20T19:05:50.250 INFO:tasks.workunit.client.0.smithi027.stdout:3/156: write d0/f11 [2490221,14794] 0 2024-09-20T19:05:50.251 INFO:tasks.workunit.client.0.smithi027.stdout:0/122: symlink d2/d14/l2c 0 2024-09-20T19:05:50.251 INFO:tasks.workunit.client.1.smithi098.stdout:3/171: dread d4/f18 [0,4194304] 0 2024-09-20T19:05:50.255 INFO:tasks.workunit.client.1.smithi098.stdout:3/172: rename d4/l27 to d4/d19/d1d/d22/l33 0 2024-09-20T19:05:50.256 INFO:tasks.workunit.client.0.smithi027.stdout:3/157: dwrite d0/d1/d7/d1d/f21 [0,4194304] 0 2024-09-20T19:05:50.256 INFO:tasks.workunit.client.1.smithi098.stdout:1/90: sync 2024-09-20T19:05:50.258 INFO:tasks.workunit.client.0.smithi027.stdout:5/110: creat d4/da/de/d1e/f20 x:0 0 0 2024-09-20T19:05:50.260 INFO:tasks.workunit.client.0.smithi027.stdout:7/112: mkdir d3/d8/d26 0 2024-09-20T19:05:50.262 INFO:tasks.workunit.client.0.smithi027.stdout:3/158: creat d0/d1/d13/f37 x:0 0 0 2024-09-20T19:05:50.265 INFO:tasks.workunit.client.0.smithi027.stdout:7/113: dread d3/d8/da/f11 [0,4194304] 0 2024-09-20T19:05:50.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/173: dwrite d4/f18 [0,4194304] 0 2024-09-20T19:05:50.267 INFO:tasks.workunit.client.1.smithi098.stdout:2/491: dread d3/df/d13/f2c [0,4194304] 0 2024-09-20T19:05:50.269 INFO:tasks.workunit.client.1.smithi098.stdout:1/91: creat d1/d3/f15 x:0 0 0 2024-09-20T19:05:50.271 INFO:tasks.workunit.client.1.smithi098.stdout:1/92: write d1/d3/fd [58548,83084] 0 2024-09-20T19:05:50.271 INFO:tasks.workunit.client.1.smithi098.stdout:1/93: readlink d1/d3/l11 0 2024-09-20T19:05:50.273 INFO:tasks.workunit.client.1.smithi098.stdout:3/174: fdatasync d4/d19/d1d/d22/f24 0 2024-09-20T19:05:50.276 INFO:tasks.workunit.client.0.smithi027.stdout:7/114: write d3/d8/f20 [66445,11571] 0 2024-09-20T19:05:50.276 INFO:tasks.workunit.client.1.smithi098.stdout:1/94: creat d1/f16 x:0 0 0 2024-09-20T19:05:50.277 INFO:tasks.workunit.client.0.smithi027.stdout:0/123: dwrite d2/f9 [4194304,4194304] 0 2024-09-20T19:05:50.277 INFO:tasks.workunit.client.1.smithi098.stdout:1/95: dread - d1/f16 zero size 2024-09-20T19:05:50.277 INFO:tasks.workunit.client.0.smithi027.stdout:7/115: chown d3/d8/da/f13 379 1 2024-09-20T19:05:50.278 INFO:tasks.workunit.client.1.smithi098.stdout:2/492: mknod d3/d16/d1d/d2b/d49/d69/d88/d8a/ca5 0 2024-09-20T19:05:50.281 INFO:tasks.workunit.client.0.smithi027.stdout:0/124: creat d2/d20/f2d x:0 0 0 2024-09-20T19:05:50.282 INFO:tasks.workunit.client.0.smithi027.stdout:7/116: dread d3/d8/da/dc/f21 [0,4194304] 0 2024-09-20T19:05:50.283 INFO:tasks.workunit.client.0.smithi027.stdout:5/111: getdents d4 0 2024-09-20T19:05:50.284 INFO:tasks.workunit.client.1.smithi098.stdout:3/175: creat d4/f34 x:0 0 0 2024-09-20T19:05:50.286 INFO:tasks.workunit.client.1.smithi098.stdout:3/176: readlink d4/d19/d1d/d22/l2a 0 2024-09-20T19:05:50.287 INFO:tasks.workunit.client.1.smithi098.stdout:3/177: write d4/f1b [63050,110540] 0 2024-09-20T19:05:50.287 INFO:tasks.workunit.client.1.smithi098.stdout:3/178: fdatasync d4/f1c 0 2024-09-20T19:05:50.289 INFO:tasks.workunit.client.1.smithi098.stdout:3/179: write d4/f18 [384579,23953] 0 2024-09-20T19:05:50.289 INFO:tasks.workunit.client.0.smithi027.stdout:5/112: dwrite d4/fd [0,4194304] 0 2024-09-20T19:05:50.289 INFO:tasks.workunit.client.1.smithi098.stdout:1/96: creat d1/d3/df/f17 x:0 0 0 2024-09-20T19:05:50.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/180: creat d4/d25/f35 x:0 0 0 2024-09-20T19:05:50.297 INFO:tasks.workunit.client.0.smithi027.stdout:7/117: symlink d3/d24/l27 0 2024-09-20T19:05:50.297 INFO:tasks.workunit.client.0.smithi027.stdout:7/118: dread - d3/f23 zero size 2024-09-20T19:05:50.297 INFO:tasks.workunit.client.0.smithi027.stdout:7/119: readlink d3/d24/l27 0 2024-09-20T19:05:50.298 INFO:tasks.workunit.client.0.smithi027.stdout:0/125: getdents d2/d7/d29 0 2024-09-20T19:05:50.298 INFO:tasks.workunit.client.1.smithi098.stdout:3/181: write d4/da/f14 [3038588,52233] 0 2024-09-20T19:05:50.298 INFO:tasks.workunit.client.0.smithi027.stdout:7/120: read - d3/f12 zero size 2024-09-20T19:05:50.299 INFO:tasks.workunit.client.1.smithi098.stdout:1/97: creat d1/d3/f18 x:0 0 0 2024-09-20T19:05:50.301 INFO:tasks.workunit.client.0.smithi027.stdout:0/126: mkdir d2/d14/d1d/d2e 0 2024-09-20T19:05:50.302 INFO:tasks.workunit.client.0.smithi027.stdout:7/121: fdatasync f2 0 2024-09-20T19:05:50.304 INFO:tasks.workunit.client.0.smithi027.stdout:0/127: mknod d2/d20/c2f 0 2024-09-20T19:05:50.307 INFO:tasks.workunit.client.1.smithi098.stdout:2/493: dread d3/fa [0,4194304] 0 2024-09-20T19:05:50.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/182: link d4/fd d4/d19/d1d/d22/f36 0 2024-09-20T19:05:50.309 INFO:tasks.workunit.client.0.smithi027.stdout:7/122: creat d3/d8/da/f28 x:0 0 0 2024-09-20T19:05:50.310 INFO:tasks.workunit.client.1.smithi098.stdout:1/98: creat d1/d3/f19 x:0 0 0 2024-09-20T19:05:50.313 INFO:tasks.workunit.client.0.smithi027.stdout:0/128: symlink d2/l30 0 2024-09-20T19:05:50.314 INFO:tasks.workunit.client.1.smithi098.stdout:1/99: unlink d1/d3/f6 0 2024-09-20T19:05:50.317 INFO:tasks.workunit.client.1.smithi098.stdout:3/183: symlink d4/d19/d1d/d2f/l37 0 2024-09-20T19:05:50.319 INFO:tasks.workunit.client.1.smithi098.stdout:1/100: rename d1/d3/df/f17 to d1/d3/df/f1a 0 2024-09-20T19:05:50.320 INFO:tasks.workunit.client.1.smithi098.stdout:2/494: creat d3/d16/fa6 x:0 0 0 2024-09-20T19:05:50.321 INFO:tasks.workunit.client.0.smithi027.stdout:7/123: creat d3/f29 x:0 0 0 2024-09-20T19:05:50.324 INFO:tasks.workunit.client.0.smithi027.stdout:5/113: dwrite f2 [0,4194304] 0 2024-09-20T19:05:50.331 INFO:tasks.workunit.client.0.smithi027.stdout:5/114: dwrite f2 [4194304,4194304] 0 2024-09-20T19:05:50.333 INFO:tasks.workunit.client.0.smithi027.stdout:5/115: truncate d4/da/de/d1e/f20 1033658 0 2024-09-20T19:05:50.360 INFO:tasks.workunit.client.1.smithi098.stdout:2/495: rmdir d3/d16/d1d/d2b/d49/d69/d88 39 2024-09-20T19:05:50.363 INFO:tasks.workunit.client.0.smithi027.stdout:0/129: truncate d2/d7/f15 2853776 0 2024-09-20T19:05:50.365 INFO:tasks.workunit.client.0.smithi027.stdout:5/116: mknod d4/da/de/c21 0 2024-09-20T19:05:50.366 INFO:tasks.workunit.client.0.smithi027.stdout:7/124: symlink d3/d8/d1c/l2a 0 2024-09-20T19:05:50.368 INFO:tasks.workunit.client.1.smithi098.stdout:2/496: dwrite d3/d51/f7f [0,4194304] 0 2024-09-20T19:05:50.368 INFO:tasks.workunit.client.0.smithi027.stdout:5/117: rmdir d4/da 39 2024-09-20T19:05:50.369 INFO:tasks.workunit.client.0.smithi027.stdout:0/130: dwrite d2/d7/fd [0,4194304] 0 2024-09-20T19:05:50.371 INFO:tasks.workunit.client.1.smithi098.stdout:1/101: dread d1/d3/f9 [0,4194304] 0 2024-09-20T19:05:50.372 INFO:tasks.workunit.client.1.smithi098.stdout:1/102: fsync d1/f10 0 2024-09-20T19:05:50.373 INFO:tasks.workunit.client.1.smithi098.stdout:1/103: write d1/d3/fe [1270308,92306] 0 2024-09-20T19:05:50.373 INFO:tasks.workunit.client.1.smithi098.stdout:1/104: fdatasync d1/d3/f19 0 2024-09-20T19:05:50.375 INFO:tasks.workunit.client.0.smithi027.stdout:7/125: creat d3/d1a/f2b x:0 0 0 2024-09-20T19:05:50.375 INFO:tasks.workunit.client.1.smithi098.stdout:1/105: dread - d1/d3/f18 zero size 2024-09-20T19:05:50.376 INFO:tasks.workunit.client.0.smithi027.stdout:5/118: readlink d4/da/l12 0 2024-09-20T19:05:50.379 INFO:tasks.workunit.client.0.smithi027.stdout:0/131: creat d2/d14/f31 x:0 0 0 2024-09-20T19:05:50.380 INFO:tasks.workunit.client.0.smithi027.stdout:1/94: sync 2024-09-20T19:05:50.381 INFO:tasks.workunit.client.0.smithi027.stdout:1/95: chown d2/d1b/l1f 1756 1 2024-09-20T19:05:50.381 INFO:tasks.workunit.client.0.smithi027.stdout:7/126: creat d3/d24/f2c x:0 0 0 2024-09-20T19:05:50.382 INFO:tasks.workunit.client.0.smithi027.stdout:7/127: readlink d3/l4 0 2024-09-20T19:05:50.383 INFO:tasks.workunit.client.1.smithi098.stdout:1/106: rmdir d1/d3 39 2024-09-20T19:05:50.384 INFO:tasks.workunit.client.0.smithi027.stdout:0/132: mknod d2/d14/d1d/c32 0 2024-09-20T19:05:50.385 INFO:tasks.workunit.client.0.smithi027.stdout:0/133: stat d2/c6 0 2024-09-20T19:05:50.385 INFO:tasks.workunit.client.0.smithi027.stdout:1/96: write d2/f13 [1694334,15503] 0 2024-09-20T19:05:50.386 INFO:tasks.workunit.client.0.smithi027.stdout:0/134: write d2/d14/f31 [177166,41611] 0 2024-09-20T19:05:50.387 INFO:tasks.workunit.client.1.smithi098.stdout:1/107: truncate d1/d3/df/f1a 984918 0 2024-09-20T19:05:50.387 INFO:tasks.workunit.client.0.smithi027.stdout:5/119: creat d4/d1f/f22 x:0 0 0 2024-09-20T19:05:50.391 INFO:tasks.workunit.client.0.smithi027.stdout:5/120: creat d4/d1f/f23 x:0 0 0 2024-09-20T19:05:50.391 INFO:tasks.workunit.client.0.smithi027.stdout:0/135: creat d2/d14/d1d/d2e/f33 x:0 0 0 2024-09-20T19:05:50.392 INFO:tasks.workunit.client.0.smithi027.stdout:0/136: chown d2 5503 1 2024-09-20T19:05:50.394 INFO:tasks.workunit.client.1.smithi098.stdout:1/108: rename d1/d3/fd to d1/d3/f1b 0 2024-09-20T19:05:50.395 INFO:tasks.workunit.client.0.smithi027.stdout:1/97: getdents d2/d8 0 2024-09-20T19:05:50.399 INFO:tasks.workunit.client.0.smithi027.stdout:1/98: rmdir d2/d8 39 2024-09-20T19:05:50.400 INFO:tasks.workunit.client.1.smithi098.stdout:1/109: dwrite d1/f14 [0,4194304] 0 2024-09-20T19:05:50.401 INFO:tasks.workunit.client.0.smithi027.stdout:5/121: dwrite d4/f11 [0,4194304] 0 2024-09-20T19:05:50.401 INFO:tasks.workunit.client.0.smithi027.stdout:1/99: chown d2/l1d 25 1 2024-09-20T19:05:50.403 INFO:tasks.workunit.client.1.smithi098.stdout:1/110: write d1/d3/f19 [279797,96831] 0 2024-09-20T19:05:50.403 INFO:tasks.workunit.client.0.smithi027.stdout:1/100: readlink d2/d14/l17 0 2024-09-20T19:05:50.403 INFO:tasks.workunit.client.0.smithi027.stdout:0/137: dwrite d2/d7/f26 [0,4194304] 0 2024-09-20T19:05:50.404 INFO:tasks.workunit.client.1.smithi098.stdout:1/111: write d1/d3/f15 [931265,50349] 0 2024-09-20T19:05:50.411 INFO:tasks.workunit.client.0.smithi027.stdout:5/122: creat d4/d1f/f24 x:0 0 0 2024-09-20T19:05:50.413 INFO:tasks.workunit.client.0.smithi027.stdout:0/138: chown d2/d7/c22 20152770 1 2024-09-20T19:05:50.415 INFO:tasks.workunit.client.0.smithi027.stdout:1/101: creat d2/d15/f22 x:0 0 0 2024-09-20T19:05:50.415 INFO:tasks.workunit.client.0.smithi027.stdout:0/139: write d2/d7/f26 [1043845,64978] 0 2024-09-20T19:05:50.417 INFO:tasks.workunit.client.0.smithi027.stdout:1/102: write d2/d1b/f1e [2016820,117782] 0 2024-09-20T19:05:50.418 INFO:tasks.workunit.client.0.smithi027.stdout:5/123: mknod d4/da/c25 0 2024-09-20T19:05:50.422 INFO:tasks.workunit.client.0.smithi027.stdout:0/140: symlink d2/d14/d1d/d2e/l34 0 2024-09-20T19:05:50.425 INFO:tasks.workunit.client.1.smithi098.stdout:1/112: rename d1/l13 to d1/l1c 0 2024-09-20T19:05:50.425 INFO:tasks.workunit.client.1.smithi098.stdout:1/113: chown d1/d3/fe 13299 1 2024-09-20T19:05:50.426 INFO:tasks.workunit.client.0.smithi027.stdout:1/103: dwrite d2/f13 [0,4194304] 0 2024-09-20T19:05:50.426 INFO:tasks.workunit.client.0.smithi027.stdout:1/104: chown d2/d1b 29 1 2024-09-20T19:05:50.427 INFO:tasks.workunit.client.0.smithi027.stdout:1/105: stat d2/d14/d21 0 2024-09-20T19:05:50.428 INFO:tasks.workunit.client.0.smithi027.stdout:0/141: rename d2/d20/f2d to d2/d7/f35 0 2024-09-20T19:05:50.428 INFO:tasks.workunit.client.1.smithi098.stdout:1/114: rmdir d1/d3/df 39 2024-09-20T19:05:50.436 INFO:tasks.workunit.client.0.smithi027.stdout:5/124: fdatasync d4/f11 0 2024-09-20T19:05:50.437 INFO:tasks.workunit.client.0.smithi027.stdout:5/125: chown d4/da/d1a/f1b 0 1 2024-09-20T19:05:50.439 INFO:tasks.workunit.client.1.smithi098.stdout:1/115: link d1/d3/fe d1/d3/f1d 0 2024-09-20T19:05:50.439 INFO:tasks.workunit.client.0.smithi027.stdout:1/106: link d2/d8/la d2/d14/l23 0 2024-09-20T19:05:50.440 INFO:tasks.workunit.client.0.smithi027.stdout:1/107: write d2/f13 [3692442,116987] 0 2024-09-20T19:05:50.441 INFO:tasks.workunit.client.0.smithi027.stdout:5/126: fdatasync d4/da/fb 0 2024-09-20T19:05:50.444 INFO:tasks.workunit.client.0.smithi027.stdout:1/108: dread d2/d15/f16 [0,4194304] 0 2024-09-20T19:05:50.445 INFO:tasks.workunit.client.0.smithi027.stdout:5/127: rmdir d4/da 39 2024-09-20T19:05:50.447 INFO:tasks.workunit.client.1.smithi098.stdout:1/116: creat d1/d3/f1e x:0 0 0 2024-09-20T19:05:50.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/184: truncate d4/d19/d1d/d22/f2c 415884 0 2024-09-20T19:05:50.448 INFO:tasks.workunit.client.1.smithi098.stdout:3/185: fdatasync d4/f1c 0 2024-09-20T19:05:50.451 INFO:tasks.workunit.client.0.smithi027.stdout:5/128: rename d4/da/de/c21 to d4/da/de/d1e/c26 0 2024-09-20T19:05:50.453 INFO:tasks.workunit.client.0.smithi027.stdout:1/109: creat d2/f24 x:0 0 0 2024-09-20T19:05:50.454 INFO:tasks.workunit.client.1.smithi098.stdout:3/186: mkdir d4/d38 0 2024-09-20T19:05:50.455 INFO:tasks.workunit.client.0.smithi027.stdout:5/129: symlink d4/da/l27 0 2024-09-20T19:05:50.456 INFO:tasks.workunit.client.0.smithi027.stdout:5/130: fdatasync d4/d1f/f24 0 2024-09-20T19:05:50.456 INFO:tasks.workunit.client.1.smithi098.stdout:1/117: rename d1/fa to d1/d3/df/f1f 0 2024-09-20T19:05:50.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/131: fdatasync d4/da/de/d1e/f20 0 2024-09-20T19:05:50.457 INFO:tasks.workunit.client.0.smithi027.stdout:1/110: dread d2/d15/f16 [0,4194304] 0 2024-09-20T19:05:50.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/132: dread - d4/f16 zero size 2024-09-20T19:05:50.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/497: write d3/d16/d1a/f27 [1038874,85234] 0 2024-09-20T19:05:50.462 INFO:tasks.workunit.client.0.smithi027.stdout:1/111: creat d2/d15/f25 x:0 0 0 2024-09-20T19:05:50.463 INFO:tasks.workunit.client.0.smithi027.stdout:1/112: write d2/f24 [1004735,9625] 0 2024-09-20T19:05:50.464 INFO:tasks.workunit.client.0.smithi027.stdout:5/133: mkdir d4/d1f/d28 0 2024-09-20T19:05:50.467 INFO:tasks.workunit.client.0.smithi027.stdout:1/113: symlink d2/d14/l26 0 2024-09-20T19:05:50.470 INFO:tasks.workunit.client.1.smithi098.stdout:1/118: rename d1/c12 to d1/d3/c20 0 2024-09-20T19:05:50.470 INFO:tasks.workunit.client.0.smithi027.stdout:5/134: dwrite d4/f11 [0,4194304] 0 2024-09-20T19:05:50.472 INFO:tasks.workunit.client.1.smithi098.stdout:2/498: creat d3/d16/d1d/fa7 x:0 0 0 2024-09-20T19:05:50.475 INFO:tasks.workunit.client.1.smithi098.stdout:2/499: mknod d3/df/d13/ca8 0 2024-09-20T19:05:50.475 INFO:tasks.workunit.client.0.smithi027.stdout:1/114: dwrite d2/f13 [4194304,4194304] 0 2024-09-20T19:05:50.477 INFO:tasks.workunit.client.1.smithi098.stdout:1/119: dread d1/d3/fe [0,4194304] 0 2024-09-20T19:05:50.477 INFO:tasks.workunit.client.0.smithi027.stdout:5/135: creat d4/da/f29 x:0 0 0 2024-09-20T19:05:50.478 INFO:tasks.workunit.client.0.smithi027.stdout:9/215: sync 2024-09-20T19:05:50.478 INFO:tasks.workunit.client.1.smithi098.stdout:1/120: dread - d1/d3/f18 zero size 2024-09-20T19:05:50.479 INFO:tasks.workunit.client.0.smithi027.stdout:5/136: write d4/da/de/d1e/f20 [1222493,40560] 0 2024-09-20T19:05:50.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/500: dwrite d3/d16/d1d/f4e [0,4194304] 0 2024-09-20T19:05:50.484 INFO:tasks.workunit.client.1.smithi098.stdout:1/121: creat d1/d3/df/f21 x:0 0 0 2024-09-20T19:05:50.486 INFO:tasks.workunit.client.1.smithi098.stdout:1/122: dread - d1/d3/df/f21 zero size 2024-09-20T19:05:50.487 INFO:tasks.workunit.client.1.smithi098.stdout:1/123: dread - d1/f16 zero size 2024-09-20T19:05:50.487 INFO:tasks.workunit.client.1.smithi098.stdout:1/124: chown d1/d3/df/f1a 40930 1 2024-09-20T19:05:50.488 INFO:tasks.workunit.client.0.smithi027.stdout:1/115: symlink d2/d14/d21/l27 0 2024-09-20T19:05:50.488 INFO:tasks.workunit.client.1.smithi098.stdout:1/125: write d1/f10 [2198138,127181] 0 2024-09-20T19:05:50.491 INFO:tasks.workunit.client.0.smithi027.stdout:5/137: symlink d4/da/l2a 0 2024-09-20T19:05:50.493 INFO:tasks.workunit.client.1.smithi098.stdout:1/126: dread d1/d3/f15 [0,4194304] 0 2024-09-20T19:05:50.494 INFO:tasks.workunit.client.0.smithi027.stdout:9/216: mknod d0/d9/d3d/c41 0 2024-09-20T19:05:50.498 INFO:tasks.workunit.client.0.smithi027.stdout:0/142: dwrite d2/f10 [0,4194304] 0 2024-09-20T19:05:50.499 INFO:tasks.workunit.client.0.smithi027.stdout:0/143: fsync d2/d7/f26 0 2024-09-20T19:05:50.502 INFO:tasks.workunit.client.0.smithi027.stdout:9/217: creat d0/f42 x:0 0 0 2024-09-20T19:05:50.515 INFO:tasks.workunit.client.1.smithi098.stdout:1/127: mknod d1/d3/c22 0 2024-09-20T19:05:50.516 INFO:tasks.workunit.client.0.smithi027.stdout:9/218: dread d0/d9/df/d1b/d1a/f13 [0,4194304] 0 2024-09-20T19:05:50.516 INFO:tasks.workunit.client.1.smithi098.stdout:2/501: getdents d3/d16/d1d/d2b/d49/d69 0 2024-09-20T19:05:50.517 INFO:tasks.workunit.client.0.smithi027.stdout:9/219: chown d0/d9/f28 1000 0 2024-09-20T19:05:50.517 INFO:tasks.workunit.client.0.smithi027.stdout:9/220: chown d0/d9/l22 3648523 1 2024-09-20T19:05:50.518 INFO:tasks.workunit.client.1.smithi098.stdout:3/187: write d4/d19/d1d/d22/f36 [405919,78497] 0 2024-09-20T19:05:50.519 INFO:tasks.workunit.client.1.smithi098.stdout:1/128: fdatasync d1/d3/f1b 0 2024-09-20T19:05:50.519 INFO:tasks.workunit.client.1.smithi098.stdout:1/129: stat d1/d3/f9 0 2024-09-20T19:05:50.521 INFO:tasks.workunit.client.1.smithi098.stdout:1/130: write d1/d3/f9 [2086659,9133] 0 2024-09-20T19:05:50.522 INFO:tasks.workunit.client.0.smithi027.stdout:0/144: symlink d2/d14/d1b/l36 0 2024-09-20T19:05:50.524 INFO:tasks.workunit.client.1.smithi098.stdout:1/131: dread d1/d3/f19 [0,4194304] 0 2024-09-20T19:05:50.525 INFO:tasks.workunit.client.0.smithi027.stdout:5/138: link d4/da/fb d4/da/f2b 0 2024-09-20T19:05:50.530 INFO:tasks.workunit.client.0.smithi027.stdout:9/221: mknod d0/d9/df/c43 0 2024-09-20T19:05:50.532 INFO:tasks.workunit.client.0.smithi027.stdout:5/139: creat d4/da/f2c x:0 0 0 2024-09-20T19:05:50.533 INFO:tasks.workunit.client.0.smithi027.stdout:5/140: dread - d4/da/f29 zero size 2024-09-20T19:05:50.534 INFO:tasks.workunit.client.0.smithi027.stdout:5/141: write d4/da/de/d1e/f20 [1814191,54172] 0 2024-09-20T19:05:50.534 INFO:tasks.workunit.client.1.smithi098.stdout:1/132: creat d1/d3/df/f23 x:0 0 0 2024-09-20T19:05:50.539 INFO:tasks.workunit.client.0.smithi027.stdout:9/222: creat d0/d9/f44 x:0 0 0 2024-09-20T19:05:50.540 INFO:tasks.workunit.client.0.smithi027.stdout:5/142: dwrite f2 [4194304,4194304] 0 2024-09-20T19:05:50.542 INFO:tasks.workunit.client.0.smithi027.stdout:1/116: truncate d2/d1b/f1e 776790 0 2024-09-20T19:05:50.542 INFO:tasks.workunit.client.0.smithi027.stdout:1/117: chown d2/d14/l17 30564041 1 2024-09-20T19:05:50.563 INFO:tasks.workunit.client.0.smithi027.stdout:6/58: sync 2024-09-20T19:05:50.563 INFO:tasks.workunit.client.0.smithi027.stdout:2/72: sync 2024-09-20T19:05:50.563 INFO:tasks.workunit.client.0.smithi027.stdout:8/95: sync 2024-09-20T19:05:50.566 INFO:tasks.workunit.client.0.smithi027.stdout:2/73: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:50.567 INFO:tasks.workunit.client.0.smithi027.stdout:2/74: write d3/fa [224196,49288] 0 2024-09-20T19:05:50.575 INFO:tasks.workunit.client.0.smithi027.stdout:2/75: dwrite d3/ff [0,4194304] 0 2024-09-20T19:05:50.576 INFO:tasks.workunit.client.0.smithi027.stdout:2/76: write d3/fa [1688637,37291] 0 2024-09-20T19:05:50.580 INFO:tasks.workunit.client.0.smithi027.stdout:2/77: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:50.582 INFO:tasks.workunit.client.1.smithi098.stdout:9/292: sync 2024-09-20T19:05:50.583 INFO:tasks.workunit.client.1.smithi098.stdout:2/502: getdents d3/d16/d1a 0 2024-09-20T19:05:50.586 INFO:tasks.workunit.client.1.smithi098.stdout:1/133: symlink d1/d3/df/l24 0 2024-09-20T19:05:50.592 INFO:tasks.workunit.client.1.smithi098.stdout:3/188: truncate d4/d19/d1d/d22/f36 4044624 0 2024-09-20T19:05:50.594 INFO:tasks.workunit.client.1.smithi098.stdout:9/293: rmdir d4/de/d27/d4a/d21/d25 39 2024-09-20T19:05:50.596 INFO:tasks.workunit.client.0.smithi027.stdout:5/143: dread d4/da/f2b [4194304,4194304] 0 2024-09-20T19:05:50.597 INFO:tasks.workunit.client.0.smithi027.stdout:5/144: write f2 [9112776,108178] 0 2024-09-20T19:05:50.600 INFO:tasks.workunit.client.1.smithi098.stdout:3/189: dwrite d4/d25/f35 [0,4194304] 0 2024-09-20T19:05:50.605 INFO:tasks.workunit.client.0.smithi027.stdout:2/78: rename c1 to d3/c12 0 2024-09-20T19:05:50.607 INFO:tasks.workunit.client.0.smithi027.stdout:0/145: getdents d2/d14/d1b 0 2024-09-20T19:05:50.608 INFO:tasks.workunit.client.0.smithi027.stdout:0/146: stat d2/lb 0 2024-09-20T19:05:50.608 INFO:tasks.workunit.client.0.smithi027.stdout:0/147: write d2/d7/f26 [3524703,72792] 0 2024-09-20T19:05:50.609 INFO:tasks.workunit.client.0.smithi027.stdout:9/223: symlink d0/d9/df/d1b/d1a/dd/l45 0 2024-09-20T19:05:50.611 INFO:tasks.workunit.client.1.smithi098.stdout:9/294: mkdir d4/de/d27/d4a/d21/d25/d66 0 2024-09-20T19:05:50.612 INFO:tasks.workunit.client.0.smithi027.stdout:1/118: mkdir d2/d28 0 2024-09-20T19:05:50.613 INFO:tasks.workunit.client.0.smithi027.stdout:1/119: truncate d2/d15/f22 637657 0 2024-09-20T19:05:50.614 INFO:tasks.workunit.client.1.smithi098.stdout:9/295: truncate d4/de/d27/d4a/d21/f4e 230672 0 2024-09-20T19:05:50.614 INFO:tasks.workunit.client.0.smithi027.stdout:1/120: fdatasync d2/d15/f25 0 2024-09-20T19:05:50.615 INFO:tasks.workunit.client.1.smithi098.stdout:2/503: link d3/d16/d1d/d4f/d8b/l66 d3/d16/d1d/d2b/d46/d74/d82/la9 0 2024-09-20T19:05:50.617 INFO:tasks.workunit.client.0.smithi027.stdout:8/96: truncate d2/d3/d6/ff 3589025 0 2024-09-20T19:05:50.619 INFO:tasks.workunit.client.1.smithi098.stdout:1/134: rename d1/d3/df/f1f to d1/f25 0 2024-09-20T19:05:50.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/190: mkdir d4/d38/d39 0 2024-09-20T19:05:50.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/191: chown d4/d19 28659 1 2024-09-20T19:05:50.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/192: fsync d4/d19/f1f 0 2024-09-20T19:05:50.624 INFO:tasks.workunit.client.1.smithi098.stdout:3/193: fdatasync d4/da/f23 0 2024-09-20T19:05:50.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/79: chown d3/ld 0 1 2024-09-20T19:05:50.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/80: fdatasync d3/f7 0 2024-09-20T19:05:50.630 INFO:tasks.workunit.client.0.smithi027.stdout:9/224: mknod d0/d9/c46 0 2024-09-20T19:05:50.631 INFO:tasks.workunit.client.0.smithi027.stdout:9/225: write d0/d9/df/d1b/d1a/dd/f29 [520580,81227] 0 2024-09-20T19:05:50.632 INFO:tasks.workunit.client.1.smithi098.stdout:1/135: symlink d1/d3/df/l26 0 2024-09-20T19:05:50.632 INFO:tasks.workunit.client.1.smithi098.stdout:1/136: chown d1/f10 9 1 2024-09-20T19:05:50.632 INFO:tasks.workunit.client.0.smithi027.stdout:9/226: read d0/fa [751559,87517] 0 2024-09-20T19:05:50.633 INFO:tasks.workunit.client.0.smithi027.stdout:9/227: write d0/d9/df/f24 [306345,40699] 0 2024-09-20T19:05:50.633 INFO:tasks.workunit.client.0.smithi027.stdout:0/148: mknod d2/d7/d29/c37 0 2024-09-20T19:05:50.634 INFO:tasks.workunit.client.0.smithi027.stdout:0/149: write d2/f9 [7222461,105143] 0 2024-09-20T19:05:50.634 INFO:tasks.workunit.client.0.smithi027.stdout:9/228: readlink d0/d9/df/d1b/d1a/l1f 0 2024-09-20T19:05:50.635 INFO:tasks.workunit.client.0.smithi027.stdout:0/150: chown d2/f19 3632084 1 2024-09-20T19:05:50.636 INFO:tasks.workunit.client.0.smithi027.stdout:1/121: unlink d2/d15/f16 0 2024-09-20T19:05:50.644 INFO:tasks.workunit.client.1.smithi098.stdout:1/137: unlink d1/d3/f1d 0 2024-09-20T19:05:50.648 INFO:tasks.workunit.client.1.smithi098.stdout:2/504: write d3/d16/d1d/f39 [25314,70728] 0 2024-09-20T19:05:50.649 INFO:tasks.workunit.client.1.smithi098.stdout:2/505: fdatasync d3/d16/d1d/d2b/f56 0 2024-09-20T19:05:50.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/194: mknod d4/d38/d39/c3a 0 2024-09-20T19:05:50.650 INFO:tasks.workunit.client.1.smithi098.stdout:2/506: stat d3/d16/d1d/d2b/f56 0 2024-09-20T19:05:50.651 INFO:tasks.workunit.client.0.smithi027.stdout:5/145: dwrite d4/da/f2b [4194304,4194304] 0 2024-09-20T19:05:50.651 INFO:tasks.workunit.client.1.smithi098.stdout:2/507: stat d3/df/d13/ca8 0 2024-09-20T19:05:50.651 INFO:tasks.workunit.client.1.smithi098.stdout:3/195: read d4/d25/f35 [303925,106600] 0 2024-09-20T19:05:50.653 INFO:tasks.workunit.client.0.smithi027.stdout:2/81: mkdir d3/d13 0 2024-09-20T19:05:50.655 INFO:tasks.workunit.client.0.smithi027.stdout:2/82: fdatasync d3/fa 0 2024-09-20T19:05:50.656 INFO:tasks.workunit.client.0.smithi027.stdout:2/83: readlink d3/ld 0 2024-09-20T19:05:50.658 INFO:tasks.workunit.client.0.smithi027.stdout:5/146: dwrite d4/d1f/f22 [0,4194304] 0 2024-09-20T19:05:50.659 INFO:tasks.workunit.client.0.smithi027.stdout:5/147: stat d4/d1f/f22 0 2024-09-20T19:05:50.659 INFO:tasks.workunit.client.1.smithi098.stdout:1/138: write d1/d3/df/f1a [207505,46444] 0 2024-09-20T19:05:50.662 INFO:tasks.workunit.client.0.smithi027.stdout:9/229: rename d0/d9/df/d1b/d1a/f40 to d0/f47 0 2024-09-20T19:05:50.663 INFO:tasks.workunit.client.1.smithi098.stdout:2/508: mknod d3/df/caa 0 2024-09-20T19:05:50.668 INFO:tasks.workunit.client.1.smithi098.stdout:9/296: rename d4/de/d24/d35/f5c to d4/de/d27/d4a/f67 0 2024-09-20T19:05:50.675 INFO:tasks.workunit.client.0.smithi027.stdout:5/148: mknod d4/da/de/d1e/c2d 0 2024-09-20T19:05:50.680 INFO:tasks.workunit.client.1.smithi098.stdout:9/297: unlink d4/de/f29 0 2024-09-20T19:05:50.682 INFO:tasks.workunit.client.0.smithi027.stdout:5/149: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:05:50.682 INFO:tasks.workunit.client.0.smithi027.stdout:0/151: rename d2/d14/d1b/l36 to d2/d7/d29/l38 0 2024-09-20T19:05:50.682 INFO:tasks.workunit.client.0.smithi027.stdout:5/150: stat d4/f11 0 2024-09-20T19:05:50.683 INFO:tasks.workunit.client.0.smithi027.stdout:5/151: truncate d4/f1c 4320174 0 2024-09-20T19:05:50.684 INFO:tasks.workunit.client.1.smithi098.stdout:8/333: sync 2024-09-20T19:05:50.684 INFO:tasks.workunit.client.1.smithi098.stdout:6/127: sync 2024-09-20T19:05:50.684 INFO:tasks.workunit.client.1.smithi098.stdout:5/237: sync 2024-09-20T19:05:50.684 INFO:tasks.workunit.client.1.smithi098.stdout:3/196: creat d4/d19/d1d/f3b x:0 0 0 2024-09-20T19:05:50.685 INFO:tasks.workunit.client.0.smithi027.stdout:9/230: symlink d0/d9/d3d/l48 0 2024-09-20T19:05:50.686 INFO:tasks.workunit.client.0.smithi027.stdout:9/231: dread - d0/d9/df/d1b/d1a/f36 zero size 2024-09-20T19:05:50.687 INFO:tasks.workunit.client.0.smithi027.stdout:9/232: stat d0/d2e/l31 0 2024-09-20T19:05:50.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/238: chown d1/d17/f19 190830 1 2024-09-20T19:05:50.687 INFO:tasks.workunit.client.1.smithi098.stdout:6/128: chown d0/d7/dc 3 1 2024-09-20T19:05:50.687 INFO:tasks.workunit.client.0.smithi027.stdout:9/233: write d0/d9/f28 [344797,116197] 0 2024-09-20T19:05:50.689 INFO:tasks.workunit.client.0.smithi027.stdout:9/234: write d0/f5 [880147,36077] 0 2024-09-20T19:05:50.690 INFO:tasks.workunit.client.1.smithi098.stdout:3/197: truncate d4/d19/d1d/d22/f24 233861 0 2024-09-20T19:05:50.690 INFO:tasks.workunit.client.1.smithi098.stdout:2/509: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:50.693 INFO:tasks.workunit.client.1.smithi098.stdout:8/334: truncate d7/de/d11/d19/d30/d68/f7b 361124 0 2024-09-20T19:05:50.694 INFO:tasks.workunit.client.0.smithi027.stdout:0/152: chown d2/d7/lf 480 1 2024-09-20T19:05:50.694 INFO:tasks.workunit.client.0.smithi027.stdout:3/159: sync 2024-09-20T19:05:50.695 INFO:tasks.workunit.client.0.smithi027.stdout:4/78: sync 2024-09-20T19:05:50.695 INFO:tasks.workunit.client.0.smithi027.stdout:7/128: sync 2024-09-20T19:05:50.695 INFO:tasks.workunit.client.1.smithi098.stdout:2/510: write d3/d16/d1d/d2b/d46/f50 [2634436,85160] 0 2024-09-20T19:05:50.697 INFO:tasks.workunit.client.0.smithi027.stdout:8/97: getdents d2/d3 0 2024-09-20T19:05:50.698 INFO:tasks.workunit.client.0.smithi027.stdout:7/129: write d3/f9 [4707975,113516] 0 2024-09-20T19:05:50.701 INFO:tasks.workunit.client.1.smithi098.stdout:5/239: dwrite d1/d17/f19 [0,4194304] 0 2024-09-20T19:05:50.702 INFO:tasks.workunit.client.0.smithi027.stdout:4/79: dwrite d5/f10 [0,4194304] 0 2024-09-20T19:05:50.703 INFO:tasks.workunit.client.1.smithi098.stdout:1/139: rename d1/d3/df/l24 to d1/l27 0 2024-09-20T19:05:50.704 INFO:tasks.workunit.client.0.smithi027.stdout:4/80: write d5/fa [103803,39387] 0 2024-09-20T19:05:50.704 INFO:tasks.workunit.client.0.smithi027.stdout:4/81: readlink d5/ld 0 2024-09-20T19:05:50.705 INFO:tasks.workunit.client.0.smithi027.stdout:1/122: getdents d2/d15 0 2024-09-20T19:05:50.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/198: creat d4/d25/f3c x:0 0 0 2024-09-20T19:05:50.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/511: mknod d3/d16/d1d/d2b/d49/d69/cab 0 2024-09-20T19:05:50.713 INFO:tasks.workunit.client.0.smithi027.stdout:0/153: mkdir d2/d14/d1b/d39 0 2024-09-20T19:05:50.716 INFO:tasks.workunit.client.1.smithi098.stdout:5/240: symlink d1/d17/d25/l45 0 2024-09-20T19:05:50.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/98: rename d2/d3/f9 to d2/d14/d13/f1d 0 2024-09-20T19:05:50.721 INFO:tasks.workunit.client.1.smithi098.stdout:1/140: symlink d1/d3/df/l28 0 2024-09-20T19:05:50.722 INFO:tasks.workunit.client.1.smithi098.stdout:1/141: chown d1/f10 1214 1 2024-09-20T19:05:50.722 INFO:tasks.workunit.client.0.smithi027.stdout:5/152: link d4/d1f/f23 d4/d1f/d28/f2e 0 2024-09-20T19:05:50.723 INFO:tasks.workunit.client.0.smithi027.stdout:3/160: dwrite d0/d1/f2e [4194304,4194304] 0 2024-09-20T19:05:50.725 INFO:tasks.workunit.client.0.smithi027.stdout:3/161: write d0/f11 [1889499,28231] 0 2024-09-20T19:05:50.725 INFO:tasks.workunit.client.0.smithi027.stdout:7/130: dread d3/f5 [0,4194304] 0 2024-09-20T19:05:50.729 INFO:tasks.workunit.client.1.smithi098.stdout:6/129: dwrite d0/de/d1b/f1c [0,4194304] 0 2024-09-20T19:05:50.733 INFO:tasks.workunit.client.0.smithi027.stdout:5/153: dwrite d4/da/de/d1e/f20 [0,4194304] 0 2024-09-20T19:05:50.733 INFO:tasks.workunit.client.0.smithi027.stdout:3/162: dread d0/f5 [4194304,4194304] 0 2024-09-20T19:05:50.734 INFO:tasks.workunit.client.0.smithi027.stdout:5/154: chown d4/da/fb 478869 1 2024-09-20T19:05:50.735 INFO:tasks.workunit.client.1.smithi098.stdout:8/335: mknod d7/de/d11/d19/d30/d68/d78/c7d 0 2024-09-20T19:05:50.735 INFO:tasks.workunit.client.1.smithi098.stdout:9/298: dread d4/de/f1d [0,4194304] 0 2024-09-20T19:05:50.742 INFO:tasks.workunit.client.0.smithi027.stdout:0/154: mknod d2/d7/c3a 0 2024-09-20T19:05:50.743 INFO:tasks.workunit.client.1.smithi098.stdout:2/512: creat d3/d16/d1d/d2b/d46/d74/d82/fac x:0 0 0 2024-09-20T19:05:50.746 INFO:tasks.workunit.client.1.smithi098.stdout:1/142: dwrite d1/d3/f1b [0,4194304] 0 2024-09-20T19:05:50.747 INFO:tasks.workunit.client.1.smithi098.stdout:3/199: rename d4/da/c12 to d4/d19/c3d 0 2024-09-20T19:05:50.752 INFO:tasks.workunit.client.1.smithi098.stdout:8/336: dwrite d7/f61 [4194304,4194304] 0 2024-09-20T19:05:50.759 INFO:tasks.workunit.client.1.smithi098.stdout:3/200: write d4/d19/d1d/d22/f24 [518118,10840] 0 2024-09-20T19:05:50.760 INFO:tasks.workunit.client.1.smithi098.stdout:6/130: stat d0/c3 0 2024-09-20T19:05:50.760 INFO:tasks.workunit.client.0.smithi027.stdout:3/163: mkdir d0/d38 0 2024-09-20T19:05:50.763 INFO:tasks.workunit.client.1.smithi098.stdout:5/241: mkdir d1/d46 0 2024-09-20T19:05:50.764 INFO:tasks.workunit.client.0.smithi027.stdout:4/82: symlink d5/d13/d16/l18 0 2024-09-20T19:05:50.765 INFO:tasks.workunit.client.1.smithi098.stdout:8/337: dwrite d7/de/d11/d1f/f4d [4194304,4194304] 0 2024-09-20T19:05:50.766 INFO:tasks.workunit.client.1.smithi098.stdout:3/201: truncate d4/f16 936468 0 2024-09-20T19:05:50.768 INFO:tasks.workunit.client.1.smithi098.stdout:4/225: sync 2024-09-20T19:05:50.768 INFO:tasks.workunit.client.1.smithi098.stdout:0/168: sync 2024-09-20T19:05:50.768 INFO:tasks.workunit.client.1.smithi098.stdout:7/272: sync 2024-09-20T19:05:50.768 INFO:tasks.workunit.client.1.smithi098.stdout:1/143: dwrite d1/d3/df/f23 [0,4194304] 0 2024-09-20T19:05:50.768 INFO:tasks.workunit.client.1.smithi098.stdout:7/273: stat d3/l9 0 2024-09-20T19:05:50.770 INFO:tasks.workunit.client.0.smithi027.stdout:3/164: dwrite d0/d19/f1a [0,4194304] 0 2024-09-20T19:05:50.770 INFO:tasks.workunit.client.0.smithi027.stdout:9/235: creat d0/d9/df/f49 x:0 0 0 2024-09-20T19:05:50.772 INFO:tasks.workunit.client.0.smithi027.stdout:3/165: write d0/d1/d7/f1e [4264690,32917] 0 2024-09-20T19:05:50.777 INFO:tasks.workunit.client.0.smithi027.stdout:5/155: symlink d4/l2f 0 2024-09-20T19:05:50.778 INFO:tasks.workunit.client.1.smithi098.stdout:2/513: unlink d3/d16/d1d/d2b/d46/l5a 0 2024-09-20T19:05:50.779 INFO:tasks.workunit.client.1.smithi098.stdout:9/299: mknod d4/de/d27/d4a/d21/d25/d66/c68 0 2024-09-20T19:05:50.779 INFO:tasks.workunit.client.1.smithi098.stdout:2/514: chown d3/d16/d1a/f37 110248556 1 2024-09-20T19:05:50.782 INFO:tasks.workunit.client.0.smithi027.stdout:8/99: link d2/d3/d6/ff d2/f1e 0 2024-09-20T19:05:50.782 INFO:tasks.workunit.client.1.smithi098.stdout:7/274: read - d3/d10/d16/d17/d33/d1f/d28/f4a zero size 2024-09-20T19:05:50.782 INFO:tasks.workunit.client.1.smithi098.stdout:4/226: write d3/d6/fd [2712755,127490] 0 2024-09-20T19:05:50.783 INFO:tasks.workunit.client.1.smithi098.stdout:6/131: unlink d0/d7/ff 0 2024-09-20T19:05:50.783 INFO:tasks.workunit.client.0.smithi027.stdout:8/100: stat d2/f7 0 2024-09-20T19:05:50.787 INFO:tasks.workunit.client.0.smithi027.stdout:9/236: dread d0/d9/f28 [0,4194304] 0 2024-09-20T19:05:50.787 INFO:tasks.workunit.client.1.smithi098.stdout:5/242: stat d1/d1b/l27 0 2024-09-20T19:05:50.790 INFO:tasks.workunit.client.0.smithi027.stdout:7/131: rename d3/d1a/c1f to d3/d8/c2d 0 2024-09-20T19:05:50.792 INFO:tasks.workunit.client.1.smithi098.stdout:8/338: dread d7/de/d11/d19/f4c [0,4194304] 0 2024-09-20T19:05:50.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/144: truncate d1/d3/f15 1768923 0 2024-09-20T19:05:50.792 INFO:tasks.workunit.client.1.smithi098.stdout:7/275: dwrite d3/f6 [4194304,4194304] 0 2024-09-20T19:05:50.792 INFO:tasks.workunit.client.1.smithi098.stdout:3/202: mkdir d4/d19/d1d/d2f/d3e 0 2024-09-20T19:05:50.794 INFO:tasks.workunit.client.0.smithi027.stdout:8/101: symlink d2/l1f 0 2024-09-20T19:05:50.797 INFO:tasks.workunit.client.1.smithi098.stdout:0/169: dwrite d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:05:50.801 INFO:tasks.workunit.client.0.smithi027.stdout:6/59: sync 2024-09-20T19:05:50.801 INFO:tasks.workunit.client.0.smithi027.stdout:2/84: sync 2024-09-20T19:05:50.802 INFO:tasks.workunit.client.1.smithi098.stdout:3/203: truncate d4/f34 407454 0 2024-09-20T19:05:50.802 INFO:tasks.workunit.client.1.smithi098.stdout:8/339: write d7/de/d11/d19/f4e [1011710,43537] 0 2024-09-20T19:05:50.802 INFO:tasks.workunit.client.1.smithi098.stdout:8/340: fsync d7/de/d11/d1d/f56 0 2024-09-20T19:05:50.802 INFO:tasks.workunit.client.1.smithi098.stdout:4/227: chown d3/d6/d11/d1e/f54 31453 1 2024-09-20T19:05:50.803 INFO:tasks.workunit.client.0.smithi027.stdout:6/60: fdatasync d4/f9 0 2024-09-20T19:05:50.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/515: fsync d3/d16/d1d/d2b/d46/fa1 0 2024-09-20T19:05:50.805 INFO:tasks.workunit.client.1.smithi098.stdout:9/300: readlink d4/de/d27/d4a/l3e 0 2024-09-20T19:05:50.805 INFO:tasks.workunit.client.1.smithi098.stdout:0/170: stat d0/db 0 2024-09-20T19:05:50.805 INFO:tasks.workunit.client.0.smithi027.stdout:0/155: rename d2/d14/d1d/d2e/f33 to d2/d7/d29/f3b 0 2024-09-20T19:05:50.807 INFO:tasks.workunit.client.0.smithi027.stdout:0/156: write f1 [1130061,44620] 0 2024-09-20T19:05:50.807 INFO:tasks.workunit.client.0.smithi027.stdout:9/237: dread d0/d9/df/d1b/f8 [0,4194304] 0 2024-09-20T19:05:50.808 INFO:tasks.workunit.client.0.smithi027.stdout:3/166: rmdir d0/d1/d33 0 2024-09-20T19:05:50.809 INFO:tasks.workunit.client.0.smithi027.stdout:0/157: read d2/d14/d1b/f24 [358339,60684] 0 2024-09-20T19:05:50.809 INFO:tasks.workunit.client.1.smithi098.stdout:4/228: dread d3/ff [4194304,4194304] 0 2024-09-20T19:05:50.811 INFO:tasks.workunit.client.1.smithi098.stdout:4/229: stat d3/d6/f23 0 2024-09-20T19:05:50.811 INFO:tasks.workunit.client.0.smithi027.stdout:0/158: dread - d2/d7/f35 zero size 2024-09-20T19:05:50.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/132: creat d0/f22 x:0 0 0 2024-09-20T19:05:50.812 INFO:tasks.workunit.client.1.smithi098.stdout:7/276: dread d3/d10/d16/d17/d33/d1f/f3c [0,4194304] 0 2024-09-20T19:05:50.813 INFO:tasks.workunit.client.0.smithi027.stdout:2/85: mknod d3/c14 0 2024-09-20T19:05:50.816 INFO:tasks.workunit.client.1.smithi098.stdout:6/133: fdatasync d0/de/d1b/f1c 0 2024-09-20T19:05:50.816 INFO:tasks.workunit.client.1.smithi098.stdout:6/134: fdatasync d0/de/f18 0 2024-09-20T19:05:50.816 INFO:tasks.workunit.client.1.smithi098.stdout:5/243: readlink d1/d17/d25/l45 0 2024-09-20T19:05:50.816 INFO:tasks.workunit.client.0.smithi027.stdout:3/167: dwrite d0/d1/d7/f10 [0,4194304] 0 2024-09-20T19:05:50.817 INFO:tasks.workunit.client.1.smithi098.stdout:3/204: creat d4/d19/f3f x:0 0 0 2024-09-20T19:05:50.822 INFO:tasks.workunit.client.1.smithi098.stdout:1/145: fdatasync d1/f25 0 2024-09-20T19:05:50.824 INFO:tasks.workunit.client.0.smithi027.stdout:5/156: write d4/d1f/d28/f2e [55760,26797] 0 2024-09-20T19:05:50.824 INFO:tasks.workunit.client.1.smithi098.stdout:6/135: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:05:50.826 INFO:tasks.workunit.client.0.smithi027.stdout:6/61: mknod d4/d6/c10 0 2024-09-20T19:05:50.826 INFO:tasks.workunit.client.0.smithi027.stdout:6/62: read - d4/f9 zero size 2024-09-20T19:05:50.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/171: dread d0/db/d1d/f21 [0,4194304] 0 2024-09-20T19:05:50.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/172: readlink d0/d6/d19/l29 0 2024-09-20T19:05:50.831 INFO:tasks.workunit.client.0.smithi027.stdout:4/83: rename d5/ld to d5/d11/l19 0 2024-09-20T19:05:50.834 INFO:tasks.workunit.client.1.smithi098.stdout:2/516: mknod d3/d16/d1d/d2b/d99/cad 0 2024-09-20T19:05:50.836 INFO:tasks.workunit.client.0.smithi027.stdout:9/238: creat d0/d2e/f4a x:0 0 0 2024-09-20T19:05:50.839 INFO:tasks.workunit.client.0.smithi027.stdout:7/132: dwrite d3/d8/da/f11 [0,4194304] 0 2024-09-20T19:05:50.841 INFO:tasks.workunit.client.0.smithi027.stdout:0/159: fsync d2/f19 0 2024-09-20T19:05:50.841 INFO:tasks.workunit.client.0.smithi027.stdout:2/86: stat d3/c12 0 2024-09-20T19:05:50.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/168: symlink d0/d1/d13/d15/l39 0 2024-09-20T19:05:50.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/169: stat d0/d1/d13 0 2024-09-20T19:05:50.843 INFO:tasks.workunit.client.1.smithi098.stdout:3/205: dread d4/f10 [0,4194304] 0 2024-09-20T19:05:50.845 INFO:tasks.workunit.client.0.smithi027.stdout:6/63: creat d4/d6/f11 x:0 0 0 2024-09-20T19:05:50.845 INFO:tasks.workunit.client.0.smithi027.stdout:6/64: readlink d4/lc 0 2024-09-20T19:05:50.846 INFO:tasks.workunit.client.0.smithi027.stdout:2/87: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:50.850 INFO:tasks.workunit.client.1.smithi098.stdout:1/146: creat d1/d3/df/f29 x:0 0 0 2024-09-20T19:05:50.851 INFO:tasks.workunit.client.1.smithi098.stdout:1/147: chown d1/d3/f18 3472 1 2024-09-20T19:05:50.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/173: symlink d0/d15/l30 0 2024-09-20T19:05:50.856 INFO:tasks.workunit.client.0.smithi027.stdout:9/239: symlink d0/d9/df/d1c/l4b 0 2024-09-20T19:05:50.856 INFO:tasks.workunit.client.0.smithi027.stdout:9/240: stat d0/d9/df/d1b/d1a/dd/f10 0 2024-09-20T19:05:50.858 INFO:tasks.workunit.client.0.smithi027.stdout:9/241: dread d0/d9/f28 [0,4194304] 0 2024-09-20T19:05:50.859 INFO:tasks.workunit.client.1.smithi098.stdout:1/148: dwrite d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:05:50.860 INFO:tasks.workunit.client.0.smithi027.stdout:0/160: mkdir d2/d14/d1b/d3c 0 2024-09-20T19:05:50.866 INFO:tasks.workunit.client.0.smithi027.stdout:6/65: mknod d4/d6/c12 0 2024-09-20T19:05:50.868 INFO:tasks.workunit.client.1.smithi098.stdout:8/341: creat d7/de/d11/d19/f7e x:0 0 0 2024-09-20T19:05:50.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/277: symlink d3/d10/d16/d17/d33/l57 0 2024-09-20T19:05:50.871 INFO:tasks.workunit.client.0.smithi027.stdout:6/66: dwrite d4/d6/fa [0,4194304] 0 2024-09-20T19:05:50.873 INFO:tasks.workunit.client.0.smithi027.stdout:8/102: rename d2/d15/f18 to d2/d14/f20 0 2024-09-20T19:05:50.875 INFO:tasks.workunit.client.1.smithi098.stdout:2/517: write d3/d16/f3b [621462,100967] 0 2024-09-20T19:05:50.876 INFO:tasks.workunit.client.1.smithi098.stdout:3/206: mkdir d4/d25/d40 0 2024-09-20T19:05:50.877 INFO:tasks.workunit.client.1.smithi098.stdout:2/518: write d3/f12 [2390306,113108] 0 2024-09-20T19:05:50.880 INFO:tasks.workunit.client.0.smithi027.stdout:5/157: creat d4/f30 x:0 0 0 2024-09-20T19:05:50.881 INFO:tasks.workunit.client.1.smithi098.stdout:4/230: truncate d3/d6/d11/d1e/d2a/d45/f4d 2748400 0 2024-09-20T19:05:50.884 INFO:tasks.workunit.client.0.smithi027.stdout:6/67: truncate d4/f7 4013860 0 2024-09-20T19:05:50.885 INFO:tasks.workunit.client.1.smithi098.stdout:1/149: dread d1/f10 [0,4194304] 0 2024-09-20T19:05:50.886 INFO:tasks.workunit.client.0.smithi027.stdout:7/133: rename d3/d8/da/dc/d1e to d3/d8/da/d2e 0 2024-09-20T19:05:50.889 INFO:tasks.workunit.client.0.smithi027.stdout:8/103: mkdir d2/d3/d6/d21 0 2024-09-20T19:05:50.890 INFO:tasks.workunit.client.1.smithi098.stdout:7/278: readlink d3/d10/d16/d17/d33/l56 0 2024-09-20T19:05:50.891 INFO:tasks.workunit.client.0.smithi027.stdout:4/84: mkdir d5/d11/d1a 0 2024-09-20T19:05:50.893 INFO:tasks.workunit.client.0.smithi027.stdout:0/161: fsync d2/d7/f15 0 2024-09-20T19:05:50.894 INFO:tasks.workunit.client.0.smithi027.stdout:9/242: write d0/fa [5145217,126507] 0 2024-09-20T19:05:50.895 INFO:tasks.workunit.client.1.smithi098.stdout:6/136: write d0/de/d1b/f1f [3155678,51366] 0 2024-09-20T19:05:50.895 INFO:tasks.workunit.client.0.smithi027.stdout:0/162: chown d2/d7/fd 29 1 2024-09-20T19:05:50.898 INFO:tasks.workunit.client.0.smithi027.stdout:5/158: symlink d4/da/l31 0 2024-09-20T19:05:50.901 INFO:tasks.workunit.client.0.smithi027.stdout:3/170: rename d0/d1/d13/d15/f2b to d0/d1/d7/d1d/f3a 0 2024-09-20T19:05:50.902 INFO:tasks.workunit.client.0.smithi027.stdout:4/85: dwrite f4 [0,4194304] 0 2024-09-20T19:05:50.903 INFO:tasks.workunit.client.1.smithi098.stdout:4/231: symlink d3/d6/d11/d1e/l55 0 2024-09-20T19:05:50.903 INFO:tasks.workunit.client.1.smithi098.stdout:4/232: chown d3/d6/l49 661655882 1 2024-09-20T19:05:50.904 INFO:tasks.workunit.client.0.smithi027.stdout:1/123: sync 2024-09-20T19:05:50.904 INFO:tasks.workunit.client.1.smithi098.stdout:2/519: dread d3/d16/f89 [0,4194304] 0 2024-09-20T19:05:50.904 INFO:tasks.workunit.client.1.smithi098.stdout:8/342: symlink d7/de/d11/l7f 0 2024-09-20T19:05:50.905 INFO:tasks.workunit.client.1.smithi098.stdout:2/520: chown d3/fa 1770 1 2024-09-20T19:05:50.908 INFO:tasks.workunit.client.0.smithi027.stdout:9/243: dread d0/d9/df/f21 [0,4194304] 0 2024-09-20T19:05:50.909 INFO:tasks.workunit.client.1.smithi098.stdout:5/244: getdents d1/d17/d35 0 2024-09-20T19:05:50.910 INFO:tasks.workunit.client.0.smithi027.stdout:5/159: dread d4/d1f/f23 [0,4194304] 0 2024-09-20T19:05:50.913 INFO:tasks.workunit.client.0.smithi027.stdout:6/68: dwrite f0 [0,4194304] 0 2024-09-20T19:05:50.915 INFO:tasks.workunit.client.0.smithi027.stdout:5/160: readlink d4/da/de/l14 0 2024-09-20T19:05:50.916 INFO:tasks.workunit.client.0.smithi027.stdout:0/163: dread d2/d7/f26 [0,4194304] 0 2024-09-20T19:05:50.918 INFO:tasks.workunit.client.0.smithi027.stdout:6/69: truncate d4/d6/f11 706968 0 2024-09-20T19:05:50.919 INFO:tasks.workunit.client.0.smithi027.stdout:5/161: truncate d4/da/f29 295658 0 2024-09-20T19:05:50.920 INFO:tasks.workunit.client.0.smithi027.stdout:8/104: dwrite d2/d14/d13/f1d [0,4194304] 0 2024-09-20T19:05:50.923 INFO:tasks.workunit.client.0.smithi027.stdout:8/105: truncate d2/d3/d6/f1a 359710 0 2024-09-20T19:05:50.926 INFO:tasks.workunit.client.0.smithi027.stdout:5/162: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:05:50.927 INFO:tasks.workunit.client.0.smithi027.stdout:5/163: chown d4/da/f29 2542081 1 2024-09-20T19:05:50.928 INFO:tasks.workunit.client.0.smithi027.stdout:5/164: chown d4/da 53 1 2024-09-20T19:05:50.955 INFO:tasks.workunit.client.0.smithi027.stdout:2/88: getdents d3/de 0 2024-09-20T19:05:50.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/343: write d7/de/d11/f71 [551969,31200] 0 2024-09-20T19:05:50.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/344: chown d7/fd 20 1 2024-09-20T19:05:50.960 INFO:tasks.workunit.client.1.smithi098.stdout:2/521: creat d3/d16/d1a/fae x:0 0 0 2024-09-20T19:05:50.960 INFO:tasks.workunit.client.0.smithi027.stdout:3/171: rmdir d0/d19 39 2024-09-20T19:05:50.961 INFO:tasks.workunit.client.0.smithi027.stdout:2/89: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:50.961 INFO:tasks.workunit.client.1.smithi098.stdout:7/279: mknod d3/d10/d16/d17/d33/c58 0 2024-09-20T19:05:50.962 INFO:tasks.workunit.client.1.smithi098.stdout:3/207: write d4/f10 [620392,67631] 0 2024-09-20T19:05:50.964 INFO:tasks.workunit.client.1.smithi098.stdout:8/345: read d7/de/d11/d1f/f4d [2928947,96033] 0 2024-09-20T19:05:50.964 INFO:tasks.workunit.client.1.smithi098.stdout:3/208: write d4/d25/f3c [735557,26516] 0 2024-09-20T19:05:50.965 INFO:tasks.workunit.client.0.smithi027.stdout:1/124: unlink d2/d8/f9 0 2024-09-20T19:05:50.967 INFO:tasks.workunit.client.1.smithi098.stdout:6/137: mknod d0/de/d1b/c23 0 2024-09-20T19:05:50.968 INFO:tasks.workunit.client.1.smithi098.stdout:0/174: getdents d0/db/d1d 0 2024-09-20T19:05:50.972 INFO:tasks.workunit.client.1.smithi098.stdout:6/138: write d0/f22 [969777,77573] 0 2024-09-20T19:05:50.974 INFO:tasks.workunit.client.1.smithi098.stdout:0/175: truncate d0/db/d1d/f2a 4315040 0 2024-09-20T19:05:50.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/280: dwrite d3/d10/d16/d17/d33/d1f/f43 [0,4194304] 0 2024-09-20T19:05:50.975 INFO:tasks.workunit.client.1.smithi098.stdout:5/245: symlink d1/d46/l47 0 2024-09-20T19:05:50.981 INFO:tasks.workunit.client.1.smithi098.stdout:3/209: read d4/da/fb [1917264,64999] 0 2024-09-20T19:05:50.982 INFO:tasks.workunit.client.1.smithi098.stdout:7/281: dwrite d3/d10/d16/f39 [0,4194304] 0 2024-09-20T19:05:50.983 INFO:tasks.workunit.client.1.smithi098.stdout:3/210: chown d4/d19/c29 16436277 1 2024-09-20T19:05:50.991 INFO:tasks.workunit.client.1.smithi098.stdout:4/233: dwrite d3/d6/d11/d1e/f26 [0,4194304] 0 2024-09-20T19:05:50.992 INFO:tasks.workunit.client.1.smithi098.stdout:7/282: dwrite d3/d10/d16/d17/d33/d1f/f43 [0,4194304] 0 2024-09-20T19:05:50.992 INFO:tasks.workunit.client.0.smithi027.stdout:4/86: mkdir d5/d11/d17/d1b 0 2024-09-20T19:05:50.995 INFO:tasks.workunit.client.1.smithi098.stdout:5/246: creat d1/d17/d25/f48 x:0 0 0 2024-09-20T19:05:50.996 INFO:tasks.workunit.client.0.smithi027.stdout:4/87: dread f4 [0,4194304] 0 2024-09-20T19:05:50.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/247: fdatasync d1/d17/f19 0 2024-09-20T19:05:50.997 INFO:tasks.workunit.client.0.smithi027.stdout:4/88: rename d5/d11 to d5/d11/d17/d1c 22 2024-09-20T19:05:50.998 INFO:tasks.workunit.client.1.smithi098.stdout:8/346: mkdir d7/de/d11/d19/d30/d59/d80 0 2024-09-20T19:05:50.998 INFO:tasks.workunit.client.0.smithi027.stdout:4/89: rename d5/d11 to d5/d11/d17/d1d 22 2024-09-20T19:05:50.999 INFO:tasks.workunit.client.1.smithi098.stdout:8/347: chown d7/f1c 1 1 2024-09-20T19:05:51.001 INFO:tasks.workunit.client.1.smithi098.stdout:8/348: chown d7/de/d35/f5a 60494209 1 2024-09-20T19:05:51.003 INFO:tasks.workunit.client.0.smithi027.stdout:9/244: symlink d0/d9/df/d1b/d1a/dd/l4c 0 2024-09-20T19:05:51.003 INFO:tasks.workunit.client.0.smithi027.stdout:1/125: creat d2/d15/f29 x:0 0 0 2024-09-20T19:05:51.004 INFO:tasks.workunit.client.1.smithi098.stdout:8/349: read d7/de/d11/d19/f2d [414609,63847] 0 2024-09-20T19:05:51.004 INFO:tasks.workunit.client.0.smithi027.stdout:1/126: chown d2/d14 16656585 1 2024-09-20T19:05:51.004 INFO:tasks.workunit.client.0.smithi027.stdout:0/164: getdents d2/d14/d1b/d39 0 2024-09-20T19:05:51.005 INFO:tasks.workunit.client.0.smithi027.stdout:9/245: truncate d0/f42 566274 0 2024-09-20T19:05:51.006 INFO:tasks.workunit.client.0.smithi027.stdout:1/127: write d2/d15/f22 [903971,44045] 0 2024-09-20T19:05:51.006 INFO:tasks.workunit.client.1.smithi098.stdout:7/283: dread d3/d10/d16/f39 [0,4194304] 0 2024-09-20T19:05:51.009 INFO:tasks.workunit.client.1.smithi098.stdout:7/284: write d3/d10/d16/f39 [1886087,115354] 0 2024-09-20T19:05:51.009 INFO:tasks.workunit.client.1.smithi098.stdout:3/211: creat d4/d38/f41 x:0 0 0 2024-09-20T19:05:51.010 INFO:tasks.workunit.client.1.smithi098.stdout:4/234: read d3/ff [4482150,42806] 0 2024-09-20T19:05:51.012 INFO:tasks.workunit.client.0.smithi027.stdout:5/165: mknod d4/c32 0 2024-09-20T19:05:51.013 INFO:tasks.workunit.client.0.smithi027.stdout:5/166: chown d4/da/f2c 38 1 2024-09-20T19:05:51.014 INFO:tasks.workunit.client.0.smithi027.stdout:7/134: getdents d3/d8 0 2024-09-20T19:05:51.014 INFO:tasks.workunit.client.0.smithi027.stdout:1/128: dwrite d2/d15/f25 [0,4194304] 0 2024-09-20T19:05:51.015 INFO:tasks.workunit.client.0.smithi027.stdout:7/135: truncate d3/f23 991930 0 2024-09-20T19:05:51.017 INFO:tasks.workunit.client.1.smithi098.stdout:6/139: write d0/f8 [612095,81173] 0 2024-09-20T19:05:51.020 INFO:tasks.workunit.client.1.smithi098.stdout:7/285: dwrite d3/d10/d18/d21/f54 [0,4194304] 0 2024-09-20T19:05:51.020 INFO:tasks.workunit.client.1.smithi098.stdout:8/350: creat d7/de/d11/d1d/f81 x:0 0 0 2024-09-20T19:05:51.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/212: rename d4/l1e to d4/d19/l42 0 2024-09-20T19:05:51.028 INFO:tasks.workunit.client.1.smithi098.stdout:0/176: dwrite d0/fa [0,4194304] 0 2024-09-20T19:05:51.028 INFO:tasks.workunit.client.1.smithi098.stdout:3/213: write d4/f34 [993318,89846] 0 2024-09-20T19:05:51.031 INFO:tasks.workunit.client.1.smithi098.stdout:3/214: stat d4/d19/d1d/d22 0 2024-09-20T19:05:51.032 INFO:tasks.workunit.client.1.smithi098.stdout:4/235: creat d3/d6/d3e/f56 x:0 0 0 2024-09-20T19:05:51.033 INFO:tasks.workunit.client.1.smithi098.stdout:5/248: getdents d1/d17/d35 0 2024-09-20T19:05:51.034 INFO:tasks.workunit.client.1.smithi098.stdout:4/236: write d3/d6/d3e/f56 [187845,81835] 0 2024-09-20T19:05:51.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/140: mkdir d0/d7/d24 0 2024-09-20T19:05:51.039 INFO:tasks.workunit.client.0.smithi027.stdout:2/90: truncate d3/fa 3503120 0 2024-09-20T19:05:51.040 INFO:tasks.workunit.client.0.smithi027.stdout:2/91: readlink d3/ld 0 2024-09-20T19:05:51.042 INFO:tasks.workunit.client.1.smithi098.stdout:5/249: dwrite d1/d17/d2e/f2f [0,4194304] 0 2024-09-20T19:05:51.045 INFO:tasks.workunit.client.0.smithi027.stdout:0/165: dwrite d2/d7/f15 [0,4194304] 0 2024-09-20T19:05:51.045 INFO:tasks.workunit.client.1.smithi098.stdout:7/286: write d3/d10/f13 [7755522,118868] 0 2024-09-20T19:05:51.049 INFO:tasks.workunit.client.0.smithi027.stdout:3/172: link d0/d19/f1a d0/d1/f3b 0 2024-09-20T19:05:51.050 INFO:tasks.workunit.client.0.smithi027.stdout:3/173: truncate d0/d1/f30 399071 0 2024-09-20T19:05:51.055 INFO:tasks.workunit.client.1.smithi098.stdout:4/237: mkdir d3/d6/d11/d57 0 2024-09-20T19:05:51.057 INFO:tasks.workunit.client.0.smithi027.stdout:9/246: rename d0/d9/df/d1b/d1a/c35 to d0/c4d 0 2024-09-20T19:05:51.058 INFO:tasks.workunit.client.1.smithi098.stdout:6/141: symlink d0/d7/l25 0 2024-09-20T19:05:51.061 INFO:tasks.workunit.client.0.smithi027.stdout:8/106: getdents d2/d14/d13 0 2024-09-20T19:05:51.062 INFO:tasks.workunit.client.1.smithi098.stdout:8/351: mkdir d7/de/d11/d19/d30/d82 0 2024-09-20T19:05:51.063 INFO:tasks.workunit.client.1.smithi098.stdout:8/352: read d7/de/d11/d19/d30/d68/f7b [331241,48074] 0 2024-09-20T19:05:51.066 INFO:tasks.workunit.client.0.smithi027.stdout:0/166: creat d2/d14/d1d/f3d x:0 0 0 2024-09-20T19:05:51.066 INFO:tasks.workunit.client.0.smithi027.stdout:4/90: write d5/fe [2817,115694] 0 2024-09-20T19:05:51.067 INFO:tasks.workunit.client.0.smithi027.stdout:1/129: symlink d2/l2a 0 2024-09-20T19:05:51.067 INFO:tasks.workunit.client.0.smithi027.stdout:4/91: stat d5/d11 0 2024-09-20T19:05:51.068 INFO:tasks.workunit.client.0.smithi027.stdout:1/130: write d2/d8/f20 [3854259,23496] 0 2024-09-20T19:05:51.071 INFO:tasks.workunit.client.1.smithi098.stdout:4/238: rmdir d3/d6/d11/d1e 39 2024-09-20T19:05:51.074 INFO:tasks.workunit.client.0.smithi027.stdout:6/70: dwrite d4/f7 [0,4194304] 0 2024-09-20T19:05:51.075 INFO:tasks.workunit.client.1.smithi098.stdout:0/177: truncate d0/db/f20 2146906 0 2024-09-20T19:05:51.077 INFO:tasks.workunit.client.0.smithi027.stdout:9/247: unlink d0/d9/c33 0 2024-09-20T19:05:51.079 INFO:tasks.workunit.client.1.smithi098.stdout:3/215: truncate d4/f10 578460 0 2024-09-20T19:05:51.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/216: write d4/d25/f2b [415995,110088] 0 2024-09-20T19:05:51.082 INFO:tasks.workunit.client.1.smithi098.stdout:4/239: rename d3/d6/d11/d46 to d3/d6/d11/d2f/d50/d58 0 2024-09-20T19:05:51.083 INFO:tasks.workunit.client.0.smithi027.stdout:8/107: creat d2/d14/d13/f22 x:0 0 0 2024-09-20T19:05:51.085 INFO:tasks.workunit.client.1.smithi098.stdout:3/217: write d4/f1b [290226,86962] 0 2024-09-20T19:05:51.086 INFO:tasks.workunit.client.0.smithi027.stdout:0/167: symlink d2/d14/d1d/d2e/l3e 0 2024-09-20T19:05:51.087 INFO:tasks.workunit.client.1.smithi098.stdout:6/142: creat d0/de/d1b/f26 x:0 0 0 2024-09-20T19:05:51.087 INFO:tasks.workunit.client.1.smithi098.stdout:8/353: dwrite d7/de/d11/d19/f4c [4194304,4194304] 0 2024-09-20T19:05:51.088 INFO:tasks.workunit.client.1.smithi098.stdout:3/218: chown d4/d19/f1f 167569901 1 2024-09-20T19:05:51.090 INFO:tasks.workunit.client.1.smithi098.stdout:6/143: dread - d0/de/d1b/f26 zero size 2024-09-20T19:05:51.094 INFO:tasks.workunit.client.1.smithi098.stdout:3/219: unlink d4/d19/f1f 0 2024-09-20T19:05:51.095 INFO:tasks.workunit.client.0.smithi027.stdout:2/92: chown d3/fa 491 1 2024-09-20T19:05:51.096 INFO:tasks.workunit.client.0.smithi027.stdout:3/174: write d0/d1/f35 [555,30647] 0 2024-09-20T19:05:51.098 INFO:tasks.workunit.client.0.smithi027.stdout:3/175: write d0/d1/d13/d15/f29 [506756,39796] 0 2024-09-20T19:05:51.099 INFO:tasks.workunit.client.1.smithi098.stdout:4/240: dread d3/f7 [0,4194304] 0 2024-09-20T19:05:51.100 INFO:tasks.workunit.client.0.smithi027.stdout:3/176: chown d0/d1/d7/l34 25 1 2024-09-20T19:05:51.102 INFO:tasks.workunit.client.1.smithi098.stdout:0/178: truncate d0/d6/d19/f10 1999595 0 2024-09-20T19:05:51.102 INFO:tasks.workunit.client.0.smithi027.stdout:2/93: dread d3/fa [0,4194304] 0 2024-09-20T19:05:51.103 INFO:tasks.workunit.client.1.smithi098.stdout:3/220: dwrite d4/f34 [0,4194304] 0 2024-09-20T19:05:51.108 INFO:tasks.workunit.client.1.smithi098.stdout:0/179: dread d0/d6/fe [0,4194304] 0 2024-09-20T19:05:51.109 INFO:tasks.workunit.client.0.smithi027.stdout:0/168: chown d2/d20/l28 278 1 2024-09-20T19:05:51.110 INFO:tasks.workunit.client.0.smithi027.stdout:0/169: chown d2/d14/l21 1008939 1 2024-09-20T19:05:51.111 INFO:tasks.workunit.client.0.smithi027.stdout:8/108: dread d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:51.113 INFO:tasks.workunit.client.1.smithi098.stdout:6/144: stat d0/d7/dc/l21 0 2024-09-20T19:05:51.113 INFO:tasks.workunit.client.0.smithi027.stdout:5/167: getdents d4/da/de 0 2024-09-20T19:05:51.115 INFO:tasks.workunit.client.0.smithi027.stdout:7/136: rename d3/d1a/f2b to d3/f2f 0 2024-09-20T19:05:51.117 INFO:tasks.workunit.client.1.smithi098.stdout:4/241: chown d3/d6/d11/l31 1687866916 1 2024-09-20T19:05:51.119 INFO:tasks.workunit.client.0.smithi027.stdout:3/177: mkdir d0/d1/d13/d3c 0 2024-09-20T19:05:51.120 INFO:tasks.workunit.client.1.smithi098.stdout:3/221: symlink d4/d19/d1d/d22/l43 0 2024-09-20T19:05:51.120 INFO:tasks.workunit.client.0.smithi027.stdout:9/248: dwrite d0/d9/df/d1b/f8 [0,4194304] 0 2024-09-20T19:05:51.121 INFO:tasks.workunit.client.1.smithi098.stdout:3/222: write d4/da/f14 [2446355,112584] 0 2024-09-20T19:05:51.122 INFO:tasks.workunit.client.0.smithi027.stdout:0/170: read d2/fe [948326,25267] 0 2024-09-20T19:05:51.122 INFO:tasks.workunit.client.1.smithi098.stdout:0/180: mkdir d0/d6/d28/d31 0 2024-09-20T19:05:51.123 INFO:tasks.workunit.client.0.smithi027.stdout:0/171: write d2/d7/f15 [2741660,42177] 0 2024-09-20T19:05:51.124 INFO:tasks.workunit.client.0.smithi027.stdout:4/92: creat d5/f1e x:0 0 0 2024-09-20T19:05:51.125 INFO:tasks.workunit.client.0.smithi027.stdout:8/109: mknod d2/c23 0 2024-09-20T19:05:51.126 INFO:tasks.workunit.client.0.smithi027.stdout:8/110: stat d2/f1e 0 2024-09-20T19:05:51.128 INFO:tasks.workunit.client.0.smithi027.stdout:1/131: rename d2/d28 to d2/d8/d2b 0 2024-09-20T19:05:51.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/145: symlink d0/d7/d24/l27 0 2024-09-20T19:05:51.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/146: stat d0/l1d 0 2024-09-20T19:05:51.134 INFO:tasks.workunit.client.0.smithi027.stdout:2/94: creat d3/d13/f15 x:0 0 0 2024-09-20T19:05:51.135 INFO:tasks.workunit.client.0.smithi027.stdout:9/249: symlink d0/d9/l4e 0 2024-09-20T19:05:51.136 INFO:tasks.workunit.client.0.smithi027.stdout:9/250: stat d0/d9/d3d 0 2024-09-20T19:05:51.138 INFO:tasks.workunit.client.1.smithi098.stdout:4/242: rename d3/d6/d11/d2f to d3/d6/d11/d59 0 2024-09-20T19:05:51.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/354: dread d7/f10 [4194304,4194304] 0 2024-09-20T19:05:51.140 INFO:tasks.workunit.client.0.smithi027.stdout:5/168: link d4/f30 d4/da/f33 0 2024-09-20T19:05:51.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/243: dread d3/d6/d3e/f56 [0,4194304] 0 2024-09-20T19:05:51.142 INFO:tasks.workunit.client.0.smithi027.stdout:8/111: mknod d2/d14/c24 0 2024-09-20T19:05:51.145 INFO:tasks.workunit.client.0.smithi027.stdout:6/71: link d4/cd d4/c13 0 2024-09-20T19:05:51.147 INFO:tasks.workunit.client.0.smithi027.stdout:5/169: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:05:51.148 INFO:tasks.workunit.client.1.smithi098.stdout:4/244: creat d3/d6/d3e/d3c/f5a x:0 0 0 2024-09-20T19:05:51.150 INFO:tasks.workunit.client.0.smithi027.stdout:3/178: symlink d0/l3d 0 2024-09-20T19:05:51.151 INFO:tasks.workunit.client.0.smithi027.stdout:3/179: fsync d0/d1/f30 0 2024-09-20T19:05:51.152 INFO:tasks.workunit.client.0.smithi027.stdout:2/95: symlink d3/de/l16 0 2024-09-20T19:05:51.152 INFO:tasks.workunit.client.0.smithi027.stdout:6/72: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:51.152 INFO:tasks.workunit.client.0.smithi027.stdout:2/96: chown d3/ld 10292 1 2024-09-20T19:05:51.153 INFO:tasks.workunit.client.0.smithi027.stdout:9/251: mkdir d0/d9/d3d/d4f 0 2024-09-20T19:05:51.153 INFO:tasks.workunit.client.1.smithi098.stdout:3/223: write d4/fd [2601984,83051] 0 2024-09-20T19:05:51.157 INFO:tasks.workunit.client.1.smithi098.stdout:0/181: write d0/f3 [1419554,77043] 0 2024-09-20T19:05:51.160 INFO:tasks.workunit.client.1.smithi098.stdout:3/224: symlink d4/d25/l44 0 2024-09-20T19:05:51.161 INFO:tasks.workunit.client.0.smithi027.stdout:6/73: dwrite d4/d6/fa [0,4194304] 0 2024-09-20T19:05:51.162 INFO:tasks.workunit.client.1.smithi098.stdout:6/147: write d0/d7/dc/fd [757027,104428] 0 2024-09-20T19:05:51.163 INFO:tasks.workunit.client.0.smithi027.stdout:1/132: link d2/d15/f22 d2/d14/d21/f2c 0 2024-09-20T19:05:51.164 INFO:tasks.workunit.client.0.smithi027.stdout:6/74: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:51.164 INFO:tasks.workunit.client.0.smithi027.stdout:1/133: chown d2/f24 1189611 1 2024-09-20T19:05:51.164 INFO:tasks.workunit.client.1.smithi098.stdout:0/182: fsync d0/d6/f12 0 2024-09-20T19:05:51.164 INFO:tasks.workunit.client.1.smithi098.stdout:0/183: chown d0/c4 17512 1 2024-09-20T19:05:51.165 INFO:tasks.workunit.client.1.smithi098.stdout:3/225: dread d4/d25/f3c [0,4194304] 0 2024-09-20T19:05:51.165 INFO:tasks.workunit.client.1.smithi098.stdout:0/184: stat d0/d6/d28/l2d 0 2024-09-20T19:05:51.167 INFO:tasks.workunit.client.0.smithi027.stdout:7/137: link d3/d8/da/dc/l15 d3/d8/l30 0 2024-09-20T19:05:51.169 INFO:tasks.workunit.client.1.smithi098.stdout:8/355: truncate d7/de/d11/d19/f4e 2843396 0 2024-09-20T19:05:51.170 INFO:tasks.workunit.client.0.smithi027.stdout:0/172: truncate d2/d7/f26 1774970 0 2024-09-20T19:05:51.173 INFO:tasks.workunit.client.0.smithi027.stdout:2/97: rename d3/f7 to d3/d13/f17 0 2024-09-20T19:05:51.175 INFO:tasks.workunit.client.0.smithi027.stdout:9/252: truncate d0/d2e/f34 1237803 0 2024-09-20T19:05:51.176 INFO:tasks.workunit.client.0.smithi027.stdout:8/112: dwrite d2/d3/f11 [0,4194304] 0 2024-09-20T19:05:51.177 INFO:tasks.workunit.client.0.smithi027.stdout:4/93: creat d5/f1f x:0 0 0 2024-09-20T19:05:51.178 INFO:tasks.workunit.client.1.smithi098.stdout:0/185: mkdir d0/db/d32 0 2024-09-20T19:05:51.179 INFO:tasks.workunit.client.1.smithi098.stdout:0/186: write d0/db/f14 [4056030,46793] 0 2024-09-20T19:05:51.183 INFO:tasks.workunit.client.1.smithi098.stdout:6/148: creat d0/de/d1b/f28 x:0 0 0 2024-09-20T19:05:51.187 INFO:tasks.workunit.client.0.smithi027.stdout:1/134: mkdir d2/d8/d2b/d2d 0 2024-09-20T19:05:51.189 INFO:tasks.workunit.client.0.smithi027.stdout:1/135: chown d2/d14/d21 1599 1 2024-09-20T19:05:51.189 INFO:tasks.workunit.client.0.smithi027.stdout:5/170: creat d4/d1f/d28/f34 x:0 0 0 2024-09-20T19:05:51.190 INFO:tasks.workunit.client.1.smithi098.stdout:3/226: link d4/da/f14 d4/da/f45 0 2024-09-20T19:05:51.193 INFO:tasks.workunit.client.0.smithi027.stdout:2/98: dread d3/d13/f17 [0,4194304] 0 2024-09-20T19:05:51.193 INFO:tasks.workunit.client.0.smithi027.stdout:0/173: creat d2/d14/f3f x:0 0 0 2024-09-20T19:05:51.194 INFO:tasks.workunit.client.1.smithi098.stdout:6/149: rmdir d0/d7/d24 39 2024-09-20T19:05:51.195 INFO:tasks.workunit.client.0.smithi027.stdout:2/99: chown d3/de/l16 105508 1 2024-09-20T19:05:51.195 INFO:tasks.workunit.client.0.smithi027.stdout:0/174: chown d2/d20/c2f 7767 1 2024-09-20T19:05:51.196 INFO:tasks.workunit.client.0.smithi027.stdout:2/100: write d3/f9 [4980100,40195] 0 2024-09-20T19:05:51.196 INFO:tasks.workunit.client.0.smithi027.stdout:2/101: stat d3 0 2024-09-20T19:05:51.197 INFO:tasks.workunit.client.1.smithi098.stdout:8/356: creat d7/de/d11/d19/d30/f83 x:0 0 0 2024-09-20T19:05:51.201 INFO:tasks.workunit.client.0.smithi027.stdout:8/113: creat d2/d3/f25 x:0 0 0 2024-09-20T19:05:51.202 INFO:tasks.workunit.client.0.smithi027.stdout:4/94: readlink d5/lf 0 2024-09-20T19:05:51.207 INFO:tasks.workunit.client.0.smithi027.stdout:7/138: readlink d3/d8/da/dc/l14 0 2024-09-20T19:05:51.210 INFO:tasks.workunit.client.1.smithi098.stdout:6/150: mkdir d0/d7/d24/d29 0 2024-09-20T19:05:51.210 INFO:tasks.workunit.client.1.smithi098.stdout:0/187: write d0/db/f20 [1896368,34966] 0 2024-09-20T19:05:51.211 INFO:tasks.workunit.client.0.smithi027.stdout:5/171: creat d4/da/de/f35 x:0 0 0 2024-09-20T19:05:51.212 INFO:tasks.workunit.client.1.smithi098.stdout:0/188: write d0/db/f20 [1692652,48143] 0 2024-09-20T19:05:51.213 INFO:tasks.workunit.client.0.smithi027.stdout:0/175: creat d2/d14/f40 x:0 0 0 2024-09-20T19:05:51.217 INFO:tasks.workunit.client.0.smithi027.stdout:2/102: unlink d3/ld 0 2024-09-20T19:05:51.219 INFO:tasks.workunit.client.1.smithi098.stdout:6/151: dwrite d0/de/d1b/f1f [0,4194304] 0 2024-09-20T19:05:51.221 INFO:tasks.workunit.client.0.smithi027.stdout:6/75: creat d4/f14 x:0 0 0 2024-09-20T19:05:51.222 INFO:tasks.workunit.client.0.smithi027.stdout:6/76: dread - d4/f9 zero size 2024-09-20T19:05:51.223 INFO:tasks.workunit.client.0.smithi027.stdout:7/139: chown d3/d8/d26 288059714 1 2024-09-20T19:05:51.226 INFO:tasks.workunit.client.1.smithi098.stdout:3/227: dwrite d4/f10 [0,4194304] 0 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: mgrmap e22: smithi098.wrcvbg(active, since 1.01114s) 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: pgmap v3: 65 pgs: 65 active+clean; 946 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:51.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:51.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:05:51.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:05:51.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:05:51.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/trash_purge_schedule"}]: dispatch 2024-09-20T19:05:51.228 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:51 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/trash_purge_schedule"}]: dispatch 2024-09-20T19:05:51.229 INFO:tasks.workunit.client.1.smithi098.stdout:6/152: mkdir d0/d7/d2a 0 2024-09-20T19:05:51.230 INFO:tasks.workunit.client.1.smithi098.stdout:0/189: dwrite d0/db/d1d/f26 [0,4194304] 0 2024-09-20T19:05:51.235 INFO:tasks.workunit.client.1.smithi098.stdout:3/228: dread d4/d19/d1d/d22/f36 [0,4194304] 0 2024-09-20T19:05:51.238 INFO:tasks.workunit.client.1.smithi098.stdout:0/190: creat d0/d6/d19/f33 x:0 0 0 2024-09-20T19:05:51.240 INFO:tasks.workunit.client.1.smithi098.stdout:6/153: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-20T19:05:51.240 INFO:tasks.workunit.client.0.smithi027.stdout:2/103: creat d3/de/f18 x:0 0 0 2024-09-20T19:05:51.241 INFO:tasks.workunit.client.0.smithi027.stdout:8/114: creat d2/d3/d1b/f26 x:0 0 0 2024-09-20T19:05:51.244 INFO:tasks.workunit.client.1.smithi098.stdout:3/229: dread d4/f10 [0,4194304] 0 2024-09-20T19:05:51.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/191: creat d0/db/d1d/f34 x:0 0 0 2024-09-20T19:05:51.246 INFO:tasks.workunit.client.1.smithi098.stdout:6/154: rename d0/d7/d2a to d0/d7/d24/d29/d2b 0 2024-09-20T19:05:51.246 INFO:tasks.workunit.client.0.smithi027.stdout:1/136: dwrite d2/d1b/f1e [0,4194304] 0 2024-09-20T19:05:51.246 INFO:tasks.workunit.client.0.smithi027.stdout:4/95: creat d5/d11/d17/f20 x:0 0 0 2024-09-20T19:05:51.247 INFO:tasks.workunit.client.1.smithi098.stdout:3/230: fdatasync d4/d25/f35 0 2024-09-20T19:05:51.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/231: stat d4/d19/d1d/d22/l43 0 2024-09-20T19:05:51.250 INFO:tasks.workunit.client.0.smithi027.stdout:4/96: dread - d5/f1e zero size 2024-09-20T19:05:51.250 INFO:tasks.workunit.client.1.smithi098.stdout:3/232: write d4/d38/f41 [141881,78351] 0 2024-09-20T19:05:51.251 INFO:tasks.workunit.client.0.smithi027.stdout:9/253: getdents d0/d2e 0 2024-09-20T19:05:51.253 INFO:tasks.workunit.client.0.smithi027.stdout:8/115: write d2/d14/d13/f22 [177419,110971] 0 2024-09-20T19:05:51.253 INFO:tasks.workunit.client.1.smithi098.stdout:3/233: read d4/d25/f2b [173055,92714] 0 2024-09-20T19:05:51.254 INFO:tasks.workunit.client.0.smithi027.stdout:6/77: mkdir d4/d15 0 2024-09-20T19:05:51.255 INFO:tasks.workunit.client.0.smithi027.stdout:5/172: dwrite d4/da/de/d1e/f20 [4194304,4194304] 0 2024-09-20T19:05:51.255 INFO:tasks.workunit.client.0.smithi027.stdout:7/140: symlink d3/d8/l31 0 2024-09-20T19:05:51.256 INFO:tasks.workunit.client.0.smithi027.stdout:5/173: chown f2 19624026 1 2024-09-20T19:05:51.256 INFO:tasks.workunit.client.0.smithi027.stdout:1/137: truncate d2/d14/d21/f2c 1210816 0 2024-09-20T19:05:51.258 INFO:tasks.workunit.client.0.smithi027.stdout:9/254: read - d0/d9/df/d1b/d1a/f36 zero size 2024-09-20T19:05:51.258 INFO:tasks.workunit.client.0.smithi027.stdout:0/176: rename d2/d14/d1d/d2e/l3e to d2/l41 0 2024-09-20T19:05:51.259 INFO:tasks.workunit.client.0.smithi027.stdout:4/97: fsync d5/fa 0 2024-09-20T19:05:51.260 INFO:tasks.workunit.client.0.smithi027.stdout:5/174: chown d4/da/l19 11086 1 2024-09-20T19:05:51.263 INFO:tasks.workunit.client.0.smithi027.stdout:5/175: fsync d4/da/f2b 0 2024-09-20T19:05:51.263 INFO:tasks.workunit.client.0.smithi027.stdout:4/98: write d5/d11/d17/f20 [698936,81928] 0 2024-09-20T19:05:51.264 INFO:tasks.workunit.client.0.smithi027.stdout:5/176: fsync d4/da/d1a/f1b 0 2024-09-20T19:05:51.267 INFO:tasks.workunit.client.0.smithi027.stdout:1/138: dwrite d2/f13 [4194304,4194304] 0 2024-09-20T19:05:51.271 INFO:tasks.workunit.client.1.smithi098.stdout:6/155: getdents d0/d7/dc 0 2024-09-20T19:05:51.274 INFO:tasks.workunit.client.0.smithi027.stdout:8/116: rename d2/f1e to d2/d14/f27 0 2024-09-20T19:05:51.275 INFO:tasks.workunit.client.0.smithi027.stdout:8/117: fsync d2/f7 0 2024-09-20T19:05:51.275 INFO:tasks.workunit.client.1.smithi098.stdout:3/234: mknod d4/d25/d40/c46 0 2024-09-20T19:05:51.281 INFO:tasks.workunit.client.0.smithi027.stdout:8/118: dwrite d2/f7 [0,4194304] 0 2024-09-20T19:05:51.281 INFO:tasks.workunit.client.1.smithi098.stdout:0/192: link d0/db/l22 d0/d6/l35 0 2024-09-20T19:05:51.282 INFO:tasks.workunit.client.0.smithi027.stdout:0/177: creat d2/d7/f42 x:0 0 0 2024-09-20T19:05:51.283 INFO:tasks.workunit.client.1.smithi098.stdout:6/156: mknod d0/de/c2c 0 2024-09-20T19:05:51.285 INFO:tasks.workunit.client.1.smithi098.stdout:0/193: write d0/d6/d19/f1c [26339,114032] 0 2024-09-20T19:05:51.286 INFO:tasks.workunit.client.0.smithi027.stdout:4/99: write d5/fe [1807031,29735] 0 2024-09-20T19:05:51.287 INFO:tasks.workunit.client.0.smithi027.stdout:5/177: mkdir d4/da/de/d1e/d36 0 2024-09-20T19:05:51.287 INFO:tasks.workunit.client.1.smithi098.stdout:6/157: mknod d0/d7/d24/d29/c2d 0 2024-09-20T19:05:51.289 INFO:tasks.workunit.client.0.smithi027.stdout:1/139: creat d2/d1b/f2e x:0 0 0 2024-09-20T19:05:51.290 INFO:tasks.workunit.client.1.smithi098.stdout:3/235: creat d4/d19/d1d/f47 x:0 0 0 2024-09-20T19:05:51.295 INFO:tasks.workunit.client.0.smithi027.stdout:8/119: fdatasync d2/d14/f27 0 2024-09-20T19:05:51.295 INFO:tasks.workunit.client.0.smithi027.stdout:0/178: creat d2/d14/d1b/f43 x:0 0 0 2024-09-20T19:05:51.297 INFO:tasks.workunit.client.1.smithi098.stdout:3/236: dread d4/d25/f2b [0,4194304] 0 2024-09-20T19:05:51.297 INFO:tasks.workunit.client.1.smithi098.stdout:6/158: symlink d0/d7/l2e 0 2024-09-20T19:05:51.297 INFO:tasks.workunit.client.0.smithi027.stdout:2/104: getdents d3/d13 0 2024-09-20T19:05:51.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/159: write d0/f8 [898615,68064] 0 2024-09-20T19:05:51.299 INFO:tasks.workunit.client.0.smithi027.stdout:5/178: dwrite d4/da/de/f35 [0,4194304] 0 2024-09-20T19:05:51.301 INFO:tasks.workunit.client.0.smithi027.stdout:0/179: write d2/f9 [189449,89802] 0 2024-09-20T19:05:51.301 INFO:tasks.workunit.client.1.smithi098.stdout:0/194: rmdir d0/db/d2e 0 2024-09-20T19:05:51.304 INFO:tasks.workunit.client.0.smithi027.stdout:1/140: dwrite d2/d1b/f1e [4194304,4194304] 0 2024-09-20T19:05:51.304 INFO:tasks.workunit.client.1.smithi098.stdout:6/160: dread d0/de/f18 [0,4194304] 0 2024-09-20T19:05:51.306 INFO:tasks.workunit.client.0.smithi027.stdout:0/180: write d2/d14/d1b/f43 [1026425,11543] 0 2024-09-20T19:05:51.310 INFO:tasks.workunit.client.0.smithi027.stdout:2/105: dread d3/ff [0,4194304] 0 2024-09-20T19:05:51.312 INFO:tasks.workunit.client.1.smithi098.stdout:0/195: dwrite d0/db/d1d/f34 [0,4194304] 0 2024-09-20T19:05:51.313 INFO:tasks.workunit.client.1.smithi098.stdout:0/196: stat d0/d6/d19/l29 0 2024-09-20T19:05:51.314 INFO:tasks.workunit.client.1.smithi098.stdout:3/237: mkdir d4/d38/d48 0 2024-09-20T19:05:51.314 INFO:tasks.workunit.client.1.smithi098.stdout:6/161: mknod d0/c2f 0 2024-09-20T19:05:51.318 INFO:tasks.workunit.client.1.smithi098.stdout:0/197: readlink d0/d6/l35 0 2024-09-20T19:05:51.318 INFO:tasks.workunit.client.1.smithi098.stdout:0/198: chown d0/db 399028 1 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: mgrmap e22: smithi098.wrcvbg(active, since 1.01114s) 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: pgmap v3: 65 pgs: 65 active+clean; 946 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/trash_purge_schedule"}]: dispatch 2024-09-20T19:05:51.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:51 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.wrcvbg/trash_purge_schedule"}]: dispatch 2024-09-20T19:05:51.322 INFO:tasks.workunit.client.1.smithi098.stdout:6/162: fdatasync d0/d7/f13 0 2024-09-20T19:05:51.322 INFO:tasks.workunit.client.1.smithi098.stdout:6/163: readlink d0/d7/l25 0 2024-09-20T19:05:51.323 INFO:tasks.workunit.client.1.smithi098.stdout:6/164: write d0/de/d1b/f28 [63477,16279] 0 2024-09-20T19:05:51.325 INFO:tasks.workunit.client.0.smithi027.stdout:0/181: creat d2/d20/f44 x:0 0 0 2024-09-20T19:05:51.328 INFO:tasks.workunit.client.1.smithi098.stdout:0/199: rename d0/d6/l35 to d0/d15/l36 0 2024-09-20T19:05:51.329 INFO:tasks.workunit.client.0.smithi027.stdout:4/100: dwrite f4 [0,4194304] 0 2024-09-20T19:05:51.330 INFO:tasks.workunit.client.0.smithi027.stdout:7/141: getdents d3/d8/da/dc 0 2024-09-20T19:05:51.330 INFO:tasks.workunit.client.1.smithi098.stdout:9/301: sync 2024-09-20T19:05:51.331 INFO:tasks.workunit.client.1.smithi098.stdout:9/302: chown d4/de/d24/d35/d2d/l54 9174379 1 2024-09-20T19:05:51.335 INFO:tasks.workunit.client.0.smithi027.stdout:9/255: rename d0/d9/df/d1b/f14 to d0/d9/df/f50 0 2024-09-20T19:05:51.337 INFO:tasks.workunit.client.0.smithi027.stdout:9/256: write d0/d9/df/d1b/d1a/dd/f29 [675805,45943] 0 2024-09-20T19:05:51.338 INFO:tasks.workunit.client.1.smithi098.stdout:3/238: link d4/da/fb d4/d25/f49 0 2024-09-20T19:05:51.340 INFO:tasks.workunit.client.0.smithi027.stdout:8/120: creat d2/d3/d6/d21/f28 x:0 0 0 2024-09-20T19:05:51.341 INFO:tasks.workunit.client.0.smithi027.stdout:8/121: dread - d2/d3/f25 zero size 2024-09-20T19:05:51.342 INFO:tasks.workunit.client.0.smithi027.stdout:2/106: write d3/fa [3823143,63683] 0 2024-09-20T19:05:51.342 INFO:tasks.workunit.client.1.smithi098.stdout:3/239: dread d4/fd [0,4194304] 0 2024-09-20T19:05:51.343 INFO:tasks.workunit.client.0.smithi027.stdout:2/107: write d3/fa [591962,89257] 0 2024-09-20T19:05:51.343 INFO:tasks.workunit.client.1.smithi098.stdout:3/240: write d4/d19/d1d/f3b [819006,50464] 0 2024-09-20T19:05:51.346 INFO:tasks.workunit.client.1.smithi098.stdout:0/200: mknod d0/d6/d28/d31/c37 0 2024-09-20T19:05:51.347 INFO:tasks.workunit.client.0.smithi027.stdout:4/101: write d5/f10 [3743700,44254] 0 2024-09-20T19:05:51.347 INFO:tasks.workunit.client.0.smithi027.stdout:7/142: symlink d3/d8/da/l32 0 2024-09-20T19:05:51.349 INFO:tasks.workunit.client.0.smithi027.stdout:7/143: write d3/d24/f2c [75256,116946] 0 2024-09-20T19:05:51.349 INFO:tasks.workunit.client.1.smithi098.stdout:6/165: truncate d0/f8 939505 0 2024-09-20T19:05:51.351 INFO:tasks.workunit.client.1.smithi098.stdout:3/241: dwrite d4/d19/f3f [0,4194304] 0 2024-09-20T19:05:51.352 INFO:tasks.workunit.client.1.smithi098.stdout:6/166: write d0/d7/dc/f1a [3209386,69886] 0 2024-09-20T19:05:51.353 INFO:tasks.workunit.client.1.smithi098.stdout:6/167: write d0/de/d1b/f26 [4970462,129071] 0 2024-09-20T19:05:51.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/168: chown d0/f22 2401217 1 2024-09-20T19:05:51.433 INFO:tasks.workunit.client.0.smithi027.stdout:6/78: sync 2024-09-20T19:05:51.433 INFO:tasks.workunit.client.0.smithi027.stdout:3/180: sync 2024-09-20T19:05:51.469 INFO:tasks.workunit.client.1.smithi098.stdout:9/303: creat d4/de/d27/d4a/f69 x:0 0 0 2024-09-20T19:05:51.471 INFO:tasks.workunit.client.0.smithi027.stdout:5/179: rename d4/f10 to d4/da/de/f37 0 2024-09-20T19:05:51.473 INFO:tasks.workunit.client.0.smithi027.stdout:8/122: symlink d2/d14/l29 0 2024-09-20T19:05:51.473 INFO:tasks.workunit.client.1.smithi098.stdout:3/242: rmdir d4/d19 39 2024-09-20T19:05:51.475 INFO:tasks.workunit.client.1.smithi098.stdout:6/169: chown d0/de/d1b/l20 21744418 1 2024-09-20T19:05:51.476 INFO:tasks.workunit.client.1.smithi098.stdout:6/170: fdatasync d0/d7/dc/f1a 0 2024-09-20T19:05:51.477 INFO:tasks.workunit.client.0.smithi027.stdout:1/141: link d2/l1d d2/d15/l2f 0 2024-09-20T19:05:51.479 INFO:tasks.workunit.client.0.smithi027.stdout:0/182: creat d2/d14/d1b/d3c/f45 x:0 0 0 2024-09-20T19:05:51.480 INFO:tasks.workunit.client.0.smithi027.stdout:8/123: dwrite d2/d3/f25 [0,4194304] 0 2024-09-20T19:05:51.480 INFO:tasks.workunit.client.0.smithi027.stdout:8/124: chown d2 0 1 2024-09-20T19:05:51.483 INFO:tasks.workunit.client.0.smithi027.stdout:4/102: chown d5/l6 140550741 1 2024-09-20T19:05:51.484 INFO:tasks.workunit.client.0.smithi027.stdout:1/142: dread d2/d15/f25 [0,4194304] 0 2024-09-20T19:05:51.485 INFO:tasks.workunit.client.1.smithi098.stdout:6/171: symlink d0/de/l30 0 2024-09-20T19:05:51.486 INFO:tasks.workunit.client.0.smithi027.stdout:7/144: dread d3/d8/f20 [0,4194304] 0 2024-09-20T19:05:51.487 INFO:tasks.workunit.client.0.smithi027.stdout:3/181: symlink d0/d1/d7/l3e 0 2024-09-20T19:05:51.488 INFO:tasks.workunit.client.1.smithi098.stdout:3/243: mknod d4/d19/d1d/d2f/c4a 0 2024-09-20T19:05:51.489 INFO:tasks.workunit.client.0.smithi027.stdout:8/125: dwrite d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:51.490 INFO:tasks.workunit.client.0.smithi027.stdout:9/257: creat d0/d9/d3d/d4f/f51 x:0 0 0 2024-09-20T19:05:51.490 INFO:tasks.workunit.client.1.smithi098.stdout:6/172: symlink d0/d7/d24/d29/l31 0 2024-09-20T19:05:51.492 INFO:tasks.workunit.client.1.smithi098.stdout:9/304: creat d4/f6a x:0 0 0 2024-09-20T19:05:51.493 INFO:tasks.workunit.client.1.smithi098.stdout:0/201: getdents d0/d6 0 2024-09-20T19:05:51.493 INFO:tasks.workunit.client.1.smithi098.stdout:9/305: chown d4/de/d24/d35/c57 9 1 2024-09-20T19:05:51.494 INFO:tasks.workunit.client.1.smithi098.stdout:2/522: sync 2024-09-20T19:05:51.494 INFO:tasks.workunit.client.1.smithi098.stdout:1/150: sync 2024-09-20T19:05:51.495 INFO:tasks.workunit.client.0.smithi027.stdout:0/183: rename d2/f12 to d2/d14/d1d/d2e/f46 0 2024-09-20T19:05:51.496 INFO:tasks.workunit.client.0.smithi027.stdout:3/182: dwrite d0/d1/f2e [0,4194304] 0 2024-09-20T19:05:51.497 INFO:tasks.workunit.client.1.smithi098.stdout:3/244: mkdir d4/d25/d40/d4b 0 2024-09-20T19:05:51.499 INFO:tasks.workunit.client.0.smithi027.stdout:3/183: write d0/d1/d13/f37 [582024,109670] 0 2024-09-20T19:05:51.501 INFO:tasks.workunit.client.1.smithi098.stdout:3/245: write d4/d19/f3f [2045778,59580] 0 2024-09-20T19:05:51.503 INFO:tasks.workunit.client.1.smithi098.stdout:2/523: unlink d3/d16/d1a/l26 0 2024-09-20T19:05:51.504 INFO:tasks.workunit.client.1.smithi098.stdout:0/202: dwrite d0/d6/d19/f33 [0,4194304] 0 2024-09-20T19:05:51.507 INFO:tasks.workunit.client.1.smithi098.stdout:9/306: mkdir d4/de/d6b 0 2024-09-20T19:05:51.510 INFO:tasks.workunit.client.0.smithi027.stdout:8/126: mkdir d2/d2a 0 2024-09-20T19:05:51.514 INFO:tasks.workunit.client.0.smithi027.stdout:2/108: truncate d3/d13/f17 1304911 0 2024-09-20T19:05:51.515 INFO:tasks.workunit.client.0.smithi027.stdout:9/258: creat d0/d9/d3d/f52 x:0 0 0 2024-09-20T19:05:51.517 INFO:tasks.workunit.client.0.smithi027.stdout:3/184: read d0/f11 [1691481,131005] 0 2024-09-20T19:05:51.519 INFO:tasks.workunit.client.1.smithi098.stdout:2/524: mknod d3/d16/d1d/d2b/d46/caf 0 2024-09-20T19:05:51.520 INFO:tasks.workunit.client.0.smithi027.stdout:2/109: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:51.521 INFO:tasks.workunit.client.1.smithi098.stdout:2/525: readlink d3/d16/d1d/l73 0 2024-09-20T19:05:51.521 INFO:tasks.workunit.client.0.smithi027.stdout:4/103: mkdir d5/d13/d16/d21 0 2024-09-20T19:05:51.522 INFO:tasks.workunit.client.0.smithi027.stdout:4/104: chown d5/d11/d17/f20 215519257 1 2024-09-20T19:05:51.523 INFO:tasks.workunit.client.1.smithi098.stdout:0/203: mkdir d0/d15/d38 0 2024-09-20T19:05:51.523 INFO:tasks.workunit.client.1.smithi098.stdout:0/204: chown d0/l9 9374860 1 2024-09-20T19:05:51.524 INFO:tasks.workunit.client.0.smithi027.stdout:3/185: read d0/d1/d13/d15/f29 [69273,118118] 0 2024-09-20T19:05:51.525 INFO:tasks.workunit.client.1.smithi098.stdout:2/526: dread d3/d51/f7f [0,4194304] 0 2024-09-20T19:05:51.525 INFO:tasks.workunit.client.1.smithi098.stdout:0/205: write d0/d6/d19/f1c [3619711,18805] 0 2024-09-20T19:05:51.526 INFO:tasks.workunit.client.1.smithi098.stdout:1/151: creat d1/d3/f2a x:0 0 0 2024-09-20T19:05:51.527 INFO:tasks.workunit.client.0.smithi027.stdout:5/180: link d4/c32 d4/da/c38 0 2024-09-20T19:05:51.528 INFO:tasks.workunit.client.1.smithi098.stdout:9/307: mkdir d4/de/d27/d6c 0 2024-09-20T19:05:51.529 INFO:tasks.workunit.client.0.smithi027.stdout:2/110: dwrite d3/de/f18 [0,4194304] 0 2024-09-20T19:05:51.529 INFO:tasks.workunit.client.1.smithi098.stdout:6/173: truncate d0/f8 335030 0 2024-09-20T19:05:51.530 INFO:tasks.workunit.client.0.smithi027.stdout:5/181: readlink d4/da/l19 0 2024-09-20T19:05:51.533 INFO:tasks.workunit.client.0.smithi027.stdout:2/111: chown d3/l10 32557 1 2024-09-20T19:05:51.533 INFO:tasks.workunit.client.0.smithi027.stdout:8/127: symlink d2/d14/l2b 0 2024-09-20T19:05:51.534 INFO:tasks.workunit.client.0.smithi027.stdout:3/186: dread d0/d1/d13/f37 [0,4194304] 0 2024-09-20T19:05:51.535 INFO:tasks.workunit.client.0.smithi027.stdout:2/112: stat d3/de 0 2024-09-20T19:05:51.537 INFO:tasks.workunit.client.0.smithi027.stdout:5/182: truncate d4/da/de/f37 2025735 0 2024-09-20T19:05:51.537 INFO:tasks.workunit.client.0.smithi027.stdout:7/145: dwrite d3/d8/da/dc/f21 [0,4194304] 0 2024-09-20T19:05:51.538 INFO:tasks.workunit.client.1.smithi098.stdout:6/174: dread d0/d7/dc/f1a [4194304,4194304] 0 2024-09-20T19:05:51.538 INFO:tasks.workunit.client.0.smithi027.stdout:8/128: write d2/d14/f27 [2706824,30174] 0 2024-09-20T19:05:51.539 INFO:tasks.workunit.client.1.smithi098.stdout:2/527: rmdir d3/d51/d68 39 2024-09-20T19:05:51.539 INFO:tasks.workunit.client.0.smithi027.stdout:4/105: creat d5/d13/d16/f22 x:0 0 0 2024-09-20T19:05:51.539 INFO:tasks.workunit.client.1.smithi098.stdout:6/175: write d0/f15 [4409274,91113] 0 2024-09-20T19:05:51.540 INFO:tasks.workunit.client.0.smithi027.stdout:8/129: dread - d2/d14/f20 zero size 2024-09-20T19:05:51.540 INFO:tasks.workunit.client.1.smithi098.stdout:2/528: read d3/d16/d1d/d4f/d8b/f3e [3657816,25173] 0 2024-09-20T19:05:51.542 INFO:tasks.workunit.client.0.smithi027.stdout:4/106: dread f4 [4194304,4194304] 0 2024-09-20T19:05:51.546 INFO:tasks.workunit.client.0.smithi027.stdout:4/107: write d5/f1e [780901,126891] 0 2024-09-20T19:05:51.550 INFO:tasks.workunit.client.0.smithi027.stdout:8/130: dwrite d2/d14/f27 [0,4194304] 0 2024-09-20T19:05:51.554 INFO:tasks.workunit.client.0.smithi027.stdout:2/113: write d3/ff [5035142,43067] 0 2024-09-20T19:05:51.554 INFO:tasks.workunit.client.0.smithi027.stdout:9/259: mknod d0/d9/df/d1b/d1a/dd/c53 0 2024-09-20T19:05:51.554 INFO:tasks.workunit.client.0.smithi027.stdout:2/114: chown d3/c12 797 1 2024-09-20T19:05:51.555 INFO:tasks.workunit.client.0.smithi027.stdout:9/260: fdatasync d0/d9/df/d1b/d1a/f36 0 2024-09-20T19:05:51.556 INFO:tasks.workunit.client.0.smithi027.stdout:5/183: fsync d4/d1f/f23 0 2024-09-20T19:05:51.558 INFO:tasks.workunit.client.0.smithi027.stdout:7/146: symlink d3/d8/da/d2e/l33 0 2024-09-20T19:05:51.558 INFO:tasks.workunit.client.0.smithi027.stdout:5/184: truncate d4/da/f29 825171 0 2024-09-20T19:05:51.559 INFO:tasks.workunit.client.0.smithi027.stdout:5/185: truncate d4/da/f29 1275486 0 2024-09-20T19:05:51.561 INFO:tasks.workunit.client.0.smithi027.stdout:4/108: creat d5/d11/f23 x:0 0 0 2024-09-20T19:05:51.562 INFO:tasks.workunit.client.0.smithi027.stdout:4/109: readlink d5/d13/d16/l18 0 2024-09-20T19:05:51.564 INFO:tasks.workunit.client.0.smithi027.stdout:8/131: rename d2/f7 to d2/d3/d1b/f2c 0 2024-09-20T19:05:51.566 INFO:tasks.workunit.client.0.smithi027.stdout:8/132: chown d2/d14/c24 124454875 1 2024-09-20T19:05:51.567 INFO:tasks.workunit.client.0.smithi027.stdout:9/261: creat d0/d9/d3d/f54 x:0 0 0 2024-09-20T19:05:51.567 INFO:tasks.workunit.client.0.smithi027.stdout:5/186: dwrite d4/da/f2c [0,4194304] 0 2024-09-20T19:05:51.569 INFO:tasks.workunit.client.0.smithi027.stdout:7/147: rmdir d3/d8/da/dc 39 2024-09-20T19:05:51.572 INFO:tasks.workunit.client.0.smithi027.stdout:8/133: mkdir d2/d3/d1b/d2d 0 2024-09-20T19:05:51.576 INFO:tasks.workunit.client.0.smithi027.stdout:8/134: dread d2/d3/f25 [0,4194304] 0 2024-09-20T19:05:51.576 INFO:tasks.workunit.client.0.smithi027.stdout:2/115: truncate d3/f9 1480508 0 2024-09-20T19:05:51.581 INFO:tasks.workunit.client.0.smithi027.stdout:2/116: creat d3/d13/f19 x:0 0 0 2024-09-20T19:05:51.582 INFO:tasks.workunit.client.0.smithi027.stdout:3/187: write d0/d19/f1a [1985130,97771] 0 2024-09-20T19:05:51.583 INFO:tasks.workunit.client.0.smithi027.stdout:8/135: unlink d2/ld 0 2024-09-20T19:05:51.584 INFO:tasks.workunit.client.0.smithi027.stdout:9/262: dwrite d0/d9/f28 [0,4194304] 0 2024-09-20T19:05:51.586 INFO:tasks.workunit.client.0.smithi027.stdout:9/263: write d0/d9/d3d/f52 [463142,21742] 0 2024-09-20T19:05:51.587 INFO:tasks.workunit.client.0.smithi027.stdout:5/187: getdents d4/da/de/d1e 0 2024-09-20T19:05:51.587 INFO:tasks.workunit.client.0.smithi027.stdout:3/188: fsync d0/d19/f1a 0 2024-09-20T19:05:51.587 INFO:tasks.workunit.client.0.smithi027.stdout:2/117: creat d3/de/f1a x:0 0 0 2024-09-20T19:05:51.588 INFO:tasks.workunit.client.0.smithi027.stdout:2/118: stat d3/l10 0 2024-09-20T19:05:51.588 INFO:tasks.workunit.client.0.smithi027.stdout:8/136: mkdir d2/d14/d13/d2e 0 2024-09-20T19:05:51.590 INFO:tasks.workunit.client.0.smithi027.stdout:5/188: chown d4/d1f/f24 1422152 1 2024-09-20T19:05:51.590 INFO:tasks.workunit.client.0.smithi027.stdout:9/264: mknod d0/d9/c55 0 2024-09-20T19:05:51.603 INFO:tasks.workunit.client.0.smithi027.stdout:9/265: symlink d0/d9/df/d1b/d1a/dd/l56 0 2024-09-20T19:05:51.605 INFO:tasks.workunit.client.0.smithi027.stdout:2/119: write d3/d13/f17 [2289140,105948] 0 2024-09-20T19:05:51.607 INFO:tasks.workunit.client.1.smithi098.stdout:9/308: mkdir d4/de/d24/d35/d6d 0 2024-09-20T19:05:51.608 INFO:tasks.workunit.client.1.smithi098.stdout:3/246: creat d4/d19/d1d/f4c x:0 0 0 2024-09-20T19:05:51.608 INFO:tasks.workunit.client.1.smithi098.stdout:6/176: mknod d0/de/c32 0 2024-09-20T19:05:51.610 INFO:tasks.workunit.client.1.smithi098.stdout:6/177: chown d0/d7/l25 271174 1 2024-09-20T19:05:51.610 INFO:tasks.workunit.client.0.smithi027.stdout:3/189: dwrite d0/d1/d7/d1d/f21 [0,4194304] 0 2024-09-20T19:05:51.611 INFO:tasks.workunit.client.1.smithi098.stdout:9/309: symlink d4/de/d24/d35/d2d/l6e 0 2024-09-20T19:05:51.612 INFO:tasks.workunit.client.0.smithi027.stdout:8/137: dwrite d2/d3/d6/f1a [0,4194304] 0 2024-09-20T19:05:51.612 INFO:tasks.workunit.client.1.smithi098.stdout:1/152: rename d1/d3/f2a to d1/d3/f2b 0 2024-09-20T19:05:51.613 INFO:tasks.workunit.client.0.smithi027.stdout:5/189: dwrite d4/da/fc [0,4194304] 0 2024-09-20T19:05:51.613 INFO:tasks.workunit.client.0.smithi027.stdout:7/148: dwrite d3/f5 [0,4194304] 0 2024-09-20T19:05:51.613 INFO:tasks.workunit.client.1.smithi098.stdout:9/310: dread - d4/de/d27/d4a/d21/f36 zero size 2024-09-20T19:05:51.617 INFO:tasks.workunit.client.1.smithi098.stdout:6/178: rename d0/d7/d24/d29/l31 to d0/d7/d24/d29/l33 0 2024-09-20T19:05:51.617 INFO:tasks.workunit.client.0.smithi027.stdout:2/120: creat d3/f1b x:0 0 0 2024-09-20T19:05:51.617 INFO:tasks.workunit.client.1.smithi098.stdout:2/529: dwrite d3/fa [0,4194304] 0 2024-09-20T19:05:51.619 INFO:tasks.workunit.client.1.smithi098.stdout:1/153: unlink d1/cb 0 2024-09-20T19:05:51.619 INFO:tasks.workunit.client.0.smithi027.stdout:7/149: read - d3/d8/da/f28 zero size 2024-09-20T19:05:51.621 INFO:tasks.workunit.client.1.smithi098.stdout:9/311: chown d4/de/d24/d35/d2d/c61 13217916 1 2024-09-20T19:05:51.622 INFO:tasks.workunit.client.1.smithi098.stdout:2/530: read d3/d16/f83 [883576,80341] 0 2024-09-20T19:05:51.626 INFO:tasks.workunit.client.0.smithi027.stdout:9/266: mkdir d0/d9/df/d57 0 2024-09-20T19:05:51.628 INFO:tasks.workunit.client.1.smithi098.stdout:9/312: dwrite d4/f8 [0,4194304] 0 2024-09-20T19:05:51.629 INFO:tasks.workunit.client.1.smithi098.stdout:2/531: rename d3/d16/d1d/d2b/d49 to d3/db0 0 2024-09-20T19:05:51.630 INFO:tasks.workunit.client.1.smithi098.stdout:1/154: creat d1/d3/f2c x:0 0 0 2024-09-20T19:05:51.636 INFO:tasks.workunit.client.0.smithi027.stdout:8/138: dwrite d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:51.637 INFO:tasks.workunit.client.1.smithi098.stdout:2/532: dwrite d3/f6d [0,4194304] 0 2024-09-20T19:05:51.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/155: creat d1/d3/f2d x:0 0 0 2024-09-20T19:05:51.639 INFO:tasks.workunit.client.1.smithi098.stdout:2/533: write d3/d16/d1a/f37 [294905,90375] 0 2024-09-20T19:05:51.639 INFO:tasks.workunit.client.0.smithi027.stdout:7/150: creat d3/d8/d1c/f34 x:0 0 0 2024-09-20T19:05:51.641 INFO:tasks.workunit.client.0.smithi027.stdout:2/121: dwrite d3/d13/f19 [0,4194304] 0 2024-09-20T19:05:51.642 INFO:tasks.workunit.client.0.smithi027.stdout:5/190: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:05:51.644 INFO:tasks.workunit.client.0.smithi027.stdout:3/190: dread d0/d1/d13/d15/f29 [0,4194304] 0 2024-09-20T19:05:51.645 INFO:tasks.workunit.client.0.smithi027.stdout:6/79: sync 2024-09-20T19:05:51.645 INFO:tasks.workunit.client.1.smithi098.stdout:1/156: mkdir d1/d3/d2e 0 2024-09-20T19:05:51.649 INFO:tasks.workunit.client.0.smithi027.stdout:9/267: unlink d0/d9/df/c16 0 2024-09-20T19:05:51.650 INFO:tasks.workunit.client.0.smithi027.stdout:3/191: creat d0/d1/f3f x:0 0 0 2024-09-20T19:05:51.650 INFO:tasks.workunit.client.0.smithi027.stdout:7/151: dread - d3/d8/da/dc/f1d zero size 2024-09-20T19:05:51.655 INFO:tasks.workunit.client.0.smithi027.stdout:5/191: dread d4/da/de/d1e/f20 [4194304,4194304] 0 2024-09-20T19:05:51.656 INFO:tasks.workunit.client.1.smithi098.stdout:2/534: dwrite d3/df/d13/f2c [8388608,4194304] 0 2024-09-20T19:05:51.656 INFO:tasks.workunit.client.0.smithi027.stdout:8/139: creat d2/d2a/f2f x:0 0 0 2024-09-20T19:05:51.657 INFO:tasks.workunit.client.0.smithi027.stdout:6/80: symlink d4/l16 0 2024-09-20T19:05:51.658 INFO:tasks.workunit.client.0.smithi027.stdout:7/152: dread - d3/d8/da/f28 zero size 2024-09-20T19:05:51.658 INFO:tasks.workunit.client.0.smithi027.stdout:5/192: chown d4/f16 391 1 2024-09-20T19:05:51.659 INFO:tasks.workunit.client.1.smithi098.stdout:1/157: dwrite d1/d3/f1e [0,4194304] 0 2024-09-20T19:05:51.662 INFO:tasks.workunit.client.1.smithi098.stdout:2/535: stat d3/d16/d1a/f4b 0 2024-09-20T19:05:51.667 INFO:tasks.workunit.client.0.smithi027.stdout:6/81: write d4/f7 [202442,118637] 0 2024-09-20T19:05:51.669 INFO:tasks.workunit.client.0.smithi027.stdout:6/82: write d4/f14 [836525,27281] 0 2024-09-20T19:05:51.671 INFO:tasks.workunit.client.1.smithi098.stdout:2/536: dwrite d3/df/f7a [0,4194304] 0 2024-09-20T19:05:51.671 INFO:tasks.workunit.client.1.smithi098.stdout:1/158: unlink d1/d3/f5 0 2024-09-20T19:05:51.673 INFO:tasks.workunit.client.0.smithi027.stdout:9/268: mkdir d0/d9/df/d1b/d1a/dd/d58 0 2024-09-20T19:05:51.674 INFO:tasks.workunit.client.1.smithi098.stdout:1/159: fdatasync d1/d3/df/f21 0 2024-09-20T19:05:51.675 INFO:tasks.workunit.client.0.smithi027.stdout:9/269: fdatasync d0/d9/df/f2a 0 2024-09-20T19:05:51.676 INFO:tasks.workunit.client.1.smithi098.stdout:1/160: chown d1/d3/f2b 79673794 1 2024-09-20T19:05:51.678 INFO:tasks.workunit.client.0.smithi027.stdout:8/140: rename d2/d3/d6/fc to d2/d3/f30 0 2024-09-20T19:05:51.678 INFO:tasks.workunit.client.1.smithi098.stdout:1/161: write d1/d3/df/f29 [445145,10053] 0 2024-09-20T19:05:51.680 INFO:tasks.workunit.client.0.smithi027.stdout:9/270: fsync d0/d9/d3d/f52 0 2024-09-20T19:05:51.680 INFO:tasks.workunit.client.0.smithi027.stdout:9/271: chown d0/d9/d3d 11 1 2024-09-20T19:05:51.680 INFO:tasks.workunit.client.0.smithi027.stdout:2/122: getdents d3/d13 0 2024-09-20T19:05:51.681 INFO:tasks.workunit.client.1.smithi098.stdout:2/537: stat d3/d16/d1d/d2b/d46/d74/d82/la9 0 2024-09-20T19:05:51.685 INFO:tasks.workunit.client.0.smithi027.stdout:3/192: truncate d0/d1/f30 16350 0 2024-09-20T19:05:51.690 INFO:tasks.workunit.client.0.smithi027.stdout:3/193: dread d0/d1/f3b [0,4194304] 0 2024-09-20T19:05:51.690 INFO:tasks.workunit.client.1.smithi098.stdout:2/538: creat d3/d51/d68/fb1 x:0 0 0 2024-09-20T19:05:51.691 INFO:tasks.workunit.client.1.smithi098.stdout:9/313: write d4/de/d27/d4a/f67 [955836,18641] 0 2024-09-20T19:05:51.692 INFO:tasks.workunit.client.0.smithi027.stdout:7/153: mknod d3/d8/c35 0 2024-09-20T19:05:51.694 INFO:tasks.workunit.client.1.smithi098.stdout:9/314: write d4/de/d48/f4d [211213,127727] 0 2024-09-20T19:05:51.695 INFO:tasks.workunit.client.1.smithi098.stdout:2/539: write d3/d16/d1d/d4f/d8b/f3e [316578,48063] 0 2024-09-20T19:05:51.695 INFO:tasks.workunit.client.0.smithi027.stdout:2/123: mkdir d3/d1c 0 2024-09-20T19:05:51.696 INFO:tasks.workunit.client.0.smithi027.stdout:9/272: rmdir d0/d9/d3d/d4f 39 2024-09-20T19:05:51.696 INFO:tasks.workunit.client.1.smithi098.stdout:9/315: rmdir d4/de/d24/d35 39 2024-09-20T19:05:51.697 INFO:tasks.workunit.client.0.smithi027.stdout:2/124: write d3/d13/f15 [663670,3925] 0 2024-09-20T19:05:51.698 INFO:tasks.workunit.client.0.smithi027.stdout:5/193: rmdir d4/da/de/d1e/d36 0 2024-09-20T19:05:51.700 INFO:tasks.workunit.client.1.smithi098.stdout:7/287: sync 2024-09-20T19:05:51.700 INFO:tasks.workunit.client.1.smithi098.stdout:5/250: sync 2024-09-20T19:05:51.700 INFO:tasks.workunit.client.1.smithi098.stdout:9/316: stat d4/de/d24/d35/f42 0 2024-09-20T19:05:51.702 INFO:tasks.workunit.client.0.smithi027.stdout:9/273: write d0/fa [4370821,56359] 0 2024-09-20T19:05:51.704 INFO:tasks.workunit.client.0.smithi027.stdout:8/141: dwrite d2/d3/f30 [0,4194304] 0 2024-09-20T19:05:51.706 INFO:tasks.workunit.client.0.smithi027.stdout:8/142: chown d2/d14/l2b 2387 1 2024-09-20T19:05:51.709 INFO:tasks.workunit.client.1.smithi098.stdout:7/288: mknod d3/d10/d18/c59 0 2024-09-20T19:05:51.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/317: dwrite d4/de/d27/d39/f5a [0,4194304] 0 2024-09-20T19:05:51.710 INFO:tasks.workunit.client.0.smithi027.stdout:6/83: dread f0 [4194304,4194304] 0 2024-09-20T19:05:51.718 INFO:tasks.workunit.client.0.smithi027.stdout:5/194: unlink d4/d1f/f23 0 2024-09-20T19:05:51.719 INFO:tasks.workunit.client.0.smithi027.stdout:5/195: write d4/d1f/d28/f34 [293831,115708] 0 2024-09-20T19:05:51.725 INFO:tasks.workunit.client.1.smithi098.stdout:1/162: dwrite d1/d3/f15 [0,4194304] 0 2024-09-20T19:05:51.726 INFO:tasks.workunit.client.1.smithi098.stdout:2/540: link d3/df/d13/f33 d3/db0/d69/fb2 0 2024-09-20T19:05:51.727 INFO:tasks.workunit.client.1.smithi098.stdout:9/318: truncate d4/de/d27/d4a/d21/f36 612179 0 2024-09-20T19:05:51.729 INFO:tasks.workunit.client.1.smithi098.stdout:9/319: truncate d4/de/d24/d35/f42 521827 0 2024-09-20T19:05:51.730 INFO:tasks.workunit.client.0.smithi027.stdout:8/143: creat d2/d3/f31 x:0 0 0 2024-09-20T19:05:51.733 INFO:tasks.workunit.client.0.smithi027.stdout:6/84: chown d4/cd 23434836 1 2024-09-20T19:05:51.736 INFO:tasks.workunit.client.0.smithi027.stdout:2/125: mknod d3/d1c/c1d 0 2024-09-20T19:05:51.737 INFO:tasks.workunit.client.1.smithi098.stdout:7/289: symlink d3/l5a 0 2024-09-20T19:05:51.744 INFO:tasks.workunit.client.0.smithi027.stdout:7/154: rename d3/d8/da/f11 to d3/f36 0 2024-09-20T19:05:51.745 INFO:tasks.workunit.client.1.smithi098.stdout:5/251: link d1/c1d d1/d46/c49 0 2024-09-20T19:05:51.750 INFO:tasks.workunit.client.0.smithi027.stdout:1/143: sync 2024-09-20T19:05:51.750 INFO:tasks.workunit.client.0.smithi027.stdout:4/110: sync 2024-09-20T19:05:51.750 INFO:tasks.workunit.client.0.smithi027.stdout:0/184: sync 2024-09-20T19:05:51.750 INFO:tasks.workunit.client.0.smithi027.stdout:6/85: unlink d4/l16 0 2024-09-20T19:05:51.752 INFO:tasks.workunit.client.0.smithi027.stdout:2/126: mknod d3/c1e 0 2024-09-20T19:05:51.752 INFO:tasks.workunit.client.0.smithi027.stdout:9/274: write d0/d9/df/f21 [649047,33201] 0 2024-09-20T19:05:51.753 INFO:tasks.workunit.client.0.smithi027.stdout:3/194: getdents d0/d19 0 2024-09-20T19:05:51.754 INFO:tasks.workunit.client.1.smithi098.stdout:5/252: creat d1/d1b/f4a x:0 0 0 2024-09-20T19:05:51.756 INFO:tasks.workunit.client.1.smithi098.stdout:9/320: dread f0 [0,4194304] 0 2024-09-20T19:05:51.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/321: read d4/de/f3f [24516,130127] 0 2024-09-20T19:05:51.760 INFO:tasks.workunit.client.0.smithi027.stdout:7/155: creat d3/d24/f37 x:0 0 0 2024-09-20T19:05:51.761 INFO:tasks.workunit.client.0.smithi027.stdout:2/127: dwrite d3/f1b [0,4194304] 0 2024-09-20T19:05:51.763 INFO:tasks.workunit.client.0.smithi027.stdout:7/156: chown d3/d8/da/f28 1874265383 1 2024-09-20T19:05:51.763 INFO:tasks.workunit.client.0.smithi027.stdout:2/128: fdatasync d3/de/f1a 0 2024-09-20T19:05:51.763 INFO:tasks.workunit.client.0.smithi027.stdout:3/195: dwrite d0/d1/d13/f1c [0,4194304] 0 2024-09-20T19:05:51.767 INFO:tasks.workunit.client.0.smithi027.stdout:8/144: symlink d2/d3/d1b/d2d/l32 0 2024-09-20T19:05:51.768 INFO:tasks.workunit.client.1.smithi098.stdout:1/163: write d1/f10 [2429716,58569] 0 2024-09-20T19:05:51.769 INFO:tasks.workunit.client.0.smithi027.stdout:5/196: truncate d4/da/de/f37 1204981 0 2024-09-20T19:05:51.769 INFO:tasks.workunit.client.0.smithi027.stdout:8/145: chown d2/d3/c4 0 1 2024-09-20T19:05:51.770 INFO:tasks.workunit.client.1.smithi098.stdout:7/290: truncate d3/d10/d16/f34 2550620 0 2024-09-20T19:05:51.771 INFO:tasks.workunit.client.1.smithi098.stdout:2/541: getdents d3/df/d13 0 2024-09-20T19:05:51.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/542: readlink d3/l94 0 2024-09-20T19:05:51.774 INFO:tasks.workunit.client.0.smithi027.stdout:0/185: creat d2/d20/f47 x:0 0 0 2024-09-20T19:05:51.849 INFO:tasks.workunit.client.1.smithi098.stdout:9/322: rmdir d4/de/d27 39 2024-09-20T19:05:51.850 INFO:tasks.workunit.client.1.smithi098.stdout:5/253: truncate d1/f2 1150524 0 2024-09-20T19:05:51.854 INFO:tasks.workunit.client.1.smithi098.stdout:7/291: rename d3/d10/d16/d17/c42 to d3/d4c/c5b 0 2024-09-20T19:05:51.857 INFO:tasks.workunit.client.1.smithi098.stdout:9/323: dwrite d4/de/d24/d35/d2d/f49 [0,4194304] 0 2024-09-20T19:05:51.857 INFO:tasks.workunit.client.1.smithi098.stdout:2/543: unlink d3/d16/d1a/c41 0 2024-09-20T19:05:51.858 INFO:tasks.workunit.client.0.smithi027.stdout:7/157: symlink d3/d8/d1c/l38 0 2024-09-20T19:05:51.867 INFO:tasks.workunit.client.0.smithi027.stdout:4/111: unlink d5/c12 0 2024-09-20T19:05:51.867 INFO:tasks.workunit.client.0.smithi027.stdout:4/112: fdatasync d5/fe 0 2024-09-20T19:05:51.868 INFO:tasks.workunit.client.1.smithi098.stdout:1/164: dread d1/f14 [0,4194304] 0 2024-09-20T19:05:51.880 INFO:tasks.workunit.client.1.smithi098.stdout:7/292: creat d3/d10/d16/d17/d33/d1f/f5c x:0 0 0 2024-09-20T19:05:51.880 INFO:tasks.workunit.client.1.smithi098.stdout:7/293: readlink d3/l5a 0 2024-09-20T19:05:51.881 INFO:tasks.workunit.client.1.smithi098.stdout:7/294: read - d3/d10/d18/f4d zero size 2024-09-20T19:05:51.881 INFO:tasks.workunit.client.0.smithi027.stdout:7/158: mkdir d3/d8/da/d2e/d39 0 2024-09-20T19:05:51.882 INFO:tasks.workunit.client.0.smithi027.stdout:7/159: chown d3/d24/l27 74295767 1 2024-09-20T19:05:51.882 INFO:tasks.workunit.client.1.smithi098.stdout:7/295: write d3/f6 [7781697,83605] 0 2024-09-20T19:05:51.882 INFO:tasks.workunit.client.0.smithi027.stdout:6/86: truncate d4/f7 2247850 0 2024-09-20T19:05:51.883 INFO:tasks.workunit.client.0.smithi027.stdout:6/87: chown d4/d6 4467 1 2024-09-20T19:05:51.883 INFO:tasks.workunit.client.0.smithi027.stdout:3/196: mknod d0/d1/d13/d3c/c40 0 2024-09-20T19:05:51.884 INFO:tasks.workunit.client.0.smithi027.stdout:1/144: truncate d2/d1b/f1e 6958513 0 2024-09-20T19:05:51.885 INFO:tasks.workunit.client.0.smithi027.stdout:2/129: write d3/f9 [1384699,10269] 0 2024-09-20T19:05:51.886 INFO:tasks.workunit.client.0.smithi027.stdout:5/197: mknod d4/c39 0 2024-09-20T19:05:51.888 INFO:tasks.workunit.client.1.smithi098.stdout:9/324: rmdir d4/de/d6b 0 2024-09-20T19:05:51.889 INFO:tasks.workunit.client.0.smithi027.stdout:0/186: mkdir d2/d48 0 2024-09-20T19:05:51.891 INFO:tasks.workunit.client.0.smithi027.stdout:8/146: sync 2024-09-20T19:05:51.891 INFO:tasks.workunit.client.1.smithi098.stdout:7/296: chown d3/d10/d18/f27 0 1 2024-09-20T19:05:51.891 INFO:tasks.workunit.client.0.smithi027.stdout:0/187: write d2/f9 [6602803,123370] 0 2024-09-20T19:05:51.892 INFO:tasks.workunit.client.1.smithi098.stdout:7/297: fdatasync d3/d10/d18/f4d 0 2024-09-20T19:05:51.895 INFO:tasks.workunit.client.1.smithi098.stdout:1/165: rename d1/d3/f18 to d1/f2f 0 2024-09-20T19:05:51.897 INFO:tasks.workunit.client.0.smithi027.stdout:7/160: creat d3/d1a/f3a x:0 0 0 2024-09-20T19:05:51.898 INFO:tasks.workunit.client.1.smithi098.stdout:9/325: creat d4/de/d27/d4a/d21/d25/d66/f6f x:0 0 0 2024-09-20T19:05:51.899 INFO:tasks.workunit.client.1.smithi098.stdout:9/326: chown d4/c63 397623349 1 2024-09-20T19:05:51.908 INFO:tasks.workunit.client.0.smithi027.stdout:2/130: rename d3/f1b to d3/de/f1f 0 2024-09-20T19:05:51.909 INFO:tasks.workunit.client.1.smithi098.stdout:9/327: creat d4/de/d27/d39/f70 x:0 0 0 2024-09-20T19:05:51.910 INFO:tasks.workunit.client.0.smithi027.stdout:5/198: symlink d4/da/l3a 0 2024-09-20T19:05:51.911 INFO:tasks.workunit.client.0.smithi027.stdout:5/199: chown d4/da/c25 1421 1 2024-09-20T19:05:51.911 INFO:tasks.workunit.client.0.smithi027.stdout:5/200: dread - d4/f30 zero size 2024-09-20T19:05:51.912 INFO:tasks.workunit.client.0.smithi027.stdout:5/201: fdatasync f2 0 2024-09-20T19:05:51.912 INFO:tasks.workunit.client.0.smithi027.stdout:5/202: dread - d4/f30 zero size 2024-09-20T19:05:51.914 INFO:tasks.workunit.client.1.smithi098.stdout:9/328: rename d4/c63 to d4/de/d24/d35/c71 0 2024-09-20T19:05:51.915 INFO:tasks.workunit.client.1.smithi098.stdout:1/166: mknod d1/d3/d2e/c30 0 2024-09-20T19:05:51.916 INFO:tasks.workunit.client.1.smithi098.stdout:1/167: dread - d1/d3/f2d zero size 2024-09-20T19:05:51.916 INFO:tasks.workunit.client.0.smithi027.stdout:9/275: mkdir d0/d9/df/d1b/d1a/dd/d58/d59 0 2024-09-20T19:05:51.918 INFO:tasks.workunit.client.1.smithi098.stdout:4/245: sync 2024-09-20T19:05:51.918 INFO:tasks.workunit.client.1.smithi098.stdout:9/329: read d4/de/f3d [418100,9894] 0 2024-09-20T19:05:51.922 INFO:tasks.workunit.client.1.smithi098.stdout:1/168: dwrite d1/d3/f1e [0,4194304] 0 2024-09-20T19:05:51.930 INFO:tasks.workunit.client.0.smithi027.stdout:2/131: unlink d3/c1e 0 2024-09-20T19:05:51.933 INFO:tasks.workunit.client.0.smithi027.stdout:2/132: dread d3/ff [0,4194304] 0 2024-09-20T19:05:51.933 INFO:tasks.workunit.client.0.smithi027.stdout:8/147: rename d2/d15 to d2/d3/d6/d21/d33 0 2024-09-20T19:05:51.934 INFO:tasks.workunit.client.1.smithi098.stdout:7/298: truncate d3/d10/d16/f39 2520038 0 2024-09-20T19:05:51.934 INFO:tasks.workunit.client.1.smithi098.stdout:1/169: rmdir d1/d3 39 2024-09-20T19:05:51.935 INFO:tasks.workunit.client.0.smithi027.stdout:4/113: truncate d5/f1e 308190 0 2024-09-20T19:05:51.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/246: unlink d3/d6/d11/d1e/f40 0 2024-09-20T19:05:51.944 INFO:tasks.workunit.client.0.smithi027.stdout:7/161: creat d3/d8/da/d2e/d39/f3b x:0 0 0 2024-09-20T19:05:51.945 INFO:tasks.workunit.client.0.smithi027.stdout:7/162: chown d3/d8 4 1 2024-09-20T19:05:51.946 INFO:tasks.workunit.client.1.smithi098.stdout:4/247: dread d3/ff [4194304,4194304] 0 2024-09-20T19:05:51.948 INFO:tasks.workunit.client.1.smithi098.stdout:7/299: truncate d3/d10/d16/f34 1741855 0 2024-09-20T19:05:51.951 INFO:tasks.workunit.client.1.smithi098.stdout:1/170: symlink d1/l31 0 2024-09-20T19:05:51.952 INFO:tasks.workunit.client.0.smithi027.stdout:3/197: creat d0/f41 x:0 0 0 2024-09-20T19:05:51.954 INFO:tasks.workunit.client.1.smithi098.stdout:9/330: getdents d4/de 0 2024-09-20T19:05:51.954 INFO:tasks.workunit.client.1.smithi098.stdout:4/248: dwrite d3/d6/f32 [0,4194304] 0 2024-09-20T19:05:51.955 INFO:tasks.workunit.client.1.smithi098.stdout:9/331: chown d4/f10 1876600036 1 2024-09-20T19:05:51.956 INFO:tasks.workunit.client.1.smithi098.stdout:7/300: mknod d3/d10/d18/d21/c5d 0 2024-09-20T19:05:51.962 INFO:tasks.workunit.client.1.smithi098.stdout:4/249: readlink l0 0 2024-09-20T19:05:51.964 INFO:tasks.workunit.client.0.smithi027.stdout:2/133: rename d3/c12 to d3/c20 0 2024-09-20T19:05:51.966 INFO:tasks.workunit.client.0.smithi027.stdout:2/134: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:51.967 INFO:tasks.workunit.client.0.smithi027.stdout:4/114: mknod d5/d13/c24 0 2024-09-20T19:05:51.968 INFO:tasks.workunit.client.0.smithi027.stdout:4/115: chown d5/fe 663 1 2024-09-20T19:05:51.968 INFO:tasks.workunit.client.1.smithi098.stdout:1/171: rmdir d1/d3 39 2024-09-20T19:05:51.969 INFO:tasks.workunit.client.0.smithi027.stdout:4/116: stat d5/d13/c24 0 2024-09-20T19:05:51.969 INFO:tasks.workunit.client.0.smithi027.stdout:1/145: dread d2/d1b/f1e [4194304,4194304] 0 2024-09-20T19:05:51.970 INFO:tasks.workunit.client.1.smithi098.stdout:4/250: mkdir d3/d6/d5b 0 2024-09-20T19:05:51.970 INFO:tasks.workunit.client.0.smithi027.stdout:7/163: symlink d3/d8/da/dc/l3c 0 2024-09-20T19:05:51.971 INFO:tasks.workunit.client.0.smithi027.stdout:7/164: chown d3/f29 45 1 2024-09-20T19:05:51.974 INFO:tasks.workunit.client.0.smithi027.stdout:6/88: getdents d4 0 2024-09-20T19:05:51.976 INFO:tasks.workunit.client.0.smithi027.stdout:3/198: dread d0/d1/d13/f37 [0,4194304] 0 2024-09-20T19:05:51.977 INFO:tasks.workunit.client.0.smithi027.stdout:7/165: dwrite d3/d8/f20 [0,4194304] 0 2024-09-20T19:05:51.977 INFO:tasks.workunit.client.1.smithi098.stdout:4/251: unlink d3/d6/c4b 0 2024-09-20T19:05:51.981 INFO:tasks.workunit.client.1.smithi098.stdout:1/172: mkdir d1/d32 0 2024-09-20T19:05:51.983 INFO:tasks.workunit.client.0.smithi027.stdout:2/135: mknod d3/d13/c21 0 2024-09-20T19:05:51.983 INFO:tasks.workunit.client.1.smithi098.stdout:9/332: dwrite d4/de/f34 [0,4194304] 0 2024-09-20T19:05:51.988 INFO:tasks.workunit.client.1.smithi098.stdout:4/252: dwrite d3/f36 [0,4194304] 0 2024-09-20T19:05:51.991 INFO:tasks.workunit.client.1.smithi098.stdout:1/173: stat d1/l1c 0 2024-09-20T19:05:51.991 INFO:tasks.workunit.client.0.smithi027.stdout:1/146: unlink d2/f24 0 2024-09-20T19:05:51.992 INFO:tasks.workunit.client.1.smithi098.stdout:9/333: symlink d4/de/d27/l72 0 2024-09-20T19:05:51.993 INFO:tasks.workunit.client.1.smithi098.stdout:4/253: fdatasync d3/d6/d11/d59/d50/f53 0 2024-09-20T19:05:51.995 INFO:tasks.workunit.client.0.smithi027.stdout:0/188: rename d2/d14/d1b/d3c to d2/d49 0 2024-09-20T19:05:51.998 INFO:tasks.workunit.client.1.smithi098.stdout:4/254: fsync d3/d6/d3e/f56 0 2024-09-20T19:05:51.998 INFO:tasks.workunit.client.1.smithi098.stdout:7/301: dwrite d3/d10/d16/f39 [0,4194304] 0 2024-09-20T19:05:51.999 INFO:tasks.workunit.client.1.smithi098.stdout:9/334: rmdir d4/de/d27/d4a/d21/d25 39 2024-09-20T19:05:52.003 INFO:tasks.workunit.client.1.smithi098.stdout:1/174: mknod d1/d3/d2e/c33 0 2024-09-20T19:05:52.004 INFO:tasks.workunit.client.0.smithi027.stdout:2/136: mknod d3/de/c22 0 2024-09-20T19:05:52.005 INFO:tasks.workunit.client.0.smithi027.stdout:2/137: read d3/fa [3305219,45416] 0 2024-09-20T19:05:52.005 INFO:tasks.workunit.client.0.smithi027.stdout:2/138: chown d3/d1c 213454855 1 2024-09-20T19:05:52.007 INFO:tasks.workunit.client.0.smithi027.stdout:5/203: getdents d4/d1f 0 2024-09-20T19:05:52.007 INFO:tasks.workunit.client.1.smithi098.stdout:4/255: mknod d3/c5c 0 2024-09-20T19:05:52.009 INFO:tasks.workunit.client.0.smithi027.stdout:9/276: getdents d0/d9/df 0 2024-09-20T19:05:52.010 INFO:tasks.workunit.client.1.smithi098.stdout:1/175: dwrite d1/d3/f1b [0,4194304] 0 2024-09-20T19:05:52.012 INFO:tasks.workunit.client.0.smithi027.stdout:4/117: symlink d5/l25 0 2024-09-20T19:05:52.015 INFO:tasks.workunit.client.1.smithi098.stdout:7/302: rename d3/d10/c45 to d3/d10/d18/d21/c5e 0 2024-09-20T19:05:52.017 INFO:tasks.workunit.client.1.smithi098.stdout:7/303: write d3/d10/d16/f39 [3212560,65449] 0 2024-09-20T19:05:52.017 INFO:tasks.workunit.client.0.smithi027.stdout:1/147: rmdir d2/d1b 39 2024-09-20T19:05:52.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/335: mkdir d4/de/d27/d6c/d73 0 2024-09-20T19:05:52.020 INFO:tasks.workunit.client.0.smithi027.stdout:6/89: getdents d4/d15 0 2024-09-20T19:05:52.022 INFO:tasks.workunit.client.1.smithi098.stdout:4/256: creat d3/d6/d11/d1e/f5d x:0 0 0 2024-09-20T19:05:52.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/176: mkdir d1/d3/df/d34 0 2024-09-20T19:05:52.025 INFO:tasks.workunit.client.0.smithi027.stdout:0/189: readlink d2/d7/d29/l38 0 2024-09-20T19:05:52.025 INFO:tasks.workunit.client.0.smithi027.stdout:0/190: chown d2/d7/c22 2638487 1 2024-09-20T19:05:52.027 INFO:tasks.workunit.client.1.smithi098.stdout:7/304: dread d3/d10/f13 [0,4194304] 0 2024-09-20T19:05:52.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/305: chown d3/d10/d16/d17/d33 139 1 2024-09-20T19:05:52.028 INFO:tasks.workunit.client.0.smithi027.stdout:7/166: creat d3/d8/d26/f3d x:0 0 0 2024-09-20T19:05:52.029 INFO:tasks.workunit.client.0.smithi027.stdout:8/148: getdents d2/d3/d6/d21 0 2024-09-20T19:05:52.030 INFO:tasks.workunit.client.0.smithi027.stdout:7/167: dread d3/d24/f2c [0,4194304] 0 2024-09-20T19:05:52.030 INFO:tasks.workunit.client.0.smithi027.stdout:8/149: truncate d2/f8 4414954 0 2024-09-20T19:05:52.031 INFO:tasks.workunit.client.1.smithi098.stdout:9/336: write f0 [1868529,123766] 0 2024-09-20T19:05:52.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/337: stat d4/de/d24/d35/d2d/l6e 0 2024-09-20T19:05:52.035 INFO:tasks.workunit.client.0.smithi027.stdout:2/139: write d3/de/f1f [5004865,91771] 0 2024-09-20T19:05:52.035 INFO:tasks.workunit.client.0.smithi027.stdout:5/204: mknod d4/da/d1a/c3b 0 2024-09-20T19:05:52.036 INFO:tasks.workunit.client.0.smithi027.stdout:5/205: chown d4/da/f29 8 1 2024-09-20T19:05:52.036 INFO:tasks.workunit.client.0.smithi027.stdout:8/150: dwrite d2/d3/f31 [0,4194304] 0 2024-09-20T19:05:52.037 INFO:tasks.workunit.client.0.smithi027.stdout:9/277: unlink d0/d9/df/d1b/d1a/dd/f10 0 2024-09-20T19:05:52.038 INFO:tasks.workunit.client.0.smithi027.stdout:8/151: write d2/d2a/f2f [356534,90169] 0 2024-09-20T19:05:52.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/306: mkdir d3/d4c/d5f 0 2024-09-20T19:05:52.041 INFO:tasks.workunit.client.0.smithi027.stdout:1/148: creat d2/d14/f30 x:0 0 0 2024-09-20T19:05:52.042 INFO:tasks.workunit.client.0.smithi027.stdout:6/90: symlink d4/l17 0 2024-09-20T19:05:52.045 INFO:tasks.workunit.client.1.smithi098.stdout:4/257: dread d3/d6/d11/f2b [0,4194304] 0 2024-09-20T19:05:52.048 INFO:tasks.workunit.client.0.smithi027.stdout:0/191: mknod d2/d7/c4a 0 2024-09-20T19:05:52.048 INFO:tasks.workunit.client.1.smithi098.stdout:7/307: mknod d3/d10/d16/d17/d33/c60 0 2024-09-20T19:05:52.048 INFO:tasks.workunit.client.0.smithi027.stdout:6/91: dwrite d4/f14 [0,4194304] 0 2024-09-20T19:05:52.051 INFO:tasks.workunit.client.1.smithi098.stdout:4/258: mkdir d3/d5e 0 2024-09-20T19:05:52.054 INFO:tasks.workunit.client.0.smithi027.stdout:7/168: creat d3/d8/da/dc/f3e x:0 0 0 2024-09-20T19:05:52.054 INFO:tasks.workunit.client.0.smithi027.stdout:7/169: read - d3/f29 zero size 2024-09-20T19:05:52.055 INFO:tasks.workunit.client.0.smithi027.stdout:0/192: dwrite d2/d14/d1b/f43 [0,4194304] 0 2024-09-20T19:05:52.056 INFO:tasks.workunit.client.1.smithi098.stdout:1/177: truncate d1/d3/df/f29 1823056 0 2024-09-20T19:05:52.061 INFO:tasks.workunit.client.1.smithi098.stdout:7/308: link d3/d10/f13 d3/d10/d16/d17/d33/d1f/d28/f61 0 2024-09-20T19:05:52.064 INFO:tasks.workunit.client.1.smithi098.stdout:4/259: rename d3/d6/d11/d59/c42 to d3/d6/d11/d1e/d2a/d45/c5f 0 2024-09-20T19:05:52.064 INFO:tasks.workunit.client.1.smithi098.stdout:7/309: stat d3/d10/d16/d17/d33/d1f/d28/f61 0 2024-09-20T19:05:52.065 INFO:tasks.workunit.client.1.smithi098.stdout:1/178: dwrite d1/d3/df/f21 [0,4194304] 0 2024-09-20T19:05:52.066 INFO:tasks.workunit.client.1.smithi098.stdout:1/179: chown d1/d3/f2c 4637 1 2024-09-20T19:05:52.067 INFO:tasks.workunit.client.1.smithi098.stdout:7/310: dread - d3/d10/d16/d17/d33/d1f/d2d/f53 zero size 2024-09-20T19:05:52.068 INFO:tasks.workunit.client.1.smithi098.stdout:7/311: fdatasync d3/d10/d16/d17/d33/d1f/f44 0 2024-09-20T19:05:52.073 INFO:tasks.workunit.client.0.smithi027.stdout:4/118: mkdir d5/d13/d16/d21/d26 0 2024-09-20T19:05:52.074 INFO:tasks.workunit.client.1.smithi098.stdout:4/260: unlink d3/d2e/f52 0 2024-09-20T19:05:52.075 INFO:tasks.workunit.client.0.smithi027.stdout:4/119: write d5/fe [1970741,121638] 0 2024-09-20T19:05:52.075 INFO:tasks.workunit.client.0.smithi027.stdout:8/152: symlink d2/d2a/l34 0 2024-09-20T19:05:52.076 INFO:tasks.workunit.client.1.smithi098.stdout:7/312: rmdir d3/d10/d16/d17/d33/d4b 39 2024-09-20T19:05:52.076 INFO:tasks.workunit.client.0.smithi027.stdout:1/149: symlink d2/d15/l31 0 2024-09-20T19:05:52.077 INFO:tasks.workunit.client.1.smithi098.stdout:7/313: fdatasync d3/d10/d16/d17/d33/d1f/d2d/f53 0 2024-09-20T19:05:52.078 INFO:tasks.workunit.client.0.smithi027.stdout:3/199: link d0/d1/f30 d0/d1/d13/d3c/f42 0 2024-09-20T19:05:52.078 INFO:tasks.workunit.client.0.smithi027.stdout:1/150: write d2/d15/f29 [952346,115780] 0 2024-09-20T19:05:52.081 INFO:tasks.workunit.client.1.smithi098.stdout:1/180: creat d1/d32/f35 x:0 0 0 2024-09-20T19:05:52.082 INFO:tasks.workunit.client.0.smithi027.stdout:3/200: chown d0/d1/d13/d15/l39 766 1 2024-09-20T19:05:52.082 INFO:tasks.workunit.client.1.smithi098.stdout:1/181: stat d1/d3/df/f23 0 2024-09-20T19:05:52.084 INFO:tasks.workunit.client.0.smithi027.stdout:6/92: rmdir d4 39 2024-09-20T19:05:52.084 INFO:tasks.workunit.client.0.smithi027.stdout:4/120: dwrite d5/d11/d17/f20 [0,4194304] 0 2024-09-20T19:05:52.087 INFO:tasks.workunit.client.0.smithi027.stdout:5/206: mkdir d4/d3c 0 2024-09-20T19:05:52.087 INFO:tasks.workunit.client.0.smithi027.stdout:5/207: stat d4/c8 0 2024-09-20T19:05:52.092 INFO:tasks.workunit.client.1.smithi098.stdout:7/314: rmdir d3/d4c/d5f 0 2024-09-20T19:05:52.093 INFO:tasks.workunit.client.0.smithi027.stdout:8/153: dread d2/d3/f25 [0,4194304] 0 2024-09-20T19:05:52.094 INFO:tasks.workunit.client.0.smithi027.stdout:0/193: rename d2/d7/f26 to d2/d14/d1d/f4b 0 2024-09-20T19:05:52.095 INFO:tasks.workunit.client.0.smithi027.stdout:5/208: mkdir d4/da/de/d1e/d3d 0 2024-09-20T19:05:52.096 INFO:tasks.workunit.client.0.smithi027.stdout:1/151: symlink d2/d8/d2b/d2d/l32 0 2024-09-20T19:05:52.107 INFO:tasks.workunit.client.1.smithi098.stdout:4/261: dwrite d3/ff [4194304,4194304] 0 2024-09-20T19:05:52.110 INFO:tasks.workunit.client.1.smithi098.stdout:1/182: dread d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:05:52.113 INFO:tasks.workunit.client.1.smithi098.stdout:7/315: symlink d3/d10/d16/d17/d33/d4b/l62 0 2024-09-20T19:05:52.114 INFO:tasks.workunit.client.1.smithi098.stdout:7/316: chown d3/d10/d18/c59 22 1 2024-09-20T19:05:52.114 INFO:tasks.workunit.client.1.smithi098.stdout:1/183: rmdir d1/d3/d2e 39 2024-09-20T19:05:52.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/262: unlink d3/d6/f4e 0 2024-09-20T19:05:52.117 INFO:tasks.workunit.client.1.smithi098.stdout:4/263: write d3/d6/f13 [3126939,1994] 0 2024-09-20T19:05:52.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/317: creat d3/d10/d18/f63 x:0 0 0 2024-09-20T19:05:52.121 INFO:tasks.workunit.client.1.smithi098.stdout:1/184: write d1/f10 [2300178,109999] 0 2024-09-20T19:05:52.122 INFO:tasks.workunit.client.1.smithi098.stdout:1/185: dread - d1/d3/f2b zero size 2024-09-20T19:05:52.124 INFO:tasks.workunit.client.1.smithi098.stdout:1/186: write d1/d3/f1b [1975138,11716] 0 2024-09-20T19:05:52.126 INFO:tasks.workunit.client.1.smithi098.stdout:1/187: rename d1/d3/df/d34 to d1/d3/df/d34/d36 22 2024-09-20T19:05:52.126 INFO:tasks.workunit.client.1.smithi098.stdout:7/318: dread d3/d10/d18/d21/f54 [0,4194304] 0 2024-09-20T19:05:52.127 INFO:tasks.workunit.client.1.smithi098.stdout:1/188: chown d1/d3/f15 1268069 1 2024-09-20T19:05:52.127 INFO:tasks.workunit.client.1.smithi098.stdout:7/319: read - d3/d10/d18/f63 zero size 2024-09-20T19:05:52.129 INFO:tasks.workunit.client.1.smithi098.stdout:7/320: readlink d3/d10/d16/d17/d33/d37/l3a 0 2024-09-20T19:05:52.133 INFO:tasks.workunit.client.1.smithi098.stdout:1/189: creat d1/f37 x:0 0 0 2024-09-20T19:05:52.134 INFO:tasks.workunit.client.1.smithi098.stdout:7/321: creat d3/f64 x:0 0 0 2024-09-20T19:05:52.137 INFO:tasks.workunit.client.1.smithi098.stdout:7/322: write d3/d10/f19 [2117614,62252] 0 2024-09-20T19:05:52.138 INFO:tasks.workunit.client.1.smithi098.stdout:1/190: mknod d1/d3/d2e/c38 0 2024-09-20T19:05:52.139 INFO:tasks.workunit.client.1.smithi098.stdout:4/264: dwrite d3/d6/d3e/f56 [0,4194304] 0 2024-09-20T19:05:52.140 INFO:tasks.workunit.client.1.smithi098.stdout:7/323: fsync d3/d10/d18/d21/f54 0 2024-09-20T19:05:52.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/265: chown d3/d6/d3e 21195 1 2024-09-20T19:05:52.143 INFO:tasks.workunit.client.0.smithi027.stdout:8/154: mkdir d2/d3/d1b/d35 0 2024-09-20T19:05:52.143 INFO:tasks.workunit.client.0.smithi027.stdout:5/209: write d4/da/f2c [1333640,71824] 0 2024-09-20T19:05:52.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/191: unlink d1/d3/df/f1a 0 2024-09-20T19:05:52.144 INFO:tasks.workunit.client.0.smithi027.stdout:3/201: rename d0/d1/d7/d1d/l23 to d0/d19/l43 0 2024-09-20T19:05:52.146 INFO:tasks.workunit.client.0.smithi027.stdout:3/202: readlink d0/d1/d7/l28 0 2024-09-20T19:05:52.148 INFO:tasks.workunit.client.1.smithi098.stdout:4/266: unlink d3/d6/d11/f43 0 2024-09-20T19:05:52.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/267: write d3/f36 [2088959,54748] 0 2024-09-20T19:05:52.151 INFO:tasks.workunit.client.0.smithi027.stdout:9/278: dwrite d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:05:52.151 INFO:tasks.workunit.client.1.smithi098.stdout:7/324: fdatasync d3/d10/d16/d17/d33/f52 0 2024-09-20T19:05:52.152 INFO:tasks.workunit.client.0.smithi027.stdout:6/93: truncate d4/f7 2461765 0 2024-09-20T19:05:52.152 INFO:tasks.workunit.client.0.smithi027.stdout:9/279: readlink d0/d9/df/d1b/d1a/l1f 0 2024-09-20T19:05:52.152 INFO:tasks.workunit.client.1.smithi098.stdout:7/325: dread - d3/f64 zero size 2024-09-20T19:05:52.154 INFO:tasks.workunit.client.0.smithi027.stdout:8/155: mkdir d2/d3/d1b/d36 0 2024-09-20T19:05:52.155 INFO:tasks.workunit.client.0.smithi027.stdout:5/210: mkdir d4/da/de/d3e 0 2024-09-20T19:05:52.157 INFO:tasks.workunit.client.0.smithi027.stdout:0/194: link d2/d49/f45 d2/d14/f4c 0 2024-09-20T19:05:52.160 INFO:tasks.workunit.client.0.smithi027.stdout:3/203: fsync d0/d1/d13/d3c/f42 0 2024-09-20T19:05:52.161 INFO:tasks.workunit.client.0.smithi027.stdout:1/152: fdatasync d2/d1b/f1e 0 2024-09-20T19:05:52.162 INFO:tasks.workunit.client.1.smithi098.stdout:1/192: symlink d1/d3/l39 0 2024-09-20T19:05:52.166 INFO:tasks.workunit.client.0.smithi027.stdout:8/156: creat d2/d3/f37 x:0 0 0 2024-09-20T19:05:52.168 INFO:tasks.workunit.client.1.smithi098.stdout:7/326: symlink d3/d10/d16/d17/d33/l65 0 2024-09-20T19:05:52.171 INFO:tasks.workunit.client.1.smithi098.stdout:4/268: link d3/d6/d3e/d3c/c51 d3/d5e/c60 0 2024-09-20T19:05:52.172 INFO:tasks.workunit.client.0.smithi027.stdout:0/195: dwrite d2/d20/f44 [0,4194304] 0 2024-09-20T19:05:52.175 INFO:tasks.workunit.client.0.smithi027.stdout:9/280: mkdir d0/d9/d3d/d5a 0 2024-09-20T19:05:52.176 INFO:tasks.workunit.client.1.smithi098.stdout:7/327: mkdir d3/d10/d16/d17/d33/d1f/d28/d66 0 2024-09-20T19:05:52.179 INFO:tasks.workunit.client.0.smithi027.stdout:3/204: dwrite d0/f41 [0,4194304] 0 2024-09-20T19:05:52.179 INFO:tasks.workunit.client.0.smithi027.stdout:2/140: sync 2024-09-20T19:05:52.182 INFO:tasks.workunit.client.0.smithi027.stdout:1/153: dwrite d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:52.183 INFO:tasks.workunit.client.1.smithi098.stdout:4/269: symlink d3/d6/d5b/l61 0 2024-09-20T19:05:52.185 INFO:tasks.workunit.client.0.smithi027.stdout:1/154: stat d2/d8/d2b/d2d/l32 0 2024-09-20T19:05:52.188 INFO:tasks.workunit.client.0.smithi027.stdout:8/157: dwrite d2/d14/d13/f1c [0,4194304] 0 2024-09-20T19:05:52.188 INFO:tasks.workunit.client.0.smithi027.stdout:5/211: unlink d4/d1f/d28/f2e 0 2024-09-20T19:05:52.190 INFO:tasks.workunit.client.0.smithi027.stdout:5/212: stat d4/d3c 0 2024-09-20T19:05:52.190 INFO:tasks.workunit.client.0.smithi027.stdout:1/155: write d2/d15/f29 [362078,34579] 0 2024-09-20T19:05:52.192 INFO:tasks.workunit.client.0.smithi027.stdout:3/205: dread d0/d1/f2e [4194304,4194304] 0 2024-09-20T19:05:52.194 INFO:tasks.workunit.client.0.smithi027.stdout:0/196: write d2/d7/d29/f3b [546222,43746] 0 2024-09-20T19:05:52.194 INFO:tasks.workunit.client.0.smithi027.stdout:5/213: read d4/f11 [2881251,47468] 0 2024-09-20T19:05:52.196 INFO:tasks.workunit.client.0.smithi027.stdout:0/197: stat d2/d7/c4a 0 2024-09-20T19:05:52.198 INFO:tasks.workunit.client.0.smithi027.stdout:6/94: truncate d4/f14 1927633 0 2024-09-20T19:05:52.200 INFO:tasks.workunit.client.1.smithi098.stdout:1/193: dwrite d1/d3/fe [0,4194304] 0 2024-09-20T19:05:52.201 INFO:tasks.workunit.client.1.smithi098.stdout:1/194: write d1/d3/fe [25493,59903] 0 2024-09-20T19:05:52.203 INFO:tasks.workunit.client.1.smithi098.stdout:4/270: dread d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:52.204 INFO:tasks.workunit.client.0.smithi027.stdout:1/156: fdatasync d2/d15/f22 0 2024-09-20T19:05:52.205 INFO:tasks.workunit.client.0.smithi027.stdout:0/198: dwrite d2/f9 [8388608,4194304] 0 2024-09-20T19:05:52.206 INFO:tasks.workunit.client.1.smithi098.stdout:1/195: creat d1/d3/d2e/f3a x:0 0 0 2024-09-20T19:05:52.208 INFO:tasks.workunit.client.0.smithi027.stdout:2/141: dread d3/fa [0,4194304] 0 2024-09-20T19:05:52.209 INFO:tasks.workunit.client.1.smithi098.stdout:1/196: readlink d1/l27 0 2024-09-20T19:05:52.211 INFO:tasks.workunit.client.0.smithi027.stdout:2/142: chown d3/de/l16 3491591 1 2024-09-20T19:05:52.211 INFO:tasks.workunit.client.1.smithi098.stdout:4/271: creat d3/d6/d11/f62 x:0 0 0 2024-09-20T19:05:52.212 INFO:tasks.workunit.client.1.smithi098.stdout:4/272: fdatasync d3/d6/f18 0 2024-09-20T19:05:52.213 INFO:tasks.workunit.client.1.smithi098.stdout:1/197: rmdir d1/d3/df 39 2024-09-20T19:05:52.215 INFO:tasks.workunit.client.0.smithi027.stdout:6/95: stat d4/f7 0 2024-09-20T19:05:52.216 INFO:tasks.workunit.client.1.smithi098.stdout:4/273: creat d3/d6/d11/d59/d50/f63 x:0 0 0 2024-09-20T19:05:52.217 INFO:tasks.workunit.client.1.smithi098.stdout:4/274: write d3/f16 [623411,25757] 0 2024-09-20T19:05:52.220 INFO:tasks.workunit.client.0.smithi027.stdout:0/199: write d2/d7/f35 [837859,114535] 0 2024-09-20T19:05:52.221 INFO:tasks.workunit.client.0.smithi027.stdout:2/143: dread d3/fa [0,4194304] 0 2024-09-20T19:05:52.221 INFO:tasks.workunit.client.1.smithi098.stdout:4/275: mkdir d3/d6/d11/d64 0 2024-09-20T19:05:52.223 INFO:tasks.workunit.client.0.smithi027.stdout:9/281: creat d0/d9/df/d1b/d1a/dd/f5b x:0 0 0 2024-09-20T19:05:52.223 INFO:tasks.workunit.client.0.smithi027.stdout:1/157: dread d2/d14/d21/f2c [0,4194304] 0 2024-09-20T19:05:52.223 INFO:tasks.workunit.client.1.smithi098.stdout:4/276: unlink d3/d6/d11/f2b 0 2024-09-20T19:05:52.224 INFO:tasks.workunit.client.0.smithi027.stdout:5/214: creat d4/d1f/d28/f3f x:0 0 0 2024-09-20T19:05:52.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/277: chown d3/d6/f18 164963 1 2024-09-20T19:05:52.225 INFO:tasks.workunit.client.1.smithi098.stdout:4/278: read d3/f7 [1137750,75099] 0 2024-09-20T19:05:52.228 INFO:tasks.workunit.client.0.smithi027.stdout:0/200: truncate d2/fc 1113226 0 2024-09-20T19:05:52.228 INFO:tasks.workunit.client.0.smithi027.stdout:2/144: rmdir d3/de 39 2024-09-20T19:05:52.228 INFO:tasks.workunit.client.0.smithi027.stdout:6/96: dread d4/f7 [0,4194304] 0 2024-09-20T19:05:52.228 INFO:tasks.workunit.client.1.smithi098.stdout:4/279: creat d3/d6/d5b/f65 x:0 0 0 2024-09-20T19:05:52.230 INFO:tasks.workunit.client.0.smithi027.stdout:5/215: creat d4/da/de/f40 x:0 0 0 2024-09-20T19:05:52.231 INFO:tasks.workunit.client.0.smithi027.stdout:2/145: dread - d3/de/f1a zero size 2024-09-20T19:05:52.232 INFO:tasks.workunit.client.1.smithi098.stdout:4/280: symlink d3/d2e/l66 0 2024-09-20T19:05:52.233 INFO:tasks.workunit.client.1.smithi098.stdout:4/281: fdatasync d3/ff 0 2024-09-20T19:05:52.234 INFO:tasks.workunit.client.0.smithi027.stdout:3/206: dread d0/d1/d7/f2c [0,4194304] 0 2024-09-20T19:05:52.238 INFO:tasks.workunit.client.1.smithi098.stdout:4/282: rename d3/ff to d3/d2e/f67 0 2024-09-20T19:05:52.239 INFO:tasks.workunit.client.1.smithi098.stdout:4/283: fsync d3/d6/d3e/f56 0 2024-09-20T19:05:52.240 INFO:tasks.workunit.client.0.smithi027.stdout:0/201: creat d2/d14/d1d/d2e/f4d x:0 0 0 2024-09-20T19:05:52.241 INFO:tasks.workunit.client.0.smithi027.stdout:5/216: mknod d4/da/c41 0 2024-09-20T19:05:52.244 INFO:tasks.workunit.client.0.smithi027.stdout:2/146: rename d3/fa to d3/d1c/f23 0 2024-09-20T19:05:52.246 INFO:tasks.workunit.client.1.smithi098.stdout:4/284: dwrite d3/d6/d11/d59/d50/f53 [0,4194304] 0 2024-09-20T19:05:52.249 INFO:tasks.workunit.client.0.smithi027.stdout:6/97: getdents d4/d15 0 2024-09-20T19:05:52.249 INFO:tasks.workunit.client.0.smithi027.stdout:9/282: dread d0/d9/df/d1b/f23 [4194304,4194304] 0 2024-09-20T19:05:52.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/285: stat d3/d6/d11/c28 0 2024-09-20T19:05:52.250 INFO:tasks.workunit.client.0.smithi027.stdout:6/98: readlink d4/lc 0 2024-09-20T19:05:52.250 INFO:tasks.workunit.client.0.smithi027.stdout:2/147: dread d3/d13/f19 [0,4194304] 0 2024-09-20T19:05:52.251 INFO:tasks.workunit.client.1.smithi098.stdout:1/198: truncate d1/d3/fe 3664198 0 2024-09-20T19:05:52.251 INFO:tasks.workunit.client.1.smithi098.stdout:1/199: read d1/d3/f1e [3514305,74124] 0 2024-09-20T19:05:52.252 INFO:tasks.workunit.client.0.smithi027.stdout:9/283: chown d0/d9/d3d/d5a 422911 1 2024-09-20T19:05:52.252 INFO:tasks.workunit.client.0.smithi027.stdout:0/202: rmdir d2 39 2024-09-20T19:05:52.253 INFO:tasks.workunit.client.0.smithi027.stdout:2/148: write d3/de/f1f [3353507,82377] 0 2024-09-20T19:05:52.270 INFO:tasks.workunit.client.0.smithi027.stdout:5/217: mknod d4/d1f/c42 0 2024-09-20T19:05:52.271 INFO:tasks.workunit.client.0.smithi027.stdout:5/218: truncate d4/d1f/f24 26335 0 2024-09-20T19:05:52.272 INFO:tasks.workunit.client.1.smithi098.stdout:4/286: creat d3/d2e/f68 x:0 0 0 2024-09-20T19:05:52.276 INFO:tasks.workunit.client.1.smithi098.stdout:1/200: creat d1/d3/d2e/f3b x:0 0 0 2024-09-20T19:05:52.277 INFO:tasks.workunit.client.1.smithi098.stdout:1/201: write d1/f10 [3608606,97568] 0 2024-09-20T19:05:52.279 INFO:tasks.workunit.client.0.smithi027.stdout:6/99: unlink d4/l17 0 2024-09-20T19:05:52.280 INFO:tasks.workunit.client.0.smithi027.stdout:6/100: chown d4/c13 11568 1 2024-09-20T19:05:52.283 INFO:tasks.workunit.client.1.smithi098.stdout:4/287: mkdir d3/d4f/d69 0 2024-09-20T19:05:52.285 INFO:tasks.workunit.client.0.smithi027.stdout:6/101: dread d4/d6/fa [0,4194304] 0 2024-09-20T19:05:52.287 INFO:tasks.workunit.client.0.smithi027.stdout:1/158: truncate d2/d8/f20 2395124 0 2024-09-20T19:05:52.289 INFO:tasks.workunit.client.0.smithi027.stdout:7/170: sync 2024-09-20T19:05:52.290 INFO:tasks.workunit.client.0.smithi027.stdout:3/207: rmdir d0/d1/d36 0 2024-09-20T19:05:52.291 INFO:tasks.workunit.client.0.smithi027.stdout:3/208: fsync d0/d1/f3f 0 2024-09-20T19:05:52.295 INFO:tasks.workunit.client.1.smithi098.stdout:1/202: getdents d1/d3 0 2024-09-20T19:05:52.295 INFO:tasks.workunit.client.1.smithi098.stdout:1/203: chown d1/d3/df/l28 1137 1 2024-09-20T19:05:52.296 INFO:tasks.workunit.client.0.smithi027.stdout:0/203: creat d2/d7/f4e x:0 0 0 2024-09-20T19:05:52.296 INFO:tasks.workunit.client.0.smithi027.stdout:3/209: dread d0/f41 [0,4194304] 0 2024-09-20T19:05:52.297 INFO:tasks.workunit.client.0.smithi027.stdout:0/204: fsync d2/d20/f44 0 2024-09-20T19:05:52.298 INFO:tasks.workunit.client.1.smithi098.stdout:4/288: dread d3/fe [0,4194304] 0 2024-09-20T19:05:52.298 INFO:tasks.workunit.client.0.smithi027.stdout:0/205: dread - d2/d14/f4c zero size 2024-09-20T19:05:52.298 INFO:tasks.workunit.client.0.smithi027.stdout:3/210: write d0/d19/f1a [2673390,57397] 0 2024-09-20T19:05:52.299 INFO:tasks.workunit.client.0.smithi027.stdout:3/211: dread - d0/d1/f3f zero size 2024-09-20T19:05:52.306 INFO:tasks.workunit.client.0.smithi027.stdout:5/219: creat d4/f43 x:0 0 0 2024-09-20T19:05:52.310 INFO:tasks.workunit.client.0.smithi027.stdout:8/158: sync 2024-09-20T19:05:52.310 INFO:tasks.workunit.client.0.smithi027.stdout:4/121: sync 2024-09-20T19:05:52.310 INFO:tasks.workunit.client.0.smithi027.stdout:7/171: link f0 d3/d8/da/d2e/f3f 0 2024-09-20T19:05:52.313 INFO:tasks.workunit.client.0.smithi027.stdout:7/172: fsync d3/f9 0 2024-09-20T19:05:52.314 INFO:tasks.workunit.client.0.smithi027.stdout:1/159: link d2/l2a d2/d8/d2b/d2d/l33 0 2024-09-20T19:05:52.315 INFO:tasks.workunit.client.0.smithi027.stdout:8/159: creat d2/d3/d6/d21/f38 x:0 0 0 2024-09-20T19:05:52.316 INFO:tasks.workunit.client.0.smithi027.stdout:7/173: write d3/f9 [4140107,22200] 0 2024-09-20T19:05:52.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:52 smithi027 ceph-mon[28196]: Deploying cephadm binary to smithi027 2024-09-20T19:05:52.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:52 smithi027 ceph-mon[28196]: Deploying cephadm binary to smithi098 2024-09-20T19:05:52.322 INFO:tasks.workunit.client.0.smithi027.stdout:1/160: write d2/d15/f29 [1352247,110343] 0 2024-09-20T19:05:52.322 INFO:tasks.workunit.client.0.smithi027.stdout:5/220: getdents d4/da 0 2024-09-20T19:05:52.323 INFO:tasks.workunit.client.0.smithi027.stdout:3/212: link d0/f2 d0/d1/d13/f44 0 2024-09-20T19:05:52.324 INFO:tasks.workunit.client.0.smithi027.stdout:4/122: dwrite d5/fa [0,4194304] 0 2024-09-20T19:05:52.328 INFO:tasks.workunit.client.0.smithi027.stdout:8/160: creat d2/f39 x:0 0 0 2024-09-20T19:05:52.332 INFO:tasks.workunit.client.0.smithi027.stdout:1/161: fsync d2/d1b/f2e 0 2024-09-20T19:05:52.333 INFO:tasks.workunit.client.0.smithi027.stdout:5/221: mkdir d4/da/de/d3e/d44 0 2024-09-20T19:05:52.335 INFO:tasks.workunit.client.0.smithi027.stdout:8/161: symlink d2/d3/d6/l3a 0 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:6/179: sync 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:2/544: sync 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:0/206: sync 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:8/357: sync 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:5/254: sync 2024-09-20T19:05:52.337 INFO:tasks.workunit.client.1.smithi098.stdout:3/247: sync 2024-09-20T19:05:52.338 INFO:tasks.workunit.client.0.smithi027.stdout:7/174: dwrite d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:52.338 INFO:tasks.workunit.client.0.smithi027.stdout:5/222: unlink d4/f1c 0 2024-09-20T19:05:52.338 INFO:tasks.workunit.client.0.smithi027.stdout:7/175: dread - d3/f29 zero size 2024-09-20T19:05:52.338 INFO:tasks.workunit.client.0.smithi027.stdout:1/162: readlink d2/d15/l31 0 2024-09-20T19:05:52.339 INFO:tasks.workunit.client.0.smithi027.stdout:1/163: chown d2/d8 30 1 2024-09-20T19:05:52.340 INFO:tasks.workunit.client.1.smithi098.stdout:2/545: chown d3/d16/d1d/d4f/d8b/d38/c90 27550164 1 2024-09-20T19:05:52.341 INFO:tasks.workunit.client.1.smithi098.stdout:0/207: unlink d0/c4 0 2024-09-20T19:05:52.342 INFO:tasks.workunit.client.1.smithi098.stdout:0/208: chown d0/d6/d28 3156532 1 2024-09-20T19:05:52.351 INFO:tasks.workunit.client.0.smithi027.stdout:2/149: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:52.353 INFO:tasks.workunit.client.0.smithi027.stdout:1/164: creat d2/d8/d2b/d2d/f34 x:0 0 0 2024-09-20T19:05:52.353 INFO:tasks.workunit.client.1.smithi098.stdout:9/338: sync 2024-09-20T19:05:52.354 INFO:tasks.workunit.client.1.smithi098.stdout:3/248: mknod d4/d19/d1d/c4d 0 2024-09-20T19:05:52.355 INFO:tasks.workunit.client.1.smithi098.stdout:9/339: read - d4/de/d27/d4a/f69 zero size 2024-09-20T19:05:52.355 INFO:tasks.workunit.client.0.smithi027.stdout:1/165: chown d2/d8/d2b/d2d 123102 1 2024-09-20T19:05:52.356 INFO:tasks.workunit.client.1.smithi098.stdout:3/249: truncate d4/d38/f41 1061165 0 2024-09-20T19:05:52.356 INFO:tasks.workunit.client.1.smithi098.stdout:9/340: fdatasync d4/f16 0 2024-09-20T19:05:52.356 INFO:tasks.workunit.client.0.smithi027.stdout:5/223: dwrite d4/da/fc [0,4194304] 0 2024-09-20T19:05:52.358 INFO:tasks.workunit.client.1.smithi098.stdout:5/255: dread d1/fb [0,4194304] 0 2024-09-20T19:05:52.360 INFO:tasks.workunit.client.0.smithi027.stdout:6/102: write d4/f7 [386684,20804] 0 2024-09-20T19:05:52.362 INFO:tasks.workunit.client.1.smithi098.stdout:3/250: mkdir d4/d19/d1d/d2f/d4e 0 2024-09-20T19:05:52.363 INFO:tasks.workunit.client.1.smithi098.stdout:1/204: write d1/f25 [8647328,129222] 0 2024-09-20T19:05:52.364 INFO:tasks.workunit.client.0.smithi027.stdout:1/166: creat d2/d14/f35 x:0 0 0 2024-09-20T19:05:52.365 INFO:tasks.workunit.client.1.smithi098.stdout:5/256: mknod d1/d17/d25/c4b 0 2024-09-20T19:05:52.367 INFO:tasks.workunit.client.1.smithi098.stdout:9/341: mkdir d4/d74 0 2024-09-20T19:05:52.371 INFO:tasks.workunit.client.0.smithi027.stdout:2/150: mkdir d3/d24 0 2024-09-20T19:05:52.373 INFO:tasks.workunit.client.0.smithi027.stdout:6/103: symlink d4/d6/l18 0 2024-09-20T19:05:52.373 INFO:tasks.workunit.client.1.smithi098.stdout:9/342: write d4/de/d27/d4a/f4b [175843,13611] 0 2024-09-20T19:05:52.375 INFO:tasks.workunit.client.1.smithi098.stdout:5/257: creat d1/d1b/d40/f4c x:0 0 0 2024-09-20T19:05:52.375 INFO:tasks.workunit.client.1.smithi098.stdout:3/251: dwrite d4/d19/f3f [4194304,4194304] 0 2024-09-20T19:05:52.376 INFO:tasks.workunit.client.0.smithi027.stdout:1/167: fsync d2/d1b/f1e 0 2024-09-20T19:05:52.379 INFO:tasks.workunit.client.1.smithi098.stdout:1/205: dwrite d1/d3/df/f21 [4194304,4194304] 0 2024-09-20T19:05:52.380 INFO:tasks.workunit.client.0.smithi027.stdout:5/224: truncate d4/da/f2b 3772924 0 2024-09-20T19:05:52.381 INFO:tasks.workunit.client.1.smithi098.stdout:4/289: dwrite d3/fe [0,4194304] 0 2024-09-20T19:05:52.381 INFO:tasks.workunit.client.0.smithi027.stdout:5/225: chown d4/da/de 13972 1 2024-09-20T19:05:52.382 INFO:tasks.workunit.client.1.smithi098.stdout:4/290: read d3/f7 [1042983,117045] 0 2024-09-20T19:05:52.386 INFO:tasks.workunit.client.0.smithi027.stdout:7/176: link d3/d8/da/dc/c22 d3/d8/da/dc/c40 0 2024-09-20T19:05:52.386 INFO:tasks.workunit.client.1.smithi098.stdout:3/252: dread d4/f10 [0,4194304] 0 2024-09-20T19:05:52.388 INFO:tasks.workunit.client.1.smithi098.stdout:9/343: read d4/de/d24/d35/f32 [3622013,14864] 0 2024-09-20T19:05:52.392 INFO:tasks.workunit.client.1.smithi098.stdout:4/291: write d3/d2e/f67 [634040,121804] 0 2024-09-20T19:05:52.395 INFO:tasks.workunit.client.1.smithi098.stdout:4/292: fdatasync d3/f36 0 2024-09-20T19:05:52.395 INFO:tasks.workunit.client.1.smithi098.stdout:5/258: truncate d1/d1b/f1c 38076 0 2024-09-20T19:05:52.396 INFO:tasks.workunit.client.0.smithi027.stdout:1/168: creat d2/d8/f36 x:0 0 0 2024-09-20T19:05:52.398 INFO:tasks.workunit.client.1.smithi098.stdout:9/344: dwrite d4/f47 [0,4194304] 0 2024-09-20T19:05:52.400 INFO:tasks.workunit.client.1.smithi098.stdout:6/180: rename d0/f15 to d0/f34 0 2024-09-20T19:05:52.402 INFO:tasks.workunit.client.0.smithi027.stdout:7/177: fsync d3/f12 0 2024-09-20T19:05:52.405 INFO:tasks.workunit.client.1.smithi098.stdout:4/293: dwrite d3/d6/d3e/f56 [0,4194304] 0 2024-09-20T19:05:52.407 INFO:tasks.workunit.client.0.smithi027.stdout:7/178: dread f0 [0,4194304] 0 2024-09-20T19:05:52.412 INFO:tasks.workunit.client.1.smithi098.stdout:6/181: creat d0/d7/d24/d29/f35 x:0 0 0 2024-09-20T19:05:52.415 INFO:tasks.workunit.client.0.smithi027.stdout:0/206: symlink d2/l4f 0 2024-09-20T19:05:52.416 INFO:tasks.workunit.client.1.smithi098.stdout:3/253: rename d4/d25/c31 to d4/c4f 0 2024-09-20T19:05:52.416 INFO:tasks.workunit.client.0.smithi027.stdout:0/207: dread - d2/d14/f4c zero size 2024-09-20T19:05:52.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/254: stat d4/d19/d1d/l28 0 2024-09-20T19:05:52.418 INFO:tasks.workunit.client.0.smithi027.stdout:9/284: mknod d0/c5c 0 2024-09-20T19:05:52.418 INFO:tasks.workunit.client.0.smithi027.stdout:7/179: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:52.421 INFO:tasks.workunit.client.0.smithi027.stdout:5/226: creat d4/f45 x:0 0 0 2024-09-20T19:05:52.421 INFO:tasks.workunit.client.0.smithi027.stdout:0/208: truncate d2/d14/d1d/f3d 653267 0 2024-09-20T19:05:52.421 INFO:tasks.workunit.client.0.smithi027.stdout:5/227: chown d4/da/l2a 15490 1 2024-09-20T19:05:52.423 INFO:tasks.workunit.client.1.smithi098.stdout:4/294: rename d3/d6/d11/d1e/d2a/d45/f4d to d3/d4f/d69/f6a 0 2024-09-20T19:05:52.429 INFO:tasks.workunit.client.0.smithi027.stdout:5/228: symlink d4/da/l46 0 2024-09-20T19:05:52.430 INFO:tasks.workunit.client.0.smithi027.stdout:7/180: dwrite d3/d1a/f3a [0,4194304] 0 2024-09-20T19:05:52.431 INFO:tasks.workunit.client.0.smithi027.stdout:9/285: rmdir d0/d2e 39 2024-09-20T19:05:52.431 INFO:tasks.workunit.client.0.smithi027.stdout:4/123: write d5/f1e [1332373,17002] 0 2024-09-20T19:05:52.431 INFO:tasks.workunit.client.1.smithi098.stdout:8/358: write d7/de/f54 [4626944,78034] 0 2024-09-20T19:05:52.432 INFO:tasks.workunit.client.1.smithi098.stdout:8/359: truncate d7/f61 9128786 0 2024-09-20T19:05:52.433 INFO:tasks.workunit.client.0.smithi027.stdout:1/169: dread d2/f13 [0,4194304] 0 2024-09-20T19:05:52.433 INFO:tasks.workunit.client.0.smithi027.stdout:9/286: readlink d0/d9/l4e 0 2024-09-20T19:05:52.433 INFO:tasks.workunit.client.0.smithi027.stdout:7/181: dread - d3/f2f zero size 2024-09-20T19:05:52.435 INFO:tasks.workunit.client.1.smithi098.stdout:4/295: mkdir d3/d6/d3e/d3c/d6b 0 2024-09-20T19:05:52.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/206: mknod d1/c3c 0 2024-09-20T19:05:52.438 INFO:tasks.workunit.client.1.smithi098.stdout:3/255: mkdir d4/da/d50 0 2024-09-20T19:05:52.440 INFO:tasks.workunit.client.0.smithi027.stdout:4/124: rename d5/d13/c24 to d5/d13/c27 0 2024-09-20T19:05:52.441 INFO:tasks.workunit.client.0.smithi027.stdout:1/170: fsync d2/d8/d2b/d2d/f34 0 2024-09-20T19:05:52.445 INFO:tasks.workunit.client.1.smithi098.stdout:5/259: dread d1/fc [4194304,4194304] 0 2024-09-20T19:05:52.446 INFO:tasks.workunit.client.1.smithi098.stdout:3/256: fdatasync d4/f10 0 2024-09-20T19:05:52.447 INFO:tasks.workunit.client.0.smithi027.stdout:5/229: creat d4/d3c/f47 x:0 0 0 2024-09-20T19:05:52.447 INFO:tasks.workunit.client.1.smithi098.stdout:0/209: dwrite d0/db/d1d/f21 [0,4194304] 0 2024-09-20T19:05:52.449 INFO:tasks.workunit.client.0.smithi027.stdout:5/230: truncate d4/da/de/f40 1016801 0 2024-09-20T19:05:52.449 INFO:tasks.workunit.client.1.smithi098.stdout:5/260: truncate d1/d17/d35/f3e 709571 0 2024-09-20T19:05:52.451 INFO:tasks.workunit.client.1.smithi098.stdout:4/296: symlink d3/d6/d3e/d3c/d6b/l6c 0 2024-09-20T19:05:52.451 INFO:tasks.workunit.client.1.smithi098.stdout:4/297: chown d3/d6/d11 11812969 1 2024-09-20T19:05:52.453 INFO:tasks.workunit.client.0.smithi027.stdout:9/287: rename d0/c2f to d0/d9/df/d1c/c5d 0 2024-09-20T19:05:52.455 INFO:tasks.workunit.client.0.smithi027.stdout:4/125: symlink d5/l28 0 2024-09-20T19:05:52.456 INFO:tasks.workunit.client.0.smithi027.stdout:4/126: dread - d5/d11/f23 zero size 2024-09-20T19:05:52.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/231: creat d4/da/f48 x:0 0 0 2024-09-20T19:05:52.458 INFO:tasks.workunit.client.1.smithi098.stdout:0/210: rmdir d0/db 39 2024-09-20T19:05:52.458 INFO:tasks.workunit.client.0.smithi027.stdout:5/232: stat d4/da/de/d1e/d3d 0 2024-09-20T19:05:52.460 INFO:tasks.workunit.client.1.smithi098.stdout:5/261: fsync d1/d17/f1e 0 2024-09-20T19:05:52.464 INFO:tasks.workunit.client.1.smithi098.stdout:1/207: link d1/d3/d2e/f3a d1/f3d 0 2024-09-20T19:05:52.469 INFO:tasks.workunit.client.0.smithi027.stdout:1/171: rename d2/d8/d2b/d2d/l33 to d2/d1b/l37 0 2024-09-20T19:05:52.471 INFO:tasks.workunit.client.1.smithi098.stdout:6/182: getdents d0 0 2024-09-20T19:05:52.473 INFO:tasks.workunit.client.0.smithi027.stdout:9/288: mknod d0/c5e 0 2024-09-20T19:05:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:52 smithi098 ceph-mon[35737]: Deploying cephadm binary to smithi027 2024-09-20T19:05:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:52 smithi098 ceph-mon[35737]: Deploying cephadm binary to smithi098 2024-09-20T19:05:52.475 INFO:tasks.workunit.client.0.smithi027.stdout:2/151: truncate d3/de/f18 2451675 0 2024-09-20T19:05:52.475 INFO:tasks.workunit.client.1.smithi098.stdout:4/298: dread d3/d2e/f67 [0,4194304] 0 2024-09-20T19:05:52.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/262: mknod d1/d17/d35/c4d 0 2024-09-20T19:05:52.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/263: stat d1/d17/l21 0 2024-09-20T19:05:52.478 INFO:tasks.workunit.client.0.smithi027.stdout:6/104: write d4/f14 [304747,108754] 0 2024-09-20T19:05:52.480 INFO:tasks.workunit.client.1.smithi098.stdout:1/208: symlink d1/d3/l3e 0 2024-09-20T19:05:52.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/257: creat d4/da/f51 x:0 0 0 2024-09-20T19:05:52.483 INFO:tasks.workunit.client.1.smithi098.stdout:0/211: creat d0/d15/d38/f39 x:0 0 0 2024-09-20T19:05:52.485 INFO:tasks.workunit.client.0.smithi027.stdout:9/289: symlink d0/d9/df/d1c/l5f 0 2024-09-20T19:05:52.485 INFO:tasks.workunit.client.1.smithi098.stdout:6/183: mknod d0/d7/d24/d29/c36 0 2024-09-20T19:05:52.485 INFO:tasks.workunit.client.1.smithi098.stdout:9/345: write d4/f1a [727984,29458] 0 2024-09-20T19:05:52.489 INFO:tasks.workunit.client.1.smithi098.stdout:5/264: mknod d1/d1b/d40/c4e 0 2024-09-20T19:05:52.490 INFO:tasks.workunit.client.0.smithi027.stdout:5/233: link d4/c15 d4/da/de/c49 0 2024-09-20T19:05:52.491 INFO:tasks.workunit.client.0.smithi027.stdout:0/209: write d2/fe [4487795,90409] 0 2024-09-20T19:05:52.492 INFO:tasks.workunit.client.0.smithi027.stdout:5/234: read - d4/f45 zero size 2024-09-20T19:05:52.494 INFO:tasks.workunit.client.0.smithi027.stdout:9/290: dwrite d0/d9/d3d/f52 [0,4194304] 0 2024-09-20T19:05:52.495 INFO:tasks.workunit.client.0.smithi027.stdout:3/213: symlink d0/d1/l45 0 2024-09-20T19:05:52.497 INFO:tasks.workunit.client.1.smithi098.stdout:5/265: rmdir d1/d17/d25 39 2024-09-20T19:05:52.497 INFO:tasks.workunit.client.0.smithi027.stdout:3/214: truncate d0/d1/f3f 698673 0 2024-09-20T19:05:52.499 INFO:tasks.workunit.client.0.smithi027.stdout:0/210: symlink d2/d7/l50 0 2024-09-20T19:05:52.501 INFO:tasks.workunit.client.1.smithi098.stdout:9/346: dread d4/de/d27/d4a/f67 [0,4194304] 0 2024-09-20T19:05:52.501 INFO:tasks.workunit.client.0.smithi027.stdout:1/172: dread d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:52.504 INFO:tasks.workunit.client.0.smithi027.stdout:3/215: truncate d0/d1/d13/d3c/f42 128309 0 2024-09-20T19:05:52.506 INFO:tasks.workunit.client.1.smithi098.stdout:5/266: symlink d1/d17/d35/l4f 0 2024-09-20T19:05:52.508 INFO:tasks.workunit.client.0.smithi027.stdout:0/211: dwrite d2/fc [0,4194304] 0 2024-09-20T19:05:52.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/347: dwrite d4/de/d24/d35/d2d/f49 [0,4194304] 0 2024-09-20T19:05:52.509 INFO:tasks.workunit.client.0.smithi027.stdout:0/212: truncate d2/d14/d1b/f2b 324848 0 2024-09-20T19:05:52.510 INFO:tasks.workunit.client.0.smithi027.stdout:9/291: mknod d0/c60 0 2024-09-20T19:05:52.512 INFO:tasks.workunit.client.1.smithi098.stdout:0/212: creat d0/db/d32/f3a x:0 0 0 2024-09-20T19:05:52.516 INFO:tasks.workunit.client.0.smithi027.stdout:3/216: mknod d0/d1/d13/c46 0 2024-09-20T19:05:52.518 INFO:tasks.workunit.client.0.smithi027.stdout:1/173: chown d2/l2a 69 1 2024-09-20T19:05:52.520 INFO:tasks.workunit.client.1.smithi098.stdout:0/213: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:52.522 INFO:tasks.workunit.client.0.smithi027.stdout:0/213: dwrite d2/fe [0,4194304] 0 2024-09-20T19:05:52.522 INFO:tasks.workunit.client.0.smithi027.stdout:0/214: chown d2/d49/f45 1048985284 1 2024-09-20T19:05:52.522 INFO:tasks.workunit.client.1.smithi098.stdout:6/184: dread d0/d7/dc/f1a [0,4194304] 0 2024-09-20T19:05:52.523 INFO:tasks.workunit.client.0.smithi027.stdout:4/127: truncate d5/fa 2506281 0 2024-09-20T19:05:52.524 INFO:tasks.workunit.client.1.smithi098.stdout:9/348: creat d4/de/d27/d4a/d21/d25/f75 x:0 0 0 2024-09-20T19:05:52.524 INFO:tasks.workunit.client.0.smithi027.stdout:4/128: write d5/d13/d16/f22 [686157,6575] 0 2024-09-20T19:05:52.525 INFO:tasks.workunit.client.1.smithi098.stdout:9/349: write d4/f6a [87423,36862] 0 2024-09-20T19:05:52.528 INFO:tasks.workunit.client.1.smithi098.stdout:9/350: truncate d4/de/d27/d4a/d21/f4e 908246 0 2024-09-20T19:05:52.535 INFO:tasks.workunit.client.0.smithi027.stdout:1/174: symlink d2/d1b/l38 0 2024-09-20T19:05:52.535 INFO:tasks.workunit.client.0.smithi027.stdout:9/292: read d0/f5 [8130758,64308] 0 2024-09-20T19:05:52.537 INFO:tasks.workunit.client.1.smithi098.stdout:4/299: write d3/f7 [288591,54046] 0 2024-09-20T19:05:52.537 INFO:tasks.workunit.client.0.smithi027.stdout:9/293: dread - d0/d9/df/d1b/d1a/dd/f5b zero size 2024-09-20T19:05:52.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/209: rename d1/d3/df to d1/d3/df/d3f 22 2024-09-20T19:05:52.541 INFO:tasks.workunit.client.1.smithi098.stdout:6/185: mkdir d0/de/d1b/d37 0 2024-09-20T19:05:52.542 INFO:tasks.workunit.client.0.smithi027.stdout:5/235: dread d4/f11 [0,4194304] 0 2024-09-20T19:05:52.546 INFO:tasks.workunit.client.0.smithi027.stdout:5/236: chown d4/da/de/d3e 423232313 1 2024-09-20T19:05:52.547 INFO:tasks.workunit.client.1.smithi098.stdout:9/351: dwrite f3 [0,4194304] 0 2024-09-20T19:05:52.547 INFO:tasks.workunit.client.1.smithi098.stdout:6/186: chown d0/d7/d24/d29/d2b 54006 1 2024-09-20T19:05:52.547 INFO:tasks.workunit.client.1.smithi098.stdout:6/187: readlink d0/l6 0 2024-09-20T19:05:52.548 INFO:tasks.workunit.client.0.smithi027.stdout:1/175: dwrite d2/d8/f36 [0,4194304] 0 2024-09-20T19:05:52.548 INFO:tasks.workunit.client.0.smithi027.stdout:4/129: creat d5/d13/d16/d21/d26/f29 x:0 0 0 2024-09-20T19:05:52.549 INFO:tasks.workunit.client.0.smithi027.stdout:6/105: dwrite d4/d6/fa [0,4194304] 0 2024-09-20T19:05:52.551 INFO:tasks.workunit.client.1.smithi098.stdout:3/258: dwrite d4/da/f14 [4194304,4194304] 0 2024-09-20T19:05:52.556 INFO:tasks.workunit.client.0.smithi027.stdout:3/217: creat d0/f47 x:0 0 0 2024-09-20T19:05:52.556 INFO:tasks.workunit.client.1.smithi098.stdout:4/300: dwrite d3/d6/d3e/d3c/f5a [0,4194304] 0 2024-09-20T19:05:52.558 INFO:tasks.workunit.client.1.smithi098.stdout:6/188: fsync d0/f34 0 2024-09-20T19:05:52.559 INFO:tasks.workunit.client.1.smithi098.stdout:4/301: chown d3/d6/d5b 22 1 2024-09-20T19:05:52.563 INFO:tasks.workunit.client.1.smithi098.stdout:3/259: unlink d4/lc 0 2024-09-20T19:05:52.563 INFO:tasks.workunit.client.1.smithi098.stdout:1/210: dwrite d1/d3/fe [0,4194304] 0 2024-09-20T19:05:52.564 INFO:tasks.workunit.client.1.smithi098.stdout:1/211: stat d1/l31 0 2024-09-20T19:05:52.566 INFO:tasks.workunit.client.0.smithi027.stdout:6/106: dwrite d4/f7 [0,4194304] 0 2024-09-20T19:05:52.567 INFO:tasks.workunit.client.0.smithi027.stdout:4/130: dwrite d5/d11/f23 [0,4194304] 0 2024-09-20T19:05:52.568 INFO:tasks.workunit.client.1.smithi098.stdout:9/352: rename d4/de/d27/d4a to d4/de/d27/d4a/d21/d76 22 2024-09-20T19:05:52.570 INFO:tasks.workunit.client.1.smithi098.stdout:4/302: symlink d3/d6/d11/d59/l6d 0 2024-09-20T19:05:52.570 INFO:tasks.workunit.client.0.smithi027.stdout:4/131: readlink d5/l25 0 2024-09-20T19:05:52.570 INFO:tasks.workunit.client.0.smithi027.stdout:1/176: rmdir d2/d8 39 2024-09-20T19:05:52.576 INFO:tasks.workunit.client.1.smithi098.stdout:1/212: rename d1/l31 to d1/d3/df/l40 0 2024-09-20T19:05:52.577 INFO:tasks.workunit.client.0.smithi027.stdout:5/237: dwrite d4/da/de/d1e/f20 [0,4194304] 0 2024-09-20T19:05:52.578 INFO:tasks.workunit.client.0.smithi027.stdout:0/215: truncate d2/fc 729312 0 2024-09-20T19:05:52.581 INFO:tasks.workunit.client.0.smithi027.stdout:3/218: rename d0/d1/d7/l28 to d0/d1/l48 0 2024-09-20T19:05:52.582 INFO:tasks.workunit.client.1.smithi098.stdout:3/260: creat d4/d19/d1d/d2f/d3e/f52 x:0 0 0 2024-09-20T19:05:52.582 INFO:tasks.workunit.client.0.smithi027.stdout:4/132: chown d5/d11/l19 126851 1 2024-09-20T19:05:52.583 INFO:tasks.workunit.client.0.smithi027.stdout:3/219: write d0/d1/d7/d1d/f21 [415766,85356] 0 2024-09-20T19:05:52.586 INFO:tasks.workunit.client.0.smithi027.stdout:3/220: truncate d0/f47 754613 0 2024-09-20T19:05:52.589 INFO:tasks.workunit.client.1.smithi098.stdout:3/261: creat d4/d19/d1d/d2f/f53 x:0 0 0 2024-09-20T19:05:52.591 INFO:tasks.workunit.client.0.smithi027.stdout:5/238: creat d4/da/d1a/f4a x:0 0 0 2024-09-20T19:05:52.592 INFO:tasks.workunit.client.1.smithi098.stdout:3/262: truncate d4/da/f51 656279 0 2024-09-20T19:05:52.594 INFO:tasks.workunit.client.1.smithi098.stdout:9/353: rename d4/de/l18 to d4/de/d24/d35/d6d/l77 0 2024-09-20T19:05:52.595 INFO:tasks.workunit.client.0.smithi027.stdout:0/216: mkdir d2/d7/d51 0 2024-09-20T19:05:52.595 INFO:tasks.workunit.client.0.smithi027.stdout:1/177: dwrite d2/d8/d2b/d2d/f34 [0,4194304] 0 2024-09-20T19:05:52.596 INFO:tasks.workunit.client.1.smithi098.stdout:9/354: chown d4/de/d27/d4a/d21/d25/f30 1380194 1 2024-09-20T19:05:52.597 INFO:tasks.workunit.client.0.smithi027.stdout:8/162: sync 2024-09-20T19:05:52.599 INFO:tasks.workunit.client.1.smithi098.stdout:3/263: unlink l0 0 2024-09-20T19:05:52.600 INFO:tasks.workunit.client.0.smithi027.stdout:8/163: fdatasync d2/d3/d6/f1a 0 2024-09-20T19:05:52.600 INFO:tasks.workunit.client.1.smithi098.stdout:9/355: mkdir d4/de/d24/d35/d6d/d78 0 2024-09-20T19:05:52.602 INFO:tasks.workunit.client.0.smithi027.stdout:8/164: chown d2/d3/f25 1020927772 1 2024-09-20T19:05:52.603 INFO:tasks.workunit.client.0.smithi027.stdout:3/221: creat d0/d1/d13/f49 x:0 0 0 2024-09-20T19:05:52.604 INFO:tasks.workunit.client.1.smithi098.stdout:9/356: mknod d4/de/d24/d35/c79 0 2024-09-20T19:05:52.604 INFO:tasks.workunit.client.0.smithi027.stdout:5/239: truncate d4/f11 3901192 0 2024-09-20T19:05:52.604 INFO:tasks.workunit.client.0.smithi027.stdout:8/165: chown d2 588 1 2024-09-20T19:05:52.606 INFO:tasks.workunit.client.0.smithi027.stdout:4/133: mkdir d5/d11/d1a/d2a 0 2024-09-20T19:05:52.606 INFO:tasks.workunit.client.1.smithi098.stdout:9/357: creat d4/de/d27/f7a x:0 0 0 2024-09-20T19:05:52.607 INFO:tasks.workunit.client.1.smithi098.stdout:9/358: readlink d4/l11 0 2024-09-20T19:05:52.608 INFO:tasks.workunit.client.0.smithi027.stdout:1/178: dwrite d2/d8/f36 [0,4194304] 0 2024-09-20T19:05:52.609 INFO:tasks.workunit.client.1.smithi098.stdout:9/359: dread d4/f6a [0,4194304] 0 2024-09-20T19:05:52.613 INFO:tasks.workunit.client.0.smithi027.stdout:4/134: creat d5/d11/d17/d1b/f2b x:0 0 0 2024-09-20T19:05:52.614 INFO:tasks.workunit.client.0.smithi027.stdout:1/179: creat d2/d8/d2b/d2d/f39 x:0 0 0 2024-09-20T19:05:52.616 INFO:tasks.workunit.client.1.smithi098.stdout:9/360: mkdir d4/de/d27/d4a/d21/d25/d51/d7b 0 2024-09-20T19:05:52.617 INFO:tasks.workunit.client.0.smithi027.stdout:1/180: readlink d2/l7 0 2024-09-20T19:05:52.620 INFO:tasks.workunit.client.1.smithi098.stdout:6/189: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:05:52.621 INFO:tasks.workunit.client.0.smithi027.stdout:8/166: dwrite d2/d3/d6/d21/f38 [0,4194304] 0 2024-09-20T19:05:52.622 INFO:tasks.workunit.client.1.smithi098.stdout:4/303: dread d3/d6/f18 [4194304,4194304] 0 2024-09-20T19:05:52.623 INFO:tasks.workunit.client.0.smithi027.stdout:8/167: read - d2/d3/d6/d21/f28 zero size 2024-09-20T19:05:52.623 INFO:tasks.workunit.client.1.smithi098.stdout:4/304: truncate d3/d6/f34 8898090 0 2024-09-20T19:05:52.624 INFO:tasks.workunit.client.1.smithi098.stdout:9/361: rename d4/de/d27/f2e to d4/de/d48/f7c 0 2024-09-20T19:05:52.625 INFO:tasks.workunit.client.0.smithi027.stdout:8/168: write d2/d3/f11 [511769,120226] 0 2024-09-20T19:05:52.626 INFO:tasks.workunit.client.1.smithi098.stdout:6/190: symlink d0/d7/d24/d29/l38 0 2024-09-20T19:05:52.627 INFO:tasks.workunit.client.0.smithi027.stdout:5/240: mknod d4/da/de/d1e/d3d/c4b 0 2024-09-20T19:05:52.628 INFO:tasks.workunit.client.0.smithi027.stdout:8/169: fsync d2/d3/f30 0 2024-09-20T19:05:52.629 INFO:tasks.workunit.client.1.smithi098.stdout:4/305: rmdir d3/d6/d3e/d3c/d6b 39 2024-09-20T19:05:52.631 INFO:tasks.workunit.client.0.smithi027.stdout:4/135: symlink d5/d13/d16/d21/d26/l2c 0 2024-09-20T19:05:52.631 INFO:tasks.workunit.client.0.smithi027.stdout:4/136: chown d5/d11/d17 762386 1 2024-09-20T19:05:52.632 INFO:tasks.workunit.client.1.smithi098.stdout:9/362: rmdir d4 39 2024-09-20T19:05:52.632 INFO:tasks.workunit.client.1.smithi098.stdout:4/306: write d3/d6/d11/d59/d50/f63 [616595,19038] 0 2024-09-20T19:05:52.632 INFO:tasks.workunit.client.0.smithi027.stdout:9/294: dwrite d0/d9/df/f50 [0,4194304] 0 2024-09-20T19:05:52.635 INFO:tasks.workunit.client.1.smithi098.stdout:1/213: dwrite d1/d3/f19 [0,4194304] 0 2024-09-20T19:05:52.636 INFO:tasks.workunit.client.0.smithi027.stdout:0/217: rename d2/d7 to d2/d20/d52 0 2024-09-20T19:05:52.640 INFO:tasks.workunit.client.0.smithi027.stdout:1/181: dwrite d2/d8/d2b/d2d/f34 [0,4194304] 0 2024-09-20T19:05:52.641 INFO:tasks.workunit.client.1.smithi098.stdout:1/214: dread d1/d3/f19 [0,4194304] 0 2024-09-20T19:05:52.642 INFO:tasks.workunit.client.1.smithi098.stdout:1/215: write d1/f10 [1571142,54243] 0 2024-09-20T19:05:52.643 INFO:tasks.workunit.client.0.smithi027.stdout:1/182: chown d2/d14/f35 2 1 2024-09-20T19:05:52.646 INFO:tasks.workunit.client.1.smithi098.stdout:4/307: creat d3/d6/d3e/f6e x:0 0 0 2024-09-20T19:05:52.646 INFO:tasks.workunit.client.0.smithi027.stdout:6/107: dwrite d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:52.650 INFO:tasks.workunit.client.0.smithi027.stdout:8/170: creat d2/d14/d13/f3b x:0 0 0 2024-09-20T19:05:52.651 INFO:tasks.workunit.client.1.smithi098.stdout:9/363: dwrite d4/de/d27/d4a/f4b [0,4194304] 0 2024-09-20T19:05:52.651 INFO:tasks.workunit.client.0.smithi027.stdout:6/108: dread d4/f14 [0,4194304] 0 2024-09-20T19:05:52.653 INFO:tasks.workunit.client.0.smithi027.stdout:6/109: read f0 [6385775,80232] 0 2024-09-20T19:05:52.654 INFO:tasks.workunit.client.0.smithi027.stdout:6/110: chown d4/f14 9 1 2024-09-20T19:05:52.656 INFO:tasks.workunit.client.0.smithi027.stdout:4/137: mknod d5/d13/d16/d21/d26/c2d 0 2024-09-20T19:05:52.659 INFO:tasks.workunit.client.0.smithi027.stdout:3/222: rename d0/d1/d13/f27 to d0/d19/f4a 0 2024-09-20T19:05:52.660 INFO:tasks.workunit.client.0.smithi027.stdout:3/223: dread - d0/d1/d13/f49 zero size 2024-09-20T19:05:52.660 INFO:tasks.workunit.client.0.smithi027.stdout:0/218: write d2/d14/d1d/d2e/f46 [3901354,90469] 0 2024-09-20T19:05:52.661 INFO:tasks.workunit.client.1.smithi098.stdout:6/191: creat d0/de/d1b/f39 x:0 0 0 2024-09-20T19:05:52.662 INFO:tasks.workunit.client.1.smithi098.stdout:1/216: dwrite d1/f2f [0,4194304] 0 2024-09-20T19:05:52.662 INFO:tasks.workunit.client.0.smithi027.stdout:0/219: chown d2/d20/d52/f4e 13742 1 2024-09-20T19:05:52.664 INFO:tasks.workunit.client.0.smithi027.stdout:1/183: truncate d2/d15/f22 625715 0 2024-09-20T19:05:52.665 INFO:tasks.workunit.client.1.smithi098.stdout:9/364: mknod d4/de/d48/c7d 0 2024-09-20T19:05:52.668 INFO:tasks.workunit.client.1.smithi098.stdout:4/308: mknod d3/d6/d11/d57/c6f 0 2024-09-20T19:05:52.669 INFO:tasks.workunit.client.0.smithi027.stdout:5/241: creat d4/da/de/d3e/d44/f4c x:0 0 0 2024-09-20T19:05:52.670 INFO:tasks.workunit.client.1.smithi098.stdout:4/309: write d3/d6/d11/d1e/f26 [1148755,85243] 0 2024-09-20T19:05:52.671 INFO:tasks.workunit.client.0.smithi027.stdout:6/111: creat d4/d6/f19 x:0 0 0 2024-09-20T19:05:52.671 INFO:tasks.workunit.client.0.smithi027.stdout:0/220: dwrite d2/fe [4194304,4194304] 0 2024-09-20T19:05:52.674 INFO:tasks.workunit.client.0.smithi027.stdout:4/138: creat d5/d13/d16/d21/f2e x:0 0 0 2024-09-20T19:05:52.675 INFO:tasks.workunit.client.1.smithi098.stdout:7/328: sync 2024-09-20T19:05:52.675 INFO:tasks.workunit.client.1.smithi098.stdout:6/192: mknod d0/de/c3a 0 2024-09-20T19:05:52.680 INFO:tasks.workunit.client.0.smithi027.stdout:3/224: unlink d0/d1/d7/d1d/f21 0 2024-09-20T19:05:52.680 INFO:tasks.workunit.client.1.smithi098.stdout:1/217: dwrite d1/d3/d2e/f3b [0,4194304] 0 2024-09-20T19:05:52.681 INFO:tasks.workunit.client.0.smithi027.stdout:3/225: dread d0/d1/f3f [0,4194304] 0 2024-09-20T19:05:52.685 INFO:tasks.workunit.client.0.smithi027.stdout:1/184: rename d2/d14 to d2/d1b/d3a 0 2024-09-20T19:05:52.686 INFO:tasks.workunit.client.1.smithi098.stdout:9/365: mkdir d4/de/d27/d4a/d21/d25/d51/d7b/d7e 0 2024-09-20T19:05:52.686 INFO:tasks.workunit.client.0.smithi027.stdout:5/242: mknod d4/da/de/d1e/c4d 0 2024-09-20T19:05:52.687 INFO:tasks.workunit.client.1.smithi098.stdout:4/310: symlink d3/d5e/l70 0 2024-09-20T19:05:52.688 INFO:tasks.workunit.client.1.smithi098.stdout:7/329: dwrite d3/d10/d16/d17/d33/d1f/d2d/f31 [0,4194304] 0 2024-09-20T19:05:52.692 INFO:tasks.workunit.client.1.smithi098.stdout:1/218: link d1/d32/f35 d1/d32/f41 0 2024-09-20T19:05:52.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/366: dwrite d4/f47 [0,4194304] 0 2024-09-20T19:05:52.696 INFO:tasks.workunit.client.0.smithi027.stdout:6/112: rename d4/le to d4/d6/l1a 0 2024-09-20T19:05:52.698 INFO:tasks.workunit.client.1.smithi098.stdout:4/311: mkdir d3/d6/d11/d59/d50/d58/d71 0 2024-09-20T19:05:52.698 INFO:tasks.workunit.client.1.smithi098.stdout:9/367: write d4/f47 [2318992,102884] 0 2024-09-20T19:05:52.698 INFO:tasks.workunit.client.0.smithi027.stdout:5/243: symlink d4/da/de/l4e 0 2024-09-20T19:05:52.700 INFO:tasks.workunit.client.0.smithi027.stdout:0/221: mknod d2/d14/d1b/d39/c53 0 2024-09-20T19:05:52.703 INFO:tasks.workunit.client.1.smithi098.stdout:9/368: dread f0 [0,4194304] 0 2024-09-20T19:05:52.704 INFO:tasks.workunit.client.0.smithi027.stdout:1/185: dwrite d2/f13 [8388608,4194304] 0 2024-09-20T19:05:52.704 INFO:tasks.workunit.client.1.smithi098.stdout:4/312: creat d3/d4f/f72 x:0 0 0 2024-09-20T19:05:52.705 INFO:tasks.workunit.client.1.smithi098.stdout:9/369: truncate d4/f1a 1118983 0 2024-09-20T19:05:52.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/186: write d2/d1b/f2e [966606,57266] 0 2024-09-20T19:05:52.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/187: chown d2/d8 15169 1 2024-09-20T19:05:52.708 INFO:tasks.workunit.client.0.smithi027.stdout:5/244: creat d4/da/d1a/f4f x:0 0 0 2024-09-20T19:05:52.708 INFO:tasks.workunit.client.0.smithi027.stdout:1/188: chown d2/d15/f29 306 1 2024-09-20T19:05:52.710 INFO:tasks.workunit.client.1.smithi098.stdout:6/193: dread d0/f34 [0,4194304] 0 2024-09-20T19:05:52.713 INFO:tasks.workunit.client.1.smithi098.stdout:4/313: dread d3/d6/f18 [4194304,4194304] 0 2024-09-20T19:05:52.714 INFO:tasks.workunit.client.0.smithi027.stdout:0/222: creat d2/d14/d1d/d2e/f54 x:0 0 0 2024-09-20T19:05:52.714 INFO:tasks.workunit.client.0.smithi027.stdout:9/295: write d0/f5 [9388750,118376] 0 2024-09-20T19:05:52.717 INFO:tasks.workunit.client.1.smithi098.stdout:9/370: dwrite d4/de/f34 [4194304,4194304] 0 2024-09-20T19:05:52.718 INFO:tasks.workunit.client.1.smithi098.stdout:7/330: getdents d3/d4c 0 2024-09-20T19:05:52.718 INFO:tasks.workunit.client.0.smithi027.stdout:5/245: mkdir d4/da/d50 0 2024-09-20T19:05:52.720 INFO:tasks.workunit.client.0.smithi027.stdout:5/246: write d4/f16 [523362,65034] 0 2024-09-20T19:05:52.722 INFO:tasks.workunit.client.0.smithi027.stdout:9/296: write d0/d9/df/d1b/f23 [7482159,113118] 0 2024-09-20T19:05:52.722 INFO:tasks.workunit.client.0.smithi027.stdout:0/223: dwrite d2/d14/d1d/f3d [0,4194304] 0 2024-09-20T19:05:52.724 INFO:tasks.workunit.client.1.smithi098.stdout:7/331: write d3/d10/f19 [5989118,78652] 0 2024-09-20T19:05:52.726 INFO:tasks.workunit.client.0.smithi027.stdout:9/297: write d0/d9/df/f2a [114744,97253] 0 2024-09-20T19:05:52.728 INFO:tasks.workunit.client.0.smithi027.stdout:9/298: chown d0/d9/lb 170 1 2024-09-20T19:05:52.728 INFO:tasks.workunit.client.1.smithi098.stdout:4/314: dwrite d3/f36 [0,4194304] 0 2024-09-20T19:05:52.731 INFO:tasks.workunit.client.1.smithi098.stdout:6/194: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-20T19:05:52.732 INFO:tasks.workunit.client.0.smithi027.stdout:0/224: fsync d2/d14/d1b/f24 0 2024-09-20T19:05:52.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/332: symlink d3/d10/d16/d17/d33/d1f/l67 0 2024-09-20T19:05:52.737 INFO:tasks.workunit.client.0.smithi027.stdout:9/299: mknod d0/d9/c61 0 2024-09-20T19:05:52.738 INFO:tasks.workunit.client.1.smithi098.stdout:6/195: dread d0/d7/dc/f1a [0,4194304] 0 2024-09-20T19:05:52.740 INFO:tasks.workunit.client.1.smithi098.stdout:4/315: mkdir d3/d6/d3e/d3c/d6b/d73 0 2024-09-20T19:05:52.742 INFO:tasks.workunit.client.0.smithi027.stdout:0/225: dwrite d2/d14/d1d/d2e/f46 [0,4194304] 0 2024-09-20T19:05:52.744 INFO:tasks.workunit.client.0.smithi027.stdout:0/226: write d2/fe [763023,38255] 0 2024-09-20T19:05:52.750 INFO:tasks.workunit.client.0.smithi027.stdout:5/247: dread d4/f16 [0,4194304] 0 2024-09-20T19:05:52.750 INFO:tasks.workunit.client.0.smithi027.stdout:9/300: rename d0/f39 to d0/d9/df/d1b/d1a/f62 0 2024-09-20T19:05:52.751 INFO:tasks.workunit.client.0.smithi027.stdout:5/248: fdatasync d4/f43 0 2024-09-20T19:05:52.751 INFO:tasks.workunit.client.1.smithi098.stdout:4/316: dwrite d3/fc [4194304,4194304] 0 2024-09-20T19:05:52.752 INFO:tasks.workunit.client.0.smithi027.stdout:5/249: fsync d4/da/de/f35 0 2024-09-20T19:05:52.754 INFO:tasks.workunit.client.1.smithi098.stdout:6/196: dread d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:52.755 INFO:tasks.workunit.client.1.smithi098.stdout:6/197: dread - d0/de/d1b/f39 zero size 2024-09-20T19:05:52.755 INFO:tasks.workunit.client.1.smithi098.stdout:7/333: link d3/d10/d18/d21/c5e d3/d10/d16/d17/d33/d1f/d2d/c68 0 2024-09-20T19:05:52.755 INFO:tasks.workunit.client.0.smithi027.stdout:7/182: sync 2024-09-20T19:05:52.755 INFO:tasks.workunit.client.0.smithi027.stdout:2/152: sync 2024-09-20T19:05:52.759 INFO:tasks.workunit.client.0.smithi027.stdout:7/183: truncate d3/d8/d26/f3d 224468 0 2024-09-20T19:05:52.761 INFO:tasks.workunit.client.0.smithi027.stdout:5/250: dwrite d4/f43 [0,4194304] 0 2024-09-20T19:05:52.762 INFO:tasks.workunit.client.1.smithi098.stdout:4/317: rename d3/d4f/d69/f6a to d3/d6/d3e/d3c/d6b/f74 0 2024-09-20T19:05:52.767 INFO:tasks.workunit.client.1.smithi098.stdout:7/334: unlink d3/d10/d16/d17/d33/d1f/f5c 0 2024-09-20T19:05:52.768 INFO:tasks.workunit.client.1.smithi098.stdout:7/335: truncate d3/f12 6107622 0 2024-09-20T19:05:52.769 INFO:tasks.workunit.client.1.smithi098.stdout:7/336: fdatasync d3/d10/d16/f39 0 2024-09-20T19:05:52.769 INFO:tasks.workunit.client.0.smithi027.stdout:9/301: readlink d0/d2e/l31 0 2024-09-20T19:05:52.771 INFO:tasks.workunit.client.1.smithi098.stdout:6/198: rename d0/d7/c16 to d0/de/d1b/d37/c3b 0 2024-09-20T19:05:52.772 INFO:tasks.workunit.client.0.smithi027.stdout:6/113: getdents d4 0 2024-09-20T19:05:52.775 INFO:tasks.workunit.client.0.smithi027.stdout:2/153: rmdir d3 39 2024-09-20T19:05:52.777 INFO:tasks.workunit.client.1.smithi098.stdout:4/318: creat d3/d6/d11/d59/d50/f75 x:0 0 0 2024-09-20T19:05:52.778 INFO:tasks.workunit.client.0.smithi027.stdout:3/226: truncate d0/d19/f1a 4097636 0 2024-09-20T19:05:52.779 INFO:tasks.workunit.client.0.smithi027.stdout:0/227: creat d2/d48/f55 x:0 0 0 2024-09-20T19:05:52.780 INFO:tasks.workunit.client.1.smithi098.stdout:7/337: mknod d3/d10/d16/d17/d33/d1f/d2d/c69 0 2024-09-20T19:05:52.780 INFO:tasks.workunit.client.0.smithi027.stdout:7/184: rmdir d3/d8/da 39 2024-09-20T19:05:52.781 INFO:tasks.workunit.client.0.smithi027.stdout:7/185: fsync d3/f12 0 2024-09-20T19:05:52.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/219: truncate d1/d3/fe 2654026 0 2024-09-20T19:05:52.783 INFO:tasks.workunit.client.0.smithi027.stdout:5/251: creat d4/da/de/d1e/f51 x:0 0 0 2024-09-20T19:05:52.783 INFO:tasks.workunit.client.1.smithi098.stdout:6/199: unlink d0/de/c2c 0 2024-09-20T19:05:52.785 INFO:tasks.workunit.client.1.smithi098.stdout:7/338: rmdir d3/d10/d18/d21 39 2024-09-20T19:05:52.786 INFO:tasks.workunit.client.1.smithi098.stdout:7/339: write d3/d10/d16/d17/d33/d1f/d2d/f31 [66505,48065] 0 2024-09-20T19:05:52.787 INFO:tasks.workunit.client.0.smithi027.stdout:6/114: mkdir d4/d1b 0 2024-09-20T19:05:52.787 INFO:tasks.workunit.client.0.smithi027.stdout:6/115: read - d4/f9 zero size 2024-09-20T19:05:52.787 INFO:tasks.workunit.client.1.smithi098.stdout:7/340: stat d3/d10/d16/d17/d33/d4b/l62 0 2024-09-20T19:05:52.788 INFO:tasks.workunit.client.1.smithi098.stdout:1/220: symlink d1/d3/d2e/l42 0 2024-09-20T19:05:52.788 INFO:tasks.workunit.client.0.smithi027.stdout:6/116: write d4/f9 [969267,84496] 0 2024-09-20T19:05:52.789 INFO:tasks.workunit.client.0.smithi027.stdout:2/154: chown d3 9 1 2024-09-20T19:05:52.790 INFO:tasks.workunit.client.0.smithi027.stdout:2/155: write d3/f9 [3380738,123638] 0 2024-09-20T19:05:52.790 INFO:tasks.workunit.client.1.smithi098.stdout:6/200: mknod d0/c3c 0 2024-09-20T19:05:52.791 INFO:tasks.workunit.client.1.smithi098.stdout:6/201: chown d0/de/d1b/l20 106070 1 2024-09-20T19:05:52.792 INFO:tasks.workunit.client.0.smithi027.stdout:3/227: creat d0/d1/d13/d15/f4b x:0 0 0 2024-09-20T19:05:52.794 INFO:tasks.workunit.client.0.smithi027.stdout:0/228: symlink d2/d14/d1b/l56 0 2024-09-20T19:05:52.794 INFO:tasks.workunit.client.1.smithi098.stdout:9/371: write d4/de/f1f [232000,95560] 0 2024-09-20T19:05:52.796 INFO:tasks.workunit.client.0.smithi027.stdout:7/186: mknod d3/d8/d26/c41 0 2024-09-20T19:05:52.797 INFO:tasks.workunit.client.0.smithi027.stdout:5/252: creat d4/da/de/d3e/d44/f52 x:0 0 0 2024-09-20T19:05:52.799 INFO:tasks.workunit.client.0.smithi027.stdout:9/302: rename d0/d9/d3d/d4f/f51 to d0/d9/d3d/d5a/f63 0 2024-09-20T19:05:52.799 INFO:tasks.workunit.client.0.smithi027.stdout:6/117: mknod d4/d6/c1c 0 2024-09-20T19:05:52.801 INFO:tasks.workunit.client.1.smithi098.stdout:2/546: sync 2024-09-20T19:05:52.801 INFO:tasks.workunit.client.1.smithi098.stdout:8/360: sync 2024-09-20T19:05:52.803 INFO:tasks.workunit.client.0.smithi027.stdout:0/229: creat d2/d14/d1b/d39/f57 x:0 0 0 2024-09-20T19:05:52.804 INFO:tasks.workunit.client.0.smithi027.stdout:7/187: dwrite d3/d8/f20 [0,4194304] 0 2024-09-20T19:05:52.808 INFO:tasks.workunit.client.1.smithi098.stdout:9/372: creat d4/de/f7f x:0 0 0 2024-09-20T19:05:52.810 INFO:tasks.workunit.client.0.smithi027.stdout:5/253: unlink d4/da/f33 0 2024-09-20T19:05:52.810 INFO:tasks.workunit.client.1.smithi098.stdout:2/547: dwrite d3/d16/d1d/d4f/d8b/f3e [0,4194304] 0 2024-09-20T19:05:52.817 INFO:tasks.workunit.client.0.smithi027.stdout:8/171: sync 2024-09-20T19:05:52.820 INFO:tasks.workunit.client.0.smithi027.stdout:8/172: write d2/d3/d6/ff [1059664,39710] 0 2024-09-20T19:05:52.823 INFO:tasks.workunit.client.0.smithi027.stdout:6/118: rename d4/d6/c10 to d4/d15/c1d 0 2024-09-20T19:05:52.823 INFO:tasks.workunit.client.0.smithi027.stdout:9/303: dwrite d0/d9/df/d1b/d1a/f13 [0,4194304] 0 2024-09-20T19:05:52.824 INFO:tasks.workunit.client.0.smithi027.stdout:8/173: truncate d2/d3/f37 618785 0 2024-09-20T19:05:52.825 INFO:tasks.workunit.client.1.smithi098.stdout:8/361: symlink d7/de/d11/d19/d30/d68/d78/l84 0 2024-09-20T19:05:52.825 INFO:tasks.workunit.client.1.smithi098.stdout:7/341: rename d3/d10/d18/f27 to d3/f6a 0 2024-09-20T19:05:52.825 INFO:tasks.workunit.client.1.smithi098.stdout:9/373: mknod d4/de/d27/d4a/d21/d25/d66/c80 0 2024-09-20T19:05:52.828 INFO:tasks.workunit.client.1.smithi098.stdout:9/374: fsync d4/de/d27/d4a/d21/d25/d66/f6f 0 2024-09-20T19:05:52.831 INFO:tasks.workunit.client.1.smithi098.stdout:9/375: read d4/fb [3351639,73250] 0 2024-09-20T19:05:52.831 INFO:tasks.workunit.client.1.smithi098.stdout:2/548: dread d3/d16/f3b [0,4194304] 0 2024-09-20T19:05:52.832 INFO:tasks.workunit.client.1.smithi098.stdout:9/376: readlink d4/de/d24/d35/d2d/l54 0 2024-09-20T19:05:52.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/362: mknod d7/de/d11/d1d/c85 0 2024-09-20T19:05:52.834 INFO:tasks.workunit.client.1.smithi098.stdout:8/363: chown d7/de/d11/d1f/d57/d72 241 1 2024-09-20T19:05:52.837 INFO:tasks.workunit.client.0.smithi027.stdout:5/254: rename d4/d3c/f47 to d4/da/d1a/f53 0 2024-09-20T19:05:52.840 INFO:tasks.workunit.client.0.smithi027.stdout:9/304: mkdir d0/d9/df/d1b/d64 0 2024-09-20T19:05:52.840 INFO:tasks.workunit.client.1.smithi098.stdout:9/377: dwrite d4/de/d27/f7a [0,4194304] 0 2024-09-20T19:05:52.841 INFO:tasks.workunit.client.0.smithi027.stdout:9/305: write d0/d9/df/d1b/f8 [2634659,3861] 0 2024-09-20T19:05:52.847 INFO:tasks.workunit.client.0.smithi027.stdout:3/228: dwrite d0/f41 [0,4194304] 0 2024-09-20T19:05:52.850 INFO:tasks.workunit.client.0.smithi027.stdout:2/156: truncate d3/de/f1f 3157028 0 2024-09-20T19:05:52.852 INFO:tasks.workunit.client.0.smithi027.stdout:2/157: write d3/f9 [2740065,42496] 0 2024-09-20T19:05:52.854 INFO:tasks.workunit.client.1.smithi098.stdout:6/202: rename d0/f8 to d0/d7/f3d 0 2024-09-20T19:05:52.855 INFO:tasks.workunit.client.1.smithi098.stdout:6/203: chown d0/c2f 0 1 2024-09-20T19:05:52.856 INFO:tasks.workunit.client.1.smithi098.stdout:6/204: chown d0/d7/dc/fd 1370491 1 2024-09-20T19:05:52.858 INFO:tasks.workunit.client.1.smithi098.stdout:2/549: dread d3/f4c [0,4194304] 0 2024-09-20T19:05:52.858 INFO:tasks.workunit.client.1.smithi098.stdout:9/378: mkdir d4/de/d27/d4a/d58/d81 0 2024-09-20T19:05:52.859 INFO:tasks.workunit.client.0.smithi027.stdout:5/255: dread d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:52.860 INFO:tasks.workunit.client.0.smithi027.stdout:8/174: truncate d2/d3/d6/f1a 3058528 0 2024-09-20T19:05:52.861 INFO:tasks.workunit.client.0.smithi027.stdout:8/175: write d2/d14/f27 [3280395,117071] 0 2024-09-20T19:05:52.862 INFO:tasks.workunit.client.1.smithi098.stdout:6/205: dread d0/de/f18 [0,4194304] 0 2024-09-20T19:05:52.862 INFO:tasks.workunit.client.0.smithi027.stdout:9/306: mknod d0/d9/df/d1b/d1a/c65 0 2024-09-20T19:05:52.864 INFO:tasks.workunit.client.1.smithi098.stdout:8/364: creat d7/de/d11/d1f/d77/f86 x:0 0 0 2024-09-20T19:05:52.864 INFO:tasks.workunit.client.0.smithi027.stdout:7/188: write f2 [2932609,44125] 0 2024-09-20T19:05:52.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/342: dwrite d3/d10/d16/d17/d33/d1f/d28/f61 [4194304,4194304] 0 2024-09-20T19:05:52.871 INFO:tasks.workunit.client.0.smithi027.stdout:2/158: creat d3/d13/f25 x:0 0 0 2024-09-20T19:05:52.875 INFO:tasks.workunit.client.1.smithi098.stdout:8/365: creat d7/de/d11/d19/d30/d55/f87 x:0 0 0 2024-09-20T19:05:52.880 INFO:tasks.workunit.client.1.smithi098.stdout:9/379: rename d4/de/d27/d4a/d21/l60 to d4/de/d27/d39/l82 0 2024-09-20T19:05:52.882 INFO:tasks.workunit.client.0.smithi027.stdout:8/176: rmdir d2/d3/d1b/d2d 39 2024-09-20T19:05:52.883 INFO:tasks.workunit.client.1.smithi098.stdout:8/366: mkdir d7/d88 0 2024-09-20T19:05:52.884 INFO:tasks.workunit.client.0.smithi027.stdout:9/307: rmdir d0/d2e 39 2024-09-20T19:05:52.885 INFO:tasks.workunit.client.0.smithi027.stdout:0/230: getdents d2/d14/d1d 0 2024-09-20T19:05:52.886 INFO:tasks.workunit.client.0.smithi027.stdout:0/231: chown d2/d14/d1d/f3d 739337424 1 2024-09-20T19:05:52.887 INFO:tasks.workunit.client.0.smithi027.stdout:7/189: rename f0 to d3/d1a/f42 0 2024-09-20T19:05:52.888 INFO:tasks.workunit.client.1.smithi098.stdout:9/380: symlink d4/de/d48/l83 0 2024-09-20T19:05:52.890 INFO:tasks.workunit.client.1.smithi098.stdout:2/550: getdents d3/d16/d1d/d2b/d46/d74 0 2024-09-20T19:05:52.891 INFO:tasks.workunit.client.0.smithi027.stdout:9/308: stat d0/d2e/f4a 0 2024-09-20T19:05:52.893 INFO:tasks.workunit.client.1.smithi098.stdout:6/206: getdents d0 0 2024-09-20T19:05:52.894 INFO:tasks.workunit.client.1.smithi098.stdout:6/207: write d0/d7/dc/f1a [191286,69069] 0 2024-09-20T19:05:52.894 INFO:tasks.workunit.client.1.smithi098.stdout:8/367: mkdir d7/de/d11/d89 0 2024-09-20T19:05:52.895 INFO:tasks.workunit.client.0.smithi027.stdout:9/309: dread d0/d9/df/f24 [0,4194304] 0 2024-09-20T19:05:52.895 INFO:tasks.workunit.client.0.smithi027.stdout:7/190: symlink d3/d1a/l43 0 2024-09-20T19:05:52.897 INFO:tasks.workunit.client.1.smithi098.stdout:8/368: dread d7/f61 [8388608,4194304] 0 2024-09-20T19:05:52.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/343: rename d3/d10/d16/d17/d33/d1f/l22 to d3/l6b 0 2024-09-20T19:05:52.900 INFO:tasks.workunit.client.1.smithi098.stdout:9/381: symlink d4/d74/l84 0 2024-09-20T19:05:52.903 INFO:tasks.workunit.client.1.smithi098.stdout:6/208: creat d0/d7/d24/f3e x:0 0 0 2024-09-20T19:05:52.905 INFO:tasks.workunit.client.0.smithi027.stdout:0/232: link d2/d20/d52/d29/f3b d2/d20/d52/f58 0 2024-09-20T19:05:52.906 INFO:tasks.workunit.client.1.smithi098.stdout:8/369: rmdir d7/de/d35 39 2024-09-20T19:05:52.906 INFO:tasks.workunit.client.1.smithi098.stdout:8/370: readlink d7/de/l28 0 2024-09-20T19:05:52.907 INFO:tasks.workunit.client.1.smithi098.stdout:8/371: chown d7/de/f3b 1120386 1 2024-09-20T19:05:52.908 INFO:tasks.workunit.client.0.smithi027.stdout:7/191: truncate d3/d8/da/dc/f1d 943878 0 2024-09-20T19:05:52.908 INFO:tasks.workunit.client.0.smithi027.stdout:7/192: chown d3/d8/da/dc/f1d 2361 1 2024-09-20T19:05:52.909 INFO:tasks.workunit.client.0.smithi027.stdout:7/193: chown d3/d8/d1c/l2a 2749994 1 2024-09-20T19:05:52.911 INFO:tasks.workunit.client.0.smithi027.stdout:3/229: getdents d0/d1/d7/d1d 0 2024-09-20T19:05:52.913 INFO:tasks.workunit.client.0.smithi027.stdout:5/256: getdents d4/da/de/d3e 0 2024-09-20T19:05:52.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/209: mknod d0/d7/d24/d29/c3f 0 2024-09-20T19:05:52.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/210: dread - d0/de/d1b/f39 zero size 2024-09-20T19:05:52.916 INFO:tasks.workunit.client.1.smithi098.stdout:2/551: mknod d3/db0/d69/d88/cb3 0 2024-09-20T19:05:52.919 INFO:tasks.workunit.client.0.smithi027.stdout:0/233: symlink d2/d20/d52/d29/l59 0 2024-09-20T19:05:52.920 INFO:tasks.workunit.client.0.smithi027.stdout:9/310: mkdir d0/d9/df/d1b/d1a/dd/d66 0 2024-09-20T19:05:52.921 INFO:tasks.workunit.client.0.smithi027.stdout:9/311: chown d0/d9/lb 95 1 2024-09-20T19:05:52.921 INFO:tasks.workunit.client.1.smithi098.stdout:6/211: rmdir d0/de/d1b 39 2024-09-20T19:05:52.922 INFO:tasks.workunit.client.0.smithi027.stdout:0/234: dread d2/d14/f31 [0,4194304] 0 2024-09-20T19:05:52.923 INFO:tasks.workunit.client.0.smithi027.stdout:3/230: mknod d0/d1/d13/d15/c4c 0 2024-09-20T19:05:52.923 INFO:tasks.workunit.client.0.smithi027.stdout:0/235: write d2/d20/d52/f15 [5171197,27944] 0 2024-09-20T19:05:52.928 INFO:tasks.workunit.client.1.smithi098.stdout:8/372: dread d7/f6e [0,4194304] 0 2024-09-20T19:05:52.928 INFO:tasks.workunit.client.1.smithi098.stdout:7/344: creat d3/d10/d16/f6c x:0 0 0 2024-09-20T19:05:52.929 INFO:tasks.workunit.client.1.smithi098.stdout:9/382: write f0 [3404578,15057] 0 2024-09-20T19:05:52.929 INFO:tasks.workunit.client.1.smithi098.stdout:8/373: readlink d7/de/d11/d1f/l40 0 2024-09-20T19:05:52.930 INFO:tasks.workunit.client.1.smithi098.stdout:2/552: dwrite d3/fd [0,4194304] 0 2024-09-20T19:05:52.930 INFO:tasks.workunit.client.0.smithi027.stdout:9/312: symlink d0/d9/d3d/d4f/l67 0 2024-09-20T19:05:52.931 INFO:tasks.workunit.client.1.smithi098.stdout:8/374: chown d7/fd 2 1 2024-09-20T19:05:52.931 INFO:tasks.workunit.client.1.smithi098.stdout:6/212: chown d0/de/d1b/l20 109015096 1 2024-09-20T19:05:52.934 INFO:tasks.workunit.client.0.smithi027.stdout:2/159: write d3/de/f1f [2963419,19514] 0 2024-09-20T19:05:52.937 INFO:tasks.workunit.client.0.smithi027.stdout:5/257: rename d4/da/f2b to d4/da/d50/f54 0 2024-09-20T19:05:52.939 INFO:tasks.workunit.client.1.smithi098.stdout:6/213: creat d0/de/d1b/d37/f40 x:0 0 0 2024-09-20T19:05:52.940 INFO:tasks.workunit.client.0.smithi027.stdout:7/194: creat d3/d8/da/f44 x:0 0 0 2024-09-20T19:05:52.944 INFO:tasks.workunit.client.0.smithi027.stdout:4/139: sync 2024-09-20T19:05:52.944 INFO:tasks.workunit.client.0.smithi027.stdout:1/189: sync 2024-09-20T19:05:52.944 INFO:tasks.workunit.client.0.smithi027.stdout:2/160: mkdir d3/d1c/d26 0 2024-09-20T19:05:52.945 INFO:tasks.workunit.client.0.smithi027.stdout:1/190: chown d2/d15/f25 4027 1 2024-09-20T19:05:52.945 INFO:tasks.workunit.client.1.smithi098.stdout:7/345: creat d3/d10/d16/d17/d33/d1f/f6d x:0 0 0 2024-09-20T19:05:52.947 INFO:tasks.workunit.client.1.smithi098.stdout:6/214: rename d0/d7/dc/f11 to d0/d7/dc/f41 0 2024-09-20T19:05:52.948 INFO:tasks.workunit.client.0.smithi027.stdout:4/140: dread d5/d11/f23 [0,4194304] 0 2024-09-20T19:05:52.948 INFO:tasks.workunit.client.1.smithi098.stdout:8/375: write d7/f8 [3369793,9188] 0 2024-09-20T19:05:52.948 INFO:tasks.workunit.client.1.smithi098.stdout:8/376: dread - d7/de/d11/d1d/f81 zero size 2024-09-20T19:05:52.949 INFO:tasks.workunit.client.1.smithi098.stdout:2/553: creat d3/d16/d1d/d2b/fb4 x:0 0 0 2024-09-20T19:05:52.951 INFO:tasks.workunit.client.0.smithi027.stdout:5/258: stat d4/da/de/c49 0 2024-09-20T19:05:52.952 INFO:tasks.workunit.client.0.smithi027.stdout:9/313: write d0/d9/df/f24 [835320,86332] 0 2024-09-20T19:05:52.954 INFO:tasks.workunit.client.1.smithi098.stdout:7/346: symlink d3/l6e 0 2024-09-20T19:05:52.955 INFO:tasks.workunit.client.0.smithi027.stdout:2/161: mkdir d3/de/d27 0 2024-09-20T19:05:52.956 INFO:tasks.workunit.client.1.smithi098.stdout:2/554: mkdir d3/d16/d1d/db5 0 2024-09-20T19:05:52.956 INFO:tasks.workunit.client.0.smithi027.stdout:1/191: rmdir d2 39 2024-09-20T19:05:52.957 INFO:tasks.workunit.client.1.smithi098.stdout:2/555: chown d3/d16/d1d/d2b/d46/d74/d82/la9 7760777 1 2024-09-20T19:05:52.958 INFO:tasks.workunit.client.1.smithi098.stdout:7/347: unlink d3/d10/d16/d17/l36 0 2024-09-20T19:05:52.959 INFO:tasks.workunit.client.1.smithi098.stdout:7/348: chown d3/d10/d18 2 1 2024-09-20T19:05:52.961 INFO:tasks.workunit.client.1.smithi098.stdout:2/556: unlink d3/d51/d68/f9a 0 2024-09-20T19:05:52.962 INFO:tasks.workunit.client.0.smithi027.stdout:4/141: symlink d5/d13/d16/l2f 0 2024-09-20T19:05:52.962 INFO:tasks.workunit.client.1.smithi098.stdout:8/377: write d7/de/d11/d19/f4a [382130,109313] 0 2024-09-20T19:05:52.964 INFO:tasks.workunit.client.0.smithi027.stdout:5/259: mkdir d4/da/de/d1e/d3d/d55 0 2024-09-20T19:05:52.967 INFO:tasks.workunit.client.1.smithi098.stdout:7/349: creat d3/d10/d16/d17/d33/d1f/d28/d66/f6f x:0 0 0 2024-09-20T19:05:52.967 INFO:tasks.workunit.client.0.smithi027.stdout:9/314: creat d0/d9/df/d1b/d1a/f68 x:0 0 0 2024-09-20T19:05:52.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/557: dwrite d3/d51/d68/fb1 [0,4194304] 0 2024-09-20T19:05:52.969 INFO:tasks.workunit.client.0.smithi027.stdout:9/315: read - d0/d9/df/d1b/d1a/dd/f5b zero size 2024-09-20T19:05:52.971 INFO:tasks.workunit.client.1.smithi098.stdout:7/350: symlink d3/d10/d16/d17/l70 0 2024-09-20T19:05:52.974 INFO:tasks.workunit.client.1.smithi098.stdout:2/558: fsync d3/db0/d69/d88/f98 0 2024-09-20T19:05:52.976 INFO:tasks.workunit.client.1.smithi098.stdout:2/559: stat d3/d16/d1d/l73 0 2024-09-20T19:05:52.976 INFO:tasks.workunit.client.1.smithi098.stdout:7/351: dread d3/d10/f13 [4194304,4194304] 0 2024-09-20T19:05:52.978 INFO:tasks.workunit.client.1.smithi098.stdout:8/378: link d7/fb d7/de/d11/d19/d30/d59/d80/f8a 0 2024-09-20T19:05:52.979 INFO:tasks.workunit.client.0.smithi027.stdout:0/236: getdents d2/d14/d1b 0 2024-09-20T19:05:52.980 INFO:tasks.workunit.client.0.smithi027.stdout:0/237: chown d2/d14/l21 754 1 2024-09-20T19:05:52.982 INFO:tasks.workunit.client.0.smithi027.stdout:4/142: creat d5/d13/f30 x:0 0 0 2024-09-20T19:05:52.982 INFO:tasks.workunit.client.0.smithi027.stdout:4/143: readlink d5/d13/l15 0 2024-09-20T19:05:52.983 INFO:tasks.workunit.client.0.smithi027.stdout:4/144: stat d5/l6 0 2024-09-20T19:05:52.984 INFO:tasks.workunit.client.1.smithi098.stdout:7/352: fdatasync d3/f2e 0 2024-09-20T19:05:52.986 INFO:tasks.workunit.client.0.smithi027.stdout:3/231: link d0/d1/l48 d0/l4d 0 2024-09-20T19:05:52.987 INFO:tasks.workunit.client.0.smithi027.stdout:3/232: stat d0/d1/d13/d15/f29 0 2024-09-20T19:05:52.987 INFO:tasks.workunit.client.1.smithi098.stdout:8/379: rmdir d7/de 39 2024-09-20T19:05:52.988 INFO:tasks.workunit.client.0.smithi027.stdout:2/162: dread d3/de/f18 [0,4194304] 0 2024-09-20T19:05:52.988 INFO:tasks.workunit.client.0.smithi027.stdout:2/163: stat d3/d13/c21 0 2024-09-20T19:05:52.989 INFO:tasks.workunit.client.1.smithi098.stdout:7/353: creat d3/d4c/f71 x:0 0 0 2024-09-20T19:05:52.989 INFO:tasks.workunit.client.0.smithi027.stdout:0/238: truncate d2/d14/f31 746544 0 2024-09-20T19:05:52.989 INFO:tasks.workunit.client.0.smithi027.stdout:2/164: write d3/d13/f25 [828627,30940] 0 2024-09-20T19:05:52.990 INFO:tasks.workunit.client.1.smithi098.stdout:2/560: symlink d3/d16/d1d/db5/lb6 0 2024-09-20T19:05:52.991 INFO:tasks.workunit.client.0.smithi027.stdout:4/145: symlink d5/d13/d16/l31 0 2024-09-20T19:05:52.992 INFO:tasks.workunit.client.0.smithi027.stdout:4/146: truncate d5/f1f 1006271 0 2024-09-20T19:05:52.993 INFO:tasks.workunit.client.0.smithi027.stdout:7/195: getdents d3/d8/d1c 0 2024-09-20T19:05:52.994 INFO:tasks.workunit.client.0.smithi027.stdout:4/147: truncate d5/d11/d17/d1b/f2b 30891 0 2024-09-20T19:05:52.996 INFO:tasks.workunit.client.1.smithi098.stdout:8/380: creat d7/de/d11/d19/d47/f8b x:0 0 0 2024-09-20T19:05:52.997 INFO:tasks.workunit.client.1.smithi098.stdout:7/354: creat d3/d10/d16/d17/d33/d1f/f72 x:0 0 0 2024-09-20T19:05:52.998 INFO:tasks.workunit.client.0.smithi027.stdout:1/192: truncate d2/d15/f22 825138 0 2024-09-20T19:05:52.999 INFO:tasks.workunit.client.0.smithi027.stdout:0/239: symlink d2/d49/l5a 0 2024-09-20T19:05:53.000 INFO:tasks.workunit.client.0.smithi027.stdout:0/240: chown d2/l4f 48 1 2024-09-20T19:05:53.000 INFO:tasks.workunit.client.1.smithi098.stdout:8/381: symlink d7/de/d11/d19/d30/d59/l8c 0 2024-09-20T19:05:53.001 INFO:tasks.workunit.client.0.smithi027.stdout:0/241: readlink d2/d20/d52/l11 0 2024-09-20T19:05:53.004 INFO:tasks.workunit.client.0.smithi027.stdout:5/260: rmdir d4/da/de/d1e/d3d/d55 0 2024-09-20T19:05:53.004 INFO:tasks.workunit.client.1.smithi098.stdout:2/561: dread d3/d16/f89 [0,4194304] 0 2024-09-20T19:05:53.004 INFO:tasks.workunit.client.0.smithi027.stdout:1/193: dwrite d2/d1b/d3a/f35 [0,4194304] 0 2024-09-20T19:05:53.005 INFO:tasks.workunit.client.0.smithi027.stdout:1/194: readlink d2/l2a 0 2024-09-20T19:05:53.005 INFO:tasks.workunit.client.1.smithi098.stdout:8/382: unlink d7/de/d11/d19/d30/f6f 0 2024-09-20T19:05:53.006 INFO:tasks.workunit.client.1.smithi098.stdout:2/562: truncate d3/d16/d1d/d2b/d99/f9d 799166 0 2024-09-20T19:05:53.007 INFO:tasks.workunit.client.0.smithi027.stdout:7/196: mkdir d3/d8/d26/d45 0 2024-09-20T19:05:53.008 INFO:tasks.workunit.client.1.smithi098.stdout:7/355: mkdir d3/d10/d16/d73 0 2024-09-20T19:05:53.011 INFO:tasks.workunit.client.0.smithi027.stdout:9/316: truncate d0/f5 1678822 0 2024-09-20T19:05:53.014 INFO:tasks.workunit.client.0.smithi027.stdout:1/195: dwrite d2/d8/d2b/d2d/f39 [0,4194304] 0 2024-09-20T19:05:53.016 INFO:tasks.workunit.client.0.smithi027.stdout:7/197: dread d3/d8/da/dc/f21 [0,4194304] 0 2024-09-20T19:05:53.017 INFO:tasks.workunit.client.1.smithi098.stdout:7/356: write d3/d10/d16/d17/d33/d1f/f3c [2459084,47217] 0 2024-09-20T19:05:53.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/357: chown d3/d10/d16/d17/d33/d1f/d28/l50 41180116 1 2024-09-20T19:05:53.019 INFO:tasks.workunit.client.0.smithi027.stdout:0/242: creat d2/d14/f5b x:0 0 0 2024-09-20T19:05:53.019 INFO:tasks.workunit.client.1.smithi098.stdout:7/358: dread - d3/d10/d18/f46 zero size 2024-09-20T19:05:53.020 INFO:tasks.workunit.client.1.smithi098.stdout:7/359: read - d3/d10/d18/f63 zero size 2024-09-20T19:05:53.020 INFO:tasks.workunit.client.0.smithi027.stdout:0/243: write d2/d14/d1d/d2e/f46 [888742,108015] 0 2024-09-20T19:05:53.021 INFO:tasks.workunit.client.1.smithi098.stdout:8/383: rename d7/de/d35/f5d to d7/de/d11/d1f/d57/d72/f8d 0 2024-09-20T19:05:53.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/563: symlink d3/d51/d9f/lb7 0 2024-09-20T19:05:53.024 INFO:tasks.workunit.client.0.smithi027.stdout:5/261: read d4/da/fb [1357049,79358] 0 2024-09-20T19:05:53.025 INFO:tasks.workunit.client.1.smithi098.stdout:8/384: fdatasync d7/fd 0 2024-09-20T19:05:53.025 INFO:tasks.workunit.client.1.smithi098.stdout:2/564: truncate d3/db0/f75 248868 0 2024-09-20T19:05:53.026 INFO:tasks.workunit.client.0.smithi027.stdout:5/262: write d4/da/f2c [3082904,130478] 0 2024-09-20T19:05:53.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/360: creat d3/d10/d16/d17/d33/d37/f74 x:0 0 0 2024-09-20T19:05:53.031 INFO:tasks.workunit.client.1.smithi098.stdout:2/565: read d3/df/d13/f2c [10180058,73727] 0 2024-09-20T19:05:53.031 INFO:tasks.workunit.client.1.smithi098.stdout:7/361: truncate d3/d10/d16/d17/d33/d1f/f44 306446 0 2024-09-20T19:05:53.032 INFO:tasks.workunit.client.1.smithi098.stdout:8/385: creat d7/de/d11/d19/d30/d82/f8e x:0 0 0 2024-09-20T19:05:53.033 INFO:tasks.workunit.client.0.smithi027.stdout:9/317: creat d0/d9/df/d1c/f69 x:0 0 0 2024-09-20T19:05:53.033 INFO:tasks.workunit.client.0.smithi027.stdout:3/233: dwrite d0/d19/f1a [0,4194304] 0 2024-09-20T19:05:53.034 INFO:tasks.workunit.client.0.smithi027.stdout:2/165: rmdir d3/de/d27 0 2024-09-20T19:05:53.035 INFO:tasks.workunit.client.0.smithi027.stdout:9/318: write d0/d9/df/f24 [1865949,84887] 0 2024-09-20T19:05:53.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/566: rename d3/d16/d1a/f37 to d3/d16/d1a/fb8 0 2024-09-20T19:05:53.038 INFO:tasks.workunit.client.0.smithi027.stdout:5/263: dwrite d4/da/d1a/f1b [0,4194304] 0 2024-09-20T19:05:53.038 INFO:tasks.workunit.client.0.smithi027.stdout:9/319: dread - d0/d9/f44 zero size 2024-09-20T19:05:53.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/362: dwrite d3/d10/d16/d17/d33/d1f/f43 [0,4194304] 0 2024-09-20T19:05:53.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/363: dread - d3/d10/d18/f63 zero size 2024-09-20T19:05:53.041 INFO:tasks.workunit.client.1.smithi098.stdout:8/386: symlink d7/de/d35/l8f 0 2024-09-20T19:05:53.041 INFO:tasks.workunit.client.1.smithi098.stdout:7/364: truncate d3/d10/d18/f4d 40191 0 2024-09-20T19:05:53.044 INFO:tasks.workunit.client.0.smithi027.stdout:0/244: truncate d2/f19 51756 0 2024-09-20T19:05:53.045 INFO:tasks.workunit.client.1.smithi098.stdout:2/567: creat d3/db0/d69/d88/d8a/fb9 x:0 0 0 2024-09-20T19:05:53.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/387: unlink d7/de/d11/d1f/c29 0 2024-09-20T19:05:53.049 INFO:tasks.workunit.client.1.smithi098.stdout:8/388: dread - d7/de/d11/d1f/d57/d72/f79 zero size 2024-09-20T19:05:53.051 INFO:tasks.workunit.client.1.smithi098.stdout:8/389: chown d7/de/d11/d19/l52 7053725 1 2024-09-20T19:05:53.055 INFO:tasks.workunit.client.0.smithi027.stdout:1/196: write d2/d1b/f1e [7575535,117091] 0 2024-09-20T19:05:53.056 INFO:tasks.workunit.client.1.smithi098.stdout:2/568: creat d3/db0/fba x:0 0 0 2024-09-20T19:05:53.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/390: symlink d7/de/d11/d19/d30/l90 0 2024-09-20T19:05:53.060 INFO:tasks.workunit.client.1.smithi098.stdout:2/569: mknod d3/d16/d1d/d2b/d46/d74/cbb 0 2024-09-20T19:05:53.067 INFO:tasks.workunit.client.1.smithi098.stdout:2/570: mkdir d3/d51/d9f/dbc 0 2024-09-20T19:05:53.069 INFO:tasks.workunit.client.1.smithi098.stdout:8/391: dwrite d7/de/d11/f60 [0,4194304] 0 2024-09-20T19:05:53.071 INFO:tasks.workunit.client.0.smithi027.stdout:6/119: sync 2024-09-20T19:05:53.071 INFO:tasks.workunit.client.0.smithi027.stdout:5/264: mknod d4/da/c56 0 2024-09-20T19:05:53.072 INFO:tasks.workunit.client.1.smithi098.stdout:2/571: mknod d3/d16/d1d/d2b/d46/d74/d7b/cbd 0 2024-09-20T19:05:53.073 INFO:tasks.workunit.client.0.smithi027.stdout:9/320: write d0/f42 [1059458,109935] 0 2024-09-20T19:05:53.074 INFO:tasks.workunit.client.0.smithi027.stdout:6/120: chown f0 136420596 1 2024-09-20T19:05:53.075 INFO:tasks.workunit.client.1.smithi098.stdout:8/392: rename d7/de/d11/d19/d30/l90 to d7/de/d11/d19/d30/d55/l91 0 2024-09-20T19:05:53.075 INFO:tasks.workunit.client.0.smithi027.stdout:1/197: dread d2/d8/f36 [0,4194304] 0 2024-09-20T19:05:53.077 INFO:tasks.workunit.client.0.smithi027.stdout:7/198: creat d3/d8/da/f46 x:0 0 0 2024-09-20T19:05:53.079 INFO:tasks.workunit.client.0.smithi027.stdout:7/199: truncate d3/d8/da/f44 273791 0 2024-09-20T19:05:53.079 INFO:tasks.workunit.client.1.smithi098.stdout:2/572: dwrite d3/df/f7a [0,4194304] 0 2024-09-20T19:05:53.083 INFO:tasks.workunit.client.0.smithi027.stdout:5/265: unlink d4/da/l3a 0 2024-09-20T19:05:53.084 INFO:tasks.workunit.client.0.smithi027.stdout:5/266: chown d4/da/de/l4e 9 1 2024-09-20T19:05:53.085 INFO:tasks.workunit.client.1.smithi098.stdout:5/267: sync 2024-09-20T19:05:53.085 INFO:tasks.workunit.client.0.smithi027.stdout:5/267: stat d4/da/c41 0 2024-09-20T19:05:53.086 INFO:tasks.workunit.client.0.smithi027.stdout:3/234: write d0/d1/d13/d3c/f42 [313471,24011] 0 2024-09-20T19:05:53.087 INFO:tasks.workunit.client.0.smithi027.stdout:9/321: unlink d0/d9/df/d1b/d1a/dd/l45 0 2024-09-20T19:05:53.088 INFO:tasks.workunit.client.1.smithi098.stdout:8/393: dread d7/de/d11/d19/d30/d55/f69 [0,4194304] 0 2024-09-20T19:05:53.089 INFO:tasks.workunit.client.0.smithi027.stdout:9/322: chown d0/d9/lb 616 1 2024-09-20T19:05:53.090 INFO:tasks.workunit.client.1.smithi098.stdout:8/394: readlink d7/de/d11/d1f/l6d 0 2024-09-20T19:05:53.090 INFO:tasks.workunit.client.0.smithi027.stdout:1/198: dread d2/d15/f22 [0,4194304] 0 2024-09-20T19:05:53.091 INFO:tasks.workunit.client.0.smithi027.stdout:7/200: rename d3/d8/da/dc/f3e to d3/d8/d1c/f47 0 2024-09-20T19:05:53.092 INFO:tasks.workunit.client.0.smithi027.stdout:1/199: chown d2/d1b/d3a/f35 0 1 2024-09-20T19:05:53.098 INFO:tasks.workunit.client.0.smithi027.stdout:6/121: creat d4/d1b/f1e x:0 0 0 2024-09-20T19:05:53.099 INFO:tasks.workunit.client.0.smithi027.stdout:6/122: write d4/d6/f19 [788639,122399] 0 2024-09-20T19:05:53.100 INFO:tasks.workunit.client.0.smithi027.stdout:5/268: creat d4/da/d1a/f57 x:0 0 0 2024-09-20T19:05:53.102 INFO:tasks.workunit.client.1.smithi098.stdout:5/268: write d1/d1b/f1c [682506,101119] 0 2024-09-20T19:05:53.103 INFO:tasks.workunit.client.1.smithi098.stdout:5/269: readlink d1/d1b/l30 0 2024-09-20T19:05:53.105 INFO:tasks.workunit.client.0.smithi027.stdout:9/323: rename d0/d9/df/d1b/d1a/dd/d58/d59 to d0/d9/df/d1c/d6a 0 2024-09-20T19:05:53.107 INFO:tasks.workunit.client.1.smithi098.stdout:8/395: dwrite d7/de/d11/d19/d47/f63 [0,4194304] 0 2024-09-20T19:05:53.107 INFO:tasks.workunit.client.0.smithi027.stdout:1/200: mkdir d2/d8/d3b 0 2024-09-20T19:05:53.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/396: readlink d7/de/d11/d1f/l6d 0 2024-09-20T19:05:53.111 INFO:tasks.workunit.client.1.smithi098.stdout:8/397: stat d7/de/d11/d1f/d57/d72/f75 0 2024-09-20T19:05:53.111 INFO:tasks.workunit.client.0.smithi027.stdout:6/123: creat d4/d1b/f1f x:0 0 0 2024-09-20T19:05:53.112 INFO:tasks.workunit.client.1.smithi098.stdout:2/573: dread d3/d16/d1d/f4e [0,4194304] 0 2024-09-20T19:05:53.113 INFO:tasks.workunit.client.1.smithi098.stdout:8/398: unlink d7/de/l43 0 2024-09-20T19:05:53.114 INFO:tasks.workunit.client.1.smithi098.stdout:5/270: mknod d1/d17/c50 0 2024-09-20T19:05:53.117 INFO:tasks.workunit.client.0.smithi027.stdout:6/124: dread d4/f14 [0,4194304] 0 2024-09-20T19:05:53.117 INFO:tasks.workunit.client.0.smithi027.stdout:0/245: dread d2/f19 [0,4194304] 0 2024-09-20T19:05:53.118 INFO:tasks.workunit.client.1.smithi098.stdout:8/399: unlink d7/c3d 0 2024-09-20T19:05:53.119 INFO:tasks.workunit.client.1.smithi098.stdout:8/400: fsync d7/de/d11/d1d/f7c 0 2024-09-20T19:05:53.119 INFO:tasks.workunit.client.0.smithi027.stdout:1/201: dwrite d2/d1b/d3a/f30 [0,4194304] 0 2024-09-20T19:05:53.119 INFO:tasks.workunit.client.0.smithi027.stdout:5/269: symlink d4/l58 0 2024-09-20T19:05:53.120 INFO:tasks.workunit.client.0.smithi027.stdout:0/246: write d2/d14/f5b [719187,60838] 0 2024-09-20T19:05:53.120 INFO:tasks.workunit.client.1.smithi098.stdout:5/271: dread - d1/d17/d25/f3d zero size 2024-09-20T19:05:53.121 INFO:tasks.workunit.client.1.smithi098.stdout:2/574: creat d3/d51/d9f/dbc/fbe x:0 0 0 2024-09-20T19:05:53.122 INFO:tasks.workunit.client.1.smithi098.stdout:8/401: truncate d7/de/d11/f7a 866675 0 2024-09-20T19:05:53.122 INFO:tasks.workunit.client.0.smithi027.stdout:9/324: mknod d0/c6b 0 2024-09-20T19:05:53.124 INFO:tasks.workunit.client.1.smithi098.stdout:5/272: creat d1/d17/d2e/f51 x:0 0 0 2024-09-20T19:05:53.124 INFO:tasks.workunit.client.1.smithi098.stdout:5/273: fdatasync d1/f2 0 2024-09-20T19:05:53.125 INFO:tasks.workunit.client.0.smithi027.stdout:6/125: symlink d4/d6/l20 0 2024-09-20T19:05:53.127 INFO:tasks.workunit.client.0.smithi027.stdout:0/247: dread d2/d20/d52/fd [4194304,4194304] 0 2024-09-20T19:05:53.127 INFO:tasks.workunit.client.1.smithi098.stdout:8/402: unlink d7/de/d11/d1d/c85 0 2024-09-20T19:05:53.128 INFO:tasks.workunit.client.0.smithi027.stdout:0/248: write d2/d14/f5b [861399,90902] 0 2024-09-20T19:05:53.129 INFO:tasks.workunit.client.0.smithi027.stdout:6/126: read d4/d6/f19 [402844,28835] 0 2024-09-20T19:05:53.129 INFO:tasks.workunit.client.0.smithi027.stdout:0/249: dread - d2/d14/d1b/d39/f57 zero size 2024-09-20T19:05:53.133 INFO:tasks.workunit.client.1.smithi098.stdout:5/274: rename d1/d17/d25/l29 to d1/d17/d25/l52 0 2024-09-20T19:05:53.139 INFO:tasks.workunit.client.0.smithi027.stdout:7/201: truncate d3/f36 417841 0 2024-09-20T19:05:53.141 INFO:tasks.workunit.client.0.smithi027.stdout:6/127: symlink d4/d15/l21 0 2024-09-20T19:05:53.141 INFO:tasks.workunit.client.0.smithi027.stdout:7/202: dread d3/d8/da/f44 [0,4194304] 0 2024-09-20T19:05:53.141 INFO:tasks.workunit.client.1.smithi098.stdout:2/575: getdents d3/df 0 2024-09-20T19:05:53.142 INFO:tasks.workunit.client.0.smithi027.stdout:0/250: mknod d2/d14/d1d/c5c 0 2024-09-20T19:05:53.144 INFO:tasks.workunit.client.1.smithi098.stdout:8/403: creat d7/de/f92 x:0 0 0 2024-09-20T19:05:53.144 INFO:tasks.workunit.client.0.smithi027.stdout:6/128: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:53.145 INFO:tasks.workunit.client.0.smithi027.stdout:9/325: creat d0/d9/df/d1b/d64/f6c x:0 0 0 2024-09-20T19:05:53.145 INFO:tasks.workunit.client.0.smithi027.stdout:6/129: write d4/d1b/f1f [989299,1625] 0 2024-09-20T19:05:53.146 INFO:tasks.workunit.client.1.smithi098.stdout:2/576: creat d3/d16/d1a/fbf x:0 0 0 2024-09-20T19:05:53.149 INFO:tasks.workunit.client.1.smithi098.stdout:2/577: fdatasync d3/d16/d1d/d2b/d46/fa1 0 2024-09-20T19:05:53.151 INFO:tasks.workunit.client.1.smithi098.stdout:5/275: write d1/d17/d25/f3b [230452,4736] 0 2024-09-20T19:05:53.153 INFO:tasks.workunit.client.0.smithi027.stdout:7/203: truncate d3/d8/f20 5186437 0 2024-09-20T19:05:53.153 INFO:tasks.workunit.client.0.smithi027.stdout:6/130: dwrite d4/f7 [4194304,4194304] 0 2024-09-20T19:05:53.154 INFO:tasks.workunit.client.1.smithi098.stdout:2/578: mkdir d3/d16/d1d/d2b/d46/dc0 0 2024-09-20T19:05:53.156 INFO:tasks.workunit.client.0.smithi027.stdout:0/251: unlink d2/d20/d52/f4e 0 2024-09-20T19:05:53.157 INFO:tasks.workunit.client.0.smithi027.stdout:0/252: fsync d2/d14/f3f 0 2024-09-20T19:05:53.157 INFO:tasks.workunit.client.1.smithi098.stdout:8/404: creat d7/de/f93 x:0 0 0 2024-09-20T19:05:53.158 INFO:tasks.workunit.client.0.smithi027.stdout:1/202: truncate d2/d8/f36 1237447 0 2024-09-20T19:05:53.158 INFO:tasks.workunit.client.0.smithi027.stdout:0/253: fsync d2/d20/f44 0 2024-09-20T19:05:53.159 INFO:tasks.workunit.client.1.smithi098.stdout:8/405: dread - d7/de/d11/d19/d30/d68/f6c zero size 2024-09-20T19:05:53.159 INFO:tasks.workunit.client.0.smithi027.stdout:0/254: readlink d2/d20/l28 0 2024-09-20T19:05:53.160 INFO:tasks.workunit.client.1.smithi098.stdout:5/276: write d1/d17/d25/f3a [951274,112165] 0 2024-09-20T19:05:53.161 INFO:tasks.workunit.client.0.smithi027.stdout:5/270: getdents d4/da/d1a 0 2024-09-20T19:05:53.164 INFO:tasks.workunit.client.0.smithi027.stdout:9/326: rename d0/d9/df/d1b/d1a to d0/d9/df/d1c/d6a/d6d 0 2024-09-20T19:05:53.165 INFO:tasks.workunit.client.1.smithi098.stdout:5/277: mknod d1/d46/c53 0 2024-09-20T19:05:53.166 INFO:tasks.workunit.client.0.smithi027.stdout:1/203: dwrite d2/d1b/d3a/f30 [0,4194304] 0 2024-09-20T19:05:53.168 INFO:tasks.workunit.client.1.smithi098.stdout:5/278: mkdir d1/d17/d35/d54 0 2024-09-20T19:05:53.170 INFO:tasks.workunit.client.0.smithi027.stdout:7/204: symlink d3/d8/da/d2e/l48 0 2024-09-20T19:05:53.175 INFO:tasks.workunit.client.0.smithi027.stdout:6/131: mkdir d4/d1b/d22 0 2024-09-20T19:05:53.179 INFO:tasks.workunit.client.0.smithi027.stdout:0/255: rename d2/d49/l5a to d2/d48/l5d 0 2024-09-20T19:05:53.179 INFO:tasks.workunit.client.1.smithi098.stdout:2/579: write d3/db0/d69/fb2 [4597949,24606] 0 2024-09-20T19:05:53.180 INFO:tasks.workunit.client.0.smithi027.stdout:0/256: chown d2/d20/d52/d29/l2a 7 1 2024-09-20T19:05:53.180 INFO:tasks.workunit.client.1.smithi098.stdout:5/279: creat d1/d17/f55 x:0 0 0 2024-09-20T19:05:53.183 INFO:tasks.workunit.client.0.smithi027.stdout:1/204: unlink d2/d15/f25 0 2024-09-20T19:05:53.184 INFO:tasks.workunit.client.1.smithi098.stdout:5/280: mkdir d1/d17/d25/d56 0 2024-09-20T19:05:53.187 INFO:tasks.workunit.client.1.smithi098.stdout:2/580: rename d3/c5 to d3/d16/d1d/d4f/cc1 0 2024-09-20T19:05:53.188 INFO:tasks.workunit.client.0.smithi027.stdout:7/205: mkdir d3/d8/da/d2e/d49 0 2024-09-20T19:05:53.189 INFO:tasks.workunit.client.0.smithi027.stdout:7/206: write d3/d1a/f3a [2638505,68261] 0 2024-09-20T19:05:53.189 INFO:tasks.workunit.client.1.smithi098.stdout:5/281: chown d1/c1d 5570389 1 2024-09-20T19:05:53.190 INFO:tasks.workunit.client.1.smithi098.stdout:5/282: fdatasync d1/d17/f1a 0 2024-09-20T19:05:53.190 INFO:tasks.workunit.client.0.smithi027.stdout:6/132: mknod d4/d6/c23 0 2024-09-20T19:05:53.191 INFO:tasks.workunit.client.1.smithi098.stdout:5/283: read d1/d17/d25/f3a [1023519,68123] 0 2024-09-20T19:05:53.192 INFO:tasks.workunit.client.0.smithi027.stdout:9/327: mknod d0/d9/df/d1c/d6a/d6d/dd/c6e 0 2024-09-20T19:05:53.193 INFO:tasks.workunit.client.0.smithi027.stdout:9/328: fdatasync d0/d9/f44 0 2024-09-20T19:05:53.194 INFO:tasks.workunit.client.0.smithi027.stdout:1/205: mknod d2/d1b/d3a/d21/c3c 0 2024-09-20T19:05:53.195 INFO:tasks.workunit.client.1.smithi098.stdout:5/284: creat d1/d46/f57 x:0 0 0 2024-09-20T19:05:53.197 INFO:tasks.workunit.client.0.smithi027.stdout:7/207: creat d3/d8/d26/f4a x:0 0 0 2024-09-20T19:05:53.198 INFO:tasks.workunit.client.1.smithi098.stdout:5/285: dread d1/d17/f1a [0,4194304] 0 2024-09-20T19:05:53.198 INFO:tasks.workunit.client.0.smithi027.stdout:6/133: symlink d4/d15/l24 0 2024-09-20T19:05:53.199 INFO:tasks.workunit.client.0.smithi027.stdout:7/208: readlink d3/d8/da/dc/l3c 0 2024-09-20T19:05:53.200 INFO:tasks.workunit.client.0.smithi027.stdout:6/134: write d4/d6/fa [2425477,101235] 0 2024-09-20T19:05:53.202 INFO:tasks.workunit.client.0.smithi027.stdout:6/135: fdatasync d4/f7 0 2024-09-20T19:05:53.202 INFO:tasks.workunit.client.0.smithi027.stdout:7/209: chown d3/d8/d1c/l38 111101765 1 2024-09-20T19:05:53.202 INFO:tasks.workunit.client.0.smithi027.stdout:0/257: creat d2/f5e x:0 0 0 2024-09-20T19:05:53.203 INFO:tasks.workunit.client.0.smithi027.stdout:9/329: dwrite d0/d9/d3d/f54 [0,4194304] 0 2024-09-20T19:05:53.205 INFO:tasks.workunit.client.0.smithi027.stdout:9/330: write d0/f42 [1163079,113662] 0 2024-09-20T19:05:53.207 INFO:tasks.workunit.client.0.smithi027.stdout:1/206: rename d2/d8/la to d2/d1b/d3a/d21/l3d 0 2024-09-20T19:05:53.211 INFO:tasks.workunit.client.0.smithi027.stdout:7/210: mknod d3/d1a/c4b 0 2024-09-20T19:05:53.211 INFO:tasks.workunit.client.1.smithi098.stdout:2/581: dread d3/df/d13/f32 [0,4194304] 0 2024-09-20T19:05:53.212 INFO:tasks.workunit.client.1.smithi098.stdout:2/582: chown d3/f15 2306 1 2024-09-20T19:05:53.213 INFO:tasks.workunit.client.0.smithi027.stdout:0/258: creat d2/d14/d1b/f5f x:0 0 0 2024-09-20T19:05:53.213 INFO:tasks.workunit.client.1.smithi098.stdout:2/583: truncate d3/df/f11 1798746 0 2024-09-20T19:05:53.215 INFO:tasks.workunit.client.1.smithi098.stdout:2/584: write d3/d51/d9f/dbc/fbe [715184,23030] 0 2024-09-20T19:05:53.216 INFO:tasks.workunit.client.0.smithi027.stdout:1/207: mkdir d2/d8/d2b/d2d/d3e 0 2024-09-20T19:05:53.220 INFO:tasks.workunit.client.1.smithi098.stdout:2/585: rename d3/f9 to d3/d16/d1d/d4f/d8b/d38/fc2 0 2024-09-20T19:05:53.221 INFO:tasks.workunit.client.0.smithi027.stdout:0/259: symlink d2/d49/l60 0 2024-09-20T19:05:53.223 INFO:tasks.workunit.client.0.smithi027.stdout:4/148: sync 2024-09-20T19:05:53.223 INFO:tasks.workunit.client.0.smithi027.stdout:8/177: sync 2024-09-20T19:05:53.223 INFO:tasks.workunit.client.1.smithi098.stdout:5/286: dread d1/f9 [0,4194304] 0 2024-09-20T19:05:53.225 INFO:tasks.workunit.client.1.smithi098.stdout:5/287: chown d1/d17/d25/f3b 5 1 2024-09-20T19:05:53.225 INFO:tasks.workunit.client.0.smithi027.stdout:6/136: rmdir d4/d1b/d22 0 2024-09-20T19:05:53.226 INFO:tasks.workunit.client.0.smithi027.stdout:6/137: chown d4/d6/l20 269 1 2024-09-20T19:05:53.228 INFO:tasks.workunit.client.0.smithi027.stdout:7/211: truncate d3/f12 3194735 0 2024-09-20T19:05:53.228 INFO:tasks.workunit.client.0.smithi027.stdout:7/212: fsync d3/d8/da/f28 0 2024-09-20T19:05:53.229 INFO:tasks.workunit.client.1.smithi098.stdout:5/288: creat d1/d17/d25/f58 x:0 0 0 2024-09-20T19:05:53.229 INFO:tasks.workunit.client.0.smithi027.stdout:7/213: chown d3/d8/da/dc/f1d 910745164 1 2024-09-20T19:05:53.230 INFO:tasks.workunit.client.0.smithi027.stdout:0/260: rename d2/d48/f55 to d2/d20/d52/d29/f61 0 2024-09-20T19:05:53.231 INFO:tasks.workunit.client.1.smithi098.stdout:2/586: creat d3/d51/fc3 x:0 0 0 2024-09-20T19:05:53.233 INFO:tasks.workunit.client.0.smithi027.stdout:4/149: mkdir d5/d11/d17/d32 0 2024-09-20T19:05:53.234 INFO:tasks.workunit.client.0.smithi027.stdout:0/261: dread d2/d20/d52/d29/f3b [0,4194304] 0 2024-09-20T19:05:53.235 INFO:tasks.workunit.client.0.smithi027.stdout:1/208: unlink d2/d8/f36 0 2024-09-20T19:05:53.237 INFO:tasks.workunit.client.1.smithi098.stdout:2/587: write d3/d16/f89 [4365453,49663] 0 2024-09-20T19:05:53.238 INFO:tasks.workunit.client.1.smithi098.stdout:5/289: mkdir d1/d17/d59 0 2024-09-20T19:05:53.239 INFO:tasks.workunit.client.0.smithi027.stdout:6/138: mknod d4/d1b/c25 0 2024-09-20T19:05:53.241 INFO:tasks.workunit.client.1.smithi098.stdout:5/290: creat d1/d1b/f5a x:0 0 0 2024-09-20T19:05:53.241 INFO:tasks.workunit.client.1.smithi098.stdout:5/291: read - d1/d17/d2e/f51 zero size 2024-09-20T19:05:53.242 INFO:tasks.workunit.client.1.smithi098.stdout:2/588: symlink d3/d16/d1d/d2b/d46/dc0/lc4 0 2024-09-20T19:05:53.242 INFO:tasks.workunit.client.0.smithi027.stdout:0/262: dwrite d2/d20/f47 [0,4194304] 0 2024-09-20T19:05:53.242 INFO:tasks.workunit.client.1.smithi098.stdout:5/292: chown d1/c1d 7754224 1 2024-09-20T19:05:53.243 INFO:tasks.workunit.client.1.smithi098.stdout:2/589: write d3/d16/d1a/fbf [669095,125777] 0 2024-09-20T19:05:53.245 INFO:tasks.workunit.client.0.smithi027.stdout:4/150: creat d5/d13/d16/d21/f33 x:0 0 0 2024-09-20T19:05:53.247 INFO:tasks.workunit.client.0.smithi027.stdout:4/151: readlink d5/d13/d16/d21/d26/l2c 0 2024-09-20T19:05:53.249 INFO:tasks.workunit.client.1.smithi098.stdout:2/590: chown d3/d16/d1d/d4f/d8b/d38/l81 2085970 1 2024-09-20T19:05:53.250 INFO:tasks.workunit.client.1.smithi098.stdout:2/591: truncate d3/fd 4968691 0 2024-09-20T19:05:53.252 INFO:tasks.workunit.client.0.smithi027.stdout:0/263: dwrite d2/d14/d1b/f2b [0,4194304] 0 2024-09-20T19:05:53.254 INFO:tasks.workunit.client.0.smithi027.stdout:6/139: symlink d4/d15/l26 0 2024-09-20T19:05:53.261 INFO:tasks.workunit.client.1.smithi098.stdout:5/293: getdents d1/d1b 0 2024-09-20T19:05:53.262 INFO:tasks.workunit.client.1.smithi098.stdout:2/592: getdents d3/d16/d1d/d2b/d46/d74/d82 0 2024-09-20T19:05:53.262 INFO:tasks.workunit.client.1.smithi098.stdout:5/294: dread - d1/d1b/f5a zero size 2024-09-20T19:05:53.264 INFO:tasks.workunit.client.0.smithi027.stdout:6/140: mknod d4/d6/c27 0 2024-09-20T19:05:53.265 INFO:tasks.workunit.client.1.smithi098.stdout:5/295: chown d1/f33 3728 1 2024-09-20T19:05:53.266 INFO:tasks.workunit.client.0.smithi027.stdout:8/178: truncate d2/d3/d6/d21/f38 1691762 0 2024-09-20T19:05:53.267 INFO:tasks.workunit.client.0.smithi027.stdout:8/179: chown d2/d14/d13/f22 10138615 1 2024-09-20T19:05:53.268 INFO:tasks.workunit.client.0.smithi027.stdout:8/180: write d2/d3/d1b/f26 [945888,46743] 0 2024-09-20T19:05:53.268 INFO:tasks.workunit.client.1.smithi098.stdout:5/296: symlink d1/d1b/l5b 0 2024-09-20T19:05:53.271 INFO:tasks.workunit.client.0.smithi027.stdout:1/209: truncate d2/d1b/f2e 417476 0 2024-09-20T19:05:53.275 INFO:tasks.workunit.client.1.smithi098.stdout:2/593: link l0 d3/d16/d1d/d2b/d99/lc5 0 2024-09-20T19:05:53.277 INFO:tasks.workunit.client.0.smithi027.stdout:7/214: dwrite d3/d8/da/dc/f21 [4194304,4194304] 0 2024-09-20T19:05:53.277 INFO:tasks.workunit.client.0.smithi027.stdout:6/141: chown d4/d15/c1d 31802 1 2024-09-20T19:05:53.278 INFO:tasks.workunit.client.0.smithi027.stdout:4/152: truncate d5/d13/d16/f22 243658 0 2024-09-20T19:05:53.283 INFO:tasks.workunit.client.0.smithi027.stdout:7/215: creat d3/d8/da/d2e/f4c x:0 0 0 2024-09-20T19:05:53.285 INFO:tasks.workunit.client.0.smithi027.stdout:4/153: rmdir d5/d11/d1a 39 2024-09-20T19:05:53.287 INFO:tasks.workunit.client.0.smithi027.stdout:1/210: dwrite d2/d1b/d3a/f30 [0,4194304] 0 2024-09-20T19:05:53.287 INFO:tasks.workunit.client.0.smithi027.stdout:4/154: fdatasync d5/f1e 0 2024-09-20T19:05:53.287 INFO:tasks.workunit.client.0.smithi027.stdout:0/264: truncate d2/d14/d1b/f2b 3629428 0 2024-09-20T19:05:53.289 INFO:tasks.workunit.client.1.smithi098.stdout:5/297: dwrite d1/d17/f1e [0,4194304] 0 2024-09-20T19:05:53.291 INFO:tasks.workunit.client.1.smithi098.stdout:2/594: truncate d3/d16/d1a/fb8 2571520 0 2024-09-20T19:05:53.294 INFO:tasks.workunit.client.0.smithi027.stdout:6/142: dwrite f0 [0,4194304] 0 2024-09-20T19:05:53.295 INFO:tasks.workunit.client.0.smithi027.stdout:0/265: rmdir d2/d49 39 2024-09-20T19:05:53.297 INFO:tasks.workunit.client.0.smithi027.stdout:1/211: truncate d2/d8/f20 1011256 0 2024-09-20T19:05:53.299 INFO:tasks.workunit.client.0.smithi027.stdout:6/143: mkdir d4/d28 0 2024-09-20T19:05:53.303 INFO:tasks.workunit.client.0.smithi027.stdout:0/266: mknod d2/d14/d1d/d2e/c62 0 2024-09-20T19:05:53.304 INFO:tasks.workunit.client.0.smithi027.stdout:7/216: dwrite d3/d8/d1c/f47 [0,4194304] 0 2024-09-20T19:05:53.307 INFO:tasks.workunit.client.0.smithi027.stdout:0/267: chown d2/d20/d52/d29/l59 11 1 2024-09-20T19:05:53.310 INFO:tasks.workunit.client.0.smithi027.stdout:3/235: sync 2024-09-20T19:05:53.310 INFO:tasks.workunit.client.0.smithi027.stdout:2/166: sync 2024-09-20T19:05:53.312 INFO:tasks.workunit.client.0.smithi027.stdout:2/167: chown d3/de/f18 25726896 1 2024-09-20T19:05:53.313 INFO:tasks.workunit.client.1.smithi098.stdout:5/298: dread d1/fc [0,4194304] 0 2024-09-20T19:05:53.314 INFO:tasks.workunit.client.0.smithi027.stdout:7/217: dread d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:53.314 INFO:tasks.workunit.client.0.smithi027.stdout:2/168: write d3/f9 [3484602,39888] 0 2024-09-20T19:05:53.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/299: truncate d1/d17/d25/f3b 755367 0 2024-09-20T19:05:53.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/300: dread - d1/d1b/f5a zero size 2024-09-20T19:05:53.344 INFO:tasks.workunit.client.0.smithi027.stdout:9/331: sync 2024-09-20T19:05:53.344 INFO:tasks.workunit.client.0.smithi027.stdout:5/271: sync 2024-09-20T19:05:53.345 INFO:tasks.workunit.client.0.smithi027.stdout:9/332: dread - d0/d9/df/d1c/d6a/d6d/f36 zero size 2024-09-20T19:05:53.354 INFO:tasks.workunit.client.0.smithi027.stdout:9/333: dwrite d0/d9/df/d1c/d6a/d6d/f36 [0,4194304] 0 2024-09-20T19:05:53.359 INFO:tasks.workunit.client.0.smithi027.stdout:9/334: dread d0/d9/df/f50 [0,4194304] 0 2024-09-20T19:05:53.359 INFO:tasks.workunit.client.0.smithi027.stdout:9/335: chown d0/d2e/f34 5726 1 2024-09-20T19:05:53.360 INFO:tasks.workunit.client.0.smithi027.stdout:9/336: chown d0/d9/df/d1b/c18 1539141 1 2024-09-20T19:05:53.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/319: sync 2024-09-20T19:05:53.370 INFO:tasks.workunit.client.1.smithi098.stdout:0/214: sync 2024-09-20T19:05:53.370 INFO:tasks.workunit.client.1.smithi098.stdout:3/264: sync 2024-09-20T19:05:53.379 INFO:tasks.workunit.client.1.smithi098.stdout:0/215: dwrite d0/db/d32/f3a [0,4194304] 0 2024-09-20T19:05:53.379 INFO:tasks.workunit.client.0.smithi027.stdout:6/144: creat d4/d1b/f29 x:0 0 0 2024-09-20T19:05:53.387 INFO:tasks.workunit.client.1.smithi098.stdout:3/265: rmdir d4/d25/d40 39 2024-09-20T19:05:53.389 INFO:tasks.workunit.client.1.smithi098.stdout:2/595: write d3/d16/f83 [2524363,81762] 0 2024-09-20T19:05:53.394 INFO:tasks.workunit.client.1.smithi098.stdout:5/301: dread d1/d17/d25/f3a [0,4194304] 0 2024-09-20T19:05:53.395 INFO:tasks.workunit.client.1.smithi098.stdout:5/302: read - d1/d1b/f4a zero size 2024-09-20T19:05:53.396 INFO:tasks.workunit.client.1.smithi098.stdout:5/303: truncate d1/d17/d25/f48 274470 0 2024-09-20T19:05:53.397 INFO:tasks.workunit.client.0.smithi027.stdout:3/236: creat d0/d1/d7/d1d/f4e x:0 0 0 2024-09-20T19:05:53.398 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:53 smithi027 ceph-mon[28196]: [20/Sep/2024:19:05:52] ENGINE Bus STARTING 2024-09-20T19:05:53.398 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:53 smithi027 ceph-mon[28196]: [20/Sep/2024:19:05:52] ENGINE Serving on http://172.21.15.98:8765 2024-09-20T19:05:53.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 -- 172.21.15.27:0/3092597680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 msgr2=0x7f9e5c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 --2- 172.21.15.27:0/3092597680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c100c60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009c20 tx=0x7f9e4c02a970 comp rx=0 tx=0).stop 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 -- 172.21.15.27:0/3092597680 shutdown_connections 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 --2- 172.21.15.27:0/3092597680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 0x7f9e5c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 --2- 172.21.15.27:0/3092597680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c100c60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.392+0000 7f9e63319640 1 -- 172.21.15.27:0/3092597680 >> 172.21.15.27:0/3092597680 conn(0x7f9e5c0fbff0 msgr2=0x7f9e5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.393+0000 7f9e63319640 1 -- 172.21.15.27:0/3092597680 shutdown_connections 2024-09-20T19:05:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.393+0000 7f9e63319640 1 -- 172.21.15.27:0/3092597680 wait complete. 2024-09-20T19:05:53.399 INFO:tasks.workunit.client.0.smithi027.stdout:0/268: dread d2/d14/f31 [0,4194304] 0 2024-09-20T19:05:53.400 INFO:tasks.workunit.client.0.smithi027.stdout:0/269: fsync d2/d14/f5b 0 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.393+0000 7f9e63319640 1 Processor -- start 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e63319640 1 -- start start 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e63319640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e63319640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 0x7f9e5c10d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e63319640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c107920 con 0x7f9e5c100860 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e63319640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c1077a0 con 0x7f9e5c101a60 2024-09-20T19:05:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e610b5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e610b5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35356/0 (socket says 172.21.15.27:35356) 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e610b5640 1 -- 172.21.15.27:0/2445438076 learned_addr learned my addr 172.21.15.27:0/2445438076 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.394+0000 7f9e608b4640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 0x7f9e5c10d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e610b5640 1 -- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 msgr2=0x7f9e5c10d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e610b5640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 0x7f9e5c10d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e610b5640 1 -- 172.21.15.27:0/2445438076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c109f80 con 0x7f9e5c100860 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e610b5640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c031fd0 tx=0x7f9e4c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e4c047070 con 0x7f9e5c100860 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e4c003e30 con 0x7f9e5c100860 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e4c034070 con 0x7f9e5c100860 2024-09-20T19:05:53.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.395+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c10a210 con 0x7f9e5c100860 2024-09-20T19:05:53.403 INFO:tasks.workunit.client.0.smithi027.stdout:0/270: dread d2/d20/d52/d29/f3b [0,4194304] 0 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.396+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c10a7c0 con 0x7f9e5c100860 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.397+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5c0a12f0 con 0x7f9e5c100860 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.397+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 23) ==== 52072+0+0 (secure 0 0 0) 0x7f9e4c04a070 con 0x7f9e5c100860 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.397+0000 7f9e5a7fc640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 0x7f9e44042020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.398+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f9e4c076790 con 0x7f9e5c100860 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.398+0000 7f9e608b4640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 0x7f9e44042020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.399+0000 7f9e608b4640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 0x7f9e44042020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c10b380 tx=0x7f9e50005f90 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:53.405 INFO:tasks.workunit.client.1.smithi098.stdout:3/266: write d4/fd [4721101,96211] 0 2024-09-20T19:05:53.405 INFO:tasks.workunit.client.1.smithi098.stdout:3/267: write d4/f10 [4439519,110133] 0 2024-09-20T19:05:53.405 INFO:tasks.workunit.client.1.smithi098.stdout:2/596: creat d3/d51/d9f/fc6 x:0 0 0 2024-09-20T19:05:53.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.404+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9e4c03f070 con 0x7f9e5c100860 2024-09-20T19:05:53.411 INFO:tasks.workunit.client.0.smithi027.stdout:5/272: creat d4/da/de/d3e/f59 x:0 0 0 2024-09-20T19:05:53.412 INFO:tasks.workunit.client.1.smithi098.stdout:4/320: truncate d3/fc 6772168 0 2024-09-20T19:05:53.412 INFO:tasks.workunit.client.1.smithi098.stdout:4/321: chown d3/d4f/f72 3959787 1 2024-09-20T19:05:53.412 INFO:tasks.workunit.client.1.smithi098.stdout:3/268: rmdir d4/d19/d1d/d22 39 2024-09-20T19:05:53.413 INFO:tasks.workunit.client.0.smithi027.stdout:2/169: write d3/ff [1220700,39511] 0 2024-09-20T19:05:53.413 INFO:tasks.workunit.client.1.smithi098.stdout:4/322: read d3/d6/d3e/d3c/d6b/f74 [708206,69767] 0 2024-09-20T19:05:53.415 INFO:tasks.workunit.client.0.smithi027.stdout:5/273: dread d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:53.416 INFO:tasks.workunit.client.1.smithi098.stdout:2/597: write d3/d16/d1a/f27 [1840869,59516] 0 2024-09-20T19:05:53.417 INFO:tasks.workunit.client.0.smithi027.stdout:7/218: dwrite d3/d8/da/f44 [0,4194304] 0 2024-09-20T19:05:53.419 INFO:tasks.workunit.client.1.smithi098.stdout:2/598: chown d3/db0/d69/d88/cb3 15174 1 2024-09-20T19:05:53.419 INFO:tasks.workunit.client.0.smithi027.stdout:8/181: link d2/d3/d6/d21/f38 d2/d3/d1b/d2d/f3c 0 2024-09-20T19:05:53.421 INFO:tasks.workunit.client.1.smithi098.stdout:4/323: dwrite d3/d6/d11/d1e/f26 [4194304,4194304] 0 2024-09-20T19:05:53.422 INFO:tasks.workunit.client.0.smithi027.stdout:8/182: readlink d2/d3/d1b/d2d/l32 0 2024-09-20T19:05:53.423 INFO:tasks.workunit.client.1.smithi098.stdout:0/216: getdents d0/d6/d28 0 2024-09-20T19:05:53.424 INFO:tasks.workunit.client.1.smithi098.stdout:0/217: stat d0/fa 0 2024-09-20T19:05:53.425 INFO:tasks.workunit.client.1.smithi098.stdout:5/304: link d1/d1b/d40/l44 d1/d17/d25/d56/l5c 0 2024-09-20T19:05:53.426 INFO:tasks.workunit.client.0.smithi027.stdout:1/212: rename d2/d1b/d3a/c19 to d2/c3f 0 2024-09-20T19:05:53.427 INFO:tasks.workunit.client.1.smithi098.stdout:3/269: mknod d4/c54 0 2024-09-20T19:05:53.428 INFO:tasks.workunit.client.0.smithi027.stdout:8/183: truncate d2/d2a/f2f 504511 0 2024-09-20T19:05:53.430 INFO:tasks.workunit.client.0.smithi027.stdout:5/274: dwrite f2 [0,4194304] 0 2024-09-20T19:05:53.431 INFO:tasks.workunit.client.1.smithi098.stdout:3/270: dread d4/da/f14 [4194304,4194304] 0 2024-09-20T19:05:53.432 INFO:tasks.workunit.client.1.smithi098.stdout:4/324: creat d3/d6/d11/d59/d50/f76 x:0 0 0 2024-09-20T19:05:53.433 INFO:tasks.workunit.client.1.smithi098.stdout:4/325: write d3/d6/f32 [3563259,68796] 0 2024-09-20T19:05:53.433 INFO:tasks.workunit.client.0.smithi027.stdout:7/219: dwrite d3/f9 [4194304,4194304] 0 2024-09-20T19:05:53.434 INFO:tasks.workunit.client.1.smithi098.stdout:0/218: rename d0/db/d1d/c2c to d0/d6/d28/c3b 0 2024-09-20T19:05:53.437 INFO:tasks.workunit.client.0.smithi027.stdout:1/213: dread d2/d1b/d3a/f35 [0,4194304] 0 2024-09-20T19:05:53.437 INFO:tasks.workunit.client.0.smithi027.stdout:0/271: rmdir d2/d20/d52/d29 39 2024-09-20T19:05:53.438 INFO:tasks.workunit.client.1.smithi098.stdout:3/271: chown d4/d19/l42 5730677 1 2024-09-20T19:05:53.440 INFO:tasks.workunit.client.1.smithi098.stdout:4/326: creat d3/d2e/f77 x:0 0 0 2024-09-20T19:05:53.443 INFO:tasks.workunit.client.1.smithi098.stdout:0/219: mknod d0/db/d1d/c3c 0 2024-09-20T19:05:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:2/170: stat d3/c20 0 2024-09-20T19:05:53.445 INFO:tasks.workunit.client.0.smithi027.stdout:4/155: chown d5/d13/d16/f22 254832406 1 2024-09-20T19:05:53.446 INFO:tasks.workunit.client.0.smithi027.stdout:2/171: chown d3/d1c/c1d 170 1 2024-09-20T19:05:53.446 INFO:tasks.workunit.client.1.smithi098.stdout:5/305: truncate d1/fe 93136 0 2024-09-20T19:05:53.447 INFO:tasks.workunit.client.1.smithi098.stdout:5/306: chown d1/d1b/f1c 82872 1 2024-09-20T19:05:53.449 INFO:tasks.workunit.client.1.smithi098.stdout:5/307: write d1/d46/f57 [484356,126017] 0 2024-09-20T19:05:53.450 INFO:tasks.workunit.client.1.smithi098.stdout:2/599: creat d3/db0/fc7 x:0 0 0 2024-09-20T19:05:53.452 INFO:tasks.workunit.client.1.smithi098.stdout:4/327: symlink d3/d6/d11/d59/l78 0 2024-09-20T19:05:53.453 INFO:tasks.workunit.client.1.smithi098.stdout:4/328: dread - d3/d2e/f68 zero size 2024-09-20T19:05:53.454 INFO:tasks.workunit.client.1.smithi098.stdout:4/329: write d3/f7 [2733566,83105] 0 2024-09-20T19:05:53.455 INFO:tasks.workunit.client.0.smithi027.stdout:3/237: mkdir d0/d38/d4f 0 2024-09-20T19:05:53.459 INFO:tasks.workunit.client.1.smithi098.stdout:2/600: creat d3/d51/d9f/dbc/fc8 x:0 0 0 2024-09-20T19:05:53.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/601: chown d3/d16/d1d/d2b/d46/d74/d82/la9 140 1 2024-09-20T19:05:53.463 INFO:tasks.workunit.client.0.smithi027.stdout:7/220: creat d3/d8/da/d2e/d39/f4d x:0 0 0 2024-09-20T19:05:53.463 INFO:tasks.workunit.client.1.smithi098.stdout:5/308: mknod d1/c5d 0 2024-09-20T19:05:53.464 INFO:tasks.workunit.client.1.smithi098.stdout:2/602: dread d3/df/d13/f32 [0,4194304] 0 2024-09-20T19:05:53.465 INFO:tasks.workunit.client.0.smithi027.stdout:0/272: symlink d2/d14/d1d/d2e/l63 0 2024-09-20T19:05:53.465 INFO:tasks.workunit.client.1.smithi098.stdout:5/309: truncate d1/d17/d35/f3f 695217 0 2024-09-20T19:05:53.466 INFO:tasks.workunit.client.1.smithi098.stdout:4/330: rmdir d3/d6/d3e/d3c/d6b 39 2024-09-20T19:05:53.467 INFO:tasks.workunit.client.1.smithi098.stdout:4/331: dread - d3/d6/d11/d59/d50/f76 zero size 2024-09-20T19:05:53.468 INFO:tasks.workunit.client.1.smithi098.stdout:4/332: stat d3/d2e 0 2024-09-20T19:05:53.468 INFO:tasks.workunit.client.0.smithi027.stdout:1/214: rename d2/d1b/l1f to d2/d8/d2b/l40 0 2024-09-20T19:05:53.472 INFO:tasks.workunit.client.0.smithi027.stdout:6/145: rmdir d4/d28 0 2024-09-20T19:05:53.475 INFO:tasks.workunit.client.1.smithi098.stdout:2/603: creat d3/d16/d1d/d2b/d46/fc9 x:0 0 0 2024-09-20T19:05:53.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:53 smithi098 ceph-mon[35737]: [20/Sep/2024:19:05:52] ENGINE Bus STARTING 2024-09-20T19:05:53.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:53 smithi098 ceph-mon[35737]: [20/Sep/2024:19:05:52] ENGINE Serving on http://172.21.15.98:8765 2024-09-20T19:05:53.476 INFO:tasks.workunit.client.0.smithi027.stdout:3/238: write d0/d19/f4a [773726,33530] 0 2024-09-20T19:05:53.477 INFO:tasks.workunit.client.0.smithi027.stdout:3/239: rename d0 to d0/d1/d13/d50 22 2024-09-20T19:05:53.480 INFO:tasks.workunit.client.0.smithi027.stdout:6/146: dwrite d4/d1b/f1e [0,4194304] 0 2024-09-20T19:05:53.480 INFO:tasks.workunit.client.0.smithi027.stdout:3/240: write d0/d1/d7/d1d/f4e [753115,22888] 0 2024-09-20T19:05:53.480 INFO:tasks.workunit.client.0.smithi027.stdout:6/147: stat d4/lc 0 2024-09-20T19:05:53.481 INFO:tasks.workunit.client.0.smithi027.stdout:8/184: mknod d2/d3/d6/d21/d33/c3d 0 2024-09-20T19:05:53.481 INFO:tasks.workunit.client.1.smithi098.stdout:2/604: dwrite d3/d16/f83 [0,4194304] 0 2024-09-20T19:05:53.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/272: getdents d4/d38/d39 0 2024-09-20T19:05:53.482 INFO:tasks.workunit.client.1.smithi098.stdout:4/333: dread d3/d6/f13 [0,4194304] 0 2024-09-20T19:05:53.484 INFO:tasks.workunit.client.0.smithi027.stdout:6/148: dread d4/f14 [0,4194304] 0 2024-09-20T19:05:53.484 INFO:tasks.workunit.client.0.smithi027.stdout:7/221: write d3/f2f [815117,6925] 0 2024-09-20T19:05:53.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/310: mkdir d1/d17/d5e 0 2024-09-20T19:05:53.491 INFO:tasks.workunit.client.0.smithi027.stdout:2/172: creat d3/d24/f28 x:0 0 0 2024-09-20T19:05:53.492 INFO:tasks.workunit.client.1.smithi098.stdout:4/334: symlink d3/d6/d11/d57/l79 0 2024-09-20T19:05:53.493 INFO:tasks.workunit.client.1.smithi098.stdout:5/311: creat d1/d17/d2e/f5f x:0 0 0 2024-09-20T19:05:53.495 INFO:tasks.workunit.client.1.smithi098.stdout:2/605: mkdir d3/db0/d69/dca 0 2024-09-20T19:05:53.496 INFO:tasks.workunit.client.1.smithi098.stdout:3/273: mknod d4/d25/d40/c55 0 2024-09-20T19:05:53.497 INFO:tasks.workunit.client.0.smithi027.stdout:5/275: creat d4/d1f/d28/f5a x:0 0 0 2024-09-20T19:05:53.499 INFO:tasks.workunit.client.1.smithi098.stdout:4/335: rename d3/d6/d3e/c3b to d3/d6/d11/d1e/d2a/d45/c7a 0 2024-09-20T19:05:53.502 INFO:tasks.workunit.client.1.smithi098.stdout:2/606: write d3/d16/f3b [46046,121209] 0 2024-09-20T19:05:53.504 INFO:tasks.workunit.client.1.smithi098.stdout:2/607: dread d3/f4c [4194304,4194304] 0 2024-09-20T19:05:53.505 INFO:tasks.workunit.client.1.smithi098.stdout:5/312: unlink d1/f14 0 2024-09-20T19:05:53.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/336: creat d3/d6/d11/d1e/f7b x:0 0 0 2024-09-20T19:05:53.511 INFO:tasks.workunit.client.0.smithi027.stdout:8/185: dread d2/d14/d13/f1c [0,4194304] 0 2024-09-20T19:05:53.511 INFO:tasks.workunit.client.0.smithi027.stdout:4/156: creat d5/f34 x:0 0 0 2024-09-20T19:05:53.512 INFO:tasks.workunit.client.1.smithi098.stdout:2/608: dwrite d3/d51/d9f/dbc/fc8 [0,4194304] 0 2024-09-20T19:05:53.513 INFO:tasks.workunit.client.0.smithi027.stdout:3/241: symlink d0/l51 0 2024-09-20T19:05:53.518 INFO:tasks.workunit.client.1.smithi098.stdout:3/274: dread d4/f34 [0,4194304] 0 2024-09-20T19:05:53.518 INFO:tasks.workunit.client.0.smithi027.stdout:8/186: dwrite d2/f39 [0,4194304] 0 2024-09-20T19:05:53.519 INFO:tasks.workunit.client.1.smithi098.stdout:5/313: unlink d1/d46/f57 0 2024-09-20T19:05:53.521 INFO:tasks.workunit.client.0.smithi027.stdout:5/276: rename d4/da/l2a to d4/da/de/d1e/d3d/l5b 0 2024-09-20T19:05:53.522 INFO:tasks.workunit.client.1.smithi098.stdout:2/609: dread d3/d16/d1d/d2b/f56 [0,4194304] 0 2024-09-20T19:05:53.525 INFO:tasks.workunit.client.1.smithi098.stdout:4/337: rename d3/c5c to d3/d6/c7c 0 2024-09-20T19:05:53.532 INFO:tasks.workunit.client.1.smithi098.stdout:5/314: mkdir d1/d17/d35/d60 0 2024-09-20T19:05:53.535 INFO:tasks.workunit.client.0.smithi027.stdout:4/157: chown d5/d13/c27 11 1 2024-09-20T19:05:53.536 INFO:tasks.workunit.client.1.smithi098.stdout:2/610: unlink d3/db0/d69/d88/d8a/fb9 0 2024-09-20T19:05:53.537 INFO:tasks.workunit.client.1.smithi098.stdout:2/611: truncate d3/db0/fc7 954792 0 2024-09-20T19:05:53.538 INFO:tasks.workunit.client.0.smithi027.stdout:1/215: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:53.539 INFO:tasks.workunit.client.1.smithi098.stdout:4/338: mkdir d3/d7d 0 2024-09-20T19:05:53.541 INFO:tasks.workunit.client.1.smithi098.stdout:5/315: creat d1/d1b/f61 x:0 0 0 2024-09-20T19:05:53.542 INFO:tasks.workunit.client.1.smithi098.stdout:5/316: write d1/d1b/f1c [1280624,10884] 0 2024-09-20T19:05:53.543 INFO:tasks.workunit.client.1.smithi098.stdout:5/317: stat d1/d17/d35/d60 0 2024-09-20T19:05:53.544 INFO:tasks.workunit.client.0.smithi027.stdout:8/187: creat d2/d3/d6/f3e x:0 0 0 2024-09-20T19:05:53.544 INFO:tasks.workunit.client.1.smithi098.stdout:3/275: getdents d4/d25/d40/d4b 0 2024-09-20T19:05:53.545 INFO:tasks.workunit.client.0.smithi027.stdout:5/277: rmdir d4 39 2024-09-20T19:05:53.548 INFO:tasks.workunit.client.0.smithi027.stdout:6/149: truncate d4/d6/fa 2041551 0 2024-09-20T19:05:53.550 INFO:tasks.workunit.client.0.smithi027.stdout:0/273: getdents d2/d14/d1d/d2e 0 2024-09-20T19:05:53.551 INFO:tasks.workunit.client.0.smithi027.stdout:0/274: stat d2/c6 0 2024-09-20T19:05:53.551 INFO:tasks.workunit.client.0.smithi027.stdout:7/222: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:53.552 INFO:tasks.workunit.client.0.smithi027.stdout:4/158: stat d5/fa 0 2024-09-20T19:05:53.553 INFO:tasks.workunit.client.0.smithi027.stdout:4/159: stat d5/d11/d17/d32 0 2024-09-20T19:05:53.553 INFO:tasks.workunit.client.1.smithi098.stdout:3/276: chown d4/c4f 2 1 2024-09-20T19:05:53.556 INFO:tasks.workunit.client.1.smithi098.stdout:3/277: truncate d4/da/f51 1020033 0 2024-09-20T19:05:53.556 INFO:tasks.workunit.client.0.smithi027.stdout:3/242: mknod d0/c52 0 2024-09-20T19:05:53.557 INFO:tasks.workunit.client.1.smithi098.stdout:4/339: dwrite d3/fe [0,4194304] 0 2024-09-20T19:05:53.558 INFO:tasks.workunit.client.1.smithi098.stdout:4/340: fdatasync d3/d6/d3e/f6e 0 2024-09-20T19:05:53.559 INFO:tasks.workunit.client.1.smithi098.stdout:3/278: creat d4/d38/f56 x:0 0 0 2024-09-20T19:05:53.560 INFO:tasks.workunit.client.0.smithi027.stdout:5/278: write d4/d1f/d28/f3f [166741,57765] 0 2024-09-20T19:05:53.561 INFO:tasks.workunit.client.1.smithi098.stdout:2/612: getdents d3/d16/d1d/d2b/d46 0 2024-09-20T19:05:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:5/279: fsync d4/da/de/d3e/d44/f4c 0 2024-09-20T19:05:53.562 INFO:tasks.workunit.client.0.smithi027.stdout:0/275: readlink d2/d20/d52/d29/l2a 0 2024-09-20T19:05:53.564 INFO:tasks.workunit.client.0.smithi027.stdout:4/160: symlink d5/d13/l35 0 2024-09-20T19:05:53.564 INFO:tasks.workunit.client.1.smithi098.stdout:4/341: symlink d3/d6/d11/d59/d50/d58/d71/l7e 0 2024-09-20T19:05:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:4/161: dread - d5/d13/f30 zero size 2024-09-20T19:05:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:9/337: sync 2024-09-20T19:05:53.565 INFO:tasks.workunit.client.0.smithi027.stdout:4/162: stat d5/f1f 0 2024-09-20T19:05:53.566 INFO:tasks.workunit.client.0.smithi027.stdout:4/163: stat d5/d13/l15 0 2024-09-20T19:05:53.567 INFO:tasks.workunit.client.1.smithi098.stdout:2/613: mkdir d3/d16/d1d/d2b/d46/d74/d7b/dcb 0 2024-09-20T19:05:53.568 INFO:tasks.workunit.client.1.smithi098.stdout:2/614: fdatasync d3/d51/fc3 0 2024-09-20T19:05:53.569 INFO:tasks.workunit.client.1.smithi098.stdout:4/342: dread d3/fe [0,4194304] 0 2024-09-20T19:05:53.570 INFO:tasks.workunit.client.1.smithi098.stdout:4/343: dread - d3/d2e/f68 zero size 2024-09-20T19:05:53.571 INFO:tasks.workunit.client.0.smithi027.stdout:8/188: dread d2/d3/f31 [0,4194304] 0 2024-09-20T19:05:53.572 INFO:tasks.workunit.client.1.smithi098.stdout:4/344: truncate d3/d6/d11/d59/d50/f75 276039 0 2024-09-20T19:05:53.575 INFO:tasks.workunit.client.0.smithi027.stdout:3/243: rename d0/f41 to d0/d19/f53 0 2024-09-20T19:05:53.577 INFO:tasks.workunit.client.0.smithi027.stdout:4/164: dwrite d5/f34 [0,4194304] 0 2024-09-20T19:05:53.578 INFO:tasks.workunit.client.0.smithi027.stdout:5/280: mkdir d4/d3c/d5c 0 2024-09-20T19:05:53.579 INFO:tasks.workunit.client.1.smithi098.stdout:3/279: link d4/d25/d40/c55 d4/d19/c57 0 2024-09-20T19:05:53.579 INFO:tasks.workunit.client.1.smithi098.stdout:4/345: dwrite d3/d6/d11/f62 [0,4194304] 0 2024-09-20T19:05:53.579 INFO:tasks.workunit.client.1.smithi098.stdout:3/280: chown d4/d25/d40 3546 1 2024-09-20T19:05:53.580 INFO:tasks.workunit.client.0.smithi027.stdout:4/165: write d5/fe [2410152,130888] 0 2024-09-20T19:05:53.580 INFO:tasks.workunit.client.1.smithi098.stdout:3/281: read - d4/da/f32 zero size 2024-09-20T19:05:53.582 INFO:tasks.workunit.client.0.smithi027.stdout:1/216: truncate d2/d1b/f2e 1941515 0 2024-09-20T19:05:53.584 INFO:tasks.workunit.client.0.smithi027.stdout:3/244: dread d0/d19/f4a [0,4194304] 0 2024-09-20T19:05:53.584 INFO:tasks.workunit.client.0.smithi027.stdout:3/245: stat d0/l51 0 2024-09-20T19:05:53.586 INFO:tasks.workunit.client.1.smithi098.stdout:2/615: mkdir d3/db0/dcc 0 2024-09-20T19:05:53.587 INFO:tasks.workunit.client.0.smithi027.stdout:3/246: write d0/d1/d13/f22 [300614,10579] 0 2024-09-20T19:05:53.588 INFO:tasks.workunit.client.1.smithi098.stdout:4/346: mkdir d3/d6/d11/d57/d7f 0 2024-09-20T19:05:53.590 INFO:tasks.workunit.client.1.smithi098.stdout:3/282: creat d4/d25/d40/f58 x:0 0 0 2024-09-20T19:05:53.591 INFO:tasks.workunit.client.1.smithi098.stdout:2/616: dread d3/d51/d68/fb1 [0,4194304] 0 2024-09-20T19:05:53.593 INFO:tasks.workunit.client.0.smithi027.stdout:5/281: symlink d4/da/d50/l5d 0 2024-09-20T19:05:53.594 INFO:tasks.workunit.client.0.smithi027.stdout:5/282: write d4/da/de/f35 [2144200,61324] 0 2024-09-20T19:05:53.595 INFO:tasks.workunit.client.0.smithi027.stdout:7/223: creat d3/d8/da/f4e x:0 0 0 2024-09-20T19:05:53.598 INFO:tasks.workunit.client.1.smithi098.stdout:2/617: creat d3/d51/d9f/fcd x:0 0 0 2024-09-20T19:05:53.599 INFO:tasks.workunit.client.0.smithi027.stdout:1/217: mkdir d2/d8/d41 0 2024-09-20T19:05:53.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/218: write d2/f13 [11913695,108962] 0 2024-09-20T19:05:53.601 INFO:tasks.workunit.client.1.smithi098.stdout:3/283: mkdir d4/d19/d1d/d2f/d4e/d59 0 2024-09-20T19:05:53.605 INFO:tasks.workunit.client.1.smithi098.stdout:2/618: rmdir d3/d16/d1d/d4f/d8b/d38 39 2024-09-20T19:05:53.606 INFO:tasks.workunit.client.0.smithi027.stdout:8/189: dread d2/d3/f11 [0,4194304] 0 2024-09-20T19:05:53.608 INFO:tasks.workunit.client.1.smithi098.stdout:3/284: dread d4/d19/d1d/f3b [0,4194304] 0 2024-09-20T19:05:53.609 INFO:tasks.workunit.client.1.smithi098.stdout:3/285: write d4/f1b [1082891,81386] 0 2024-09-20T19:05:53.610 INFO:tasks.workunit.client.0.smithi027.stdout:6/150: dread d4/d6/f19 [0,4194304] 0 2024-09-20T19:05:53.613 INFO:tasks.workunit.client.1.smithi098.stdout:2/619: dread d3/d16/d1d/d2b/d46/d74/f7d [0,4194304] 0 2024-09-20T19:05:53.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/620: read d3/f6d [3298188,61023] 0 2024-09-20T19:05:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:6/151: dread f0 [0,4194304] 0 2024-09-20T19:05:53.624 INFO:tasks.workunit.client.0.smithi027.stdout:5/283: rename f2 to d4/d3c/f5e 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:7/224: symlink d3/d1a/l4f 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:5/284: chown d4/d1f/d28/f3f 17098 1 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:6/152: write d4/d1b/f1f [1521494,77883] 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:7/225: stat d3/d8/d26/c41 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:7/226: write d3/d8/f20 [1262447,1655] 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:0/276: truncate d2/d14/d1d/d2e/f46 1488592 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:8/190: dread d2/d3/d1b/f2c [0,4194304] 0 2024-09-20T19:05:53.625 INFO:tasks.workunit.client.0.smithi027.stdout:8/191: read d2/d2a/f2f [167531,4361] 0 2024-09-20T19:05:53.626 INFO:tasks.workunit.client.1.smithi098.stdout:3/286: fsync d4/da/f14 0 2024-09-20T19:05:53.626 INFO:tasks.workunit.client.1.smithi098.stdout:4/347: truncate d3/d6/d3e/d3c/d6b/f74 965576 0 2024-09-20T19:05:53.626 INFO:tasks.workunit.client.0.smithi027.stdout:1/219: rename d2/d8/d2b/d2d/l32 to d2/d8/d2b/d2d/l42 0 2024-09-20T19:05:53.627 INFO:tasks.workunit.client.1.smithi098.stdout:3/287: fdatasync d4/da/f45 0 2024-09-20T19:05:53.628 INFO:tasks.workunit.client.0.smithi027.stdout:1/220: truncate d2/d1b/f1e 8045195 0 2024-09-20T19:05:53.631 INFO:tasks.workunit.client.0.smithi027.stdout:8/192: dread d2/d14/f27 [0,4194304] 0 2024-09-20T19:05:53.631 INFO:tasks.workunit.client.1.smithi098.stdout:2/621: creat d3/db0/dcc/fce x:0 0 0 2024-09-20T19:05:53.632 INFO:tasks.workunit.client.0.smithi027.stdout:3/247: dread d0/d1/f2e [4194304,4194304] 0 2024-09-20T19:05:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:4/166: truncate d5/d11/d17/f20 1278884 0 2024-09-20T19:05:53.636 INFO:tasks.workunit.client.0.smithi027.stdout:2/173: sync 2024-09-20T19:05:53.641 INFO:tasks.workunit.client.0.smithi027.stdout:7/227: mkdir d3/d8/da/d2e/d50 0 2024-09-20T19:05:53.642 INFO:tasks.workunit.client.0.smithi027.stdout:5/285: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:05:53.644 INFO:tasks.workunit.client.0.smithi027.stdout:0/277: mknod d2/d20/c64 0 2024-09-20T19:05:53.645 INFO:tasks.workunit.client.0.smithi027.stdout:5/286: truncate d4/da/d1a/f1b 5120509 0 2024-09-20T19:05:53.646 INFO:tasks.workunit.client.0.smithi027.stdout:5/287: chown d4/c32 1770401 1 2024-09-20T19:05:53.648 INFO:tasks.workunit.client.0.smithi027.stdout:8/193: creat d2/d14/f3f x:0 0 0 2024-09-20T19:05:53.648 INFO:tasks.workunit.client.1.smithi098.stdout:2/622: dread d3/db0/d69/fb2 [0,4194304] 0 2024-09-20T19:05:53.648 INFO:tasks.workunit.client.1.smithi098.stdout:1/221: sync 2024-09-20T19:05:53.648 INFO:tasks.workunit.client.1.smithi098.stdout:9/383: sync 2024-09-20T19:05:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:3/248: unlink d0/d1/d13/d15/f4b 0 2024-09-20T19:05:53.649 INFO:tasks.workunit.client.0.smithi027.stdout:8/194: chown d2/d3/f25 4013170 1 2024-09-20T19:05:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:4/167: mkdir d5/d13/d36 0 2024-09-20T19:05:53.650 INFO:tasks.workunit.client.0.smithi027.stdout:7/228: dwrite d3/f12 [0,4194304] 0 2024-09-20T19:05:53.651 INFO:tasks.workunit.client.1.smithi098.stdout:9/384: write d4/de/d27/d4a/f4b [290818,129221] 0 2024-09-20T19:05:53.651 INFO:tasks.workunit.client.1.smithi098.stdout:1/222: truncate d1/d3/d2e/f3a 526806 0 2024-09-20T19:05:53.651 INFO:tasks.workunit.client.1.smithi098.stdout:2/623: fsync d3/d16/d1d/d2b/f5c 0 2024-09-20T19:05:53.652 INFO:tasks.workunit.client.1.smithi098.stdout:1/223: readlink d1/d3/df/l28 0 2024-09-20T19:05:53.655 INFO:tasks.workunit.client.0.smithi027.stdout:1/221: creat d2/d8/d41/f43 x:0 0 0 2024-09-20T19:05:53.657 INFO:tasks.workunit.client.1.smithi098.stdout:9/385: dwrite d4/de/f1f [0,4194304] 0 2024-09-20T19:05:53.658 INFO:tasks.workunit.client.1.smithi098.stdout:1/224: write d1/f16 [158497,58811] 0 2024-09-20T19:05:53.659 INFO:tasks.workunit.client.0.smithi027.stdout:4/168: dwrite d5/d13/d16/d21/d26/f29 [0,4194304] 0 2024-09-20T19:05:53.660 INFO:tasks.workunit.client.1.smithi098.stdout:2/624: symlink d3/d16/d96/lcf 0 2024-09-20T19:05:53.662 INFO:tasks.workunit.client.1.smithi098.stdout:2/625: write d3/d16/d1d/d2b/f56 [30065,929] 0 2024-09-20T19:05:53.662 INFO:tasks.workunit.client.1.smithi098.stdout:9/386: creat d4/de/d27/d4a/d21/d25/d51/f85 x:0 0 0 2024-09-20T19:05:53.662 INFO:tasks.workunit.client.0.smithi027.stdout:3/249: dread - d0/d1/f26 zero size 2024-09-20T19:05:53.663 INFO:tasks.workunit.client.1.smithi098.stdout:9/387: write d4/f47 [1004167,116062] 0 2024-09-20T19:05:53.664 INFO:tasks.workunit.client.1.smithi098.stdout:1/225: rename d1/d32 to d1/d3/df/d34/d43 0 2024-09-20T19:05:53.665 INFO:tasks.workunit.client.1.smithi098.stdout:9/388: write d4/de/d27/d4a/d21/f4e [513415,89708] 0 2024-09-20T19:05:53.670 INFO:tasks.workunit.client.1.smithi098.stdout:1/226: rmdir d1 39 2024-09-20T19:05:53.671 INFO:tasks.workunit.client.0.smithi027.stdout:0/278: link f1 d2/d20/d52/d29/f65 0 2024-09-20T19:05:53.673 INFO:tasks.workunit.client.1.smithi098.stdout:9/389: truncate d4/de/f3d 949627 0 2024-09-20T19:05:53.674 INFO:tasks.workunit.client.1.smithi098.stdout:3/288: write d4/d19/d1d/f3b [586703,93084] 0 2024-09-20T19:05:53.677 INFO:tasks.workunit.client.1.smithi098.stdout:1/227: write d1/d3/df/f23 [1445808,37638] 0 2024-09-20T19:05:53.677 INFO:tasks.workunit.client.0.smithi027.stdout:6/153: getdents d4/d1b 0 2024-09-20T19:05:53.678 INFO:tasks.workunit.client.1.smithi098.stdout:1/228: write d1/d3/df/f21 [1814173,98754] 0 2024-09-20T19:05:53.679 INFO:tasks.workunit.client.0.smithi027.stdout:3/250: rename d0/d38/d4f to d0/d19/d54 0 2024-09-20T19:05:53.679 INFO:tasks.workunit.client.1.smithi098.stdout:3/289: chown d4/d25/d40/c55 1046747036 1 2024-09-20T19:05:53.680 INFO:tasks.workunit.client.1.smithi098.stdout:3/290: chown d4/d19/d1d/d2f/f53 16500 1 2024-09-20T19:05:53.680 INFO:tasks.workunit.client.0.smithi027.stdout:7/229: mkdir d3/d8/da/d51 0 2024-09-20T19:05:53.682 INFO:tasks.workunit.client.1.smithi098.stdout:9/390: rename d4/de/d27/d4a/d21/d25/d66 to d4/de/d27/d4a/d58/d81/d86 0 2024-09-20T19:05:53.682 INFO:tasks.workunit.client.0.smithi027.stdout:7/230: write d3/d8/d26/f4a [308497,59125] 0 2024-09-20T19:05:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:1/222: mkdir d2/d8/d3b/d44 0 2024-09-20T19:05:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:0/279: creat d2/d14/d1b/d39/f66 x:0 0 0 2024-09-20T19:05:53.684 INFO:tasks.workunit.client.0.smithi027.stdout:7/231: read d3/f2f [481031,70700] 0 2024-09-20T19:05:53.685 INFO:tasks.workunit.client.1.smithi098.stdout:4/348: write d3/d6/d3e/d3c/d6b/f74 [338558,68470] 0 2024-09-20T19:05:53.687 INFO:tasks.workunit.client.1.smithi098.stdout:1/229: truncate d1/d3/f2d 352748 0 2024-09-20T19:05:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:0/280: dread - d2/d14/d1b/d39/f66 zero size 2024-09-20T19:05:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:5/288: rmdir d4/d3c/d5c 0 2024-09-20T19:05:53.687 INFO:tasks.workunit.client.0.smithi027.stdout:7/232: chown d3/d8/da/d2e/l48 6245 1 2024-09-20T19:05:53.688 INFO:tasks.workunit.client.0.smithi027.stdout:0/281: readlink d2/d14/l2c 0 2024-09-20T19:05:53.688 INFO:tasks.workunit.client.1.smithi098.stdout:1/230: chown d1/d3/f2d 370195475 1 2024-09-20T19:05:53.689 INFO:tasks.workunit.client.1.smithi098.stdout:9/391: getdents d4/de/d27/d4a/d58/d5b 0 2024-09-20T19:05:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:0/282: chown d2/d14/f31 805286 1 2024-09-20T19:05:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:6/154: chown d4/d6/fa 64966092 1 2024-09-20T19:05:53.690 INFO:tasks.workunit.client.0.smithi027.stdout:3/251: mkdir d0/d1/d13/d15/d55 0 2024-09-20T19:05:53.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/349: dwrite d3/f36 [0,4194304] 0 2024-09-20T19:05:53.693 INFO:tasks.workunit.client.0.smithi027.stdout:3/252: write d0/d1/f3b [3487480,113005] 0 2024-09-20T19:05:53.694 INFO:tasks.workunit.client.0.smithi027.stdout:4/169: creat d5/f37 x:0 0 0 2024-09-20T19:05:53.694 INFO:tasks.workunit.client.1.smithi098.stdout:9/392: rmdir d4/de/d24/d35/d2d 39 2024-09-20T19:05:53.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/393: chown d4/de/d27/l72 0 1 2024-09-20T19:05:53.695 INFO:tasks.workunit.client.1.smithi098.stdout:1/231: creat d1/d3/f44 x:0 0 0 2024-09-20T19:05:53.696 INFO:tasks.workunit.client.0.smithi027.stdout:4/170: fdatasync d5/f10 0 2024-09-20T19:05:53.696 INFO:tasks.workunit.client.1.smithi098.stdout:4/350: creat d3/d6/d11/d59/d50/d58/f80 x:0 0 0 2024-09-20T19:05:53.700 INFO:tasks.workunit.client.1.smithi098.stdout:1/232: unlink d1/d3/d2e/l42 0 2024-09-20T19:05:53.704 INFO:tasks.workunit.client.0.smithi027.stdout:3/253: creat d0/d1/f56 x:0 0 0 2024-09-20T19:05:53.706 INFO:tasks.workunit.client.1.smithi098.stdout:3/291: dread d4/f1c [0,4194304] 0 2024-09-20T19:05:53.708 INFO:tasks.workunit.client.0.smithi027.stdout:1/223: truncate d2/d8/f20 458613 0 2024-09-20T19:05:53.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/351: creat d3/d6/d3e/d3c/f81 x:0 0 0 2024-09-20T19:05:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:7/233: creat d3/d8/d26/d45/f52 x:0 0 0 2024-09-20T19:05:53.713 INFO:tasks.workunit.client.0.smithi027.stdout:7/234: readlink d3/d8/l31 0 2024-09-20T19:05:53.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/292: creat d4/d38/d39/f5a x:0 0 0 2024-09-20T19:05:53.719 INFO:tasks.workunit.client.1.smithi098.stdout:3/293: symlink d4/d19/d1d/d2f/d3e/l5b 0 2024-09-20T19:05:53.720 INFO:tasks.workunit.client.0.smithi027.stdout:9/338: sync 2024-09-20T19:05:53.721 INFO:tasks.workunit.client.1.smithi098.stdout:3/294: fdatasync d4/d38/d39/f5a 0 2024-09-20T19:05:53.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/352: fdatasync d3/f5 0 2024-09-20T19:05:53.724 INFO:tasks.workunit.client.0.smithi027.stdout:3/254: dread d0/f2 [0,4194304] 0 2024-09-20T19:05:53.724 INFO:tasks.workunit.client.1.smithi098.stdout:2/626: dwrite d3/d16/d1d/d2b/d46/fa1 [0,4194304] 0 2024-09-20T19:05:53.725 INFO:tasks.workunit.client.0.smithi027.stdout:3/255: write d0/d1/d13/f1c [4535275,32694] 0 2024-09-20T19:05:53.729 INFO:tasks.workunit.client.0.smithi027.stdout:0/283: creat d2/d20/d52/f67 x:0 0 0 2024-09-20T19:05:53.730 INFO:tasks.workunit.client.1.smithi098.stdout:3/295: dwrite d4/f1b [0,4194304] 0 2024-09-20T19:05:53.731 INFO:tasks.workunit.client.1.smithi098.stdout:3/296: dread - d4/da/f32 zero size 2024-09-20T19:05:53.731 INFO:tasks.workunit.client.0.smithi027.stdout:0/284: chown d2/d14/d1d/f3d 0 1 2024-09-20T19:05:53.732 INFO:tasks.workunit.client.0.smithi027.stdout:0/285: stat d2/d14/d1d/d2e/c62 0 2024-09-20T19:05:53.733 INFO:tasks.workunit.client.0.smithi027.stdout:5/289: getdents d4 0 2024-09-20T19:05:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:0/286: read d2/d20/d52/f58 [282047,20204] 0 2024-09-20T19:05:53.734 INFO:tasks.workunit.client.0.smithi027.stdout:5/290: write d4/d1f/f24 [539092,53406] 0 2024-09-20T19:05:53.735 INFO:tasks.workunit.client.0.smithi027.stdout:8/195: truncate d2/d14/f27 229044 0 2024-09-20T19:05:53.737 INFO:tasks.workunit.client.0.smithi027.stdout:9/339: rename d0/d2e/f4a to d0/d9/df/d1b/d64/f6f 0 2024-09-20T19:05:53.741 INFO:tasks.workunit.client.0.smithi027.stdout:7/235: creat d3/d8/da/d51/f53 x:0 0 0 2024-09-20T19:05:53.742 INFO:tasks.workunit.client.0.smithi027.stdout:7/236: chown d3/d8/da/f13 116685658 1 2024-09-20T19:05:53.744 INFO:tasks.workunit.client.1.smithi098.stdout:4/353: unlink d3/d6/c7c 0 2024-09-20T19:05:53.744 INFO:tasks.workunit.client.1.smithi098.stdout:4/354: readlink d3/d6/l17 0 2024-09-20T19:05:53.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.740+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9e5c0fd2a0 con 0x7f9e4403fb60 2024-09-20T19:05:53.748 INFO:tasks.workunit.client.0.smithi027.stdout:3/256: creat d0/d19/f57 x:0 0 0 2024-09-20T19:05:53.749 INFO:tasks.workunit.client.0.smithi027.stdout:3/257: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:53.750 INFO:tasks.workunit.client.1.smithi098.stdout:4/355: dwrite d3/d6/d3e/d3c/f5a [0,4194304] 0 2024-09-20T19:05:53.751 INFO:tasks.workunit.client.0.smithi027.stdout:3/258: chown d0/d1/d13/f49 49918 1 2024-09-20T19:05:53.752 INFO:tasks.workunit.client.1.smithi098.stdout:4/356: write d3/d6/d11/d59/d50/f75 [529036,113099] 0 2024-09-20T19:05:53.753 INFO:tasks.workunit.client.1.smithi098.stdout:3/297: rename d4/da/f23 to d4/da/f5c 0 2024-09-20T19:05:53.754 INFO:tasks.workunit.client.0.smithi027.stdout:6/155: dwrite d4/d6/f19 [0,4194304] 0 2024-09-20T19:05:53.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.748+0000 7f9e5a7fc640 1 -- 172.21.15.27:0/2445438076 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f9e5c0fd2a0 con 0x7f9e4403fb60 2024-09-20T19:05:53.757 INFO:tasks.workunit.client.0.smithi027.stdout:1/224: dread d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:53.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.752+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 msgr2=0x7f9e44042020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.752+0000 7f9e63319640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 0x7f9e44042020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c10b380 tx=0x7f9e50005f90 comp rx=0 tx=0).stop 2024-09-20T19:05:53.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.752+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 msgr2=0x7f9e5c10d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.752+0000 7f9e63319640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c031fd0 tx=0x7f9e4c009800 comp rx=0 tx=0).stop 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 shutdown_connections 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9e4403fb60 0x7f9e44042020 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c101a60 0x7f9e5c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 --2- 172.21.15.27:0/2445438076 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e5c100860 0x7f9e5c10d400 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 >> 172.21.15.27:0/2445438076 conn(0x7f9e5c0fbff0 msgr2=0x7f9e5c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:53.759 INFO:tasks.workunit.client.1.smithi098.stdout:1/233: truncate d1/d3/f15 3812515 0 2024-09-20T19:05:53.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 shutdown_connections 2024-09-20T19:05:53.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.753+0000 7f9e63319640 1 -- 172.21.15.27:0/2445438076 wait complete. 2024-09-20T19:05:53.764 INFO:tasks.workunit.client.1.smithi098.stdout:4/357: creat d3/d6/d11/d64/f82 x:0 0 0 2024-09-20T19:05:53.764 INFO:tasks.workunit.client.1.smithi098.stdout:4/358: stat d3/d6/fd 0 2024-09-20T19:05:53.764 INFO:tasks.workunit.client.0.smithi027.stdout:3/259: dwrite d0/d1/d7/f1e [4194304,4194304] 0 2024-09-20T19:05:53.765 INFO:tasks.workunit.client.0.smithi027.stdout:9/340: truncate d0/f47 805632 0 2024-09-20T19:05:53.768 INFO:tasks.workunit.client.0.smithi027.stdout:5/291: rename d4/da/de/d1e/c26 to d4/da/d1a/c5f 0 2024-09-20T19:05:53.774 INFO:tasks.workunit.client.1.smithi098.stdout:4/359: dwrite d3/d6/d11/d59/d50/f53 [4194304,4194304] 0 2024-09-20T19:05:53.777 INFO:tasks.workunit.client.0.smithi027.stdout:4/171: getdents d5/d11 0 2024-09-20T19:05:53.778 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:05:53.780 INFO:tasks.workunit.client.0.smithi027.stdout:4/172: write d5/d13/d16/d21/d26/f29 [1205773,112195] 0 2024-09-20T19:05:53.782 INFO:tasks.workunit.client.1.smithi098.stdout:2/627: truncate d3/df/f11 740083 0 2024-09-20T19:05:53.782 INFO:tasks.workunit.client.0.smithi027.stdout:4/173: read d5/d13/d16/d21/d26/f29 [564847,74371] 0 2024-09-20T19:05:53.785 INFO:tasks.workunit.client.1.smithi098.stdout:3/298: dread d4/f18 [0,4194304] 0 2024-09-20T19:05:53.785 INFO:tasks.workunit.client.1.smithi098.stdout:1/234: rename d1/d3/df/l40 to d1/d3/df/d34/l45 0 2024-09-20T19:05:53.787 INFO:tasks.workunit.client.1.smithi098.stdout:3/299: truncate d4/d19/d1d/f47 77271 0 2024-09-20T19:05:53.788 INFO:tasks.workunit.client.0.smithi027.stdout:1/225: fdatasync d2/d1b/d3a/d21/f2c 0 2024-09-20T19:05:53.790 INFO:tasks.workunit.client.0.smithi027.stdout:1/226: write d2/d1b/d3a/f30 [1010690,42962] 0 2024-09-20T19:05:53.791 INFO:tasks.workunit.client.0.smithi027.stdout:3/260: rmdir d0/d1/d13/d3c 39 2024-09-20T19:05:53.793 INFO:tasks.workunit.client.0.smithi027.stdout:9/341: mknod d0/d9/df/d1c/d6a/d6d/c70 0 2024-09-20T19:05:53.793 INFO:tasks.workunit.client.0.smithi027.stdout:9/342: dread - d0/d9/df/f49 zero size 2024-09-20T19:05:53.794 INFO:tasks.workunit.client.0.smithi027.stdout:6/156: rename d4/d1b/f1f to d4/d6/f2a 0 2024-09-20T19:05:53.795 INFO:tasks.workunit.client.0.smithi027.stdout:9/343: chown d0/d9/df/f21 484058 1 2024-09-20T19:05:53.796 INFO:tasks.workunit.client.1.smithi098.stdout:1/235: dwrite d1/d3/f9 [0,4194304] 0 2024-09-20T19:05:53.797 INFO:tasks.workunit.client.0.smithi027.stdout:9/344: dread - d0/d9/df/d1c/d6a/d6d/f62 zero size 2024-09-20T19:05:53.798 INFO:tasks.workunit.client.1.smithi098.stdout:3/300: unlink d4/d19/d1d/d22/l2a 0 2024-09-20T19:05:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:6/157: read d4/d6/f2a [584407,117105] 0 2024-09-20T19:05:53.799 INFO:tasks.workunit.client.0.smithi027.stdout:9/345: chown d0/d9/d3d/f54 10281 1 2024-09-20T19:05:53.801 INFO:tasks.workunit.client.0.smithi027.stdout:6/158: write d4/d1b/f1e [1476370,48959] 0 2024-09-20T19:05:53.801 INFO:tasks.workunit.client.1.smithi098.stdout:1/236: rmdir d1/d3/df/d34/d43 39 2024-09-20T19:05:53.802 INFO:tasks.workunit.client.0.smithi027.stdout:6/159: readlink d4/d15/l26 0 2024-09-20T19:05:53.807 INFO:tasks.workunit.client.1.smithi098.stdout:1/237: chown d1/d3/f19 236839 1 2024-09-20T19:05:53.808 INFO:tasks.workunit.client.0.smithi027.stdout:9/346: dwrite d0/d9/d3d/f54 [0,4194304] 0 2024-09-20T19:05:53.809 INFO:tasks.workunit.client.0.smithi027.stdout:4/174: unlink d5/d13/c27 0 2024-09-20T19:05:53.813 INFO:tasks.workunit.client.0.smithi027.stdout:8/196: write d2/d3/f11 [99369,109778] 0 2024-09-20T19:05:53.819 INFO:tasks.workunit.client.1.smithi098.stdout:1/238: creat d1/d3/f46 x:0 0 0 2024-09-20T19:05:53.821 INFO:tasks.workunit.client.0.smithi027.stdout:7/237: link d3/c19 d3/d8/d1c/c54 0 2024-09-20T19:05:53.821 INFO:tasks.workunit.client.1.smithi098.stdout:4/360: fsync d3/d2e/f67 0 2024-09-20T19:05:53.824 INFO:tasks.workunit.client.0.smithi027.stdout:6/160: mkdir d4/d1b/d2b 0 2024-09-20T19:05:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:7/238: dwrite d3/d8/da/d2e/d39/f3b [0,4194304] 0 2024-09-20T19:05:53.829 INFO:tasks.workunit.client.1.smithi098.stdout:2/628: dwrite d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:53.829 INFO:tasks.workunit.client.0.smithi027.stdout:9/347: symlink d0/d9/df/d1b/d64/l71 0 2024-09-20T19:05:53.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/629: chown d3/df/c8e 89357194 1 2024-09-20T19:05:53.831 INFO:tasks.workunit.client.0.smithi027.stdout:4/175: rmdir d5/d11/d17 39 2024-09-20T19:05:53.832 INFO:tasks.workunit.client.0.smithi027.stdout:7/239: chown d3/d8/da/d2e/f4c 712559321 1 2024-09-20T19:05:53.834 INFO:tasks.workunit.client.0.smithi027.stdout:3/261: symlink d0/d1/d13/d3c/l58 0 2024-09-20T19:05:53.834 INFO:tasks.workunit.client.1.smithi098.stdout:2/630: write d3/f12 [5437200,102297] 0 2024-09-20T19:05:53.835 INFO:tasks.workunit.client.0.smithi027.stdout:6/161: mkdir d4/d15/d2c 0 2024-09-20T19:05:53.836 INFO:tasks.workunit.client.1.smithi098.stdout:4/361: link d3/d6/d11/d59/l78 d3/d7d/l83 0 2024-09-20T19:05:53.836 INFO:tasks.workunit.client.1.smithi098.stdout:3/301: write d4/d25/f2b [1366742,54262] 0 2024-09-20T19:05:53.837 INFO:tasks.workunit.client.1.smithi098.stdout:2/631: creat d3/df/fd0 x:0 0 0 2024-09-20T19:05:53.839 INFO:tasks.workunit.client.0.smithi027.stdout:2/174: sync 2024-09-20T19:05:53.840 INFO:tasks.workunit.client.1.smithi098.stdout:2/632: dread d3/d16/d1d/d2b/f56 [0,4194304] 0 2024-09-20T19:05:53.841 INFO:tasks.workunit.client.1.smithi098.stdout:2/633: write d3/f15 [5026069,90357] 0 2024-09-20T19:05:53.843 INFO:tasks.workunit.client.1.smithi098.stdout:3/302: mknod d4/d19/c5d 0 2024-09-20T19:05:53.845 INFO:tasks.workunit.client.0.smithi027.stdout:7/240: write d3/d8/da/f4e [776920,75] 0 2024-09-20T19:05:53.848 INFO:tasks.workunit.client.1.smithi098.stdout:1/239: rename d1/d3/f15 to d1/d3/d2e/f47 0 2024-09-20T19:05:53.850 INFO:tasks.workunit.client.1.smithi098.stdout:2/634: dwrite d3/d51/d9f/fc6 [0,4194304] 0 2024-09-20T19:05:53.850 INFO:tasks.workunit.client.1.smithi098.stdout:1/240: stat d1/d3/d2e/f3a 0 2024-09-20T19:05:53.851 INFO:tasks.workunit.client.1.smithi098.stdout:4/362: mkdir d3/d6/d11/d57/d7f/d84 0 2024-09-20T19:05:53.851 INFO:tasks.workunit.client.0.smithi027.stdout:5/292: dwrite d4/da/fb [4194304,4194304] 0 2024-09-20T19:05:53.853 INFO:tasks.workunit.client.1.smithi098.stdout:4/363: write d3/d6/d11/d59/d50/f63 [1589566,74171] 0 2024-09-20T19:05:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:3/262: symlink d0/d1/d13/d15/d55/l59 0 2024-09-20T19:05:53.853 INFO:tasks.workunit.client.0.smithi027.stdout:6/162: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:53.856 INFO:tasks.workunit.client.0.smithi027.stdout:9/348: dwrite d0/d9/df/f2a [0,4194304] 0 2024-09-20T19:05:53.858 INFO:tasks.workunit.client.1.smithi098.stdout:2/635: creat d3/d51/d9f/dbc/fd1 x:0 0 0 2024-09-20T19:05:53.859 INFO:tasks.workunit.client.0.smithi027.stdout:8/197: dread d2/d14/d13/f1d [0,4194304] 0 2024-09-20T19:05:53.860 INFO:tasks.workunit.client.1.smithi098.stdout:2/636: chown d3/df/d13/f3a 1515604071 1 2024-09-20T19:05:53.860 INFO:tasks.workunit.client.0.smithi027.stdout:7/241: creat d3/d8/da/d2e/f55 x:0 0 0 2024-09-20T19:05:53.861 INFO:tasks.workunit.client.0.smithi027.stdout:2/175: mknod d3/d1c/d26/c29 0 2024-09-20T19:05:53.864 INFO:tasks.workunit.client.0.smithi027.stdout:4/176: mkdir d5/d11/d38 0 2024-09-20T19:05:53.864 INFO:tasks.workunit.client.0.smithi027.stdout:9/349: chown d0/d9/d3d/l48 89258646 1 2024-09-20T19:05:53.864 INFO:tasks.workunit.client.0.smithi027.stdout:6/163: read f0 [3805358,27518] 0 2024-09-20T19:05:53.865 INFO:tasks.workunit.client.1.smithi098.stdout:3/303: mknod d4/d19/d1d/c5e 0 2024-09-20T19:05:53.866 INFO:tasks.workunit.client.0.smithi027.stdout:6/164: fdatasync d4/d6/f19 0 2024-09-20T19:05:53.867 INFO:tasks.workunit.client.0.smithi027.stdout:5/293: creat d4/da/de/d3e/d44/f60 x:0 0 0 2024-09-20T19:05:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:2/176: mkdir d3/d1c/d26/d2a 0 2024-09-20T19:05:53.868 INFO:tasks.workunit.client.0.smithi027.stdout:6/165: chown d4/d6/c1c 88 1 2024-09-20T19:05:53.871 INFO:tasks.workunit.client.1.smithi098.stdout:4/364: creat d3/d7d/f85 x:0 0 0 2024-09-20T19:05:53.872 INFO:tasks.workunit.client.0.smithi027.stdout:7/242: mkdir d3/d8/d26/d45/d56 0 2024-09-20T19:05:53.873 INFO:tasks.workunit.client.1.smithi098.stdout:3/304: fsync d4/d25/f3c 0 2024-09-20T19:05:53.874 INFO:tasks.workunit.client.0.smithi027.stdout:7/243: write d3/d8/da/d51/f53 [579071,25793] 0 2024-09-20T19:05:53.875 INFO:tasks.workunit.client.0.smithi027.stdout:7/244: rename d3 to d3/d8/d26/d45/d57 22 2024-09-20T19:05:53.876 INFO:tasks.workunit.client.0.smithi027.stdout:5/294: dread d4/da/d50/f54 [4194304,4194304] 0 2024-09-20T19:05:53.876 INFO:tasks.workunit.client.0.smithi027.stdout:8/198: symlink d2/d3/d1b/d2d/l40 0 2024-09-20T19:05:53.877 INFO:tasks.workunit.client.1.smithi098.stdout:3/305: read d4/d25/f35 [1178072,115153] 0 2024-09-20T19:05:53.878 INFO:tasks.workunit.client.0.smithi027.stdout:4/177: symlink d5/d13/d16/l39 0 2024-09-20T19:05:53.878 INFO:tasks.workunit.client.1.smithi098.stdout:3/306: read - d4/d19/d1d/d2f/f53 zero size 2024-09-20T19:05:53.878 INFO:tasks.workunit.client.0.smithi027.stdout:7/245: truncate d3/d8/da/dc/f1d 1673704 0 2024-09-20T19:05:53.880 INFO:tasks.workunit.client.1.smithi098.stdout:4/365: rmdir d3/d6 39 2024-09-20T19:05:53.880 INFO:tasks.workunit.client.0.smithi027.stdout:4/178: write d5/f37 [638712,67554] 0 2024-09-20T19:05:53.881 INFO:tasks.workunit.client.0.smithi027.stdout:7/246: read d3/d8/da/dc/f21 [8294430,112013] 0 2024-09-20T19:05:53.882 INFO:tasks.workunit.client.0.smithi027.stdout:7/247: readlink d3/d8/l31 0 2024-09-20T19:05:53.882 INFO:tasks.workunit.client.0.smithi027.stdout:5/295: dread d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:53.883 INFO:tasks.workunit.client.0.smithi027.stdout:9/350: creat d0/d9/df/d1c/f72 x:0 0 0 2024-09-20T19:05:53.883 INFO:tasks.workunit.client.1.smithi098.stdout:4/366: read d3/fc [3465084,97931] 0 2024-09-20T19:05:53.885 INFO:tasks.workunit.client.0.smithi027.stdout:6/166: creat d4/f2d x:0 0 0 2024-09-20T19:05:53.885 INFO:tasks.workunit.client.0.smithi027.stdout:5/296: fdatasync d4/da/de/d3e/d44/f4c 0 2024-09-20T19:05:53.886 INFO:tasks.workunit.client.0.smithi027.stdout:9/351: read d0/d9/df/d1b/f23 [4977610,10373] 0 2024-09-20T19:05:53.887 INFO:tasks.workunit.client.1.smithi098.stdout:2/637: rename d3/d16/f45 to d3/d16/d1d/d2b/fd2 0 2024-09-20T19:05:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:5/297: write d4/da/de/f35 [5140406,76] 0 2024-09-20T19:05:53.888 INFO:tasks.workunit.client.0.smithi027.stdout:9/352: fsync d0/d9/df/f2a 0 2024-09-20T19:05:53.889 INFO:tasks.workunit.client.0.smithi027.stdout:5/298: read d4/da/de/f40 [20535,95483] 0 2024-09-20T19:05:53.890 INFO:tasks.workunit.client.1.smithi098.stdout:3/307: chown d4/d19/d1d/d22/f2c 201437 1 2024-09-20T19:05:53.891 INFO:tasks.workunit.client.1.smithi098.stdout:1/241: getdents d1/d3/df/d34/d43 0 2024-09-20T19:05:53.893 INFO:tasks.workunit.client.0.smithi027.stdout:8/199: rename d2/d14/d13/f1c to d2/d3/f41 0 2024-09-20T19:05:53.894 INFO:tasks.workunit.client.0.smithi027.stdout:8/200: readlink d2/lb 0 2024-09-20T19:05:53.895 INFO:tasks.workunit.client.1.smithi098.stdout:4/367: write d3/d6/d11/d1e/f26 [4156868,95032] 0 2024-09-20T19:05:53.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/215: sync 2024-09-20T19:05:53.900 INFO:tasks.workunit.client.1.smithi098.stdout:3/308: rmdir d4/d19/d1d/d2f/d3e 39 2024-09-20T19:05:53.903 INFO:tasks.workunit.client.1.smithi098.stdout:6/216: dread d0/d7/dc/f41 [0,4194304] 0 2024-09-20T19:05:53.907 INFO:tasks.workunit.client.1.smithi098.stdout:3/309: dwrite d4/d19/f20 [0,4194304] 0 2024-09-20T19:05:53.907 INFO:tasks.workunit.client.1.smithi098.stdout:4/368: mknod d3/d6/d11/d57/d7f/c86 0 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 -- 172.21.15.27:0/2404980870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c0fffe0 msgr2=0x7f4d5c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 --2- 172.21.15.27:0/2404980870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1003e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009c20 tx=0x7f4d5402a970 comp rx=0 tx=0).stop 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 -- 172.21.15.27:0/2404980870 shutdown_connections 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 --2- 172.21.15.27:0/2404980870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 --2- 172.21.15.27:0/2404980870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1003e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 -- 172.21.15.27:0/2404980870 >> 172.21.15.27:0/2404980870 conn(0x7f4d5c0fb770 msgr2=0x7f4d5c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 -- 172.21.15.27:0/2404980870 shutdown_connections 2024-09-20T19:05:53.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.902+0000 7f4d60942640 1 -- 172.21.15.27:0/2404980870 wait complete. 2024-09-20T19:05:53.909 INFO:tasks.workunit.client.1.smithi098.stdout:4/369: stat d3/d6/d11/d1e/d2a/l35 0 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.903+0000 7f4d60942640 1 Processor -- start 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.903+0000 7f4d60942640 1 -- start start 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.903+0000 7f4d60942640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.903+0000 7f4d60942640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d60942640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c108590 con 0x7f4d5c1011e0 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d60942640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c108410 con 0x7f4d5c0fffe0 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35380/0 (socket says 172.21.15.27:35380) 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 -- 172.21.15.27:0/3421345402 learned_addr learned my addr 172.21.15.27:0/3421345402 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d5a59c640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 -- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c0fffe0 msgr2=0x7f4d5c1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 -- 172.21.15.27:0/3421345402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c1955e0 con 0x7f4d5c1011e0 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.904+0000 7f4d59d9b640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000fa80 tx=0x7f4d5000ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.905+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d5000dc90 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.905+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d5000de30 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.905+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d50017410 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.905+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c1958d0 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.905+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c195ee0 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.906+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5c108d70 con 0x7f4d5c1011e0 2024-09-20T19:05:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.907+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 23) ==== 52072+0+0 (secure 0 0 0) 0x7f4d5001e020 con 0x7f4d5c1011e0 2024-09-20T19:05:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.907+0000 7f4d4b7fe640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 0x7f4d440420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.907+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f4d50014070 con 0x7f4d5c1011e0 2024-09-20T19:05:53.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.909+0000 7f4d5a59c640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 0x7f4d440420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:53.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.912+0000 7f4d5a59c640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 0x7f4d440420a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f80 tx=0x7f4d5403c040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:53.919 INFO:tasks.workunit.client.0.smithi027.stdout:3/263: link d0/f47 d0/f5a 0 2024-09-20T19:05:53.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:53.914+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4d50012150 con 0x7f4d5c1011e0 2024-09-20T19:05:53.921 INFO:tasks.workunit.client.1.smithi098.stdout:1/242: creat d1/d3/df/d34/f48 x:0 0 0 2024-09-20T19:05:53.922 INFO:tasks.workunit.client.0.smithi027.stdout:0/287: sync 2024-09-20T19:05:53.923 INFO:tasks.workunit.client.0.smithi027.stdout:9/353: mknod d0/d9/d3d/d4f/c73 0 2024-09-20T19:05:53.925 INFO:tasks.workunit.client.0.smithi027.stdout:9/354: dread - d0/d9/df/d1c/d6a/d6d/f68 zero size 2024-09-20T19:05:53.925 INFO:tasks.workunit.client.1.smithi098.stdout:2/638: dwrite d3/db0/f6a [0,4194304] 0 2024-09-20T19:05:53.925 INFO:tasks.workunit.client.0.smithi027.stdout:5/299: fdatasync d4/da/de/f37 0 2024-09-20T19:05:53.930 INFO:tasks.workunit.client.0.smithi027.stdout:6/167: rename d4/d6/l18 to d4/l2e 0 2024-09-20T19:05:53.934 INFO:tasks.workunit.client.0.smithi027.stdout:7/248: dwrite d3/d24/f2c [0,4194304] 0 2024-09-20T19:05:53.934 INFO:tasks.workunit.client.0.smithi027.stdout:2/177: truncate d3/ff 3220215 0 2024-09-20T19:05:53.935 INFO:tasks.workunit.client.1.smithi098.stdout:1/243: creat d1/d3/f49 x:0 0 0 2024-09-20T19:05:53.935 INFO:tasks.workunit.client.0.smithi027.stdout:7/249: rename d3/d8 to d3/d8/da/d2e/d50/d58 22 2024-09-20T19:05:53.936 INFO:tasks.workunit.client.1.smithi098.stdout:2/639: mkdir d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3 0 2024-09-20T19:05:53.939 INFO:tasks.workunit.client.1.smithi098.stdout:1/244: write d1/d3/f2c [406959,89265] 0 2024-09-20T19:05:53.941 INFO:tasks.workunit.client.1.smithi098.stdout:2/640: rename d3/db0/d69/cab to d3/cd4 0 2024-09-20T19:05:53.943 INFO:tasks.workunit.client.1.smithi098.stdout:2/641: fdatasync d3/d16/d1d/d2b/d46/fc9 0 2024-09-20T19:05:53.943 INFO:tasks.workunit.client.0.smithi027.stdout:0/288: truncate d2/d14/f31 679670 0 2024-09-20T19:05:53.944 INFO:tasks.workunit.client.1.smithi098.stdout:2/642: read - d3/d16/d1a/f7c zero size 2024-09-20T19:05:53.944 INFO:tasks.workunit.client.1.smithi098.stdout:1/245: mkdir d1/d3/df/d4a 0 2024-09-20T19:05:53.945 INFO:tasks.workunit.client.1.smithi098.stdout:2/643: stat d3/d51/d9f 0 2024-09-20T19:05:53.950 INFO:tasks.workunit.client.1.smithi098.stdout:6/217: dwrite d0/d7/f3d [0,4194304] 0 2024-09-20T19:05:53.950 INFO:tasks.workunit.client.0.smithi027.stdout:9/355: creat d0/d9/df/f74 x:0 0 0 2024-09-20T19:05:53.950 INFO:tasks.workunit.client.0.smithi027.stdout:8/201: write d2/d2a/f2f [1357347,125499] 0 2024-09-20T19:05:53.952 INFO:tasks.workunit.client.0.smithi027.stdout:5/300: unlink d4/d1f/c42 0 2024-09-20T19:05:53.957 INFO:tasks.workunit.client.0.smithi027.stdout:6/168: creat d4/d15/f2f x:0 0 0 2024-09-20T19:05:53.957 INFO:tasks.workunit.client.0.smithi027.stdout:6/169: chown f0 61275 1 2024-09-20T19:05:53.958 INFO:tasks.workunit.client.0.smithi027.stdout:6/170: write d4/f9 [1794273,37389] 0 2024-09-20T19:05:53.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/218: dwrite d0/f22 [0,4194304] 0 2024-09-20T19:05:53.959 INFO:tasks.workunit.client.0.smithi027.stdout:6/171: write d4/f9 [979999,26291] 0 2024-09-20T19:05:53.962 INFO:tasks.workunit.client.0.smithi027.stdout:4/179: write d5/d11/f23 [1811902,11420] 0 2024-09-20T19:05:53.964 INFO:tasks.workunit.client.0.smithi027.stdout:6/172: read d4/d6/fa [1659301,40249] 0 2024-09-20T19:05:53.964 INFO:tasks.workunit.client.1.smithi098.stdout:6/219: dread d0/de/d1b/f26 [0,4194304] 0 2024-09-20T19:05:53.965 INFO:tasks.workunit.client.1.smithi098.stdout:6/220: fsync d0/d7/d24/d29/f35 0 2024-09-20T19:05:53.971 INFO:tasks.workunit.client.0.smithi027.stdout:3/264: mknod d0/c5b 0 2024-09-20T19:05:53.973 INFO:tasks.workunit.client.0.smithi027.stdout:8/202: rename d2/d3/d1b/d2d/l32 to d2/d3/d1b/d2d/l42 0 2024-09-20T19:05:53.973 INFO:tasks.workunit.client.0.smithi027.stdout:6/173: dwrite d4/d6/f19 [0,4194304] 0 2024-09-20T19:05:53.974 INFO:tasks.workunit.client.1.smithi098.stdout:6/221: mkdir d0/d7/d24/d29/d42 0 2024-09-20T19:05:53.977 INFO:tasks.workunit.client.1.smithi098.stdout:6/222: dread d0/d7/dc/fd [0,4194304] 0 2024-09-20T19:05:53.977 INFO:tasks.workunit.client.1.smithi098.stdout:6/223: readlink d0/d7/d24/l27 0 2024-09-20T19:05:53.979 INFO:tasks.workunit.client.0.smithi027.stdout:5/301: rename d4/d3c to d4/da/de/d3e/d61 0 2024-09-20T19:05:53.982 INFO:tasks.workunit.client.1.smithi098.stdout:1/246: truncate d1/d3/f2d 327645 0 2024-09-20T19:05:53.984 INFO:tasks.workunit.client.0.smithi027.stdout:4/180: mkdir d5/d13/d16/d21/d3a 0 2024-09-20T19:05:53.986 INFO:tasks.workunit.client.1.smithi098.stdout:6/224: dread d0/f22 [0,4194304] 0 2024-09-20T19:05:53.986 INFO:tasks.workunit.client.0.smithi027.stdout:7/250: symlink d3/d8/da/l59 0 2024-09-20T19:05:53.986 INFO:tasks.workunit.client.1.smithi098.stdout:2/644: dwrite d3/df/f11 [0,4194304] 0 2024-09-20T19:05:53.988 INFO:tasks.workunit.client.0.smithi027.stdout:7/251: write d3/d8/da/d51/f53 [1503689,53053] 0 2024-09-20T19:05:53.989 INFO:tasks.workunit.client.0.smithi027.stdout:8/203: dread d2/d3/d6/d21/f38 [0,4194304] 0 2024-09-20T19:05:53.991 INFO:tasks.workunit.client.0.smithi027.stdout:8/204: fdatasync d2/d3/d6/ff 0 2024-09-20T19:05:53.993 INFO:tasks.workunit.client.0.smithi027.stdout:3/265: truncate d0/d19/f4a 126686 0 2024-09-20T19:05:53.994 INFO:tasks.workunit.client.0.smithi027.stdout:3/266: readlink d0/d1/d7/l34 0 2024-09-20T19:05:53.995 INFO:tasks.workunit.client.1.smithi098.stdout:6/225: mkdir d0/de/d1b/d37/d43 0 2024-09-20T19:05:53.996 INFO:tasks.workunit.client.1.smithi098.stdout:6/226: chown d0/d7/d24/d29/c2d 168952710 1 2024-09-20T19:05:53.997 INFO:tasks.workunit.client.0.smithi027.stdout:6/174: symlink d4/d1b/l30 0 2024-09-20T19:05:53.997 INFO:tasks.workunit.client.1.smithi098.stdout:1/247: getdents d1/d3/df/d34/d43 0 2024-09-20T19:05:53.998 INFO:tasks.workunit.client.1.smithi098.stdout:6/227: truncate d0/d7/dc/f1a 5633165 0 2024-09-20T19:05:53.999 INFO:tasks.workunit.client.0.smithi027.stdout:3/267: truncate d0/d1/f30 1294784 0 2024-09-20T19:05:53.999 INFO:tasks.workunit.client.0.smithi027.stdout:6/175: fsync d4/d1b/f1e 0 2024-09-20T19:05:54.000 INFO:tasks.workunit.client.1.smithi098.stdout:1/248: mkdir d1/d3/df/d4b 0 2024-09-20T19:05:54.000 INFO:tasks.workunit.client.0.smithi027.stdout:8/205: dwrite d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:54.001 INFO:tasks.workunit.client.0.smithi027.stdout:4/181: unlink d5/f1f 0 2024-09-20T19:05:54.002 INFO:tasks.workunit.client.0.smithi027.stdout:2/178: link d3/d13/f19 d3/d13/f2b 0 2024-09-20T19:05:54.003 INFO:tasks.workunit.client.0.smithi027.stdout:4/182: stat d5/l25 0 2024-09-20T19:05:54.003 INFO:tasks.workunit.client.1.smithi098.stdout:6/228: dread d0/f22 [0,4194304] 0 2024-09-20T19:05:54.003 INFO:tasks.workunit.client.0.smithi027.stdout:8/206: read d2/d3/f41 [1757727,54188] 0 2024-09-20T19:05:54.004 INFO:tasks.workunit.client.0.smithi027.stdout:3/268: chown d0/d1/d13/d15/l24 464435 1 2024-09-20T19:05:54.004 INFO:tasks.workunit.client.0.smithi027.stdout:1/227: sync 2024-09-20T19:05:54.005 INFO:tasks.workunit.client.1.smithi098.stdout:1/249: unlink d1/d3/f44 0 2024-09-20T19:05:54.005 INFO:tasks.workunit.client.0.smithi027.stdout:0/289: link d2/d20/d52/d29/l59 d2/d20/d52/d29/l68 0 2024-09-20T19:05:54.007 INFO:tasks.workunit.client.1.smithi098.stdout:2/645: getdents d3 0 2024-09-20T19:05:54.009 INFO:tasks.workunit.client.0.smithi027.stdout:6/176: dread d4/d6/f19 [0,4194304] 0 2024-09-20T19:05:54.012 INFO:tasks.workunit.client.1.smithi098.stdout:6/229: rename d0/d7 to d0/de/d1b/d37/d44 0 2024-09-20T19:05:54.014 INFO:tasks.workunit.client.1.smithi098.stdout:6/230: truncate d0/de/d1b/d37/d44/d24/f3e 145687 0 2024-09-20T19:05:54.014 INFO:tasks.workunit.client.1.smithi098.stdout:1/250: mknod d1/d3/df/c4c 0 2024-09-20T19:05:54.015 INFO:tasks.workunit.client.1.smithi098.stdout:1/251: stat d1/d3/f2c 0 2024-09-20T19:05:54.015 INFO:tasks.workunit.client.1.smithi098.stdout:6/231: chown d0/de/d1b/d37/d44/d24/f3e 133173394 1 2024-09-20T19:05:54.015 INFO:tasks.workunit.client.1.smithi098.stdout:1/252: chown d1/d3/d2e/f3b 86 1 2024-09-20T19:05:54.020 INFO:tasks.workunit.client.1.smithi098.stdout:6/232: creat d0/de/d1b/d37/f45 x:0 0 0 2024-09-20T19:05:54.021 INFO:tasks.workunit.client.0.smithi027.stdout:9/356: truncate d0/d9/df/f50 2102127 0 2024-09-20T19:05:54.024 INFO:tasks.workunit.client.0.smithi027.stdout:6/177: dread d4/d6/fa [0,4194304] 0 2024-09-20T19:05:54.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/646: unlink d3/df/f11 0 2024-09-20T19:05:54.025 INFO:tasks.workunit.client.0.smithi027.stdout:7/252: dread d3/d8/da/f13 [0,4194304] 0 2024-09-20T19:05:54.028 INFO:tasks.workunit.client.1.smithi098.stdout:6/233: write d0/de/d1b/d37/d44/dc/f41 [488840,9341] 0 2024-09-20T19:05:54.029 INFO:tasks.workunit.client.0.smithi027.stdout:7/253: write d3/d24/f2c [2294184,6392] 0 2024-09-20T19:05:54.029 INFO:tasks.workunit.client.1.smithi098.stdout:6/234: write d0/de/d1b/f1f [2195846,99186] 0 2024-09-20T19:05:54.032 INFO:tasks.workunit.client.1.smithi098.stdout:2/647: creat d3/d16/d1d/d2b/d46/fd5 x:0 0 0 2024-09-20T19:05:54.032 INFO:tasks.workunit.client.0.smithi027.stdout:8/207: mkdir d2/d14/d13/d43 0 2024-09-20T19:05:54.032 INFO:tasks.workunit.client.0.smithi027.stdout:9/357: dwrite d0/d9/d3d/f54 [0,4194304] 0 2024-09-20T19:05:54.032 INFO:tasks.workunit.client.0.smithi027.stdout:8/208: readlink d2/d14/l29 0 2024-09-20T19:05:54.034 INFO:tasks.workunit.client.0.smithi027.stdout:9/358: write d0/d9/df/d1b/f17 [3821909,100804] 0 2024-09-20T19:05:54.035 INFO:tasks.workunit.client.0.smithi027.stdout:3/269: creat d0/d19/d54/f5c x:0 0 0 2024-09-20T19:05:54.037 INFO:tasks.workunit.client.0.smithi027.stdout:0/290: rename d2/d14/l17 to d2/d48/l69 0 2024-09-20T19:05:54.039 INFO:tasks.workunit.client.0.smithi027.stdout:0/291: chown d2/d14/d1b 904 1 2024-09-20T19:05:54.039 INFO:tasks.workunit.client.1.smithi098.stdout:6/235: mknod d0/c46 0 2024-09-20T19:05:54.043 INFO:tasks.workunit.client.0.smithi027.stdout:1/228: dwrite d2/d1b/d3a/f35 [4194304,4194304] 0 2024-09-20T19:05:54.047 INFO:tasks.workunit.client.0.smithi027.stdout:1/229: fsync d2/d8/d41/f43 0 2024-09-20T19:05:54.049 INFO:tasks.workunit.client.0.smithi027.stdout:6/178: write d4/d6/f19 [2450442,79405] 0 2024-09-20T19:05:54.050 INFO:tasks.workunit.client.0.smithi027.stdout:6/179: chown d4/f9 82083 1 2024-09-20T19:05:54.050 INFO:tasks.workunit.client.0.smithi027.stdout:6/180: dread - d4/d15/f2f zero size 2024-09-20T19:05:54.052 INFO:tasks.workunit.client.1.smithi098.stdout:6/236: symlink d0/de/d1b/d37/d43/l47 0 2024-09-20T19:05:54.055 INFO:tasks.workunit.client.1.smithi098.stdout:6/237: write d0/de/d1b/d37/d44/f3d [2736466,10592] 0 2024-09-20T19:05:54.057 INFO:tasks.workunit.client.1.smithi098.stdout:6/238: write d0/de/d1b/f28 [505784,24351] 0 2024-09-20T19:05:54.058 INFO:tasks.workunit.client.1.smithi098.stdout:1/253: dwrite d1/d3/df/d34/d43/f41 [0,4194304] 0 2024-09-20T19:05:54.059 INFO:tasks.workunit.client.1.smithi098.stdout:1/254: chown d1/d3/df 363674 1 2024-09-20T19:05:54.060 INFO:tasks.workunit.client.1.smithi098.stdout:6/239: truncate d0/de/d1b/d37/f40 792684 0 2024-09-20T19:05:54.062 INFO:tasks.workunit.client.1.smithi098.stdout:1/255: chown d1/d3/df/l28 350936 1 2024-09-20T19:05:54.069 INFO:tasks.workunit.client.1.smithi098.stdout:6/240: creat d0/de/d1b/d37/d43/f48 x:0 0 0 2024-09-20T19:05:54.070 INFO:tasks.workunit.client.1.smithi098.stdout:1/256: dread d1/d3/df/d34/d43/f41 [0,4194304] 0 2024-09-20T19:05:54.071 INFO:tasks.workunit.client.0.smithi027.stdout:8/209: dwrite d2/d3/f41 [0,4194304] 0 2024-09-20T19:05:54.073 INFO:tasks.workunit.client.1.smithi098.stdout:1/257: chown d1/d3/df/f23 42991 1 2024-09-20T19:05:54.073 INFO:tasks.workunit.client.1.smithi098.stdout:2/648: dwrite d3/df/d13/f32 [0,4194304] 0 2024-09-20T19:05:54.074 INFO:tasks.workunit.client.1.smithi098.stdout:2/649: chown d3/db0 4709 1 2024-09-20T19:05:54.075 INFO:tasks.workunit.client.0.smithi027.stdout:9/359: dread d0/d9/d3d/f52 [0,4194304] 0 2024-09-20T19:05:54.076 INFO:tasks.workunit.client.0.smithi027.stdout:4/183: creat d5/d11/d17/d32/f3b x:0 0 0 2024-09-20T19:05:54.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/241: mknod d0/de/d1b/d37/d43/c49 0 2024-09-20T19:05:54.077 INFO:tasks.workunit.client.0.smithi027.stdout:6/181: symlink d4/l31 0 2024-09-20T19:05:54.077 INFO:tasks.workunit.client.0.smithi027.stdout:9/360: stat d0/d9/d3d/d5a/f63 0 2024-09-20T19:05:54.078 INFO:tasks.workunit.client.0.smithi027.stdout:7/254: mknod d3/d8/c5a 0 2024-09-20T19:05:54.080 INFO:tasks.workunit.client.1.smithi098.stdout:6/242: write d0/de/d1b/f1c [4687767,34474] 0 2024-09-20T19:05:54.081 INFO:tasks.workunit.client.0.smithi027.stdout:9/361: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:54.083 INFO:tasks.workunit.client.0.smithi027.stdout:2/179: dwrite d3/d1c/f23 [0,4194304] 0 2024-09-20T19:05:54.084 INFO:tasks.workunit.client.1.smithi098.stdout:1/258: dwrite d1/f10 [4194304,4194304] 0 2024-09-20T19:05:54.085 INFO:tasks.workunit.client.0.smithi027.stdout:5/302: truncate d4/da/f2c 385705 0 2024-09-20T19:05:54.088 INFO:tasks.workunit.client.1.smithi098.stdout:1/259: readlink d1/d3/l39 0 2024-09-20T19:05:54.093 INFO:tasks.workunit.client.0.smithi027.stdout:8/210: write d2/d3/f31 [2439650,128935] 0 2024-09-20T19:05:54.094 INFO:tasks.workunit.client.1.smithi098.stdout:6/243: dwrite d0/de/d1b/d37/d44/f13 [4194304,4194304] 0 2024-09-20T19:05:54.094 INFO:tasks.workunit.client.1.smithi098.stdout:1/260: creat d1/d3/df/d4b/f4d x:0 0 0 2024-09-20T19:05:54.097 INFO:tasks.workunit.client.0.smithi027.stdout:4/184: creat d5/d11/d17/d1b/f3c x:0 0 0 2024-09-20T19:05:54.098 INFO:tasks.workunit.client.0.smithi027.stdout:9/362: dwrite d0/d9/df/d1c/d6a/d6d/dd/f5b [0,4194304] 0 2024-09-20T19:05:54.100 INFO:tasks.workunit.client.0.smithi027.stdout:2/180: creat d3/de/f2c x:0 0 0 2024-09-20T19:05:54.101 INFO:tasks.workunit.client.0.smithi027.stdout:7/255: dread d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:54.102 INFO:tasks.workunit.client.0.smithi027.stdout:2/181: write d3/de/f1a [554465,53592] 0 2024-09-20T19:05:54.106 INFO:tasks.workunit.client.1.smithi098.stdout:6/244: dwrite d0/de/d1b/f1c [4194304,4194304] 0 2024-09-20T19:05:54.108 INFO:tasks.workunit.client.0.smithi027.stdout:0/292: truncate d2/fe 7813385 0 2024-09-20T19:05:54.111 INFO:tasks.workunit.client.1.smithi098.stdout:6/245: dread d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:05:54.111 INFO:tasks.workunit.client.0.smithi027.stdout:5/303: write d4/d1f/d28/f5a [179995,41197] 0 2024-09-20T19:05:54.113 INFO:tasks.workunit.client.0.smithi027.stdout:3/270: getdents d0/d19 0 2024-09-20T19:05:54.114 INFO:tasks.workunit.client.0.smithi027.stdout:1/230: truncate d2/d15/f29 667563 0 2024-09-20T19:05:54.119 INFO:tasks.workunit.client.0.smithi027.stdout:8/211: stat d2/d3/d1b/d2d/l42 0 2024-09-20T19:05:54.119 INFO:tasks.workunit.client.1.smithi098.stdout:6/246: dwrite d0/de/d1b/d37/d43/f48 [0,4194304] 0 2024-09-20T19:05:54.122 INFO:tasks.workunit.client.0.smithi027.stdout:8/212: write d2/f8 [3010028,122975] 0 2024-09-20T19:05:54.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/256: rmdir d3/d8/da/dc 39 2024-09-20T19:05:54.127 INFO:tasks.workunit.client.0.smithi027.stdout:8/213: chown d2/d3/l5 0 1 2024-09-20T19:05:54.128 INFO:tasks.workunit.client.0.smithi027.stdout:2/182: dwrite d3/de/f1a [0,4194304] 0 2024-09-20T19:05:54.132 INFO:tasks.workunit.client.0.smithi027.stdout:1/231: dread d2/d1b/d3a/f35 [0,4194304] 0 2024-09-20T19:05:54.133 INFO:tasks.workunit.client.0.smithi027.stdout:0/293: mknod d2/d48/c6a 0 2024-09-20T19:05:54.134 INFO:tasks.workunit.client.0.smithi027.stdout:5/304: rmdir d4/d1f 39 2024-09-20T19:05:54.135 INFO:tasks.workunit.client.0.smithi027.stdout:0/294: readlink d2/d20/d52/d29/l38 0 2024-09-20T19:05:54.137 INFO:tasks.workunit.client.0.smithi027.stdout:0/295: fsync d2/d20/d52/f42 0 2024-09-20T19:05:54.139 INFO:tasks.workunit.client.1.smithi098.stdout:1/261: creat d1/f4e x:0 0 0 2024-09-20T19:05:54.140 INFO:tasks.workunit.client.0.smithi027.stdout:0/296: chown d2/d20/d52/lf 0 1 2024-09-20T19:05:54.145 INFO:tasks.workunit.client.1.smithi098.stdout:8/406: sync 2024-09-20T19:05:54.145 INFO:tasks.workunit.client.1.smithi098.stdout:7/365: sync 2024-09-20T19:05:54.146 INFO:tasks.workunit.client.0.smithi027.stdout:0/297: write d2/d14/d1b/d39/f66 [423758,29002] 0 2024-09-20T19:05:54.146 INFO:tasks.workunit.client.0.smithi027.stdout:0/298: write d2/d20/f47 [1649539,52004] 0 2024-09-20T19:05:54.146 INFO:tasks.workunit.client.0.smithi027.stdout:1/232: dwrite d2/f13 [8388608,4194304] 0 2024-09-20T19:05:54.146 INFO:tasks.workunit.client.0.smithi027.stdout:2/183: creat d3/d1c/f2d x:0 0 0 2024-09-20T19:05:54.146 INFO:tasks.workunit.client.0.smithi027.stdout:0/299: dread - d2/d14/f3f zero size 2024-09-20T19:05:54.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/366: rmdir d3/d10/d16/d17/d33/d1f/d28/d66 39 2024-09-20T19:05:54.147 INFO:tasks.workunit.client.0.smithi027.stdout:4/185: rmdir d5/d11/d38 0 2024-09-20T19:05:54.148 INFO:tasks.workunit.client.1.smithi098.stdout:7/367: write d3/d10/d18/f51 [878047,8415] 0 2024-09-20T19:05:54.149 INFO:tasks.workunit.client.0.smithi027.stdout:6/182: getdents d4/d6 0 2024-09-20T19:05:54.151 INFO:tasks.workunit.client.0.smithi027.stdout:5/305: creat d4/da/de/d1e/f62 x:0 0 0 2024-09-20T19:05:54.151 INFO:tasks.workunit.client.1.smithi098.stdout:8/407: rename d7/de/d11/d19/f2d to d7/de/f94 0 2024-09-20T19:05:54.152 INFO:tasks.workunit.client.0.smithi027.stdout:2/184: symlink d3/de/l2e 0 2024-09-20T19:05:54.154 INFO:tasks.workunit.client.1.smithi098.stdout:7/368: creat d3/d10/d16/d17/d33/d1f/d2d/f75 x:0 0 0 2024-09-20T19:05:54.156 INFO:tasks.workunit.client.1.smithi098.stdout:8/408: dread - d7/de/d11/f58 zero size 2024-09-20T19:05:54.157 INFO:tasks.workunit.client.0.smithi027.stdout:4/186: dread d5/f37 [0,4194304] 0 2024-09-20T19:05:54.157 INFO:tasks.workunit.client.0.smithi027.stdout:7/257: rename d3/d8/da/dc/f1d to d3/d8/d26/d45/d56/f5b 0 2024-09-20T19:05:54.159 INFO:tasks.workunit.client.0.smithi027.stdout:3/271: creat d0/f5d x:0 0 0 2024-09-20T19:05:54.161 INFO:tasks.workunit.client.1.smithi098.stdout:7/369: chown d3/d10/d16/d17/d33/d1f/d28/d66 0 1 2024-09-20T19:05:54.161 INFO:tasks.workunit.client.0.smithi027.stdout:7/258: write d3/d8/da/f4e [1138739,85873] 0 2024-09-20T19:05:54.162 INFO:tasks.workunit.client.0.smithi027.stdout:9/363: getdents d0/d9/d3d/d4f 0 2024-09-20T19:05:54.164 INFO:tasks.workunit.client.0.smithi027.stdout:7/259: readlink d3/l7 0 2024-09-20T19:05:54.167 INFO:tasks.workunit.client.1.smithi098.stdout:7/370: mkdir d3/d76 0 2024-09-20T19:05:54.168 INFO:tasks.workunit.client.1.smithi098.stdout:7/371: chown d3/c1e 165933 1 2024-09-20T19:05:54.169 INFO:tasks.workunit.client.0.smithi027.stdout:7/260: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:54.171 INFO:tasks.workunit.client.0.smithi027.stdout:0/300: read d2/d14/d1d/d2e/f46 [1324173,130075] 0 2024-09-20T19:05:54.172 INFO:tasks.workunit.client.0.smithi027.stdout:1/233: rename d2/l1d to d2/d8/d2b/d2d/l45 0 2024-09-20T19:05:54.174 INFO:tasks.workunit.client.0.smithi027.stdout:3/272: write d0/d1/d7/f2c [192917,94568] 0 2024-09-20T19:05:54.175 INFO:tasks.workunit.client.0.smithi027.stdout:1/234: read d2/f13 [3762401,69672] 0 2024-09-20T19:05:54.176 INFO:tasks.workunit.client.0.smithi027.stdout:9/364: rmdir d0/d2e 39 2024-09-20T19:05:54.177 INFO:tasks.workunit.client.0.smithi027.stdout:9/365: chown d0/d9/l4e 14032393 1 2024-09-20T19:05:54.179 INFO:tasks.workunit.client.1.smithi098.stdout:7/372: link d3/d10/d16/d17/d33/d1f/f43 d3/d10/d16/d17/d33/d1f/d2d/f77 0 2024-09-20T19:05:54.179 INFO:tasks.workunit.client.0.smithi027.stdout:8/214: link d2/d3/c4 d2/d3/d6/d21/d33/c44 0 2024-09-20T19:05:54.183 INFO:tasks.workunit.client.0.smithi027.stdout:5/306: unlink d4/d1f/d28/f5a 0 2024-09-20T19:05:54.184 INFO:tasks.workunit.client.1.smithi098.stdout:7/373: creat d3/d10/d16/d17/d33/d37/f78 x:0 0 0 2024-09-20T19:05:54.185 INFO:tasks.workunit.client.0.smithi027.stdout:9/366: dwrite d0/f42 [0,4194304] 0 2024-09-20T19:05:54.189 INFO:tasks.workunit.client.0.smithi027.stdout:4/187: mkdir d5/d11/d3d 0 2024-09-20T19:05:54.189 INFO:tasks.workunit.client.1.smithi098.stdout:7/374: unlink d3/c1e 0 2024-09-20T19:05:54.190 INFO:tasks.workunit.client.0.smithi027.stdout:8/215: dread d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:54.190 INFO:tasks.workunit.client.0.smithi027.stdout:9/367: read - d0/d9/df/d1c/d6a/d6d/dd/f38 zero size 2024-09-20T19:05:54.191 INFO:tasks.workunit.client.0.smithi027.stdout:7/261: creat d3/d8/d26/f5c x:0 0 0 2024-09-20T19:05:54.193 INFO:tasks.workunit.client.0.smithi027.stdout:4/188: fsync d5/d13/d16/d21/f33 0 2024-09-20T19:05:54.194 INFO:tasks.workunit.client.0.smithi027.stdout:3/273: dread d0/d1/d13/f1c [0,4194304] 0 2024-09-20T19:05:54.194 INFO:tasks.workunit.client.0.smithi027.stdout:4/189: stat d5/l6 0 2024-09-20T19:05:54.194 INFO:tasks.workunit.client.0.smithi027.stdout:7/262: write d3/d8/da/d2e/f55 [107182,96704] 0 2024-09-20T19:05:54.198 INFO:tasks.workunit.client.0.smithi027.stdout:3/274: chown d0/d1/d7/d1d/f3a 1 1 2024-09-20T19:05:54.201 INFO:tasks.workunit.client.1.smithi098.stdout:7/375: link d3/d10/d18/f63 d3/d10/d16/f79 0 2024-09-20T19:05:54.202 INFO:tasks.workunit.client.0.smithi027.stdout:3/275: chown d0/l4d 4431 1 2024-09-20T19:05:54.203 INFO:tasks.workunit.client.1.smithi098.stdout:1/262: getdents d1 0 2024-09-20T19:05:54.204 INFO:tasks.workunit.client.1.smithi098.stdout:7/376: write d3/d10/d16/d17/d33/d1f/f72 [409382,80907] 0 2024-09-20T19:05:54.205 INFO:tasks.workunit.client.1.smithi098.stdout:7/377: write d3/d10/d16/f2c [4198068,31554] 0 2024-09-20T19:05:54.206 INFO:tasks.workunit.client.1.smithi098.stdout:6/247: write d0/f34 [130823,76405] 0 2024-09-20T19:05:54.206 INFO:tasks.workunit.client.0.smithi027.stdout:7/263: dwrite d3/d8/da/f46 [0,4194304] 0 2024-09-20T19:05:54.209 INFO:tasks.workunit.client.1.smithi098.stdout:1/263: symlink d1/d3/df/l4f 0 2024-09-20T19:05:54.209 INFO:tasks.workunit.client.0.smithi027.stdout:4/190: dwrite d5/f1e [0,4194304] 0 2024-09-20T19:05:54.210 INFO:tasks.workunit.client.0.smithi027.stdout:5/307: unlink d4/da/de/d1e/f51 0 2024-09-20T19:05:54.220 INFO:tasks.workunit.client.1.smithi098.stdout:1/264: dwrite d1/d3/df/d34/f48 [0,4194304] 0 2024-09-20T19:05:54.222 INFO:tasks.workunit.client.1.smithi098.stdout:6/248: dwrite d0/f22 [0,4194304] 0 2024-09-20T19:05:54.226 INFO:tasks.workunit.client.1.smithi098.stdout:7/378: dread d3/d10/d16/d17/d33/d1f/d2d/f3b [0,4194304] 0 2024-09-20T19:05:54.229 INFO:tasks.workunit.client.0.smithi027.stdout:3/276: rename d0/d1/d7 to d0/d1/d5e 0 2024-09-20T19:05:54.231 INFO:tasks.workunit.client.0.smithi027.stdout:3/277: stat d0/d1/l14 0 2024-09-20T19:05:54.233 INFO:tasks.workunit.client.1.smithi098.stdout:1/265: truncate d1/d3/fe 1514134 0 2024-09-20T19:05:54.234 INFO:tasks.workunit.client.1.smithi098.stdout:1/266: readlink d1/d3/df/l4f 0 2024-09-20T19:05:54.234 INFO:tasks.workunit.client.0.smithi027.stdout:3/278: fdatasync d0/d1/f3b 0 2024-09-20T19:05:54.234 INFO:tasks.workunit.client.0.smithi027.stdout:6/183: dwrite d4/d6/fa [0,4194304] 0 2024-09-20T19:05:54.237 INFO:tasks.workunit.client.1.smithi098.stdout:7/379: mkdir d3/d76/d7a 0 2024-09-20T19:05:54.239 INFO:tasks.workunit.client.1.smithi098.stdout:1/267: creat d1/f50 x:0 0 0 2024-09-20T19:05:54.243 INFO:tasks.workunit.client.0.smithi027.stdout:4/191: mknod d5/d13/d16/c3e 0 2024-09-20T19:05:54.245 INFO:tasks.workunit.client.1.smithi098.stdout:7/380: mknod d3/d10/d16/d17/d33/d1f/d28/c7b 0 2024-09-20T19:05:54.245 INFO:tasks.workunit.client.0.smithi027.stdout:1/235: write d2/d15/f22 [1530760,101510] 0 2024-09-20T19:05:54.245 INFO:tasks.workunit.client.0.smithi027.stdout:2/185: dwrite d3/ff [0,4194304] 0 2024-09-20T19:05:54.251 INFO:tasks.workunit.client.1.smithi098.stdout:7/381: mkdir d3/d10/d16/d17/d7c 0 2024-09-20T19:05:54.255 INFO:tasks.workunit.client.0.smithi027.stdout:0/301: truncate d2/d14/d1d/f3d 3669058 0 2024-09-20T19:05:54.258 INFO:tasks.workunit.client.0.smithi027.stdout:7/264: mknod d3/d8/c5d 0 2024-09-20T19:05:54.258 INFO:tasks.workunit.client.0.smithi027.stdout:2/186: dwrite d3/de/f2c [0,4194304] 0 2024-09-20T19:05:54.259 INFO:tasks.workunit.client.0.smithi027.stdout:0/302: fdatasync d2/d20/d52/f67 0 2024-09-20T19:05:54.261 INFO:tasks.workunit.client.0.smithi027.stdout:4/192: mkdir d5/d11/d17/d32/d3f 0 2024-09-20T19:05:54.265 INFO:tasks.workunit.client.0.smithi027.stdout:1/236: mknod d2/d15/c46 0 2024-09-20T19:05:54.265 INFO:tasks.workunit.client.1.smithi098.stdout:7/382: rename d3/d10/d18/d21 to d3/d10/d16/d17/d33/d1f/d28/d7d 0 2024-09-20T19:05:54.266 INFO:tasks.workunit.client.0.smithi027.stdout:9/368: creat d0/f75 x:0 0 0 2024-09-20T19:05:54.266 INFO:tasks.workunit.client.0.smithi027.stdout:8/216: dwrite d2/d3/d6/d21/f38 [0,4194304] 0 2024-09-20T19:05:54.269 INFO:tasks.workunit.client.1.smithi098.stdout:1/268: truncate d1/f10 6991782 0 2024-09-20T19:05:54.269 INFO:tasks.workunit.client.0.smithi027.stdout:6/184: creat d4/d15/d2c/f32 x:0 0 0 2024-09-20T19:05:54.270 INFO:tasks.workunit.client.0.smithi027.stdout:1/237: chown d2/d15/f22 337 1 2024-09-20T19:05:54.273 INFO:tasks.workunit.client.0.smithi027.stdout:5/308: creat d4/f63 x:0 0 0 2024-09-20T19:05:54.276 INFO:tasks.workunit.client.0.smithi027.stdout:5/309: stat d4/da/de/d3e/d61/f5e 0 2024-09-20T19:05:54.277 INFO:tasks.workunit.client.1.smithi098.stdout:7/383: link d3/d10/d16/d17/d33/d1f/d2d/f53 d3/d10/d16/d17/f7e 0 2024-09-20T19:05:54.278 INFO:tasks.workunit.client.0.smithi027.stdout:0/303: mkdir d2/d48/d6b 0 2024-09-20T19:05:54.280 INFO:tasks.workunit.client.0.smithi027.stdout:5/310: fsync d4/d1f/d28/f3f 0 2024-09-20T19:05:54.280 INFO:tasks.workunit.client.0.smithi027.stdout:7/265: dwrite d3/f23 [0,4194304] 0 2024-09-20T19:05:54.282 INFO:tasks.workunit.client.1.smithi098.stdout:7/384: fdatasync d3/f8 0 2024-09-20T19:05:54.285 INFO:tasks.workunit.client.0.smithi027.stdout:9/369: unlink d0/d9/df/d1c/l5f 0 2024-09-20T19:05:54.287 INFO:tasks.workunit.client.0.smithi027.stdout:5/311: dread - d4/da/de/d3e/d44/f52 zero size 2024-09-20T19:05:54.288 INFO:tasks.workunit.client.0.smithi027.stdout:4/193: mknod d5/d11/c40 0 2024-09-20T19:05:54.289 INFO:tasks.workunit.client.1.smithi098.stdout:7/385: rmdir d3 39 2024-09-20T19:05:54.291 INFO:tasks.workunit.client.0.smithi027.stdout:3/279: dwrite d0/f47 [0,4194304] 0 2024-09-20T19:05:54.295 INFO:tasks.workunit.client.0.smithi027.stdout:2/187: write d3/de/f18 [1542053,37579] 0 2024-09-20T19:05:54.300 INFO:tasks.workunit.client.0.smithi027.stdout:6/185: mkdir d4/d1b/d2b/d33 0 2024-09-20T19:05:54.303 INFO:tasks.workunit.client.0.smithi027.stdout:7/266: dread d3/d8/da/f46 [0,4194304] 0 2024-09-20T19:05:54.303 INFO:tasks.workunit.client.0.smithi027.stdout:0/304: creat d2/d14/d1d/f6c x:0 0 0 2024-09-20T19:05:54.305 INFO:tasks.workunit.client.0.smithi027.stdout:5/312: dwrite d4/da/de/d3e/d44/f52 [0,4194304] 0 2024-09-20T19:05:54.306 INFO:tasks.workunit.client.1.smithi098.stdout:7/386: link d3/d10/d16/d17/d33/d1f/d2d/f75 d3/d4c/f7f 0 2024-09-20T19:05:54.307 INFO:tasks.workunit.client.0.smithi027.stdout:0/305: write d2/d14/d1b/f5f [547293,10908] 0 2024-09-20T19:05:54.310 INFO:tasks.workunit.client.1.smithi098.stdout:7/387: read d3/d10/d16/d17/d33/d1f/d28/f61 [6641988,77118] 0 2024-09-20T19:05:54.312 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:54 smithi027 ceph-mon[28196]: [20/Sep/2024:19:05:52] ENGINE Serving on https://172.21.15.98:7150 2024-09-20T19:05:54.312 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:54 smithi027 ceph-mon[28196]: [20/Sep/2024:19:05:52] ENGINE Bus STARTED 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:54 smithi027 ceph-mon[28196]: [20/Sep/2024:19:05:52] ENGINE Error in HTTPServer.serve 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Traceback (most recent call last): 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._run(expiration_interval) 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T19:05:54.313 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s = self.context.wrap_socket( 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: return self.sslsocket_class._create( 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self.do_handshake() 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._sslobj.do_handshake() 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:54 smithi027 ceph-mon[28196]: pgmap v5: 65 pgs: 65 active+clean; 946 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail 2024-09-20T19:05:54.314 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:54 smithi027 ceph-mon[28196]: mgrmap e23: smithi098.wrcvbg(active, since 4s) 2024-09-20T19:05:54.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.305+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4d5c02c640 con 0x7f4d4403fbe0 2024-09-20T19:05:54.315 INFO:tasks.workunit.client.0.smithi027.stdout:9/370: creat d0/d2e/f76 x:0 0 0 2024-09-20T19:05:54.315 INFO:tasks.workunit.client.1.smithi098.stdout:1/269: dwrite d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:05:54.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.310+0000 7f4d4b7fe640 1 -- 172.21.15.27:0/3421345402 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f4d5c02c640 con 0x7f4d4403fbe0 2024-09-20T19:05:54.316 INFO:tasks.workunit.client.0.smithi027.stdout:4/194: rename d5/f1e to d5/d11/d1a/d2a/f41 0 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 msgr2=0x7f4d440420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 0x7f4d440420a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f80 tx=0x7f4d5403c040 comp rx=0 tx=0).stop 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 msgr2=0x7f4d5c1950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000fa80 tx=0x7f4d5000ff40 comp rx=0 tx=0).stop 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 shutdown_connections 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f4d4403fbe0 0x7f4d440420a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d5c1011e0 0x7f4d5c1950a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 --2- 172.21.15.27:0/3421345402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d5c0fffe0 0x7f4d5c1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 >> 172.21.15.27:0/3421345402 conn(0x7f4d5c0fb770 msgr2=0x7f4d5c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:54.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 shutdown_connections 2024-09-20T19:05:54.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.313+0000 7f4d60942640 1 -- 172.21.15.27:0/3421345402 wait complete. 2024-09-20T19:05:54.320 INFO:tasks.workunit.client.0.smithi027.stdout:5/313: creat d4/d1f/f64 x:0 0 0 2024-09-20T19:05:54.320 INFO:tasks.workunit.client.1.smithi098.stdout:1/270: unlink d1/d3/df/d4b/f4d 0 2024-09-20T19:05:54.321 INFO:tasks.workunit.client.1.smithi098.stdout:1/271: chown d1/d3/f19 18 1 2024-09-20T19:05:54.324 INFO:tasks.workunit.client.1.smithi098.stdout:7/388: creat d3/d10/d16/d17/d7c/f80 x:0 0 0 2024-09-20T19:05:54.325 INFO:tasks.workunit.client.0.smithi027.stdout:6/186: symlink d4/d1b/d2b/d33/l34 0 2024-09-20T19:05:54.327 INFO:tasks.workunit.client.0.smithi027.stdout:8/217: getdents d2 0 2024-09-20T19:05:54.331 INFO:tasks.workunit.client.1.smithi098.stdout:7/389: dread d3/d10/d16/d17/d33/d1f/d2d/f38 [0,4194304] 0 2024-09-20T19:05:54.333 INFO:tasks.workunit.client.0.smithi027.stdout:9/371: rmdir d0/d9/d3d 39 2024-09-20T19:05:54.335 INFO:tasks.workunit.client.0.smithi027.stdout:0/306: rename d2/d14/l2c to d2/d20/d52/d29/l6d 0 2024-09-20T19:05:54.337 INFO:tasks.workunit.client.1.smithi098.stdout:1/272: creat d1/d3/df/d34/f51 x:0 0 0 2024-09-20T19:05:54.338 INFO:tasks.workunit.client.1.smithi098.stdout:7/390: dwrite d3/d10/d16/d17/d33/d1f/f44 [0,4194304] 0 2024-09-20T19:05:54.338 INFO:tasks.workunit.client.0.smithi027.stdout:1/238: dwrite d2/d15/f29 [0,4194304] 0 2024-09-20T19:05:54.342 INFO:tasks.workunit.client.0.smithi027.stdout:6/187: creat d4/d1b/f35 x:0 0 0 2024-09-20T19:05:54.343 INFO:tasks.workunit.client.0.smithi027.stdout:6/188: chown d4/d6/f19 4 1 2024-09-20T19:05:54.344 INFO:tasks.workunit.client.0.smithi027.stdout:6/189: write d4/f2d [844112,128661] 0 2024-09-20T19:05:54.348 INFO:tasks.workunit.client.0.smithi027.stdout:8/218: symlink d2/d3/l45 0 2024-09-20T19:05:54.353 INFO:tasks.workunit.client.0.smithi027.stdout:9/372: mknod d0/d9/df/d1c/c77 0 2024-09-20T19:05:54.354 INFO:tasks.workunit.client.0.smithi027.stdout:1/239: rename d2 to d2/d47 22 2024-09-20T19:05:54.355 INFO:tasks.workunit.client.0.smithi027.stdout:8/219: truncate d2/d2a/f2f 2461664 0 2024-09-20T19:05:54.356 INFO:tasks.workunit.client.0.smithi027.stdout:6/190: fdatasync d4/f14 0 2024-09-20T19:05:54.358 INFO:tasks.workunit.client.0.smithi027.stdout:6/191: dread - d4/d1b/f29 zero size 2024-09-20T19:05:54.359 INFO:tasks.workunit.client.0.smithi027.stdout:8/220: mknod d2/c46 0 2024-09-20T19:05:54.359 INFO:tasks.workunit.client.0.smithi027.stdout:8/221: readlink d2/lb 0 2024-09-20T19:05:54.360 INFO:tasks.workunit.client.0.smithi027.stdout:1/240: symlink d2/d8/d41/l48 0 2024-09-20T19:05:54.360 INFO:tasks.workunit.client.0.smithi027.stdout:4/195: link d5/d11/l19 d5/d11/d3d/l42 0 2024-09-20T19:05:54.362 INFO:tasks.workunit.client.0.smithi027.stdout:1/241: read d2/d15/f29 [2154958,14406] 0 2024-09-20T19:05:54.372 INFO:tasks.workunit.client.0.smithi027.stdout:8/222: dwrite d2/d3/d1b/f26 [0,4194304] 0 2024-09-20T19:05:54.374 INFO:tasks.workunit.client.1.smithi098.stdout:0/220: sync 2024-09-20T19:05:54.374 INFO:tasks.workunit.client.1.smithi098.stdout:0/221: chown d0/d6/f12 10940 1 2024-09-20T19:05:54.375 INFO:tasks.workunit.client.1.smithi098.stdout:7/391: chown d3/d10/d16/d17/d33/d1f/d28/l49 2031 1 2024-09-20T19:05:54.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/222: fsync d0/d15/d38/f39 0 2024-09-20T19:05:54.375 INFO:tasks.workunit.client.1.smithi098.stdout:1/273: dread - d1/f37 zero size 2024-09-20T19:05:54.376 INFO:tasks.workunit.client.0.smithi027.stdout:6/192: symlink d4/d6/l36 0 2024-09-20T19:05:54.377 INFO:tasks.workunit.client.1.smithi098.stdout:0/223: write d0/db/d1d/f34 [1211094,84830] 0 2024-09-20T19:05:54.378 INFO:tasks.workunit.client.0.smithi027.stdout:2/188: dread d3/f9 [0,4194304] 0 2024-09-20T19:05:54.378 INFO:tasks.workunit.client.0.smithi027.stdout:2/189: chown d3 16256 1 2024-09-20T19:05:54.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/224: mknod d0/d6/d28/d31/c3d 0 2024-09-20T19:05:54.383 INFO:tasks.workunit.client.0.smithi027.stdout:2/190: write d3/d24/f28 [368819,105247] 0 2024-09-20T19:05:54.383 INFO:tasks.workunit.client.0.smithi027.stdout:4/196: creat d5/d11/d17/d32/f43 x:0 0 0 2024-09-20T19:05:54.384 INFO:tasks.workunit.client.1.smithi098.stdout:1/274: mkdir d1/d3/df/d34/d52 0 2024-09-20T19:05:54.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/225: symlink d0/d15/d38/l3e 0 2024-09-20T19:05:54.388 INFO:tasks.workunit.client.1.smithi098.stdout:7/392: dwrite d3/d10/d16/d17/d33/d4b/f55 [0,4194304] 0 2024-09-20T19:05:54.390 INFO:tasks.workunit.client.1.smithi098.stdout:7/393: chown d3/d10/d16/d17/d33/d1f/d2d/f75 984401754 1 2024-09-20T19:05:54.390 INFO:tasks.workunit.client.0.smithi027.stdout:6/193: mkdir d4/d15/d37 0 2024-09-20T19:05:54.390 INFO:tasks.workunit.client.1.smithi098.stdout:0/226: creat d0/db/d1d/f3f x:0 0 0 2024-09-20T19:05:54.391 INFO:tasks.workunit.client.1.smithi098.stdout:7/394: write d3/d10/d18/f4d [1026201,48830] 0 2024-09-20T19:05:54.393 INFO:tasks.workunit.client.1.smithi098.stdout:1/275: getdents d1/d3/df 0 2024-09-20T19:05:54.394 INFO:tasks.workunit.client.1.smithi098.stdout:7/395: stat d3/d10/d16/d17/d33/d1f/c30 0 2024-09-20T19:05:54.395 INFO:tasks.workunit.client.0.smithi027.stdout:6/194: mknod d4/c38 0 2024-09-20T19:05:54.395 INFO:tasks.workunit.client.0.smithi027.stdout:6/195: chown d4/d1b/c25 1959853 1 2024-09-20T19:05:54.395 INFO:tasks.workunit.client.0.smithi027.stdout:6/196: chown d4/d1b/f35 4062 1 2024-09-20T19:05:54.395 INFO:tasks.workunit.client.1.smithi098.stdout:0/227: mknod d0/d15/c40 0 2024-09-20T19:05:54.403 INFO:tasks.workunit.client.1.smithi098.stdout:7/396: dwrite d3/d10/f19 [4194304,4194304] 0 2024-09-20T19:05:54.404 INFO:tasks.workunit.client.0.smithi027.stdout:4/197: rename d5/d13/d16/d21/d26/c2d to d5/d11/c44 0 2024-09-20T19:05:54.407 INFO:tasks.workunit.client.1.smithi098.stdout:1/276: dwrite d1/f14 [0,4194304] 0 2024-09-20T19:05:54.407 INFO:tasks.workunit.client.0.smithi027.stdout:2/191: getdents d3/d24 0 2024-09-20T19:05:54.408 INFO:tasks.workunit.client.0.smithi027.stdout:6/197: dread d4/f2d [0,4194304] 0 2024-09-20T19:05:54.408 INFO:tasks.workunit.client.0.smithi027.stdout:4/198: write d5/d13/d16/d21/f2e [799310,16673] 0 2024-09-20T19:05:54.408 INFO:tasks.workunit.client.0.smithi027.stdout:2/192: stat d3/c14 0 2024-09-20T19:05:54.409 INFO:tasks.workunit.client.0.smithi027.stdout:9/373: getdents d0/d9/df/d1c 0 2024-09-20T19:05:54.412 INFO:tasks.workunit.client.1.smithi098.stdout:7/397: rename d3/d10/d16/d17/d33/d1f/d28/d7d/c5d to d3/d10/d16/d17/d33/d1f/d28/d66/c81 0 2024-09-20T19:05:54.413 INFO:tasks.workunit.client.0.smithi027.stdout:5/314: write d4/da/f2c [687517,56031] 0 2024-09-20T19:05:54.414 INFO:tasks.workunit.client.1.smithi098.stdout:1/277: mkdir d1/d3/df/d34/d43/d53 0 2024-09-20T19:05:54.415 INFO:tasks.workunit.client.0.smithi027.stdout:6/198: fdatasync d4/d15/d2c/f32 0 2024-09-20T19:05:54.418 INFO:tasks.workunit.client.0.smithi027.stdout:5/315: mknod d4/da/c65 0 2024-09-20T19:05:54.420 INFO:tasks.workunit.client.1.smithi098.stdout:7/398: dwrite d3/f64 [0,4194304] 0 2024-09-20T19:05:54.424 INFO:tasks.workunit.client.0.smithi027.stdout:8/223: write d2/d14/f27 [3173897,87781] 0 2024-09-20T19:05:54.429 INFO:tasks.workunit.client.0.smithi027.stdout:2/193: mkdir d3/d2f 0 2024-09-20T19:05:54.432 INFO:tasks.workunit.client.0.smithi027.stdout:1/242: dwrite d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:54.437 INFO:tasks.workunit.client.1.smithi098.stdout:0/228: dread d0/d6/d19/f33 [0,4194304] 0 2024-09-20T19:05:54.438 INFO:tasks.workunit.client.0.smithi027.stdout:4/199: mknod d5/d11/d17/d32/d3f/c45 0 2024-09-20T19:05:54.438 INFO:tasks.workunit.client.0.smithi027.stdout:6/199: mkdir d4/d15/d37/d39 0 2024-09-20T19:05:54.442 INFO:tasks.workunit.client.0.smithi027.stdout:9/374: link d0/c5c d0/d9/d3d/d4f/c78 0 2024-09-20T19:05:54.445 INFO:tasks.workunit.client.1.smithi098.stdout:1/278: write d1/d3/f1e [1887332,116213] 0 2024-09-20T19:05:54.446 INFO:tasks.workunit.client.0.smithi027.stdout:1/243: truncate d2/f13 12521873 0 2024-09-20T19:05:54.450 INFO:tasks.workunit.client.1.smithi098.stdout:1/279: rename d1/l1c to d1/d3/df/d4a/l54 0 2024-09-20T19:05:54.451 INFO:tasks.workunit.client.1.smithi098.stdout:7/399: dwrite d3/d4c/f7f [0,4194304] 0 2024-09-20T19:05:54.451 INFO:tasks.workunit.client.1.smithi098.stdout:1/280: chown d1/d3/l39 230313337 1 2024-09-20T19:05:54.452 INFO:tasks.workunit.client.1.smithi098.stdout:7/400: truncate d3/d4c/f7f 4791404 0 2024-09-20T19:05:54.454 INFO:tasks.workunit.client.0.smithi027.stdout:2/194: dwrite d3/de/f1a [0,4194304] 0 2024-09-20T19:05:54.455 INFO:tasks.workunit.client.0.smithi027.stdout:4/200: creat d5/d13/d16/f46 x:0 0 0 2024-09-20T19:05:54.456 INFO:tasks.workunit.client.1.smithi098.stdout:1/281: unlink d1/f2f 0 2024-09-20T19:05:54.459 INFO:tasks.workunit.client.0.smithi027.stdout:8/224: dwrite d2/d3/f31 [0,4194304] 0 2024-09-20T19:05:54.459 INFO:tasks.workunit.client.0.smithi027.stdout:2/195: rename d3/d13 to d3/d13/d30 22 2024-09-20T19:05:54.461 INFO:tasks.workunit.client.1.smithi098.stdout:1/282: unlink d1/d3/d2e/f3a 0 2024-09-20T19:05:54.462 INFO:tasks.workunit.client.1.smithi098.stdout:7/401: creat d3/f82 x:0 0 0 2024-09-20T19:05:54.463 INFO:tasks.workunit.client.0.smithi027.stdout:1/244: getdents d2/d8/d2b/d2d/d3e 0 2024-09-20T19:05:54.464 INFO:tasks.workunit.client.1.smithi098.stdout:7/402: write d3/f11 [8311131,87956] 0 2024-09-20T19:05:54.464 INFO:tasks.workunit.client.0.smithi027.stdout:2/196: fsync d3/f9 0 2024-09-20T19:05:54.466 INFO:tasks.workunit.client.0.smithi027.stdout:4/201: creat d5/d13/d16/d21/d26/f47 x:0 0 0 2024-09-20T19:05:54.467 INFO:tasks.workunit.client.0.smithi027.stdout:8/225: creat d2/f47 x:0 0 0 2024-09-20T19:05:54.469 INFO:tasks.workunit.client.0.smithi027.stdout:5/316: dwrite d4/fd [4194304,4194304] 0 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 -- 172.21.15.27:0/793977594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc093c50 msgr2=0x7fb6bc096060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/793977594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc093c50 0x7fb6bc096060 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009880 tx=0x7fb6b002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 -- 172.21.15.27:0/793977594 shutdown_connections 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/793977594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/793977594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc093c50 0x7fb6bc096060 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.465+0000 7fb6c9d44640 1 -- 172.21.15.27:0/793977594 >> 172.21.15.27:0/793977594 conn(0x7fb6bc08fa40 msgr2=0x7fb6bc091ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:54.472 INFO:tasks.workunit.client.1.smithi098.stdout:7/403: dread - d3/d10/d16/d17/f3d zero size 2024-09-20T19:05:54.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.466+0000 7fb6c9d44640 1 -- 172.21.15.27:0/793977594 shutdown_connections 2024-09-20T19:05:54.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.466+0000 7fb6c9d44640 1 -- 172.21.15.27:0/793977594 wait complete. 2024-09-20T19:05:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.467+0000 7fb6c9d44640 1 Processor -- start 2024-09-20T19:05:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c9d44640 1 -- start start 2024-09-20T19:05:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c9d44640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6bc093c50 0x7fb6bc1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c9d44640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:54.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c9d44640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc0a4860 con 0x7fb6bc0965a0 2024-09-20T19:05:54.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c9d44640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc0a46e0 con 0x7fb6bc093c50 2024-09-20T19:05:54.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:54.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35398/0 (socket says 172.21.15.27:35398) 2024-09-20T19:05:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.468+0000 7fb6c3fff640 1 -- 172.21.15.27:0/3045880729 learned_addr learned my addr 172.21.15.27:0/3045880729 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:54.476 INFO:tasks.workunit.client.0.smithi027.stdout:9/375: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79 0 2024-09-20T19:05:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.469+0000 7fb6c3fff640 1 -- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6bc093c50 msgr2=0x7fb6bc1426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.469+0000 7fb6c3fff640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6bc093c50 0x7fb6bc1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.469+0000 7fb6c3fff640 1 -- 172.21.15.27:0/3045880729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc099300 con 0x7fb6bc0965a0 2024-09-20T19:05:54.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.469+0000 7fb6c3fff640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b420 tx=0x7fb6b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.470+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6b8011630 con 0x7fb6bc0965a0 2024-09-20T19:05:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.470+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc09a270 con 0x7fb6bc0965a0 2024-09-20T19:05:54.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.470+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6bc09a800 con 0x7fb6bc0965a0 2024-09-20T19:05:54.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:54 smithi098 ceph-mon[35737]: [20/Sep/2024:19:05:52] ENGINE Serving on https://172.21.15.98:7150 2024-09-20T19:05:54.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:54 smithi098 ceph-mon[35737]: [20/Sep/2024:19:05:52] ENGINE Bus STARTED 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:54 smithi098 ceph-mon[35737]: [20/Sep/2024:19:05:52] ENGINE Error in HTTPServer.serve 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Traceback (most recent call last): 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._run(expiration_interval) 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T19:05:54.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s = self.context.wrap_socket( 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: return self.sslsocket_class._create( 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self.do_handshake() 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._sslobj.do_handshake() 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:54 smithi098 ceph-mon[35737]: pgmap v5: 65 pgs: 65 active+clean; 946 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail 2024-09-20T19:05:54.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:54 smithi098 ceph-mon[35737]: mgrmap e23: smithi098.wrcvbg(active, since 4s) 2024-09-20T19:05:54.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.470+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6b8016070 con 0x7fb6bc0965a0 2024-09-20T19:05:54.479 INFO:tasks.workunit.client.0.smithi027.stdout:6/200: getdents d4/d1b/d2b 0 2024-09-20T19:05:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.472+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6b8010d40 con 0x7fb6bc0965a0 2024-09-20T19:05:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.472+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a80052c0 con 0x7fb6bc0965a0 2024-09-20T19:05:54.480 INFO:tasks.workunit.client.0.smithi027.stdout:9/376: stat d0/d9/df/d57 0 2024-09-20T19:05:54.480 INFO:tasks.workunit.client.0.smithi027.stdout:8/226: symlink d2/d3/d1b/d2d/l48 0 2024-09-20T19:05:54.481 INFO:tasks.workunit.client.0.smithi027.stdout:5/317: rmdir d4/da/de/d1e 39 2024-09-20T19:05:54.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.477+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 23) ==== 52072+0+0 (secure 0 0 0) 0x7fb6b80117d0 con 0x7fb6bc0965a0 2024-09-20T19:05:54.483 INFO:tasks.workunit.client.0.smithi027.stdout:4/202: rename d5/d11/d17/d32 to d5/d13/d36/d48 0 2024-09-20T19:05:54.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.477+0000 7fb6c1ffb640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 0x7fb6b4041e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:54.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.478+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7fb6b80556a0 con 0x7fb6bc0965a0 2024-09-20T19:05:54.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.478+0000 7fb6c8d42640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 0x7fb6b4041e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:54.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.479+0000 7fb6c8d42640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 0x7fb6b4041e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00058c0 tx=0x7fb6b0005850 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:54.486 INFO:tasks.workunit.client.0.smithi027.stdout:4/203: write d5/d13/d36/d48/f43 [789195,110378] 0 2024-09-20T19:05:54.486 INFO:tasks.workunit.client.0.smithi027.stdout:4/204: chown d5/d11/d17 109 1 2024-09-20T19:05:54.487 INFO:tasks.workunit.client.0.smithi027.stdout:6/201: rename d4/d1b/d2b/d33/l34 to d4/d15/d37/d39/l3a 0 2024-09-20T19:05:54.488 INFO:tasks.workunit.client.0.smithi027.stdout:8/227: dread d2/d3/f11 [0,4194304] 0 2024-09-20T19:05:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.483+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb6b8023330 con 0x7fb6bc0965a0 2024-09-20T19:05:54.489 INFO:tasks.workunit.client.0.smithi027.stdout:1/245: getdents d2/d1b/d3a 0 2024-09-20T19:05:54.490 INFO:tasks.workunit.client.0.smithi027.stdout:4/205: readlink d5/d11/d3d/l42 0 2024-09-20T19:05:54.492 INFO:tasks.workunit.client.0.smithi027.stdout:5/318: rename d4/d1f/f22 to d4/da/de/f66 0 2024-09-20T19:05:54.494 INFO:tasks.workunit.client.0.smithi027.stdout:1/246: dread d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:54.495 INFO:tasks.workunit.client.0.smithi027.stdout:6/202: rename d4/d1b/c25 to d4/d1b/d2b/c3b 0 2024-09-20T19:05:54.495 INFO:tasks.workunit.client.0.smithi027.stdout:8/228: creat d2/d14/d13/d43/f49 x:0 0 0 2024-09-20T19:05:54.496 INFO:tasks.workunit.client.0.smithi027.stdout:6/203: write d4/d1b/f29 [299553,116918] 0 2024-09-20T19:05:54.499 INFO:tasks.workunit.client.0.smithi027.stdout:1/247: getdents d2/d8/d2b/d2d 0 2024-09-20T19:05:54.501 INFO:tasks.workunit.client.0.smithi027.stdout:8/229: unlink d2/d3/d6/f1a 0 2024-09-20T19:05:54.502 INFO:tasks.workunit.client.0.smithi027.stdout:8/230: chown d2/d14 1183 1 2024-09-20T19:05:54.505 INFO:tasks.workunit.client.0.smithi027.stdout:5/319: dwrite d4/da/f2c [0,4194304] 0 2024-09-20T19:05:54.509 INFO:tasks.workunit.client.0.smithi027.stdout:5/320: creat d4/da/d50/f67 x:0 0 0 2024-09-20T19:05:54.510 INFO:tasks.workunit.client.1.smithi098.stdout:1/283: truncate d1/f25 3041046 0 2024-09-20T19:05:54.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/404: write d3/d10/d16/d17/d33/d1f/d28/d7d/f3f [799014,109368] 0 2024-09-20T19:05:54.513 INFO:tasks.workunit.client.1.smithi098.stdout:7/405: readlink d3/l9 0 2024-09-20T19:05:54.514 INFO:tasks.workunit.client.0.smithi027.stdout:1/248: dwrite d2/d8/d2b/d2d/f34 [4194304,4194304] 0 2024-09-20T19:05:54.515 INFO:tasks.workunit.client.1.smithi098.stdout:7/406: rmdir d3/d10/d16/d17/d33/d1f/d28 39 2024-09-20T19:05:54.516 INFO:tasks.workunit.client.0.smithi027.stdout:8/231: dwrite d2/f39 [0,4194304] 0 2024-09-20T19:05:54.518 INFO:tasks.workunit.client.1.smithi098.stdout:7/407: fsync d3/d10/d16/d17/d33/d1f/d2d/f77 0 2024-09-20T19:05:54.519 INFO:tasks.workunit.client.1.smithi098.stdout:7/408: chown d3/d10/d16/d17/d33/l65 1 1 2024-09-20T19:05:54.524 INFO:tasks.workunit.client.1.smithi098.stdout:7/409: dread d3/d10/d16/d17/d33/d1f/f72 [0,4194304] 0 2024-09-20T19:05:54.528 INFO:tasks.workunit.client.1.smithi098.stdout:7/410: creat d3/d76/f83 x:0 0 0 2024-09-20T19:05:54.530 INFO:tasks.workunit.client.1.smithi098.stdout:7/411: fdatasync d3/d10/d16/d17/d33/d1f/f44 0 2024-09-20T19:05:54.530 INFO:tasks.workunit.client.0.smithi027.stdout:8/232: creat d2/d3/f4a x:0 0 0 2024-09-20T19:05:54.532 INFO:tasks.workunit.client.1.smithi098.stdout:1/284: link d1/d3/f9 d1/f55 0 2024-09-20T19:05:54.533 INFO:tasks.workunit.client.0.smithi027.stdout:9/377: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:05:54.534 INFO:tasks.workunit.client.1.smithi098.stdout:7/412: creat d3/d10/d16/f84 x:0 0 0 2024-09-20T19:05:54.535 INFO:tasks.workunit.client.1.smithi098.stdout:1/285: write d1/d3/f46 [537201,9418] 0 2024-09-20T19:05:54.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.530+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 24) ==== 52128+0+0 (secure 0 0 0) 0x7fb6b8052b40 con 0x7fb6bc0965a0 2024-09-20T19:05:54.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/249: dread d2/d15/f22 [0,4194304] 0 2024-09-20T19:05:54.538 INFO:tasks.workunit.client.1.smithi098.stdout:7/413: creat d3/d10/d16/d17/d33/d4b/f85 x:0 0 0 2024-09-20T19:05:54.538 INFO:tasks.workunit.client.0.smithi027.stdout:4/206: dwrite f4 [0,4194304] 0 2024-09-20T19:05:54.540 INFO:tasks.workunit.client.1.smithi098.stdout:1/286: creat d1/d3/df/d34/d43/f56 x:0 0 0 2024-09-20T19:05:54.542 INFO:tasks.workunit.client.1.smithi098.stdout:7/414: mkdir d3/d76/d86 0 2024-09-20T19:05:54.544 INFO:tasks.workunit.client.0.smithi027.stdout:1/250: chown d2/d8/d3b/d44 824 1 2024-09-20T19:05:54.546 INFO:tasks.workunit.client.0.smithi027.stdout:4/207: mkdir d5/d13/d36/d49 0 2024-09-20T19:05:54.548 INFO:tasks.workunit.client.0.smithi027.stdout:6/204: dwrite d4/f14 [0,4194304] 0 2024-09-20T19:05:54.552 INFO:tasks.workunit.client.0.smithi027.stdout:6/205: write d4/d1b/f29 [980320,29828] 0 2024-09-20T19:05:54.553 INFO:tasks.workunit.client.0.smithi027.stdout:5/321: dwrite d4/da/de/d3e/d44/f4c [0,4194304] 0 2024-09-20T19:05:54.556 INFO:tasks.workunit.client.0.smithi027.stdout:4/208: mknod d5/d13/d16/d21/d26/c4a 0 2024-09-20T19:05:54.557 INFO:tasks.workunit.client.0.smithi027.stdout:9/378: mkdir d0/d9/df/d1c/d6a/d6d/dd/d7a 0 2024-09-20T19:05:54.558 INFO:tasks.workunit.client.0.smithi027.stdout:9/379: dread - d0/d9/df/f74 zero size 2024-09-20T19:05:54.559 INFO:tasks.workunit.client.0.smithi027.stdout:1/251: write d2/d1b/f2e [1815213,100571] 0 2024-09-20T19:05:54.561 INFO:tasks.workunit.client.0.smithi027.stdout:6/206: unlink d4/l31 0 2024-09-20T19:05:54.562 INFO:tasks.workunit.client.0.smithi027.stdout:9/380: chown d0/d9/df/d1c/d6a/d6d/f68 304576 1 2024-09-20T19:05:54.565 INFO:tasks.workunit.client.0.smithi027.stdout:8/233: dwrite d2/d14/f27 [0,4194304] 0 2024-09-20T19:05:54.566 INFO:tasks.workunit.client.0.smithi027.stdout:1/252: creat d2/d1b/f49 x:0 0 0 2024-09-20T19:05:54.568 INFO:tasks.workunit.client.0.smithi027.stdout:6/207: mknod d4/d1b/c3c 0 2024-09-20T19:05:54.568 INFO:tasks.workunit.client.1.smithi098.stdout:1/287: fsync d1/f3d 0 2024-09-20T19:05:54.571 INFO:tasks.workunit.client.0.smithi027.stdout:4/209: truncate d5/d11/d17/f20 1081295 0 2024-09-20T19:05:54.571 INFO:tasks.workunit.client.0.smithi027.stdout:6/208: creat d4/d1b/f3d x:0 0 0 2024-09-20T19:05:54.572 INFO:tasks.workunit.client.0.smithi027.stdout:1/253: write d2/d8/d2b/d2d/f34 [5628126,10395] 0 2024-09-20T19:05:54.572 INFO:tasks.workunit.client.1.smithi098.stdout:7/415: dwrite d3/f6a [0,4194304] 0 2024-09-20T19:05:54.573 INFO:tasks.workunit.client.0.smithi027.stdout:9/381: link d0/d9/df/d1c/f72 d0/d9/df/d57/f7b 0 2024-09-20T19:05:54.575 INFO:tasks.workunit.client.1.smithi098.stdout:1/288: creat d1/d3/f57 x:0 0 0 2024-09-20T19:05:54.575 INFO:tasks.workunit.client.0.smithi027.stdout:1/254: write d2/d8/d2b/d2d/f39 [2384554,16814] 0 2024-09-20T19:05:54.576 INFO:tasks.workunit.client.1.smithi098.stdout:1/289: chown d1/d3/f46 939583 1 2024-09-20T19:05:54.576 INFO:tasks.workunit.client.0.smithi027.stdout:1/255: chown d2/d15/l31 608763 1 2024-09-20T19:05:54.577 INFO:tasks.workunit.client.0.smithi027.stdout:8/234: creat d2/d3/d1b/d2d/f4b x:0 0 0 2024-09-20T19:05:54.578 INFO:tasks.workunit.client.0.smithi027.stdout:6/209: write d4/d6/f11 [1444463,89508] 0 2024-09-20T19:05:54.579 INFO:tasks.workunit.client.1.smithi098.stdout:1/290: rename d1/d3/df/d34/d43/f41 to d1/d3/df/f58 0 2024-09-20T19:05:54.580 INFO:tasks.workunit.client.1.smithi098.stdout:7/416: symlink d3/d10/d16/d17/d33/l87 0 2024-09-20T19:05:54.582 INFO:tasks.workunit.client.0.smithi027.stdout:9/382: mknod d0/d9/df/c7c 0 2024-09-20T19:05:54.582 INFO:tasks.workunit.client.1.smithi098.stdout:1/291: creat d1/d3/df/d34/d43/f59 x:0 0 0 2024-09-20T19:05:54.583 INFO:tasks.workunit.client.1.smithi098.stdout:1/292: fsync d1/d3/d2e/f3b 0 2024-09-20T19:05:54.584 INFO:tasks.workunit.client.1.smithi098.stdout:7/417: dread - d3/d10/d16/d17/d33/d1f/d28/f4a zero size 2024-09-20T19:05:54.584 INFO:tasks.workunit.client.0.smithi027.stdout:9/383: write d0/d9/df/d1b/d64/f6c [362218,105478] 0 2024-09-20T19:05:54.585 INFO:tasks.workunit.client.0.smithi027.stdout:1/256: creat d2/d8/d2b/f4a x:0 0 0 2024-09-20T19:05:54.587 INFO:tasks.workunit.client.0.smithi027.stdout:6/210: symlink d4/d1b/d2b/d33/l3e 0 2024-09-20T19:05:54.587 INFO:tasks.workunit.client.1.smithi098.stdout:1/293: symlink d1/d3/d2e/l5a 0 2024-09-20T19:05:54.589 INFO:tasks.workunit.client.1.smithi098.stdout:7/418: rename d3/d10/d16/d17/d33/l87 to d3/d10/d16/d17/d33/d1f/d28/d7d/l88 0 2024-09-20T19:05:54.592 INFO:tasks.workunit.client.0.smithi027.stdout:6/211: creat d4/d15/d37/d39/f3f x:0 0 0 2024-09-20T19:05:54.593 INFO:tasks.workunit.client.1.smithi098.stdout:7/419: dread d3/d10/d16/d17/d33/d4b/f55 [0,4194304] 0 2024-09-20T19:05:54.594 INFO:tasks.workunit.client.1.smithi098.stdout:7/420: dread - d3/d10/d16/d17/d33/d37/f78 zero size 2024-09-20T19:05:54.594 INFO:tasks.workunit.client.0.smithi027.stdout:6/212: stat d4/d1b/d2b/d33/l3e 0 2024-09-20T19:05:54.597 INFO:tasks.workunit.client.0.smithi027.stdout:9/384: dwrite d0/d9/d3d/f54 [4194304,4194304] 0 2024-09-20T19:05:54.597 INFO:tasks.workunit.client.0.smithi027.stdout:6/213: read d4/d6/f19 [1252865,85235] 0 2024-09-20T19:05:54.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/257: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:54.602 INFO:tasks.workunit.client.0.smithi027.stdout:7/267: sync 2024-09-20T19:05:54.602 INFO:tasks.workunit.client.0.smithi027.stdout:3/280: sync 2024-09-20T19:05:54.605 INFO:tasks.workunit.client.0.smithi027.stdout:3/281: chown d0/d1/d13/d3c 232116 1 2024-09-20T19:05:54.605 INFO:tasks.workunit.client.0.smithi027.stdout:7/268: read d3/d24/f2c [3074802,88169] 0 2024-09-20T19:05:54.605 INFO:tasks.workunit.client.0.smithi027.stdout:1/258: unlink d2/d15/f22 0 2024-09-20T19:05:54.606 INFO:tasks.workunit.client.0.smithi027.stdout:3/282: chown d0/d1/d13/d3c/f42 35 1 2024-09-20T19:05:54.607 INFO:tasks.workunit.client.0.smithi027.stdout:9/385: creat d0/f7d x:0 0 0 2024-09-20T19:05:54.607 INFO:tasks.workunit.client.1.smithi098.stdout:5/318: sync 2024-09-20T19:05:54.608 INFO:tasks.workunit.client.0.smithi027.stdout:6/214: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:54.610 INFO:tasks.workunit.client.0.smithi027.stdout:9/386: read d0/d9/f28 [1968207,42312] 0 2024-09-20T19:05:54.615 INFO:tasks.workunit.client.0.smithi027.stdout:1/259: dwrite d2/d15/f29 [0,4194304] 0 2024-09-20T19:05:54.615 INFO:tasks.workunit.client.1.smithi098.stdout:5/319: dwrite d1/d17/d25/f3d [0,4194304] 0 2024-09-20T19:05:54.616 INFO:tasks.workunit.client.0.smithi027.stdout:1/260: chown d2/d15/c46 911 1 2024-09-20T19:05:54.626 INFO:tasks.workunit.client.0.smithi027.stdout:3/283: rename d0/d19/f53 to d0/d1/d13/d15/d55/f5f 0 2024-09-20T19:05:54.629 INFO:tasks.workunit.client.1.smithi098.stdout:1/294: fsync d1/d3/df/f58 0 2024-09-20T19:05:54.629 INFO:tasks.workunit.client.1.smithi098.stdout:5/320: creat d1/d17/d35/d54/f62 x:0 0 0 2024-09-20T19:05:54.630 INFO:tasks.workunit.client.0.smithi027.stdout:4/210: truncate d5/d11/d1a/d2a/f41 3724705 0 2024-09-20T19:05:54.631 INFO:tasks.workunit.client.0.smithi027.stdout:7/269: mkdir d3/d5e 0 2024-09-20T19:05:54.632 INFO:tasks.workunit.client.1.smithi098.stdout:1/295: fsync d1/f37 0 2024-09-20T19:05:54.634 INFO:tasks.workunit.client.0.smithi027.stdout:3/284: dwrite d0/d19/f57 [0,4194304] 0 2024-09-20T19:05:54.638 INFO:tasks.workunit.client.0.smithi027.stdout:1/261: rename d2/d1b/d3a/d21 to d2/d8/d3b/d4b 0 2024-09-20T19:05:54.640 INFO:tasks.workunit.client.0.smithi027.stdout:8/235: dwrite d2/d3/f25 [0,4194304] 0 2024-09-20T19:05:54.642 INFO:tasks.workunit.client.1.smithi098.stdout:5/321: creat d1/d17/f63 x:0 0 0 2024-09-20T19:05:54.645 INFO:tasks.workunit.client.0.smithi027.stdout:9/387: symlink d0/d9/df/d57/l7e 0 2024-09-20T19:05:54.645 INFO:tasks.workunit.client.0.smithi027.stdout:9/388: write d0/d9/df/d1b/f17 [1928833,62544] 0 2024-09-20T19:05:54.648 INFO:tasks.workunit.client.0.smithi027.stdout:3/285: mknod d0/d1/d5e/d1d/c60 0 2024-09-20T19:05:54.649 INFO:tasks.workunit.client.1.smithi098.stdout:1/296: link d1/d3/d2e/f47 d1/d3/df/d34/d52/f5b 0 2024-09-20T19:05:54.652 INFO:tasks.workunit.client.0.smithi027.stdout:1/262: unlink d2/d8/d3b/d4b/c3c 0 2024-09-20T19:05:54.653 INFO:tasks.workunit.client.1.smithi098.stdout:7/421: dwrite d3/d10/d16/f79 [0,4194304] 0 2024-09-20T19:05:54.656 INFO:tasks.workunit.client.0.smithi027.stdout:4/211: symlink d5/d11/l4b 0 2024-09-20T19:05:54.657 INFO:tasks.workunit.client.0.smithi027.stdout:1/263: dread d2/d15/f29 [0,4194304] 0 2024-09-20T19:05:54.659 INFO:tasks.workunit.client.0.smithi027.stdout:8/236: rename d2/f8 to d2/d3/d1b/d36/f4c 0 2024-09-20T19:05:54.662 INFO:tasks.workunit.client.0.smithi027.stdout:8/237: write d2/d14/d13/f3b [981591,63648] 0 2024-09-20T19:05:54.662 INFO:tasks.workunit.client.0.smithi027.stdout:9/389: creat d0/d9/df/d1c/f7f x:0 0 0 2024-09-20T19:05:54.664 INFO:tasks.workunit.client.1.smithi098.stdout:5/322: link d1/d17/d35/c4d d1/d17/d2e/c64 0 2024-09-20T19:05:54.664 INFO:tasks.workunit.client.0.smithi027.stdout:7/270: mknod d3/d5e/c5f 0 2024-09-20T19:05:54.666 INFO:tasks.workunit.client.0.smithi027.stdout:7/271: write d3/d8/da/d51/f53 [211396,53395] 0 2024-09-20T19:05:54.668 INFO:tasks.workunit.client.0.smithi027.stdout:3/286: fdatasync d0/d1/d13/d15/f29 0 2024-09-20T19:05:54.669 INFO:tasks.workunit.client.1.smithi098.stdout:1/297: truncate d1/d3/df/f58 738365 0 2024-09-20T19:05:54.670 INFO:tasks.workunit.client.1.smithi098.stdout:5/323: dwrite d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:05:54.679 INFO:tasks.workunit.client.1.smithi098.stdout:5/324: unlink d1/d17/d35/f3e 0 2024-09-20T19:05:54.682 INFO:tasks.workunit.client.1.smithi098.stdout:7/422: getdents d3/d10/d16 0 2024-09-20T19:05:54.683 INFO:tasks.workunit.client.1.smithi098.stdout:7/423: truncate d3/d4c/f7f 5709266 0 2024-09-20T19:05:54.684 INFO:tasks.workunit.client.1.smithi098.stdout:7/424: stat d3/d10/d16/d17/l70 0 2024-09-20T19:05:54.685 INFO:tasks.workunit.client.0.smithi027.stdout:9/390: symlink d0/d9/df/d1c/d6a/d6d/dd/d58/l80 0 2024-09-20T19:05:54.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/325: symlink d1/d1b/l65 0 2024-09-20T19:05:54.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/326: fdatasync d1/d17/d35/f3f 0 2024-09-20T19:05:54.689 INFO:tasks.workunit.client.1.smithi098.stdout:7/425: symlink d3/d10/d16/d17/d33/d37/l89 0 2024-09-20T19:05:54.689 INFO:tasks.workunit.client.0.smithi027.stdout:8/238: dwrite d2/d3/d1b/f2c [4194304,4194304] 0 2024-09-20T19:05:54.690 INFO:tasks.workunit.client.1.smithi098.stdout:1/298: dread d1/d3/d2e/f47 [0,4194304] 0 2024-09-20T19:05:54.694 INFO:tasks.workunit.client.0.smithi027.stdout:8/239: dread d2/d3/f25 [0,4194304] 0 2024-09-20T19:05:54.695 INFO:tasks.workunit.client.1.smithi098.stdout:7/426: mknod d3/d4c/c8a 0 2024-09-20T19:05:54.695 INFO:tasks.workunit.client.0.smithi027.stdout:3/287: rmdir d0/d1 39 2024-09-20T19:05:54.701 INFO:tasks.workunit.client.1.smithi098.stdout:5/327: symlink d1/d17/d25/d56/l66 0 2024-09-20T19:05:54.702 INFO:tasks.workunit.client.1.smithi098.stdout:5/328: dread - d1/d1b/f5a zero size 2024-09-20T19:05:54.705 INFO:tasks.workunit.client.0.smithi027.stdout:9/391: rename d0/d2e/f37 to d0/d9/df/d1c/f81 0 2024-09-20T19:05:54.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/299: dread d1/d3/df/f23 [0,4194304] 0 2024-09-20T19:05:54.709 INFO:tasks.workunit.client.0.smithi027.stdout:1/264: write d2/f13 [12798710,63499] 0 2024-09-20T19:05:54.712 INFO:tasks.workunit.client.1.smithi098.stdout:1/300: creat d1/d3/df/d4a/f5c x:0 0 0 2024-09-20T19:05:54.713 INFO:tasks.workunit.client.1.smithi098.stdout:1/301: fsync d1/d3/f57 0 2024-09-20T19:05:54.713 INFO:tasks.workunit.client.1.smithi098.stdout:7/427: getdents d3/d10/d16/d17/d33/d1f/d28 0 2024-09-20T19:05:54.715 INFO:tasks.workunit.client.0.smithi027.stdout:7/272: link d3/d8/da/l59 d3/d1a/l60 0 2024-09-20T19:05:54.715 INFO:tasks.workunit.client.1.smithi098.stdout:1/302: write d1/d3/f1b [588669,104412] 0 2024-09-20T19:05:54.716 INFO:tasks.workunit.client.0.smithi027.stdout:7/273: chown d3/d1a/f3a 23101257 1 2024-09-20T19:05:54.716 INFO:tasks.workunit.client.0.smithi027.stdout:1/265: rename d2/d1b/d3a/l17 to d2/d8/d2b/d2d/d3e/l4c 0 2024-09-20T19:05:54.718 INFO:tasks.workunit.client.0.smithi027.stdout:8/240: creat d2/d14/d13/d2e/f4d x:0 0 0 2024-09-20T19:05:54.719 INFO:tasks.workunit.client.0.smithi027.stdout:3/288: creat d0/d1/f61 x:0 0 0 2024-09-20T19:05:54.719 INFO:tasks.workunit.client.0.smithi027.stdout:4/212: getdents d5/d13/d36/d48/d3f 0 2024-09-20T19:05:54.720 INFO:tasks.workunit.client.0.smithi027.stdout:3/289: truncate d0/d1/f61 100640 0 2024-09-20T19:05:54.722 INFO:tasks.workunit.client.0.smithi027.stdout:7/274: mkdir d3/d8/d1c/d61 0 2024-09-20T19:05:54.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/428: link d3/l5a d3/d10/d16/d17/d7c/l8b 0 2024-09-20T19:05:54.723 INFO:tasks.workunit.client.1.smithi098.stdout:7/429: write d3/d4c/f7f [1334585,6137] 0 2024-09-20T19:05:54.724 INFO:tasks.workunit.client.0.smithi027.stdout:4/213: mkdir d5/d13/d36/d48/d3f/d4c 0 2024-09-20T19:05:54.724 INFO:tasks.workunit.client.1.smithi098.stdout:7/430: fsync d3/d10/d16/d17/d33/d1f/d2d/f31 0 2024-09-20T19:05:54.724 INFO:tasks.workunit.client.0.smithi027.stdout:8/241: dread d2/d3/d6/d21/f38 [0,4194304] 0 2024-09-20T19:05:54.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/431: stat d3/d10/d16/d17/f3d 0 2024-09-20T19:05:54.727 INFO:tasks.workunit.client.0.smithi027.stdout:8/242: chown d2/d14/d13/d2e/f4d 1059 1 2024-09-20T19:05:54.727 INFO:tasks.workunit.client.1.smithi098.stdout:7/432: mkdir d3/d10/d16/d17/d33/d1f/d28/d7d/d8c 0 2024-09-20T19:05:54.728 INFO:tasks.workunit.client.1.smithi098.stdout:7/433: fsync d3/d10/d16/d17/d7c/f80 0 2024-09-20T19:05:54.731 INFO:tasks.workunit.client.0.smithi027.stdout:3/290: dwrite d0/d1/d13/f22 [0,4194304] 0 2024-09-20T19:05:54.733 INFO:tasks.workunit.client.0.smithi027.stdout:7/275: rename d3/d8/c5a to d3/c62 0 2024-09-20T19:05:54.733 INFO:tasks.workunit.client.0.smithi027.stdout:3/291: chown d0/d1/d13/d15/d55/l59 9089 1 2024-09-20T19:05:54.734 INFO:tasks.workunit.client.0.smithi027.stdout:4/214: creat d5/d11/f4d x:0 0 0 2024-09-20T19:05:54.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/434: mknod d3/d10/d16/d73/c8d 0 2024-09-20T19:05:54.738 INFO:tasks.workunit.client.0.smithi027.stdout:8/243: dwrite d2/d3/d6/d21/f28 [0,4194304] 0 2024-09-20T19:05:54.738 INFO:tasks.workunit.client.0.smithi027.stdout:7/276: unlink d3/d8/f20 0 2024-09-20T19:05:54.739 INFO:tasks.workunit.client.1.smithi098.stdout:1/303: dwrite d1/d3/fe [0,4194304] 0 2024-09-20T19:05:54.740 INFO:tasks.workunit.client.0.smithi027.stdout:8/244: chown d2/d3/d1b/d36/f4c 191907 1 2024-09-20T19:05:54.741 INFO:tasks.workunit.client.0.smithi027.stdout:8/245: fsync d2/d14/d13/f22 0 2024-09-20T19:05:54.743 INFO:tasks.workunit.client.1.smithi098.stdout:1/304: dread d1/d3/f46 [0,4194304] 0 2024-09-20T19:05:54.744 INFO:tasks.workunit.client.0.smithi027.stdout:8/246: write d2/f39 [2114896,92986] 0 2024-09-20T19:05:54.745 INFO:tasks.workunit.client.0.smithi027.stdout:8/247: chown d2/d2a 448 1 2024-09-20T19:05:54.745 INFO:tasks.workunit.client.0.smithi027.stdout:7/277: fsync d3/d8/da/d2e/f3f 0 2024-09-20T19:05:54.746 INFO:tasks.workunit.client.1.smithi098.stdout:1/305: mknod d1/d3/df/d34/d43/c5d 0 2024-09-20T19:05:54.747 INFO:tasks.workunit.client.0.smithi027.stdout:7/278: chown d3/d1a/f42 1 1 2024-09-20T19:05:54.749 INFO:tasks.workunit.client.0.smithi027.stdout:8/248: creat d2/d3/d6/d21/f4e x:0 0 0 2024-09-20T19:05:54.752 INFO:tasks.workunit.client.0.smithi027.stdout:7/279: rename d3/d8/d1c/f34 to d3/d8/da/dc/f63 0 2024-09-20T19:05:54.755 INFO:tasks.workunit.client.1.smithi098.stdout:1/306: dwrite d1/d3/f57 [0,4194304] 0 2024-09-20T19:05:54.756 INFO:tasks.workunit.client.1.smithi098.stdout:1/307: fsync d1/d3/df/d34/d43/f59 0 2024-09-20T19:05:54.756 INFO:tasks.workunit.client.0.smithi027.stdout:8/249: creat d2/d3/d1b/d2d/f4f x:0 0 0 2024-09-20T19:05:54.757 INFO:tasks.workunit.client.0.smithi027.stdout:8/250: stat d2/d14/d13/d43 0 2024-09-20T19:05:54.757 INFO:tasks.workunit.client.1.smithi098.stdout:1/308: dread - d1/d3/df/d34/f51 zero size 2024-09-20T19:05:54.760 INFO:tasks.workunit.client.0.smithi027.stdout:8/251: symlink d2/d14/d13/d2e/l50 0 2024-09-20T19:05:54.763 INFO:tasks.workunit.client.0.smithi027.stdout:8/252: write d2/d14/d13/d43/f49 [609575,113685] 0 2024-09-20T19:05:54.767 INFO:tasks.workunit.client.0.smithi027.stdout:3/292: dwrite d0/d1/fb [0,4194304] 0 2024-09-20T19:05:54.772 INFO:tasks.workunit.client.0.smithi027.stdout:3/293: rename d0/d1/f61 to d0/d1/d13/d3c/f62 0 2024-09-20T19:05:54.774 INFO:tasks.workunit.client.0.smithi027.stdout:8/253: dwrite d2/d3/d1b/f2c [4194304,4194304] 0 2024-09-20T19:05:54.776 INFO:tasks.workunit.client.0.smithi027.stdout:3/294: write d0/d1/f3b [587645,67592] 0 2024-09-20T19:05:54.778 INFO:tasks.workunit.client.0.smithi027.stdout:8/254: mkdir d2/d14/d13/d51 0 2024-09-20T19:05:54.779 INFO:tasks.workunit.client.1.smithi098.stdout:1/309: dwrite d1/d3/df/d34/d43/f35 [0,4194304] 0 2024-09-20T19:05:54.780 INFO:tasks.workunit.client.0.smithi027.stdout:8/255: dread d2/d3/f37 [0,4194304] 0 2024-09-20T19:05:54.781 INFO:tasks.workunit.client.0.smithi027.stdout:3/295: rename d0/d19/c2f to d0/d1/d13/d15/c63 0 2024-09-20T19:05:54.782 INFO:tasks.workunit.client.0.smithi027.stdout:8/256: mknod d2/d14/c52 0 2024-09-20T19:05:54.787 INFO:tasks.workunit.client.1.smithi098.stdout:1/310: mknod d1/d3/df/d34/d52/c5e 0 2024-09-20T19:05:54.788 INFO:tasks.workunit.client.1.smithi098.stdout:1/311: dread - d1/d3/df/d4a/f5c zero size 2024-09-20T19:05:54.789 INFO:tasks.workunit.client.0.smithi027.stdout:8/257: creat d2/d14/d13/d2e/f53 x:0 0 0 2024-09-20T19:05:54.790 INFO:tasks.workunit.client.0.smithi027.stdout:8/258: write d2/f47 [157469,23065] 0 2024-09-20T19:05:54.790 INFO:tasks.workunit.client.0.smithi027.stdout:3/296: mkdir d0/d1/d13/d64 0 2024-09-20T19:05:54.791 INFO:tasks.workunit.client.1.smithi098.stdout:1/312: truncate d1/d3/df/d34/d43/f56 679808 0 2024-09-20T19:05:54.791 INFO:tasks.workunit.client.0.smithi027.stdout:8/259: chown d2/d2a/f2f 2 1 2024-09-20T19:05:54.792 INFO:tasks.workunit.client.0.smithi027.stdout:3/297: mkdir d0/d1/d65 0 2024-09-20T19:05:54.793 INFO:tasks.workunit.client.1.smithi098.stdout:1/313: rmdir d1/d3/df/d34/d43 39 2024-09-20T19:05:54.795 INFO:tasks.workunit.client.1.smithi098.stdout:1/314: chown d1/f10 48 1 2024-09-20T19:05:54.795 INFO:tasks.workunit.client.0.smithi027.stdout:8/260: creat d2/d3/d1b/d35/f54 x:0 0 0 2024-09-20T19:05:54.796 INFO:tasks.workunit.client.0.smithi027.stdout:3/298: rename d0/d1/d5e/d1d/f1f to d0/d1/d13/d3c/f66 0 2024-09-20T19:05:54.797 INFO:tasks.workunit.client.1.smithi098.stdout:1/315: getdents d1/d3/df/d4b 0 2024-09-20T19:05:54.801 INFO:tasks.workunit.client.0.smithi027.stdout:8/261: dwrite d2/d3/f11 [0,4194304] 0 2024-09-20T19:05:54.802 INFO:tasks.workunit.client.1.smithi098.stdout:1/316: link d1/d3/f9 d1/d3/df/d34/f5f 0 2024-09-20T19:05:54.802 INFO:tasks.workunit.client.0.smithi027.stdout:3/299: link d0/d1/d13/d15/f29 d0/d19/d54/f67 0 2024-09-20T19:05:54.802 INFO:tasks.workunit.client.0.smithi027.stdout:8/262: readlink d2/lb 0 2024-09-20T19:05:54.803 INFO:tasks.workunit.client.0.smithi027.stdout:8/263: write d2/d14/d13/d2e/f53 [722271,115561] 0 2024-09-20T19:05:54.804 INFO:tasks.workunit.client.0.smithi027.stdout:3/300: creat d0/d1/d13/d15/f68 x:0 0 0 2024-09-20T19:05:54.805 INFO:tasks.workunit.client.0.smithi027.stdout:8/264: fdatasync d2/d3/d1b/f26 0 2024-09-20T19:05:54.805 INFO:tasks.workunit.client.0.smithi027.stdout:3/301: chown d0/d1/l2d 29985546 1 2024-09-20T19:05:54.805 INFO:tasks.workunit.client.1.smithi098.stdout:1/317: rename d1/d3/df/d34/f51 to d1/d3/df/d34/d43/d53/f60 0 2024-09-20T19:05:54.806 INFO:tasks.workunit.client.1.smithi098.stdout:1/318: chown d1/d3/f49 17526714 1 2024-09-20T19:05:54.807 INFO:tasks.workunit.client.0.smithi027.stdout:2/197: sync 2024-09-20T19:05:54.807 INFO:tasks.workunit.client.0.smithi027.stdout:0/307: sync 2024-09-20T19:05:54.807 INFO:tasks.workunit.client.0.smithi027.stdout:0/308: readlink d2/lb 0 2024-09-20T19:05:54.808 INFO:tasks.workunit.client.0.smithi027.stdout:8/265: mknod d2/d14/d13/c55 0 2024-09-20T19:05:54.811 INFO:tasks.workunit.client.0.smithi027.stdout:3/302: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:54.811 INFO:tasks.workunit.client.0.smithi027.stdout:2/198: mkdir d3/d1c/d31 0 2024-09-20T19:05:54.812 INFO:tasks.workunit.client.0.smithi027.stdout:8/266: mknod d2/d3/d1b/d35/c56 0 2024-09-20T19:05:54.812 INFO:tasks.workunit.client.0.smithi027.stdout:2/199: dread - d3/d1c/f2d zero size 2024-09-20T19:05:54.813 INFO:tasks.workunit.client.0.smithi027.stdout:2/200: fdatasync d3/ff 0 2024-09-20T19:05:54.814 INFO:tasks.workunit.client.0.smithi027.stdout:3/303: creat d0/d1/d5e/d1d/f69 x:0 0 0 2024-09-20T19:05:54.815 INFO:tasks.workunit.client.0.smithi027.stdout:3/304: fsync d0/d1/fb 0 2024-09-20T19:05:54.815 INFO:tasks.workunit.client.0.smithi027.stdout:0/309: creat d2/d20/d52/f6e x:0 0 0 2024-09-20T19:05:54.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/319: dwrite d1/d3/f2b [0,4194304] 0 2024-09-20T19:05:54.817 INFO:tasks.workunit.client.0.smithi027.stdout:3/305: chown d0/d1/d5e/d1d 17 1 2024-09-20T19:05:54.817 INFO:tasks.workunit.client.1.smithi098.stdout:1/320: dread d1/f3d [0,4194304] 0 2024-09-20T19:05:54.817 INFO:tasks.workunit.client.0.smithi027.stdout:8/267: creat d2/d3/f57 x:0 0 0 2024-09-20T19:05:54.818 INFO:tasks.workunit.client.1.smithi098.stdout:1/321: chown d1/f3d 1012846627 1 2024-09-20T19:05:54.821 INFO:tasks.workunit.client.0.smithi027.stdout:0/310: rename d2/d14/d1d/f4b to d2/d14/d1b/d39/f6f 0 2024-09-20T19:05:54.822 INFO:tasks.workunit.client.0.smithi027.stdout:2/201: dwrite d3/de/f1a [0,4194304] 0 2024-09-20T19:05:54.823 INFO:tasks.workunit.client.0.smithi027.stdout:0/311: readlink d2/d14/d1d/d2e/l63 0 2024-09-20T19:05:54.824 INFO:tasks.workunit.client.0.smithi027.stdout:0/312: truncate d2/f5e 291117 0 2024-09-20T19:05:54.824 INFO:tasks.workunit.client.0.smithi027.stdout:3/306: creat d0/d1/d13/d15/d55/f6a x:0 0 0 2024-09-20T19:05:54.826 INFO:tasks.workunit.client.0.smithi027.stdout:3/307: write d0/d1/d5e/d1d/f3a [793441,55645] 0 2024-09-20T19:05:54.827 INFO:tasks.workunit.client.0.smithi027.stdout:8/268: rename d2/d14/d13/d2e/l50 to d2/d3/d1b/d36/l58 0 2024-09-20T19:05:54.828 INFO:tasks.workunit.client.0.smithi027.stdout:0/313: dread d2/f19 [0,4194304] 0 2024-09-20T19:05:54.831 INFO:tasks.workunit.client.1.smithi098.stdout:1/322: rmdir d1/d3/df/d4b 0 2024-09-20T19:05:54.836 INFO:tasks.workunit.client.0.smithi027.stdout:2/202: creat d3/d2f/f32 x:0 0 0 2024-09-20T19:05:54.838 INFO:tasks.workunit.client.0.smithi027.stdout:0/314: chown d2/l41 66729485 1 2024-09-20T19:05:54.839 INFO:tasks.workunit.client.1.smithi098.stdout:1/323: truncate d1/f55 2470045 0 2024-09-20T19:05:54.839 INFO:tasks.workunit.client.0.smithi027.stdout:2/203: dread d3/d24/f28 [0,4194304] 0 2024-09-20T19:05:54.840 INFO:tasks.workunit.client.0.smithi027.stdout:3/308: mknod d0/c6b 0 2024-09-20T19:05:54.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/309: read - d0/d1/d13/d3c/f66 zero size 2024-09-20T19:05:54.844 INFO:tasks.workunit.client.0.smithi027.stdout:8/269: link d2/d14/c17 d2/d14/d13/d43/c59 0 2024-09-20T19:05:54.846 INFO:tasks.workunit.client.0.smithi027.stdout:0/315: mkdir d2/d49/d70 0 2024-09-20T19:05:54.846 INFO:tasks.workunit.client.0.smithi027.stdout:2/204: getdents d3/d1c/d26/d2a 0 2024-09-20T19:05:54.848 INFO:tasks.workunit.client.0.smithi027.stdout:0/316: creat d2/d14/d1d/f71 x:0 0 0 2024-09-20T19:05:54.849 INFO:tasks.workunit.client.0.smithi027.stdout:2/205: write d3/de/f1a [4843907,11872] 0 2024-09-20T19:05:54.849 INFO:tasks.workunit.client.0.smithi027.stdout:8/270: creat d2/d3/d6/d21/d33/f5a x:0 0 0 2024-09-20T19:05:54.851 INFO:tasks.workunit.client.0.smithi027.stdout:3/310: dwrite d0/d1/f3b [0,4194304] 0 2024-09-20T19:05:54.854 INFO:tasks.workunit.client.0.smithi027.stdout:8/271: creat d2/d14/d13/d43/f5b x:0 0 0 2024-09-20T19:05:54.856 INFO:tasks.workunit.client.0.smithi027.stdout:8/272: write d2/d14/d13/f1d [1802521,61276] 0 2024-09-20T19:05:54.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.904+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb6a8000bf0 con 0x7fb6b403f980 2024-09-20T19:05:54.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.914+0000 7fb6c1ffb640 1 -- 172.21.15.27:0/3045880729 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb6a8000bf0 con 0x7fb6b403f980 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (6m) 2m ago 8m 25.3M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (8m) 2m ago 8m 8128k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (7m) 23s ago 7m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (8m) 2m ago 8m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (7m) 23s ago 7m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (6m) 2m ago 7m 80.6M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (2m) 2m ago 2m 13.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (2m) 2m ago 2m 11.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (2m) 23s ago 2m 115M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:05:54.920 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (2m) 23s ago 2m 13.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (9m) 2m ago 9m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (48s) 23s ago 7m 132M - 19.3.0-5099-g88deadb8 441f9a3fe515 c9edfbf21dc4 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (9m) 2m ago 9m 48.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (7m) 23s ago 7m 37.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (8m) 2m ago 8m 16.2M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 23s ago 7m 14.7M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (6m) 2m ago 6m 47.2M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (5m) 2m ago 5m 47.3M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (5m) 2m ago 5m 52.8M 3946M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (4m) 23s ago 4m 80.4M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (4m) 23s ago 4m 75.4M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (3m) 23s ago 3m 74.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:05:54.921 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (6m) 2m ago 7m 59.4M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:05:54.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 msgr2=0x7fb6b4041e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 0x7fb6b4041e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00058c0 tx=0x7fb6b0005850 comp rx=0 tx=0).stop 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 msgr2=0x7fb6bc142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b420 tx=0x7fb6b800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 shutdown_connections 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fb6b403f980 0x7fb6b4041e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6bc0965a0 0x7fb6bc142bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 --2- 172.21.15.27:0/3045880729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6bc093c50 0x7fb6bc1426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 >> 172.21.15.27:0/3045880729 conn(0x7fb6bc08fa40 msgr2=0x7fb6bc091e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.916+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 shutdown_connections 2024-09-20T19:05:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:54.917+0000 7fb6c9d44640 1 -- 172.21.15.27:0/3045880729 wait complete. 2024-09-20T19:05:54.953 INFO:tasks.workunit.client.0.smithi027.stdout:2/206: creat d3/d2f/f33 x:0 0 0 2024-09-20T19:05:54.953 INFO:tasks.workunit.client.0.smithi027.stdout:2/207: chown d3/c20 178 1 2024-09-20T19:05:54.954 INFO:tasks.workunit.client.0.smithi027.stdout:2/208: read - d3/d1c/f2d zero size 2024-09-20T19:05:54.962 INFO:tasks.workunit.client.0.smithi027.stdout:2/209: dwrite d3/de/f18 [0,4194304] 0 2024-09-20T19:05:55.000 INFO:tasks.workunit.client.0.smithi027.stdout:9/392: sync 2024-09-20T19:05:55.000 INFO:tasks.workunit.client.0.smithi027.stdout:5/322: sync 2024-09-20T19:05:55.000 INFO:tasks.workunit.client.0.smithi027.stdout:6/215: sync 2024-09-20T19:05:55.001 INFO:tasks.workunit.client.0.smithi027.stdout:6/216: write d4/d15/f2f [909953,61] 0 2024-09-20T19:05:55.002 INFO:tasks.workunit.client.0.smithi027.stdout:9/393: dread - d0/d9/df/d1c/d6a/d6d/dd/f38 zero size 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 -- 172.21.15.27:0/2476540691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290104d80 msgr2=0x7f4290107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 --2- 172.21.15.27:0/2476540691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290104d80 0x7f4290107170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4280009880 tx=0x7f428002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 -- 172.21.15.27:0/2476540691 shutdown_connections 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 --2- 172.21.15.27:0/2476540691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290104d80 0x7f4290107170 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 --2- 172.21.15.27:0/2476540691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290102450 0x7f4290104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 -- 172.21.15.27:0/2476540691 >> 172.21.15.27:0/2476540691 conn(0x7f42900fc010 msgr2=0x7f42900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 -- 172.21.15.27:0/2476540691 shutdown_connections 2024-09-20T19:05:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.008+0000 7f4297792640 1 -- 172.21.15.27:0/2476540691 wait complete. 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.009+0000 7f4297792640 1 Processor -- start 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.009+0000 7f4297792640 1 -- start start 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4297792640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4297792640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290104d80 0x7f42901979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4297792640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f429010a720 con 0x7f4290102450 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4297792640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f429010a5a0 con 0x7f4290104d80 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35416/0 (socket says 172.21.15.27:35416) 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 -- 172.21.15.27:0/1567113184 learned_addr learned my addr 172.21.15.27:0/1567113184 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4294d2d640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290104d80 0x7f42901979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 -- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290104d80 msgr2=0x7f42901979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290104d80 0x7f42901979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 -- 172.21.15.27:0/1567113184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4290198040 con 0x7f4290102450 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f429552e640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c810 tx=0x7f428c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f428c004020 con 0x7f4290102450 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f428c0041c0 con 0x7f4290102450 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.010+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429019ca80 con 0x7f4290102450 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.011+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f428c0047a0 con 0x7f4290102450 2024-09-20T19:05:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.011+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429019cfe0 con 0x7f4290102450 2024-09-20T19:05:55.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.012+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 52128+0+0 (secure 0 0 0) 0x7f428c004980 con 0x7f4290102450 2024-09-20T19:05:55.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.012+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4290102830 con 0x7f4290102450 2024-09-20T19:05:55.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.012+0000 7f42867fc640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 0x7f427c042050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.012+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f428c0557a0 con 0x7f4290102450 2024-09-20T19:05:55.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.012+0000 7f4294d2d640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 0x7f427c042050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.013+0000 7f4294d2d640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 0x7f427c042050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4280009230 tx=0x7f42800058d0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:55.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/394: sync 2024-09-20T19:05:55.021 INFO:tasks.workunit.client.0.smithi027.stdout:8/273: creat d2/d14/d13/f5c x:0 0 0 2024-09-20T19:05:55.022 INFO:tasks.workunit.client.0.smithi027.stdout:3/311: link d0/f5a d0/d19/f6c 0 2024-09-20T19:05:55.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.017+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f428c014030 con 0x7f4290102450 2024-09-20T19:05:55.025 INFO:tasks.workunit.client.0.smithi027.stdout:2/210: stat d3/d13/f2b 0 2024-09-20T19:05:55.026 INFO:tasks.workunit.client.0.smithi027.stdout:2/211: stat d3/ff 0 2024-09-20T19:05:55.026 INFO:tasks.workunit.client.0.smithi027.stdout:2/212: write d3/f9 [1739153,28578] 0 2024-09-20T19:05:55.027 INFO:tasks.workunit.client.1.smithi098.stdout:9/395: symlink d4/de/d27/d4a/l87 0 2024-09-20T19:05:55.028 INFO:tasks.workunit.client.0.smithi027.stdout:3/312: dread d0/d1/d13/d3c/f42 [0,4194304] 0 2024-09-20T19:05:55.029 INFO:tasks.workunit.client.0.smithi027.stdout:5/323: truncate d4/da/de/f37 1331983 0 2024-09-20T19:05:55.030 INFO:tasks.workunit.client.0.smithi027.stdout:9/394: write d0/d9/df/d1b/d64/f6f [347537,8966] 0 2024-09-20T19:05:55.033 INFO:tasks.workunit.client.0.smithi027.stdout:8/274: mkdir d2/d14/d13/d43/d5d 0 2024-09-20T19:05:55.035 INFO:tasks.workunit.client.0.smithi027.stdout:6/217: unlink d4/d15/d37/d39/l3a 0 2024-09-20T19:05:55.037 INFO:tasks.workunit.client.0.smithi027.stdout:6/218: write d4/f7 [6775300,44805] 0 2024-09-20T19:05:55.039 INFO:tasks.workunit.client.0.smithi027.stdout:8/275: creat d2/d3/f5e x:0 0 0 2024-09-20T19:05:55.040 INFO:tasks.workunit.client.0.smithi027.stdout:3/313: truncate d0/d1/fb 793275 0 2024-09-20T19:05:55.041 INFO:tasks.workunit.client.0.smithi027.stdout:0/317: dwrite f1 [0,4194304] 0 2024-09-20T19:05:55.044 INFO:tasks.workunit.client.0.smithi027.stdout:5/324: creat d4/da/de/d1e/d3d/f68 x:0 0 0 2024-09-20T19:05:55.048 INFO:tasks.workunit.client.0.smithi027.stdout:3/314: unlink d0/c32 0 2024-09-20T19:05:55.050 INFO:tasks.workunit.client.0.smithi027.stdout:5/325: mkdir d4/da/de/d3e/d69 0 2024-09-20T19:05:55.050 INFO:tasks.workunit.client.0.smithi027.stdout:8/276: symlink d2/d14/d13/d51/l5f 0 2024-09-20T19:05:55.052 INFO:tasks.workunit.client.0.smithi027.stdout:8/277: chown d2/d3/d1b/d2d/l42 0 1 2024-09-20T19:05:55.053 INFO:tasks.workunit.client.0.smithi027.stdout:0/318: symlink d2/l72 0 2024-09-20T19:05:55.053 INFO:tasks.workunit.client.0.smithi027.stdout:8/278: dread - d2/d3/d1b/d2d/f4f zero size 2024-09-20T19:05:55.055 INFO:tasks.workunit.client.0.smithi027.stdout:0/319: chown d2/d14/d1d/d2e/c62 41 1 2024-09-20T19:05:55.055 INFO:tasks.workunit.client.0.smithi027.stdout:8/279: readlink d2/d3/d6/l3a 0 2024-09-20T19:05:55.057 INFO:tasks.workunit.client.1.smithi098.stdout:9/396: dwrite d4/de/d27/d4a/d21/d25/f30 [0,4194304] 0 2024-09-20T19:05:55.058 INFO:tasks.workunit.client.0.smithi027.stdout:3/315: symlink d0/d1/d13/l6d 0 2024-09-20T19:05:55.060 INFO:tasks.workunit.client.0.smithi027.stdout:5/326: mkdir d4/da/de/d3e/d69/d6a 0 2024-09-20T19:05:55.062 INFO:tasks.workunit.client.0.smithi027.stdout:0/320: symlink d2/d14/d1d/d2e/l73 0 2024-09-20T19:05:55.063 INFO:tasks.workunit.client.0.smithi027.stdout:0/321: write d2/d14/f3f [166613,34763] 0 2024-09-20T19:05:55.064 INFO:tasks.workunit.client.0.smithi027.stdout:8/280: rename d2/d3/d1b/d35/f54 to d2/d14/d13/d2e/f60 0 2024-09-20T19:05:55.064 INFO:tasks.workunit.client.1.smithi098.stdout:9/397: dread d4/de/d24/d35/f42 [0,4194304] 0 2024-09-20T19:05:55.067 INFO:tasks.workunit.client.1.smithi098.stdout:9/398: chown d4/de/d27/d39/l82 19225092 1 2024-09-20T19:05:55.068 INFO:tasks.workunit.client.1.smithi098.stdout:9/399: chown d4/de/d27/d4a/d21/d25/f59 51 1 2024-09-20T19:05:55.069 INFO:tasks.workunit.client.0.smithi027.stdout:0/322: creat d2/d14/d1b/d39/f74 x:0 0 0 2024-09-20T19:05:55.071 INFO:tasks.workunit.client.0.smithi027.stdout:3/316: rename d0/l51 to d0/d19/l6e 0 2024-09-20T19:05:55.075 INFO:tasks.workunit.client.0.smithi027.stdout:0/323: unlink d2/d14/d1d/d2e/l63 0 2024-09-20T19:05:55.077 INFO:tasks.workunit.client.0.smithi027.stdout:5/327: dread d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:55.078 INFO:tasks.workunit.client.0.smithi027.stdout:8/281: dwrite d2/f39 [4194304,4194304] 0 2024-09-20T19:05:55.081 INFO:tasks.workunit.client.0.smithi027.stdout:3/317: mkdir d0/d1/d13/d15/d6f 0 2024-09-20T19:05:55.086 INFO:tasks.workunit.client.0.smithi027.stdout:9/395: dwrite d0/d9/df/d1c/f81 [0,4194304] 0 2024-09-20T19:05:55.088 INFO:tasks.workunit.client.0.smithi027.stdout:5/328: mknod d4/da/de/d3e/d44/c6b 0 2024-09-20T19:05:55.091 INFO:tasks.workunit.client.0.smithi027.stdout:8/282: truncate d2/d14/f3f 511168 0 2024-09-20T19:05:55.091 INFO:tasks.workunit.client.0.smithi027.stdout:3/318: fdatasync d0/d1/d13/d15/f68 0 2024-09-20T19:05:55.091 INFO:tasks.workunit.client.0.smithi027.stdout:6/219: dwrite f0 [0,4194304] 0 2024-09-20T19:05:55.092 INFO:tasks.workunit.client.0.smithi027.stdout:8/283: chown d2/d14/c24 3 1 2024-09-20T19:05:55.093 INFO:tasks.workunit.client.1.smithi098.stdout:9/400: dread d4/de/d27/d39/f5a [0,4194304] 0 2024-09-20T19:05:55.094 INFO:tasks.workunit.client.0.smithi027.stdout:0/324: rename d2/d20/f44 to d2/d14/d1b/f75 0 2024-09-20T19:05:55.094 INFO:tasks.workunit.client.0.smithi027.stdout:6/220: stat f0 0 2024-09-20T19:05:55.096 INFO:tasks.workunit.client.0.smithi027.stdout:9/396: creat d0/d9/d3d/d5a/f82 x:0 0 0 2024-09-20T19:05:55.098 INFO:tasks.workunit.client.0.smithi027.stdout:0/325: creat d2/d48/f76 x:0 0 0 2024-09-20T19:05:55.098 INFO:tasks.workunit.client.0.smithi027.stdout:5/329: write d4/da/de/d3e/d61/f5e [4232427,105914] 0 2024-09-20T19:05:55.100 INFO:tasks.workunit.client.0.smithi027.stdout:6/221: truncate d4/d15/d37/d39/f3f 742342 0 2024-09-20T19:05:55.101 INFO:tasks.workunit.client.0.smithi027.stdout:9/397: write d0/d9/df/f21 [678419,94751] 0 2024-09-20T19:05:55.102 INFO:tasks.workunit.client.1.smithi098.stdout:9/401: dwrite d4/de/d27/d39/f5a [0,4194304] 0 2024-09-20T19:05:55.102 INFO:tasks.workunit.client.0.smithi027.stdout:0/326: readlink d2/d14/d1b/l56 0 2024-09-20T19:05:55.104 INFO:tasks.workunit.client.0.smithi027.stdout:5/330: chown d4/d1f/f24 522781562 1 2024-09-20T19:05:55.107 INFO:tasks.workunit.client.0.smithi027.stdout:8/284: dwrite d2/d14/d13/f5c [0,4194304] 0 2024-09-20T19:05:55.114 INFO:tasks.workunit.client.0.smithi027.stdout:3/319: getdents d0/d1/d5e 0 2024-09-20T19:05:55.116 INFO:tasks.workunit.client.0.smithi027.stdout:9/398: creat d0/d9/df/d1c/d6a/f83 x:0 0 0 2024-09-20T19:05:55.116 INFO:tasks.workunit.client.0.smithi027.stdout:4/215: sync 2024-09-20T19:05:55.116 INFO:tasks.workunit.client.0.smithi027.stdout:6/222: creat d4/d15/d37/f40 x:0 0 0 2024-09-20T19:05:55.116 INFO:tasks.workunit.client.0.smithi027.stdout:7/280: sync 2024-09-20T19:05:55.116 INFO:tasks.workunit.client.0.smithi027.stdout:1/266: sync 2024-09-20T19:05:55.119 INFO:tasks.workunit.client.0.smithi027.stdout:3/320: dread - d0/d1/d13/d3c/f66 zero size 2024-09-20T19:05:55.122 INFO:tasks.workunit.client.0.smithi027.stdout:9/399: creat d0/d9/df/d57/f84 x:0 0 0 2024-09-20T19:05:55.123 INFO:tasks.workunit.client.0.smithi027.stdout:1/267: symlink d2/d8/l4d 0 2024-09-20T19:05:55.123 INFO:tasks.workunit.client.0.smithi027.stdout:4/216: write d5/d13/d36/d48/f43 [1925688,32834] 0 2024-09-20T19:05:55.127 INFO:tasks.workunit.client.0.smithi027.stdout:7/281: creat d3/d8/d26/d45/d56/f64 x:0 0 0 2024-09-20T19:05:55.129 INFO:tasks.workunit.client.0.smithi027.stdout:0/327: getdents d2/d14/d1d 0 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:8/409: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:6/249: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:2/650: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:4/370: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:3/310: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:5/329: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/229: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:1/324: sync 2024-09-20T19:05:55.131 INFO:tasks.workunit.client.1.smithi098.stdout:7/435: sync 2024-09-20T19:05:55.132 INFO:tasks.workunit.client.1.smithi098.stdout:5/330: chown d1/d17/d5e 1 1 2024-09-20T19:05:55.133 INFO:tasks.workunit.client.0.smithi027.stdout:0/328: read - d2/d49/f45 zero size 2024-09-20T19:05:55.134 INFO:tasks.workunit.client.0.smithi027.stdout:8/285: getdents d2/d3/d1b 0 2024-09-20T19:05:55.135 INFO:tasks.workunit.client.0.smithi027.stdout:5/331: dwrite d4/d1f/d28/f34 [0,4194304] 0 2024-09-20T19:05:55.135 INFO:tasks.workunit.client.1.smithi098.stdout:6/250: readlink d0/de/d1b/d37/d44/dc/l10 0 2024-09-20T19:05:55.136 INFO:tasks.workunit.client.0.smithi027.stdout:4/217: creat d5/d13/d16/d21/d3a/f4e x:0 0 0 2024-09-20T19:05:55.137 INFO:tasks.workunit.client.1.smithi098.stdout:0/230: truncate d0/db/d1d/f21 4525744 0 2024-09-20T19:05:55.138 INFO:tasks.workunit.client.1.smithi098.stdout:1/325: mkdir d1/d3/d2e/d61 0 2024-09-20T19:05:55.139 INFO:tasks.workunit.client.0.smithi027.stdout:5/332: read d4/d1f/d28/f3f [55445,88167] 0 2024-09-20T19:05:55.140 INFO:tasks.workunit.client.1.smithi098.stdout:9/402: dread d4/de/d24/d35/f32 [0,4194304] 0 2024-09-20T19:05:55.141 INFO:tasks.workunit.client.0.smithi027.stdout:7/282: dread d3/d8/d26/f4a [0,4194304] 0 2024-09-20T19:05:55.141 INFO:tasks.workunit.client.0.smithi027.stdout:3/321: getdents d0/d19/d54 0 2024-09-20T19:05:55.142 INFO:tasks.workunit.client.0.smithi027.stdout:0/329: write d2/d14/d1d/d2e/f54 [861180,25884] 0 2024-09-20T19:05:55.143 INFO:tasks.workunit.client.0.smithi027.stdout:6/223: dwrite d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:55.143 INFO:tasks.workunit.client.1.smithi098.stdout:3/311: symlink d4/d19/d1d/d2f/l5f 0 2024-09-20T19:05:55.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/371: dwrite d3/fe [0,4194304] 0 2024-09-20T19:05:55.145 INFO:tasks.workunit.client.0.smithi027.stdout:8/286: creat d2/d3/d1b/d36/f61 x:0 0 0 2024-09-20T19:05:55.146 INFO:tasks.workunit.client.1.smithi098.stdout:0/231: symlink d0/d15/l41 0 2024-09-20T19:05:55.147 INFO:tasks.workunit.client.0.smithi027.stdout:6/224: dread - d4/d15/d37/f40 zero size 2024-09-20T19:05:55.148 INFO:tasks.workunit.client.0.smithi027.stdout:8/287: fdatasync d2/d3/d1b/f2c 0 2024-09-20T19:05:55.148 INFO:tasks.workunit.client.0.smithi027.stdout:6/225: chown d4/d6/c12 18 1 2024-09-20T19:05:55.149 INFO:tasks.workunit.client.0.smithi027.stdout:8/288: chown d2/c46 22524 1 2024-09-20T19:05:55.149 INFO:tasks.workunit.client.0.smithi027.stdout:6/226: readlink d4/d15/l26 0 2024-09-20T19:05:55.151 INFO:tasks.workunit.client.0.smithi027.stdout:8/289: write d2/d14/d13/d2e/f4d [220505,75966] 0 2024-09-20T19:05:55.151 INFO:tasks.workunit.client.0.smithi027.stdout:4/218: mkdir d5/d13/d16/d4f 0 2024-09-20T19:05:55.152 INFO:tasks.workunit.client.1.smithi098.stdout:5/331: dwrite d1/f9 [0,4194304] 0 2024-09-20T19:05:55.152 INFO:tasks.workunit.client.1.smithi098.stdout:1/326: read d1/f16 [89716,96570] 0 2024-09-20T19:05:55.154 INFO:tasks.workunit.client.1.smithi098.stdout:7/436: rename d3/d10/d16/d17/d33/d37/f78 to d3/d10/d16/d17/d33/d1f/d28/d66/f8e 0 2024-09-20T19:05:55.157 INFO:tasks.workunit.client.0.smithi027.stdout:3/322: mkdir d0/d1/d13/d15/d55/d70 0 2024-09-20T19:05:55.161 INFO:tasks.workunit.client.0.smithi027.stdout:0/330: unlink d2/d14/f5b 0 2024-09-20T19:05:55.163 INFO:tasks.workunit.client.1.smithi098.stdout:8/410: link d7/de/d11/d1f/d57/d72/f79 d7/de/d11/d1d/f95 0 2024-09-20T19:05:55.164 INFO:tasks.workunit.client.1.smithi098.stdout:9/403: stat d4/de/d24/d35/d2d/c61 0 2024-09-20T19:05:55.165 INFO:tasks.workunit.client.0.smithi027.stdout:8/290: dwrite d2/d3/f4a [0,4194304] 0 2024-09-20T19:05:55.165 INFO:tasks.workunit.client.0.smithi027.stdout:5/333: mkdir d4/d6c 0 2024-09-20T19:05:55.166 INFO:tasks.workunit.client.1.smithi098.stdout:4/372: dread d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:55.169 INFO:tasks.workunit.client.0.smithi027.stdout:7/283: dwrite d3/d8/da/f46 [0,4194304] 0 2024-09-20T19:05:55.172 INFO:tasks.workunit.client.1.smithi098.stdout:0/232: mknod d0/d6/d28/d31/c42 0 2024-09-20T19:05:55.173 INFO:tasks.workunit.client.1.smithi098.stdout:0/233: truncate d0/d6/d19/f1c 4662977 0 2024-09-20T19:05:55.174 INFO:tasks.workunit.client.1.smithi098.stdout:0/234: write d0/db/d1d/f21 [996844,67168] 0 2024-09-20T19:05:55.176 INFO:tasks.workunit.client.0.smithi027.stdout:3/323: rename d0/d1/l14 to d0/d19/d54/l71 0 2024-09-20T19:05:55.177 INFO:tasks.workunit.client.1.smithi098.stdout:7/437: mknod d3/d4c/c8f 0 2024-09-20T19:05:55.178 INFO:tasks.workunit.client.0.smithi027.stdout:0/331: rmdir d2/d14/d1b 39 2024-09-20T19:05:55.178 INFO:tasks.workunit.client.0.smithi027.stdout:9/400: dwrite d0/d9/df/d57/f7b [0,4194304] 0 2024-09-20T19:05:55.178 INFO:tasks.workunit.client.0.smithi027.stdout:1/268: dwrite d2/d1b/d3a/f35 [0,4194304] 0 2024-09-20T19:05:55.178 INFO:tasks.workunit.client.0.smithi027.stdout:9/401: readlink d0/d9/l4e 0 2024-09-20T19:05:55.178 INFO:tasks.workunit.client.1.smithi098.stdout:7/438: fdatasync d3/d76/f83 0 2024-09-20T19:05:55.181 INFO:tasks.workunit.client.0.smithi027.stdout:9/402: dread - d0/f7d zero size 2024-09-20T19:05:55.181 INFO:tasks.workunit.client.0.smithi027.stdout:9/403: write d0/d9/df/d1c/f72 [3899219,106330] 0 2024-09-20T19:05:55.181 INFO:tasks.workunit.client.1.smithi098.stdout:8/411: rmdir d7/de/d11/d1f 39 2024-09-20T19:05:55.182 INFO:tasks.workunit.client.0.smithi027.stdout:3/324: chown d0/d1/d13/d15/l39 0 1 2024-09-20T19:05:55.183 INFO:tasks.workunit.client.0.smithi027.stdout:5/334: symlink d4/da/l6d 0 2024-09-20T19:05:55.183 INFO:tasks.workunit.client.0.smithi027.stdout:2/213: sync 2024-09-20T19:05:55.184 INFO:tasks.workunit.client.0.smithi027.stdout:3/325: readlink d0/d19/l43 0 2024-09-20T19:05:55.185 INFO:tasks.workunit.client.1.smithi098.stdout:3/312: mkdir d4/d38/d48/d60 0 2024-09-20T19:05:55.187 INFO:tasks.workunit.client.0.smithi027.stdout:8/291: creat d2/d14/d13/d2e/f62 x:0 0 0 2024-09-20T19:05:55.188 INFO:tasks.workunit.client.1.smithi098.stdout:2/651: creat d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fd6 x:0 0 0 2024-09-20T19:05:55.190 INFO:tasks.workunit.client.1.smithi098.stdout:4/373: creat d3/d6/d11/d57/d7f/f87 x:0 0 0 2024-09-20T19:05:55.191 INFO:tasks.workunit.client.0.smithi027.stdout:0/332: mkdir d2/d14/d1d/d77 0 2024-09-20T19:05:55.191 INFO:tasks.workunit.client.0.smithi027.stdout:7/284: read d3/d8/da/dc/f21 [3053902,88231] 0 2024-09-20T19:05:55.194 INFO:tasks.workunit.client.1.smithi098.stdout:1/327: mkdir d1/d3/d62 0 2024-09-20T19:05:55.195 INFO:tasks.workunit.client.1.smithi098.stdout:0/235: mknod d0/d6/d28/c43 0 2024-09-20T19:05:55.198 INFO:tasks.workunit.client.1.smithi098.stdout:5/332: link d1/f2 d1/d17/d2e/f67 0 2024-09-20T19:05:55.201 INFO:tasks.workunit.client.0.smithi027.stdout:3/326: creat d0/d1/d13/d15/d55/f72 x:0 0 0 2024-09-20T19:05:55.201 INFO:tasks.workunit.client.0.smithi027.stdout:9/404: read d0/fa [442207,129528] 0 2024-09-20T19:05:55.203 INFO:tasks.workunit.client.0.smithi027.stdout:8/292: creat d2/d3/d6/d21/f63 x:0 0 0 2024-09-20T19:05:55.203 INFO:tasks.workunit.client.0.smithi027.stdout:1/269: fdatasync d2/d1b/d3a/f35 0 2024-09-20T19:05:55.203 INFO:tasks.workunit.client.0.smithi027.stdout:3/327: write d0/d1/d5e/f1e [9350800,113172] 0 2024-09-20T19:05:55.205 INFO:tasks.workunit.client.0.smithi027.stdout:9/405: chown d0/d9/df/d1b/d64/l71 72678295 1 2024-09-20T19:05:55.206 INFO:tasks.workunit.client.0.smithi027.stdout:1/270: write d2/d1b/f1e [725489,38192] 0 2024-09-20T19:05:55.210 INFO:tasks.workunit.client.1.smithi098.stdout:7/439: mkdir d3/d10/d16/d90 0 2024-09-20T19:05:55.210 INFO:tasks.workunit.client.0.smithi027.stdout:7/285: mkdir d3/d8/d26/d65 0 2024-09-20T19:05:55.211 INFO:tasks.workunit.client.0.smithi027.stdout:1/271: fdatasync d2/d8/d2b/f4a 0 2024-09-20T19:05:55.211 INFO:tasks.workunit.client.1.smithi098.stdout:4/374: mkdir d3/d2e/d88 0 2024-09-20T19:05:55.211 INFO:tasks.workunit.client.1.smithi098.stdout:0/236: dwrite d0/d15/d38/f39 [0,4194304] 0 2024-09-20T19:05:55.213 INFO:tasks.workunit.client.1.smithi098.stdout:8/412: truncate d7/de/d11/d1f/d57/d72/f79 972294 0 2024-09-20T19:05:55.215 INFO:tasks.workunit.client.1.smithi098.stdout:5/333: mkdir d1/d17/d35/d54/d68 0 2024-09-20T19:05:55.218 INFO:tasks.workunit.client.0.smithi027.stdout:3/328: dwrite d0/d1/f35 [0,4194304] 0 2024-09-20T19:05:55.218 INFO:tasks.workunit.client.0.smithi027.stdout:8/293: mkdir d2/d14/d64 0 2024-09-20T19:05:55.219 INFO:tasks.workunit.client.1.smithi098.stdout:3/313: symlink d4/d25/d40/d4b/l61 0 2024-09-20T19:05:55.221 INFO:tasks.workunit.client.0.smithi027.stdout:2/214: dread d3/d13/f2b [0,4194304] 0 2024-09-20T19:05:55.222 INFO:tasks.workunit.client.1.smithi098.stdout:6/251: truncate d0/de/d1b/f1c 1919718 0 2024-09-20T19:05:55.223 INFO:tasks.workunit.client.0.smithi027.stdout:6/227: truncate d4/d6/fa 3543742 0 2024-09-20T19:05:55.223 INFO:tasks.workunit.client.0.smithi027.stdout:8/294: write d2/d3/f57 [309544,125512] 0 2024-09-20T19:05:55.226 INFO:tasks.workunit.client.1.smithi098.stdout:6/252: dread d0/de/d1b/f28 [0,4194304] 0 2024-09-20T19:05:55.226 INFO:tasks.workunit.client.0.smithi027.stdout:6/228: dread d4/d15/d37/d39/f3f [0,4194304] 0 2024-09-20T19:05:55.227 INFO:tasks.workunit.client.0.smithi027.stdout:1/272: creat d2/d1b/d3a/f4e x:0 0 0 2024-09-20T19:05:55.230 INFO:tasks.workunit.client.0.smithi027.stdout:6/229: chown d4/d1b/c3c 37089701 1 2024-09-20T19:05:55.230 INFO:tasks.workunit.client.1.smithi098.stdout:4/375: mknod d3/d6/c89 0 2024-09-20T19:05:55.231 INFO:tasks.workunit.client.1.smithi098.stdout:8/413: rmdir d7/de/d11/d19/d30/d59 39 2024-09-20T19:05:55.232 INFO:tasks.workunit.client.0.smithi027.stdout:2/215: mkdir d3/de/d34 0 2024-09-20T19:05:55.233 INFO:tasks.workunit.client.1.smithi098.stdout:5/334: mkdir d1/d46/d69 0 2024-09-20T19:05:55.234 INFO:tasks.workunit.client.0.smithi027.stdout:4/219: dwrite d5/d11/d17/f20 [0,4194304] 0 2024-09-20T19:05:55.238 INFO:tasks.workunit.client.0.smithi027.stdout:4/220: write d5/d11/d17/d1b/f2b [328179,72605] 0 2024-09-20T19:05:55.239 INFO:tasks.workunit.client.1.smithi098.stdout:6/253: creat d0/de/d1b/d37/d44/dc/f4a x:0 0 0 2024-09-20T19:05:55.239 INFO:tasks.workunit.client.0.smithi027.stdout:9/406: symlink d0/d9/df/d1c/d6a/d6d/dd/d66/d79/l85 0 2024-09-20T19:05:55.240 INFO:tasks.workunit.client.0.smithi027.stdout:5/335: write d4/da/de/f40 [220859,72589] 0 2024-09-20T19:05:55.241 INFO:tasks.workunit.client.1.smithi098.stdout:6/254: dread d0/de/d1b/d37/d44/d24/f3e [0,4194304] 0 2024-09-20T19:05:55.242 INFO:tasks.workunit.client.0.smithi027.stdout:8/295: rename d2/d3/d1b/d2d to d2/d65 0 2024-09-20T19:05:55.242 INFO:tasks.workunit.client.0.smithi027.stdout:6/230: dwrite d4/d15/d37/d39/f3f [0,4194304] 0 2024-09-20T19:05:55.246 INFO:tasks.workunit.client.1.smithi098.stdout:4/376: creat d3/d6/d11/d59/d50/d58/d71/f8a x:0 0 0 2024-09-20T19:05:55.246 INFO:tasks.workunit.client.1.smithi098.stdout:4/377: stat d3/d6/f34 0 2024-09-20T19:05:55.246 INFO:tasks.workunit.client.0.smithi027.stdout:9/407: write d0/d9/df/d1c/d6a/d6d/f68 [775557,39510] 0 2024-09-20T19:05:55.247 INFO:tasks.workunit.client.0.smithi027.stdout:1/273: unlink d2/d1b/d3a/f30 0 2024-09-20T19:05:55.254 INFO:tasks.workunit.client.0.smithi027.stdout:9/408: read d0/d9/df/d1b/f17 [2530381,14887] 0 2024-09-20T19:05:55.255 INFO:tasks.workunit.client.1.smithi098.stdout:9/404: write d4/de/d48/f7c [788406,110154] 0 2024-09-20T19:05:55.256 INFO:tasks.workunit.client.0.smithi027.stdout:9/409: chown d0/d9/df/c43 100 1 2024-09-20T19:05:55.256 INFO:tasks.workunit.client.1.smithi098.stdout:4/378: dwrite d3/d6/d11/d1e/f5d [0,4194304] 0 2024-09-20T19:05:55.259 INFO:tasks.workunit.client.1.smithi098.stdout:4/379: write d3/d6/d11/d59/d50/f76 [784319,38243] 0 2024-09-20T19:05:55.263 INFO:tasks.workunit.client.1.smithi098.stdout:4/380: chown d3/d5e 1 1 2024-09-20T19:05:55.265 INFO:tasks.workunit.client.1.smithi098.stdout:4/381: dread d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:55.267 INFO:tasks.workunit.client.0.smithi027.stdout:5/336: mknod d4/da/de/d3e/c6e 0 2024-09-20T19:05:55.268 INFO:tasks.workunit.client.1.smithi098.stdout:7/440: write d3/d10/d16/d17/d33/d1f/d28/d7d/f54 [3404050,46838] 0 2024-09-20T19:05:55.268 INFO:tasks.workunit.client.1.smithi098.stdout:1/328: truncate d1/d3/df/d34/d43/f35 137877 0 2024-09-20T19:05:55.268 INFO:tasks.workunit.client.1.smithi098.stdout:7/441: chown d3/d10/d18 59123 1 2024-09-20T19:05:55.270 INFO:tasks.workunit.client.1.smithi098.stdout:1/329: truncate d1/d3/df/d34/d43/f56 1127029 0 2024-09-20T19:05:55.271 INFO:tasks.workunit.client.0.smithi027.stdout:6/231: unlink d4/d15/c1d 0 2024-09-20T19:05:55.276 INFO:tasks.workunit.client.0.smithi027.stdout:3/329: write d0/f5a [64171,71292] 0 2024-09-20T19:05:55.278 INFO:tasks.workunit.client.0.smithi027.stdout:8/296: rename d2/d65/l48 to d2/d3/d6/d21/l66 0 2024-09-20T19:05:55.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/382: creat d3/d6/d11/d57/d7f/f8b x:0 0 0 2024-09-20T19:05:55.280 INFO:tasks.workunit.client.1.smithi098.stdout:4/383: fdatasync d3/d6/d11/d1e/f26 0 2024-09-20T19:05:55.281 INFO:tasks.workunit.client.1.smithi098.stdout:4/384: dread - d3/d6/d11/d57/d7f/f87 zero size 2024-09-20T19:05:55.281 INFO:tasks.workunit.client.1.smithi098.stdout:6/255: link d0/de/d1b/d37/d44/dc/f1a d0/de/d1b/d37/f4b 0 2024-09-20T19:05:55.282 INFO:tasks.workunit.client.0.smithi027.stdout:9/410: creat d0/d9/df/d1c/d6a/d6d/dd/d66/f86 x:0 0 0 2024-09-20T19:05:55.282 INFO:tasks.workunit.client.0.smithi027.stdout:0/333: dwrite d2/d14/d1b/f2b [4194304,4194304] 0 2024-09-20T19:05:55.282 INFO:tasks.workunit.client.0.smithi027.stdout:9/411: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:55.283 INFO:tasks.workunit.client.1.smithi098.stdout:6/256: write d0/de/d1b/d37/d44/dc/f41 [304310,29715] 0 2024-09-20T19:05:55.283 INFO:tasks.workunit.client.0.smithi027.stdout:2/216: symlink d3/de/d34/l35 0 2024-09-20T19:05:55.284 INFO:tasks.workunit.client.0.smithi027.stdout:2/217: read d3/de/f1a [878587,98437] 0 2024-09-20T19:05:55.285 INFO:tasks.workunit.client.1.smithi098.stdout:6/257: dread d0/de/d1b/d37/d44/dc/f41 [0,4194304] 0 2024-09-20T19:05:55.288 INFO:tasks.workunit.client.0.smithi027.stdout:5/337: rmdir d4/d1f 39 2024-09-20T19:05:55.288 INFO:tasks.workunit.client.1.smithi098.stdout:7/442: write d3/d10/d16/f39 [1669295,62739] 0 2024-09-20T19:05:55.291 INFO:tasks.workunit.client.0.smithi027.stdout:6/232: creat d4/f41 x:0 0 0 2024-09-20T19:05:55.296 INFO:tasks.workunit.client.1.smithi098.stdout:3/314: getdents d4 0 2024-09-20T19:05:55.297 INFO:tasks.workunit.client.1.smithi098.stdout:6/258: dwrite d0/de/d1b/d37/f45 [0,4194304] 0 2024-09-20T19:05:55.298 INFO:tasks.workunit.client.1.smithi098.stdout:4/385: dread d3/fc [0,4194304] 0 2024-09-20T19:05:55.300 INFO:tasks.workunit.client.1.smithi098.stdout:4/386: dread - d3/d6/d11/d59/d50/d58/d71/f8a zero size 2024-09-20T19:05:55.301 INFO:tasks.workunit.client.0.smithi027.stdout:0/334: mknod d2/d20/c78 0 2024-09-20T19:05:55.302 INFO:tasks.workunit.client.1.smithi098.stdout:4/387: chown d3/f5 2259 1 2024-09-20T19:05:55.304 INFO:tasks.workunit.client.0.smithi027.stdout:9/412: mknod d0/d9/df/d1b/d64/c87 0 2024-09-20T19:05:55.304 INFO:tasks.workunit.client.0.smithi027.stdout:0/335: dread d2/d14/f3f [0,4194304] 0 2024-09-20T19:05:55.305 INFO:tasks.workunit.client.1.smithi098.stdout:8/414: getdents d7/de/d11/d19/d47 0 2024-09-20T19:05:55.305 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:55 smithi027 ceph-mon[28196]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:55.306 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:55 smithi027 ceph-mon[28196]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:55.306 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:55 smithi027 ceph-mon[28196]: mgrmap e24: smithi098.wrcvbg(active, since 5s) 2024-09-20T19:05:55.308 INFO:tasks.workunit.client.1.smithi098.stdout:5/335: dwrite d1/f2c [0,4194304] 0 2024-09-20T19:05:55.309 INFO:tasks.workunit.client.1.smithi098.stdout:5/336: write d1/d17/f1a [1501052,86345] 0 2024-09-20T19:05:55.313 INFO:tasks.workunit.client.1.smithi098.stdout:7/443: symlink d3/d4c/l91 0 2024-09-20T19:05:55.315 INFO:tasks.workunit.client.1.smithi098.stdout:7/444: stat d3/d10/d16/d17/d33/d1f/d28/d66/f8e 0 2024-09-20T19:05:55.316 INFO:tasks.workunit.client.1.smithi098.stdout:7/445: write d3/d10/d16/f39 [2783917,77853] 0 2024-09-20T19:05:55.320 INFO:tasks.workunit.client.1.smithi098.stdout:6/259: unlink d0/f34 0 2024-09-20T19:05:55.321 INFO:tasks.workunit.client.1.smithi098.stdout:4/388: mkdir d3/d6/d8c 0 2024-09-20T19:05:55.323 INFO:tasks.workunit.client.1.smithi098.stdout:8/415: rmdir d7/de/d11/d19/d30/d68/d78 39 2024-09-20T19:05:55.324 INFO:tasks.workunit.client.0.smithi027.stdout:0/336: unlink d2/d20/d52/d29/l2a 0 2024-09-20T19:05:55.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/416: readlink d7/de/l1a 0 2024-09-20T19:05:55.324 INFO:tasks.workunit.client.1.smithi098.stdout:5/337: rename d1/d17/d25/f3a to d1/d17/d35/f6a 0 2024-09-20T19:05:55.325 INFO:tasks.workunit.client.0.smithi027.stdout:9/413: symlink d0/d9/df/d57/l88 0 2024-09-20T19:05:55.326 INFO:tasks.workunit.client.0.smithi027.stdout:2/218: symlink d3/l36 0 2024-09-20T19:05:55.326 INFO:tasks.workunit.client.0.smithi027.stdout:9/414: chown d0/d9/df/d1c/d6a/d6d/dd/d66/d79 349 1 2024-09-20T19:05:55.327 INFO:tasks.workunit.client.0.smithi027.stdout:4/221: getdents d5/d13/d16/d21 0 2024-09-20T19:05:55.328 INFO:tasks.workunit.client.1.smithi098.stdout:9/405: getdents d4/de/d27/d4a/d21/d25/d51 0 2024-09-20T19:05:55.329 INFO:tasks.workunit.client.0.smithi027.stdout:5/338: mkdir d4/d6c/d6f 0 2024-09-20T19:05:55.329 INFO:tasks.workunit.client.0.smithi027.stdout:4/222: write f4 [4103348,56207] 0 2024-09-20T19:05:55.330 INFO:tasks.workunit.client.0.smithi027.stdout:9/415: truncate d0/d9/df/f49 220305 0 2024-09-20T19:05:55.330 INFO:tasks.workunit.client.0.smithi027.stdout:8/297: rmdir d2/d14/d64 0 2024-09-20T19:05:55.331 INFO:tasks.workunit.client.0.smithi027.stdout:5/339: truncate d4/da/d1a/f57 129748 0 2024-09-20T19:05:55.332 INFO:tasks.workunit.client.0.smithi027.stdout:1/274: getdents d2/d8/d3b 0 2024-09-20T19:05:55.333 INFO:tasks.workunit.client.1.smithi098.stdout:4/389: creat d3/d6/d11/d59/d50/f8d x:0 0 0 2024-09-20T19:05:55.334 INFO:tasks.workunit.client.1.smithi098.stdout:4/390: chown d3/d6/d11/d57/l79 1 1 2024-09-20T19:05:55.338 INFO:tasks.workunit.client.1.smithi098.stdout:1/330: dwrite d1/d3/f9 [0,4194304] 0 2024-09-20T19:05:55.339 INFO:tasks.workunit.client.1.smithi098.stdout:7/446: rename d3/f82 to d3/d10/d16/d17/d7c/f92 0 2024-09-20T19:05:55.340 INFO:tasks.workunit.client.1.smithi098.stdout:1/331: write d1/d3/f2b [1005035,77856] 0 2024-09-20T19:05:55.342 INFO:tasks.workunit.client.1.smithi098.stdout:9/406: mkdir d4/de/d27/d88 0 2024-09-20T19:05:55.344 INFO:tasks.workunit.client.0.smithi027.stdout:9/416: stat d0/f5 0 2024-09-20T19:05:55.347 INFO:tasks.workunit.client.0.smithi027.stdout:4/223: mknod d5/d13/d16/d21/d3a/c50 0 2024-09-20T19:05:55.348 INFO:tasks.workunit.client.0.smithi027.stdout:2/219: truncate d3/de/f1a 2023327 0 2024-09-20T19:05:55.348 INFO:tasks.workunit.client.0.smithi027.stdout:4/224: stat d5/d13/d36/d48/d3f/c45 0 2024-09-20T19:05:55.349 INFO:tasks.workunit.client.0.smithi027.stdout:4/225: stat d5/d13/d16/d21/d26/l2c 0 2024-09-20T19:05:55.351 INFO:tasks.workunit.client.1.smithi098.stdout:6/260: truncate d0/de/d1b/f1c 629420 0 2024-09-20T19:05:55.353 INFO:tasks.workunit.client.0.smithi027.stdout:1/275: stat d2/d8/d2b/l40 0 2024-09-20T19:05:55.355 INFO:tasks.workunit.client.1.smithi098.stdout:7/447: symlink d3/d10/d16/d17/d33/d1f/d28/l93 0 2024-09-20T19:05:55.361 INFO:tasks.workunit.client.0.smithi027.stdout:2/220: unlink d3/de/f2c 0 2024-09-20T19:05:55.363 INFO:tasks.workunit.client.1.smithi098.stdout:8/417: rmdir d7/de/d11/d89 0 2024-09-20T19:05:55.364 INFO:tasks.workunit.client.0.smithi027.stdout:6/233: getdents d4/d15 0 2024-09-20T19:05:55.364 INFO:tasks.workunit.client.1.smithi098.stdout:4/391: creat d3/d6/d8c/f8e x:0 0 0 2024-09-20T19:05:55.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/392: chown d3/d6/d11/d57 1280529990 1 2024-09-20T19:05:55.366 INFO:tasks.workunit.client.0.smithi027.stdout:8/298: dwrite d2/d3/d1b/f26 [0,4194304] 0 2024-09-20T19:05:55.366 INFO:tasks.workunit.client.1.smithi098.stdout:5/338: creat d1/f6b x:0 0 0 2024-09-20T19:05:55.367 INFO:tasks.workunit.client.0.smithi027.stdout:6/234: write d4/d1b/f1e [4139938,96254] 0 2024-09-20T19:05:55.373 INFO:tasks.workunit.client.0.smithi027.stdout:0/337: dwrite d2/d14/f31 [0,4194304] 0 2024-09-20T19:05:55.375 INFO:tasks.workunit.client.1.smithi098.stdout:9/407: symlink d4/de/d24/d35/l89 0 2024-09-20T19:05:55.377 INFO:tasks.workunit.client.0.smithi027.stdout:2/221: mknod d3/d1c/d26/c37 0 2024-09-20T19:05:55.378 INFO:tasks.workunit.client.1.smithi098.stdout:4/393: dread - d3/d6/d11/d59/f4c zero size 2024-09-20T19:05:55.379 INFO:tasks.workunit.client.0.smithi027.stdout:8/299: dread d2/d14/f27 [0,4194304] 0 2024-09-20T19:05:55.380 INFO:tasks.workunit.client.0.smithi027.stdout:8/300: chown d2/d3/d6/d21/f63 4 1 2024-09-20T19:05:55.381 INFO:tasks.workunit.client.0.smithi027.stdout:4/226: mkdir d5/d11/d51 0 2024-09-20T19:05:55.383 INFO:tasks.workunit.client.0.smithi027.stdout:1/276: dread d2/f13 [8388608,4194304] 0 2024-09-20T19:05:55.386 INFO:tasks.workunit.client.0.smithi027.stdout:6/235: dread d4/d15/f2f [0,4194304] 0 2024-09-20T19:05:55.387 INFO:tasks.workunit.client.0.smithi027.stdout:6/236: fsync d4/d1b/f3d 0 2024-09-20T19:05:55.391 INFO:tasks.workunit.client.0.smithi027.stdout:5/340: getdents d4/da/de/d1e 0 2024-09-20T19:05:55.393 INFO:tasks.workunit.client.0.smithi027.stdout:4/227: dwrite d5/d11/f23 [4194304,4194304] 0 2024-09-20T19:05:55.394 INFO:tasks.workunit.client.0.smithi027.stdout:1/277: creat d2/d1b/f4f x:0 0 0 2024-09-20T19:05:55.395 INFO:tasks.workunit.client.0.smithi027.stdout:1/278: dread - d2/d1b/f4f zero size 2024-09-20T19:05:55.397 INFO:tasks.workunit.client.0.smithi027.stdout:9/417: getdents d0/d9/df/d1c/d6a/d6d/dd/d58 0 2024-09-20T19:05:55.400 INFO:tasks.workunit.client.0.smithi027.stdout:1/279: truncate d2/f13 12866102 0 2024-09-20T19:05:55.400 INFO:tasks.workunit.client.0.smithi027.stdout:2/222: chown d3/de/f1a 730164541 1 2024-09-20T19:05:55.401 INFO:tasks.workunit.client.1.smithi098.stdout:4/394: dwrite d3/d6/d11/d57/d7f/f8b [0,4194304] 0 2024-09-20T19:05:55.401 INFO:tasks.workunit.client.1.smithi098.stdout:8/418: mknod d7/de/d11/d19/d30/d68/c96 0 2024-09-20T19:05:55.402 INFO:tasks.workunit.client.0.smithi027.stdout:4/228: rmdir d5/d11/d3d 39 2024-09-20T19:05:55.403 INFO:tasks.workunit.client.0.smithi027.stdout:5/341: fdatasync d4/f11 0 2024-09-20T19:05:55.403 INFO:tasks.workunit.client.1.smithi098.stdout:6/261: dwrite d0/de/d1b/d37/d44/dc/f41 [0,4194304] 0 2024-09-20T19:05:55.403 INFO:tasks.workunit.client.1.smithi098.stdout:5/339: mknod d1/d46/d69/c6c 0 2024-09-20T19:05:55.404 INFO:tasks.workunit.client.1.smithi098.stdout:9/408: write d4/de/d27/d4a/d21/d25/f59 [184198,60657] 0 2024-09-20T19:05:55.405 INFO:tasks.workunit.client.0.smithi027.stdout:5/342: dread - d4/f63 zero size 2024-09-20T19:05:55.406 INFO:tasks.workunit.client.0.smithi027.stdout:4/229: write d5/d13/d16/d21/f2e [1858421,35624] 0 2024-09-20T19:05:55.409 INFO:tasks.workunit.client.0.smithi027.stdout:2/223: creat d3/d24/f38 x:0 0 0 2024-09-20T19:05:55.411 INFO:tasks.workunit.client.0.smithi027.stdout:1/280: stat d2/d8/d3b/d4b/l3d 0 2024-09-20T19:05:55.417 INFO:tasks.workunit.client.0.smithi027.stdout:0/338: dread d2/d20/d52/f15 [0,4194304] 0 2024-09-20T19:05:55.417 INFO:tasks.workunit.client.0.smithi027.stdout:5/343: mknod d4/da/c70 0 2024-09-20T19:05:55.418 INFO:tasks.workunit.client.0.smithi027.stdout:9/418: dwrite d0/d9/df/d1c/d6a/f83 [0,4194304] 0 2024-09-20T19:05:55.421 INFO:tasks.workunit.client.0.smithi027.stdout:8/301: getdents d2/d3/d1b/d35 0 2024-09-20T19:05:55.425 INFO:tasks.workunit.client.0.smithi027.stdout:5/344: chown d4/c15 819204807 1 2024-09-20T19:05:55.425 INFO:tasks.workunit.client.0.smithi027.stdout:8/302: symlink d2/l67 0 2024-09-20T19:05:55.426 INFO:tasks.workunit.client.0.smithi027.stdout:4/230: dread d5/d13/d36/d48/f43 [0,4194304] 0 2024-09-20T19:05:55.427 INFO:tasks.workunit.client.0.smithi027.stdout:9/419: dread d0/d9/df/d1b/d64/f6c [0,4194304] 0 2024-09-20T19:05:55.429 INFO:tasks.workunit.client.0.smithi027.stdout:1/281: link d2/d1b/f2e d2/f50 0 2024-09-20T19:05:55.432 INFO:tasks.workunit.client.0.smithi027.stdout:1/282: truncate d2/d1b/f4f 636304 0 2024-09-20T19:05:55.433 INFO:tasks.workunit.client.0.smithi027.stdout:5/345: truncate d4/da/f29 1964423 0 2024-09-20T19:05:55.435 INFO:tasks.workunit.client.0.smithi027.stdout:0/339: dwrite d2/d20/d52/f67 [0,4194304] 0 2024-09-20T19:05:55.436 INFO:tasks.workunit.client.0.smithi027.stdout:8/303: mknod d2/d3/d1b/d36/c68 0 2024-09-20T19:05:55.438 INFO:tasks.workunit.client.0.smithi027.stdout:5/346: write d4/da/f29 [578162,122499] 0 2024-09-20T19:05:55.439 INFO:tasks.workunit.client.0.smithi027.stdout:6/237: dread d4/d6/fa [0,4194304] 0 2024-09-20T19:05:55.441 INFO:tasks.workunit.client.0.smithi027.stdout:6/238: stat d4/c38 0 2024-09-20T19:05:55.446 INFO:tasks.workunit.client.0.smithi027.stdout:8/304: write d2/d3/d6/d21/f38 [5088265,73836] 0 2024-09-20T19:05:55.446 INFO:tasks.workunit.client.0.smithi027.stdout:7/286: sync 2024-09-20T19:05:55.449 INFO:tasks.workunit.client.0.smithi027.stdout:5/347: rename d4/da/de/l4e to d4/da/d50/l71 0 2024-09-20T19:05:55.450 INFO:tasks.workunit.client.0.smithi027.stdout:4/231: dwrite d5/d13/d36/d48/f43 [0,4194304] 0 2024-09-20T19:05:55.453 INFO:tasks.workunit.client.0.smithi027.stdout:9/420: dwrite d0/d9/df/d1c/f72 [0,4194304] 0 2024-09-20T19:05:55.463 INFO:tasks.workunit.client.0.smithi027.stdout:7/287: truncate d3/f5 5211706 0 2024-09-20T19:05:55.464 INFO:tasks.workunit.client.0.smithi027.stdout:9/421: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:55.464 INFO:tasks.workunit.client.0.smithi027.stdout:5/348: symlink d4/da/d1a/l72 0 2024-09-20T19:05:55.464 INFO:tasks.workunit.client.0.smithi027.stdout:6/239: dwrite d4/d1b/f35 [0,4194304] 0 2024-09-20T19:05:55.467 INFO:tasks.workunit.client.0.smithi027.stdout:2/224: dread d3/de/f1f [0,4194304] 0 2024-09-20T19:05:55.468 INFO:tasks.workunit.client.0.smithi027.stdout:5/349: read - d4/da/d1a/f4f zero size 2024-09-20T19:05:55.470 INFO:tasks.workunit.client.0.smithi027.stdout:1/283: dwrite d2/d15/f29 [0,4194304] 0 2024-09-20T19:05:55.471 INFO:tasks.workunit.client.0.smithi027.stdout:8/305: symlink d2/d14/d13/d43/d5d/l69 0 2024-09-20T19:05:55.472 INFO:tasks.workunit.client.0.smithi027.stdout:4/232: mkdir d5/d13/d36/d48/d3f/d4c/d52 0 2024-09-20T19:05:55.474 INFO:tasks.workunit.client.0.smithi027.stdout:4/233: write d5/d13/f30 [130978,47583] 0 2024-09-20T19:05:55.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:55 smithi098 ceph-mon[35737]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:55.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:55 smithi098 ceph-mon[35737]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:55.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:55 smithi098 ceph-mon[35737]: mgrmap e24: smithi098.wrcvbg(active, since 5s) 2024-09-20T19:05:55.478 INFO:tasks.workunit.client.0.smithi027.stdout:5/350: mknod d4/da/d50/c73 0 2024-09-20T19:05:55.478 INFO:tasks.workunit.client.0.smithi027.stdout:2/225: readlink d3/de/l11 0 2024-09-20T19:05:55.478 INFO:tasks.workunit.client.0.smithi027.stdout:8/306: creat d2/d65/f6a x:0 0 0 2024-09-20T19:05:55.478 INFO:tasks.workunit.client.0.smithi027.stdout:9/422: creat d0/d9/df/d1c/d6a/d6d/dd/d66/f89 x:0 0 0 2024-09-20T19:05:55.479 INFO:tasks.workunit.client.0.smithi027.stdout:2/226: read - d3/d1c/f2d zero size 2024-09-20T19:05:55.479 INFO:tasks.workunit.client.0.smithi027.stdout:1/284: unlink d2/d8/d2b/l40 0 2024-09-20T19:05:55.480 INFO:tasks.workunit.client.0.smithi027.stdout:4/234: unlink d5/d11/d3d/l42 0 2024-09-20T19:05:55.483 INFO:tasks.workunit.client.0.smithi027.stdout:5/351: truncate d4/da/de/d3e/f59 128687 0 2024-09-20T19:05:55.485 INFO:tasks.workunit.client.0.smithi027.stdout:8/307: write d2/d65/f4f [578651,66947] 0 2024-09-20T19:05:55.486 INFO:tasks.workunit.client.0.smithi027.stdout:9/423: write d0/d9/df/d1c/f81 [4677218,15350] 0 2024-09-20T19:05:55.487 INFO:tasks.workunit.client.0.smithi027.stdout:2/227: write d3/d2f/f32 [117535,119187] 0 2024-09-20T19:05:55.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.482+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f429019d490 con 0x7f4290102450 2024-09-20T19:05:55.488 INFO:tasks.workunit.client.0.smithi027.stdout:1/285: symlink d2/d8/d2b/l51 0 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.483+0000 7f42867fc640 1 -- 172.21.15.27:0/1567113184 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f428c004370 con 0x7f4290102450 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:55.489 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:05:55.490 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:05:55.491 INFO:tasks.workunit.client.0.smithi027.stdout:8/308: fsync d2/d3/d1b/d36/f61 0 2024-09-20T19:05:55.492 INFO:tasks.workunit.client.1.smithi098.stdout:4/395: truncate d3/d6/d11/f15 1195182 0 2024-09-20T19:05:55.493 INFO:tasks.workunit.client.0.smithi027.stdout:1/286: creat d2/d8/f52 x:0 0 0 2024-09-20T19:05:55.493 INFO:tasks.workunit.client.1.smithi098.stdout:7/448: rename d3/d10/d16/d17/d7c/f80 to d3/d10/d16/d17/d33/d1f/d28/d7d/f94 0 2024-09-20T19:05:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.487+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 msgr2=0x7f427c042050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.487+0000 7f4297792640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 0x7f427c042050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4280009230 tx=0x7f42800058d0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.487+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 msgr2=0x7f4290197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.487+0000 7f4297792640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c810 tx=0x7f428c00ccd0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 shutdown_connections 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f427c03fb90 0x7f427c042050 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4280009230 tx=0x7f42800058d0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4290104d80 0x7f42901979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 --2- 172.21.15.27:0/1567113184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4290102450 0x7f4290197480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 >> 172.21.15.27:0/1567113184 conn(0x7f42900fc010 msgr2=0x7f42900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:55.494 INFO:tasks.workunit.client.0.smithi027.stdout:9/424: unlink d0/d9/c61 0 2024-09-20T19:05:55.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 shutdown_connections 2024-09-20T19:05:55.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.488+0000 7f4297792640 1 -- 172.21.15.27:0/1567113184 wait complete. 2024-09-20T19:05:55.495 INFO:tasks.workunit.client.0.smithi027.stdout:5/352: chown d4/d1f/d28/f3f 0 1 2024-09-20T19:05:55.495 INFO:tasks.workunit.client.1.smithi098.stdout:9/409: mkdir d4/d74/d8a 0 2024-09-20T19:05:55.496 INFO:tasks.workunit.client.0.smithi027.stdout:1/287: stat d2/d8/d41/l48 0 2024-09-20T19:05:55.497 INFO:tasks.workunit.client.1.smithi098.stdout:1/332: dwrite d1/f25 [0,4194304] 0 2024-09-20T19:05:55.497 INFO:tasks.workunit.client.1.smithi098.stdout:5/340: rename d1/d1b/f61 to d1/d46/d69/f6d 0 2024-09-20T19:05:55.499 INFO:tasks.workunit.client.1.smithi098.stdout:5/341: dread - d1/d46/d69/f6d zero size 2024-09-20T19:05:55.499 INFO:tasks.workunit.client.1.smithi098.stdout:8/419: getdents d7/d88 0 2024-09-20T19:05:55.500 INFO:tasks.workunit.client.0.smithi027.stdout:1/288: write d2/d1b/d3a/f35 [5263213,81251] 0 2024-09-20T19:05:55.501 INFO:tasks.workunit.client.0.smithi027.stdout:4/235: dwrite d5/d11/f4d [0,4194304] 0 2024-09-20T19:05:55.503 INFO:tasks.workunit.client.1.smithi098.stdout:5/342: dread - d1/d46/d69/f6d zero size 2024-09-20T19:05:55.503 INFO:tasks.workunit.client.1.smithi098.stdout:8/420: chown d7/c42 183094 1 2024-09-20T19:05:55.504 INFO:tasks.workunit.client.1.smithi098.stdout:4/396: dwrite d3/d6/d5b/f65 [0,4194304] 0 2024-09-20T19:05:55.506 INFO:tasks.workunit.client.0.smithi027.stdout:6/240: dread f0 [4194304,4194304] 0 2024-09-20T19:05:55.506 INFO:tasks.workunit.client.0.smithi027.stdout:9/425: dread d0/d9/df/d1c/f72 [0,4194304] 0 2024-09-20T19:05:55.508 INFO:tasks.workunit.client.0.smithi027.stdout:5/353: creat d4/d1f/f74 x:0 0 0 2024-09-20T19:05:55.511 INFO:tasks.workunit.client.0.smithi027.stdout:2/228: truncate d3/ff 3095366 0 2024-09-20T19:05:55.512 INFO:tasks.workunit.client.1.smithi098.stdout:7/449: symlink d3/d10/d16/l95 0 2024-09-20T19:05:55.513 INFO:tasks.workunit.client.0.smithi027.stdout:2/229: stat d3/d13/f15 0 2024-09-20T19:05:55.513 INFO:tasks.workunit.client.0.smithi027.stdout:8/309: dread d2/d14/d13/f3b [0,4194304] 0 2024-09-20T19:05:55.515 INFO:tasks.workunit.client.0.smithi027.stdout:4/236: dwrite d5/f10 [0,4194304] 0 2024-09-20T19:05:55.516 INFO:tasks.workunit.client.0.smithi027.stdout:2/230: chown d3/de/f1f 1306715 1 2024-09-20T19:05:55.516 INFO:tasks.workunit.client.1.smithi098.stdout:6/262: mkdir d0/de/d1b/d37/d44/d24/d29/d42/d4c 0 2024-09-20T19:05:55.517 INFO:tasks.workunit.client.1.smithi098.stdout:8/421: stat d7/de/d11/d19/d30/d59 0 2024-09-20T19:05:55.520 INFO:tasks.workunit.client.0.smithi027.stdout:5/354: chown d4/c39 3426 1 2024-09-20T19:05:55.520 INFO:tasks.workunit.client.0.smithi027.stdout:6/241: creat d4/f42 x:0 0 0 2024-09-20T19:05:55.520 INFO:tasks.workunit.client.0.smithi027.stdout:4/237: readlink d5/d11/l4b 0 2024-09-20T19:05:55.522 INFO:tasks.workunit.client.0.smithi027.stdout:5/355: write d4/da/d1a/f4f [494020,32374] 0 2024-09-20T19:05:55.525 INFO:tasks.workunit.client.0.smithi027.stdout:5/356: write d4/da/f2c [2277067,101071] 0 2024-09-20T19:05:55.526 INFO:tasks.workunit.client.1.smithi098.stdout:5/343: link d1/d17/f63 d1/d46/f6e 0 2024-09-20T19:05:55.528 INFO:tasks.workunit.client.0.smithi027.stdout:2/231: dread d3/d13/f25 [0,4194304] 0 2024-09-20T19:05:55.529 INFO:tasks.workunit.client.1.smithi098.stdout:5/344: write d1/d17/d2e/f51 [651371,103162] 0 2024-09-20T19:05:55.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/333: dwrite d1/d3/d2e/f47 [0,4194304] 0 2024-09-20T19:05:55.529 INFO:tasks.workunit.client.1.smithi098.stdout:9/410: creat d4/de/d24/f8b x:0 0 0 2024-09-20T19:05:55.532 INFO:tasks.workunit.client.0.smithi027.stdout:6/242: readlink d4/d15/l24 0 2024-09-20T19:05:55.533 INFO:tasks.workunit.client.1.smithi098.stdout:9/411: chown d4/de/d27/d4a/d58/d5b 0 1 2024-09-20T19:05:55.535 INFO:tasks.workunit.client.0.smithi027.stdout:4/238: dwrite d5/d13/f30 [0,4194304] 0 2024-09-20T19:05:55.538 INFO:tasks.workunit.client.1.smithi098.stdout:1/334: creat d1/d3/df/d4a/f63 x:0 0 0 2024-09-20T19:05:55.539 INFO:tasks.workunit.client.1.smithi098.stdout:7/450: link d3/l7 d3/d10/d18/l96 0 2024-09-20T19:05:55.541 INFO:tasks.workunit.client.1.smithi098.stdout:1/335: write d1/f3d [129382,67037] 0 2024-09-20T19:05:55.542 INFO:tasks.workunit.client.0.smithi027.stdout:5/357: rename d4/da/de/d1e to d4/da/de/d3e/d69/d75 0 2024-09-20T19:05:55.542 INFO:tasks.workunit.client.0.smithi027.stdout:8/310: getdents d2/d14/d13/d51 0 2024-09-20T19:05:55.542 INFO:tasks.workunit.client.1.smithi098.stdout:4/397: dread d3/d6/f32 [0,4194304] 0 2024-09-20T19:05:55.543 INFO:tasks.workunit.client.1.smithi098.stdout:9/412: dwrite d4/de/d27/d4a/d21/d25/f59 [0,4194304] 0 2024-09-20T19:05:55.545 INFO:tasks.workunit.client.0.smithi027.stdout:5/358: write d4/da/de/d3e/d69/d75/f62 [424317,57747] 0 2024-09-20T19:05:55.545 INFO:tasks.workunit.client.0.smithi027.stdout:2/232: dwrite d3/f9 [0,4194304] 0 2024-09-20T19:05:55.546 INFO:tasks.workunit.client.1.smithi098.stdout:1/336: read d1/d3/f46 [250376,72952] 0 2024-09-20T19:05:55.547 INFO:tasks.workunit.client.1.smithi098.stdout:2/652: sync 2024-09-20T19:05:55.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/398: write d3/d6/d3e/d3c/d6b/f74 [1130074,16830] 0 2024-09-20T19:05:55.550 INFO:tasks.workunit.client.0.smithi027.stdout:5/359: write d4/da/f48 [285298,59927] 0 2024-09-20T19:05:55.551 INFO:tasks.workunit.client.1.smithi098.stdout:1/337: stat d1/d3/df/d34/d43/d53/f60 0 2024-09-20T19:05:55.551 INFO:tasks.workunit.client.1.smithi098.stdout:5/345: dread d1/d17/d2e/f51 [0,4194304] 0 2024-09-20T19:05:55.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/239: dread d5/f10 [0,4194304] 0 2024-09-20T19:05:55.552 INFO:tasks.workunit.client.0.smithi027.stdout:1/289: fsync d2/f13 0 2024-09-20T19:05:55.553 INFO:tasks.workunit.client.0.smithi027.stdout:1/290: chown d2/d8/d2b/d2d/l42 51185793 1 2024-09-20T19:05:55.554 INFO:tasks.workunit.client.0.smithi027.stdout:2/233: creat d3/d13/f39 x:0 0 0 2024-09-20T19:05:55.557 INFO:tasks.workunit.client.1.smithi098.stdout:2/653: dread d3/df/d13/f32 [0,4194304] 0 2024-09-20T19:05:55.558 INFO:tasks.workunit.client.0.smithi027.stdout:6/243: getdents d4/d1b/d2b 0 2024-09-20T19:05:55.559 INFO:tasks.workunit.client.0.smithi027.stdout:9/426: dread d0/fa [0,4194304] 0 2024-09-20T19:05:55.559 INFO:tasks.workunit.client.0.smithi027.stdout:4/240: mkdir d5/d11/d17/d53 0 2024-09-20T19:05:55.560 INFO:tasks.workunit.client.1.smithi098.stdout:7/451: write d3/d10/d16/d17/d33/d1f/d28/d7d/f94 [848400,89348] 0 2024-09-20T19:05:55.560 INFO:tasks.workunit.client.1.smithi098.stdout:7/452: stat d3/f2e 0 2024-09-20T19:05:55.561 INFO:tasks.workunit.client.0.smithi027.stdout:6/244: chown d4/d15/f2f 257101314 1 2024-09-20T19:05:55.564 INFO:tasks.workunit.client.1.smithi098.stdout:8/422: dwrite d7/f1c [0,4194304] 0 2024-09-20T19:05:55.564 INFO:tasks.workunit.client.1.smithi098.stdout:2/654: mkdir d3/d51/d68/dd7 0 2024-09-20T19:05:55.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/655: stat d3/d16/d1d/d2b/d46/fc9 0 2024-09-20T19:05:55.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/656: write d3/fd [1367038,80395] 0 2024-09-20T19:05:55.568 INFO:tasks.workunit.client.1.smithi098.stdout:9/413: rename d4/de/d27/d39/l82 to d4/l8c 0 2024-09-20T19:05:55.569 INFO:tasks.workunit.client.1.smithi098.stdout:8/423: dread - d7/de/d11/f6b zero size 2024-09-20T19:05:55.570 INFO:tasks.workunit.client.1.smithi098.stdout:9/414: write d4/de/d27/d39/f5a [1665586,50934] 0 2024-09-20T19:05:55.570 INFO:tasks.workunit.client.1.smithi098.stdout:2/657: mknod d3/df/d13/cd8 0 2024-09-20T19:05:55.572 INFO:tasks.workunit.client.1.smithi098.stdout:1/338: rename d1/d3/df/l4f to d1/d3/d62/l64 0 2024-09-20T19:05:55.576 INFO:tasks.workunit.client.1.smithi098.stdout:8/424: truncate d7/de/f54 1113121 0 2024-09-20T19:05:55.579 INFO:tasks.workunit.client.1.smithi098.stdout:1/339: mkdir d1/d3/df/d34/d43/d65 0 2024-09-20T19:05:55.581 INFO:tasks.workunit.client.1.smithi098.stdout:7/453: dread d3/d10/d16/d17/d33/f52 [0,4194304] 0 2024-09-20T19:05:55.581 INFO:tasks.workunit.client.1.smithi098.stdout:1/340: truncate d1/f37 371995 0 2024-09-20T19:05:55.582 INFO:tasks.workunit.client.1.smithi098.stdout:6/263: dwrite d0/de/d1b/f1c [0,4194304] 0 2024-09-20T19:05:55.584 INFO:tasks.workunit.client.1.smithi098.stdout:1/341: write d1/d3/df/f21 [285300,45190] 0 2024-09-20T19:05:55.584 INFO:tasks.workunit.client.1.smithi098.stdout:8/425: dread - d7/de/d11/d19/d30/d55/f66 zero size 2024-09-20T19:05:55.586 INFO:tasks.workunit.client.1.smithi098.stdout:8/426: write d7/de/f92 [691190,106735] 0 2024-09-20T19:05:55.586 INFO:tasks.workunit.client.1.smithi098.stdout:9/415: rename d4/de/d24/d35/d2d/l54 to d4/de/d27/d4a/l8d 0 2024-09-20T19:05:55.590 INFO:tasks.workunit.client.1.smithi098.stdout:1/342: dread d1/d3/df/d34/f5f [0,4194304] 0 2024-09-20T19:05:55.596 INFO:tasks.workunit.client.1.smithi098.stdout:9/416: unlink d4/de/d27/d4a/d21/d25/d51/f85 0 2024-09-20T19:05:55.596 INFO:tasks.workunit.client.1.smithi098.stdout:5/346: truncate d1/f2c 26696 0 2024-09-20T19:05:55.597 INFO:tasks.workunit.client.1.smithi098.stdout:4/399: truncate d3/d6/d3e/f56 3770130 0 2024-09-20T19:05:55.598 INFO:tasks.workunit.client.1.smithi098.stdout:1/343: dwrite d1/d3/df/d34/d43/f59 [0,4194304] 0 2024-09-20T19:05:55.600 INFO:tasks.workunit.client.1.smithi098.stdout:1/344: write d1/d3/d2e/f47 [1228433,129477] 0 2024-09-20T19:05:55.600 INFO:tasks.workunit.client.1.smithi098.stdout:4/400: truncate d3/d6/d11/d59/d50/f75 1250665 0 2024-09-20T19:05:55.602 INFO:tasks.workunit.client.1.smithi098.stdout:2/658: getdents d3/df/d13 0 2024-09-20T19:05:55.603 INFO:tasks.workunit.client.1.smithi098.stdout:2/659: stat d3/d16/d1d/f39 0 2024-09-20T19:05:55.604 INFO:tasks.workunit.client.1.smithi098.stdout:2/660: write d3/d51/d9f/fcd [78555,9249] 0 2024-09-20T19:05:55.610 INFO:tasks.workunit.client.1.smithi098.stdout:4/401: creat d3/d6/d11/d64/f8f x:0 0 0 2024-09-20T19:05:55.612 INFO:tasks.workunit.client.1.smithi098.stdout:7/454: getdents d3/d10/d16/d17/d33/d1f/d28 0 2024-09-20T19:05:55.612 INFO:tasks.workunit.client.1.smithi098.stdout:4/402: dread - d3/d2e/f77 zero size 2024-09-20T19:05:55.613 INFO:tasks.workunit.client.1.smithi098.stdout:9/417: mkdir d4/de/d27/d4a/d8e 0 2024-09-20T19:05:55.614 INFO:tasks.workunit.client.1.smithi098.stdout:2/661: mkdir d3/dd9 0 2024-09-20T19:05:55.615 INFO:tasks.workunit.client.1.smithi098.stdout:9/418: stat d4/de/c33 0 2024-09-20T19:05:55.616 INFO:tasks.workunit.client.1.smithi098.stdout:4/403: write d3/d6/d11/d59/d50/f76 [1513092,114602] 0 2024-09-20T19:05:55.617 INFO:tasks.workunit.client.1.smithi098.stdout:2/662: chown d3/d16/d1d/d4f/d8b 8100797 1 2024-09-20T19:05:55.618 INFO:tasks.workunit.client.1.smithi098.stdout:9/419: fsync d4/de/f7f 0 2024-09-20T19:05:55.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/345: mknod d1/d3/df/d34/c66 0 2024-09-20T19:05:55.619 INFO:tasks.workunit.client.1.smithi098.stdout:6/264: dwrite d0/de/d1b/f1c [4194304,4194304] 0 2024-09-20T19:05:55.619 INFO:tasks.workunit.client.0.smithi027.stdout:3/330: sync 2024-09-20T19:05:55.621 INFO:tasks.workunit.client.0.smithi027.stdout:1/291: dread d2/f13 [8388608,4194304] 0 2024-09-20T19:05:55.622 INFO:tasks.workunit.client.1.smithi098.stdout:3/315: sync 2024-09-20T19:05:55.622 INFO:tasks.workunit.client.1.smithi098.stdout:0/237: sync 2024-09-20T19:05:55.622 INFO:tasks.workunit.client.1.smithi098.stdout:9/420: write d4/de/d48/f4d [1133782,129900] 0 2024-09-20T19:05:55.623 INFO:tasks.workunit.client.0.smithi027.stdout:4/241: write d5/d11/d17/f20 [1200139,119607] 0 2024-09-20T19:05:55.623 INFO:tasks.workunit.client.0.smithi027.stdout:9/427: write d0/d2e/f34 [2250246,63663] 0 2024-09-20T19:05:55.623 INFO:tasks.workunit.client.0.smithi027.stdout:2/234: symlink d3/d2f/l3a 0 2024-09-20T19:05:55.624 INFO:tasks.workunit.client.0.smithi027.stdout:6/245: write d4/d15/d2c/f32 [468112,75829] 0 2024-09-20T19:05:55.624 INFO:tasks.workunit.client.0.smithi027.stdout:4/242: chown d5/l6 187602 1 2024-09-20T19:05:55.625 INFO:tasks.workunit.client.1.smithi098.stdout:6/265: write d0/de/d1b/d37/d44/dc/f4a [28341,4194] 0 2024-09-20T19:05:55.625 INFO:tasks.workunit.client.1.smithi098.stdout:3/316: chown d4/d19/c57 9046082 1 2024-09-20T19:05:55.625 INFO:tasks.workunit.client.0.smithi027.stdout:4/243: readlink d5/l25 0 2024-09-20T19:05:55.627 INFO:tasks.workunit.client.0.smithi027.stdout:8/311: truncate d2/d3/d1b/f26 2546849 0 2024-09-20T19:05:55.627 INFO:tasks.workunit.client.1.smithi098.stdout:2/663: mknod d3/d51/d68/cda 0 2024-09-20T19:05:55.628 INFO:tasks.workunit.client.0.smithi027.stdout:9/428: readlink d0/d9/df/d1c/l3f 0 2024-09-20T19:05:55.628 INFO:tasks.workunit.client.0.smithi027.stdout:4/244: read d5/fe [706661,29990] 0 2024-09-20T19:05:55.629 INFO:tasks.workunit.client.1.smithi098.stdout:7/455: symlink d3/d76/d7a/l97 0 2024-09-20T19:05:55.630 INFO:tasks.workunit.client.0.smithi027.stdout:8/312: read - d2/d3/d6/d21/f63 zero size 2024-09-20T19:05:55.630 INFO:tasks.workunit.client.0.smithi027.stdout:1/292: mknod d2/d8/c53 0 2024-09-20T19:05:55.632 INFO:tasks.workunit.client.0.smithi027.stdout:2/235: fdatasync d3/d13/f2b 0 2024-09-20T19:05:55.633 INFO:tasks.workunit.client.0.smithi027.stdout:1/293: stat d2/d8/d2b/d2d/d3e 0 2024-09-20T19:05:55.633 INFO:tasks.workunit.client.1.smithi098.stdout:8/427: write d7/de/f54 [1611936,128247] 0 2024-09-20T19:05:55.634 INFO:tasks.workunit.client.1.smithi098.stdout:2/664: fdatasync d3/d51/d9f/dbc/fc8 0 2024-09-20T19:05:55.635 INFO:tasks.workunit.client.1.smithi098.stdout:4/404: dwrite d3/d6/d11/d57/d7f/f87 [0,4194304] 0 2024-09-20T19:05:55.642 INFO:tasks.workunit.client.0.smithi027.stdout:3/331: rename d0/d1/d13/f44 to d0/d19/d54/f73 0 2024-09-20T19:05:55.642 INFO:tasks.workunit.client.1.smithi098.stdout:0/238: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:55.643 INFO:tasks.workunit.client.0.smithi027.stdout:3/332: chown d0/d1/d13/d15/d6f 11333 1 2024-09-20T19:05:55.644 INFO:tasks.workunit.client.1.smithi098.stdout:5/347: dwrite d1/d17/d35/f41 [0,4194304] 0 2024-09-20T19:05:55.646 INFO:tasks.workunit.client.1.smithi098.stdout:5/348: readlink d1/d46/l47 0 2024-09-20T19:05:55.647 INFO:tasks.workunit.client.1.smithi098.stdout:3/317: mknod d4/d25/d40/c62 0 2024-09-20T19:05:55.648 INFO:tasks.workunit.client.1.smithi098.stdout:5/349: write d1/d17/d25/f3d [575533,46660] 0 2024-09-20T19:05:55.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.645+0000 7f089b7fe640 1 -- 172.21.15.27:0/2458120198 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08a0031740 con 0x7f08a40732a0 2024-09-20T19:05:55.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.645+0000 7f08aaf30640 1 -- 172.21.15.27:0/2458120198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 msgr2=0x7f08a4073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.645+0000 7f08aaf30640 1 --2- 172.21.15.27:0/2458120198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a4073680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009880 tx=0x7f08a002a4b0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 -- 172.21.15.27:0/2458120198 shutdown_connections 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 --2- 172.21.15.27:0/2458120198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 --2- 172.21.15.27:0/2458120198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a4073680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 -- 172.21.15.27:0/2458120198 >> 172.21.15.27:0/2458120198 conn(0x7f08a406ea50 msgr2=0x7f08a4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 -- 172.21.15.27:0/2458120198 shutdown_connections 2024-09-20T19:05:55.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.646+0000 7f08aaf30640 1 -- 172.21.15.27:0/2458120198 wait complete. 2024-09-20T19:05:55.652 INFO:tasks.workunit.client.0.smithi027.stdout:9/429: creat d0/d9/df/d1c/d6a/d6d/dd/d58/f8a x:0 0 0 2024-09-20T19:05:55.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 Processor -- start 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 -- start start 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4110da0 con 0x7f08a41091f0 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f08aaf30640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4110c20 con 0x7f08a40732a0 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f089bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f089bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51464/0 (socket says 172.21.15.27:51464) 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.647+0000 7f089bfff640 1 -- 172.21.15.27:0/4063576636 learned_addr learned my addr 172.21.15.27:0/4063576636 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.648+0000 7f08a8ccc640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.648+0000 7f089bfff640 1 -- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 msgr2=0x7f08a419dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.648+0000 7f089bfff640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a419dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.648+0000 7f089bfff640 1 -- 172.21.15.27:0/4063576636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a419e690 con 0x7f08a41091f0 2024-09-20T19:05:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.648+0000 7f089bfff640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f089401fac0 tx=0x7f089401ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:55.655 INFO:tasks.workunit.client.1.smithi098.stdout:1/346: dread d1/d3/df/f21 [4194304,4194304] 0 2024-09-20T19:05:55.655 INFO:tasks.workunit.client.1.smithi098.stdout:7/456: fsync d3/d10/d16/f2c 0 2024-09-20T19:05:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.650+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f089401dcb0 con 0x7f08a41091f0 2024-09-20T19:05:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.650+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41a30d0 con 0x7f08a41091f0 2024-09-20T19:05:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.650+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f089401de50 con 0x7f08a41091f0 2024-09-20T19:05:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.650+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0894029910 con 0x7f08a41091f0 2024-09-20T19:05:55.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.650+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a41a3660 con 0x7f08a41091f0 2024-09-20T19:05:55.657 INFO:tasks.workunit.client.1.smithi098.stdout:7/457: fdatasync d3/d10/d18/f46 0 2024-09-20T19:05:55.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/318: read d4/da/f14 [5464582,42162] 0 2024-09-20T19:05:55.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.653+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 24) ==== 52128+0+0 (secure 0 0 0) 0x7f0894029b90 con 0x7f08a41091f0 2024-09-20T19:05:55.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.653+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a4073680 con 0x7f08a41091f0 2024-09-20T19:05:55.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.653+0000 7f0899ffb640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 0x7f088c042140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:55.659 INFO:tasks.workunit.client.1.smithi098.stdout:6/266: dread d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:05:55.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.654+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f0894019030 con 0x7f08a41091f0 2024-09-20T19:05:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.654+0000 7f08a8ccc640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 0x7f088c042140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:55.660 INFO:tasks.workunit.client.1.smithi098.stdout:8/428: symlink d7/de/d11/d19/d30/d59/l97 0 2024-09-20T19:05:55.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.655+0000 7f08a8ccc640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 0x7f088c042140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08a0000c00 tx=0x7f08a0005a20 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:55.661 INFO:tasks.workunit.client.1.smithi098.stdout:6/267: write d0/de/d1b/d37/f40 [1243461,8941] 0 2024-09-20T19:05:55.662 INFO:tasks.workunit.client.0.smithi027.stdout:2/236: rename d3/d1c/d26/c29 to d3/d1c/d26/d2a/c3b 0 2024-09-20T19:05:55.663 INFO:tasks.workunit.client.1.smithi098.stdout:2/665: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:55.663 INFO:tasks.workunit.client.1.smithi098.stdout:9/421: truncate d4/de/f3d 1083104 0 2024-09-20T19:05:55.664 INFO:tasks.workunit.client.0.smithi027.stdout:2/237: truncate d3/d13/f17 2731349 0 2024-09-20T19:05:55.664 INFO:tasks.workunit.client.1.smithi098.stdout:2/666: dread - d3/d51/fc3 zero size 2024-09-20T19:05:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:55.660+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0894021d00 con 0x7f08a41091f0 2024-09-20T19:05:55.668 INFO:tasks.workunit.client.0.smithi027.stdout:8/313: symlink d2/d3/d1b/l6b 0 2024-09-20T19:05:55.670 INFO:tasks.workunit.client.0.smithi027.stdout:9/430: creat d0/d9/df/d1c/d6a/d6d/dd/d66/f8b x:0 0 0 2024-09-20T19:05:55.671 INFO:tasks.workunit.client.0.smithi027.stdout:6/246: dwrite d4/d15/f2f [0,4194304] 0 2024-09-20T19:05:55.673 INFO:tasks.workunit.client.0.smithi027.stdout:6/247: chown d4/d6/c12 243165 1 2024-09-20T19:05:55.674 INFO:tasks.workunit.client.0.smithi027.stdout:8/314: truncate d2/d3/f4a 5199708 0 2024-09-20T19:05:55.676 INFO:tasks.workunit.client.1.smithi098.stdout:1/347: dwrite d1/f14 [0,4194304] 0 2024-09-20T19:05:55.677 INFO:tasks.workunit.client.0.smithi027.stdout:3/333: symlink d0/d1/d13/d15/d6f/l74 0 2024-09-20T19:05:55.681 INFO:tasks.workunit.client.0.smithi027.stdout:3/334: fdatasync d0/d1/d5e/f2c 0 2024-09-20T19:05:55.681 INFO:tasks.workunit.client.0.smithi027.stdout:1/294: creat d2/d8/d3b/d4b/f54 x:0 0 0 2024-09-20T19:05:55.681 INFO:tasks.workunit.client.0.smithi027.stdout:4/245: dwrite d5/fa [0,4194304] 0 2024-09-20T19:05:55.681 INFO:tasks.workunit.client.0.smithi027.stdout:2/238: write d3/d13/f25 [1781438,94940] 0 2024-09-20T19:05:55.682 INFO:tasks.workunit.client.1.smithi098.stdout:8/429: mknod d7/de/d11/d1f/d57/c98 0 2024-09-20T19:05:55.682 INFO:tasks.workunit.client.0.smithi027.stdout:8/315: rmdir d2/d3/d6/d21/d33 39 2024-09-20T19:05:55.683 INFO:tasks.workunit.client.1.smithi098.stdout:6/268: symlink d0/de/d1b/d37/l4d 0 2024-09-20T19:05:55.687 INFO:tasks.workunit.client.1.smithi098.stdout:9/422: unlink d4/de/d24/d35/l2b 0 2024-09-20T19:05:55.687 INFO:tasks.workunit.client.1.smithi098.stdout:4/405: stat d3/d6/d3e/f56 0 2024-09-20T19:05:55.688 INFO:tasks.workunit.client.1.smithi098.stdout:4/406: chown d3/d6/d11/d59/l6d 63248773 1 2024-09-20T19:05:55.689 INFO:tasks.workunit.client.0.smithi027.stdout:9/431: mknod d0/d9/df/d1c/d6a/d6d/dd/d58/c8c 0 2024-09-20T19:05:55.692 INFO:tasks.workunit.client.0.smithi027.stdout:9/432: chown d0/d9/df/d1c/d6a/d6d/dd/d66/f86 9 1 2024-09-20T19:05:55.692 INFO:tasks.workunit.client.0.smithi027.stdout:3/335: symlink d0/d1/d5e/l75 0 2024-09-20T19:05:55.693 INFO:tasks.workunit.client.0.smithi027.stdout:4/246: dwrite d5/d13/d16/d21/d3a/f4e [0,4194304] 0 2024-09-20T19:05:55.695 INFO:tasks.workunit.client.0.smithi027.stdout:2/239: mkdir d3/d13/d3c 0 2024-09-20T19:05:55.696 INFO:tasks.workunit.client.1.smithi098.stdout:4/407: dwrite d3/d6/d11/d59/d50/d58/d71/f8a [0,4194304] 0 2024-09-20T19:05:55.697 INFO:tasks.workunit.client.1.smithi098.stdout:8/430: unlink d7/de/d11/d1f/l40 0 2024-09-20T19:05:55.699 INFO:tasks.workunit.client.1.smithi098.stdout:6/269: rename d0/de/d1b/d37/d44/dc/l10 to d0/de/d1b/d37/d44/dc/l4e 0 2024-09-20T19:05:55.701 INFO:tasks.workunit.client.1.smithi098.stdout:9/423: unlink d4/de/d48/l83 0 2024-09-20T19:05:55.705 INFO:tasks.workunit.client.1.smithi098.stdout:4/408: symlink d3/d6/d3e/d3c/d6b/l90 0 2024-09-20T19:05:55.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/458: write d3/d10/d16/d17/d33/d1f/d2d/f3b [493754,62488] 0 2024-09-20T19:05:55.706 INFO:tasks.workunit.client.1.smithi098.stdout:4/409: read - d3/d2e/f77 zero size 2024-09-20T19:05:55.709 INFO:tasks.workunit.client.1.smithi098.stdout:8/431: rename d7/de/f94 to d7/de/d11/d19/d47/f99 0 2024-09-20T19:05:55.710 INFO:tasks.workunit.client.1.smithi098.stdout:6/270: rmdir d0/de/d1b/d37 39 2024-09-20T19:05:55.712 INFO:tasks.workunit.client.1.smithi098.stdout:0/239: getdents d0/d6/d28 0 2024-09-20T19:05:55.713 INFO:tasks.workunit.client.1.smithi098.stdout:9/424: truncate d4/de/d24/d35/f43 689883 0 2024-09-20T19:05:55.716 INFO:tasks.workunit.client.0.smithi027.stdout:1/295: write d2/d1b/f2e [1654775,29255] 0 2024-09-20T19:05:55.716 INFO:tasks.workunit.client.1.smithi098.stdout:7/459: dread - d3/d10/d16/f6c zero size 2024-09-20T19:05:55.718 INFO:tasks.workunit.client.0.smithi027.stdout:8/316: getdents d2/d2a 0 2024-09-20T19:05:55.718 INFO:tasks.workunit.client.1.smithi098.stdout:7/460: write d3/f2e [3027373,90438] 0 2024-09-20T19:05:55.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/317: chown d2/d14/d13/f1d 2 1 2024-09-20T19:05:55.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/667: dwrite d3/f3c [0,4194304] 0 2024-09-20T19:05:55.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/461: chown d3/d10/d16/d17/d33/d1f 48712 1 2024-09-20T19:05:55.722 INFO:tasks.workunit.client.1.smithi098.stdout:8/432: creat d7/de/d11/d1f/d57/f9a x:0 0 0 2024-09-20T19:05:55.723 INFO:tasks.workunit.client.0.smithi027.stdout:4/247: rename d5/d13/d36/d48/f43 to d5/f54 0 2024-09-20T19:05:55.724 INFO:tasks.workunit.client.0.smithi027.stdout:1/296: dwrite d2/d8/d41/f43 [0,4194304] 0 2024-09-20T19:05:55.726 INFO:tasks.workunit.client.0.smithi027.stdout:8/318: mkdir d2/d14/d13/d2e/d6c 0 2024-09-20T19:05:55.730 INFO:tasks.workunit.client.1.smithi098.stdout:0/240: dread d0/d6/fe [0,4194304] 0 2024-09-20T19:05:55.732 INFO:tasks.workunit.client.0.smithi027.stdout:6/248: truncate d4/d15/d37/d39/f3f 2998067 0 2024-09-20T19:05:55.734 INFO:tasks.workunit.client.0.smithi027.stdout:7/288: sync 2024-09-20T19:05:55.734 INFO:tasks.workunit.client.0.smithi027.stdout:0/340: sync 2024-09-20T19:05:55.734 INFO:tasks.workunit.client.0.smithi027.stdout:2/240: rename d3/de/l16 to d3/d24/l3d 0 2024-09-20T19:05:55.735 INFO:tasks.workunit.client.0.smithi027.stdout:9/433: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:55.735 INFO:tasks.workunit.client.0.smithi027.stdout:4/248: unlink d5/d13/d16/d21/d3a/c50 0 2024-09-20T19:05:55.737 INFO:tasks.workunit.client.1.smithi098.stdout:2/668: mknod d3/df/d13/cdb 0 2024-09-20T19:05:55.737 INFO:tasks.workunit.client.0.smithi027.stdout:8/319: mkdir d2/d3/d6/d6d 0 2024-09-20T19:05:55.738 INFO:tasks.workunit.client.1.smithi098.stdout:7/462: stat d3/d10/d16/d17/d33/d1f/d2d/c68 0 2024-09-20T19:05:55.739 INFO:tasks.workunit.client.1.smithi098.stdout:8/433: fsync d7/de/d11/d1d/f1e 0 2024-09-20T19:05:55.740 INFO:tasks.workunit.client.0.smithi027.stdout:3/336: dwrite d0/d19/f4a [0,4194304] 0 2024-09-20T19:05:55.740 INFO:tasks.workunit.client.1.smithi098.stdout:6/271: mknod d0/de/d1b/d37/d44/d24/c4f 0 2024-09-20T19:05:55.742 INFO:tasks.workunit.client.1.smithi098.stdout:9/425: mkdir d4/de/d27/d4a/d58/d5b/d8f 0 2024-09-20T19:05:55.742 INFO:tasks.workunit.client.0.smithi027.stdout:9/434: write d0/d2e/f34 [3286344,42910] 0 2024-09-20T19:05:55.744 INFO:tasks.workunit.client.0.smithi027.stdout:1/297: rename d2/l2a to d2/d1b/l55 0 2024-09-20T19:05:55.746 INFO:tasks.workunit.client.0.smithi027.stdout:6/249: dread d4/f2d [0,4194304] 0 2024-09-20T19:05:55.753 INFO:tasks.workunit.client.1.smithi098.stdout:8/434: mkdir d7/de/d11/d1f/d57/d9b 0 2024-09-20T19:05:55.754 INFO:tasks.workunit.client.0.smithi027.stdout:8/320: readlink d2/d3/d1b/d36/l58 0 2024-09-20T19:05:55.754 INFO:tasks.workunit.client.0.smithi027.stdout:6/250: write d4/d1b/f35 [4112810,126826] 0 2024-09-20T19:05:55.755 INFO:tasks.workunit.client.1.smithi098.stdout:6/272: mkdir d0/de/d1b/d37/d44/d24/d29/d50 0 2024-09-20T19:05:55.756 INFO:tasks.workunit.client.0.smithi027.stdout:2/241: dwrite d3/d1c/f23 [0,4194304] 0 2024-09-20T19:05:55.756 INFO:tasks.workunit.client.0.smithi027.stdout:1/298: mkdir d2/d1b/d56 0 2024-09-20T19:05:55.758 INFO:tasks.workunit.client.0.smithi027.stdout:6/251: fsync d4/d15/d2c/f32 0 2024-09-20T19:05:55.759 INFO:tasks.workunit.client.1.smithi098.stdout:4/410: truncate d3/d6/d3e/d3c/d6b/f74 2000652 0 2024-09-20T19:05:55.760 INFO:tasks.workunit.client.1.smithi098.stdout:4/411: fdatasync d3/d6/d11/d1e/f26 0 2024-09-20T19:05:55.761 INFO:tasks.workunit.client.0.smithi027.stdout:1/299: write d2/d1b/d3a/f35 [822427,2348] 0 2024-09-20T19:05:55.762 INFO:tasks.workunit.client.0.smithi027.stdout:1/300: readlink d2/d8/d41/l48 0 2024-09-20T19:05:55.763 INFO:tasks.workunit.client.1.smithi098.stdout:4/412: chown d3/d6/d11/d59/d50/d58/d71/f8a 29421056 1 2024-09-20T19:05:55.763 INFO:tasks.workunit.client.0.smithi027.stdout:0/341: mkdir d2/d48/d6b/d79 0 2024-09-20T19:05:55.764 INFO:tasks.workunit.client.0.smithi027.stdout:1/301: truncate d2/d8/d3b/d4b/f54 850490 0 2024-09-20T19:05:55.767 INFO:tasks.workunit.client.1.smithi098.stdout:2/669: link d3/df/fd0 d3/d51/d9f/dbc/fdc 0 2024-09-20T19:05:55.768 INFO:tasks.workunit.client.1.smithi098.stdout:2/670: write d3/d16/d1a/fae [383692,110720] 0 2024-09-20T19:05:55.770 INFO:tasks.workunit.client.0.smithi027.stdout:9/435: rename d0/d9/df/d1c/d6a/d6d/dd/d7a to d0/d9/d3d/d4f/d8d 0 2024-09-20T19:05:55.771 INFO:tasks.workunit.client.1.smithi098.stdout:8/435: mkdir d7/de/d11/d1f/d9c 0 2024-09-20T19:05:55.772 INFO:tasks.workunit.client.1.smithi098.stdout:0/241: dread d0/d6/d19/f1c [0,4194304] 0 2024-09-20T19:05:55.772 INFO:tasks.workunit.client.0.smithi027.stdout:1/302: dwrite d2/d8/d41/f43 [0,4194304] 0 2024-09-20T19:05:55.772 INFO:tasks.workunit.client.1.smithi098.stdout:6/273: mkdir d0/de/d1b/d37/d43/d51 0 2024-09-20T19:05:55.774 INFO:tasks.workunit.client.1.smithi098.stdout:6/274: write d0/de/d1b/d37/f40 [1033002,118664] 0 2024-09-20T19:05:55.774 INFO:tasks.workunit.client.1.smithi098.stdout:9/426: mknod d4/de/d27/d88/c90 0 2024-09-20T19:05:55.776 INFO:tasks.workunit.client.1.smithi098.stdout:6/275: chown d0/de/d1b/d37/d43/f48 1226 1 2024-09-20T19:05:55.776 INFO:tasks.workunit.client.0.smithi027.stdout:9/436: write d0/d9/df/f2a [2760028,78948] 0 2024-09-20T19:05:55.777 INFO:tasks.workunit.client.1.smithi098.stdout:6/276: readlink d0/de/d1b/d37/l4d 0 2024-09-20T19:05:55.780 INFO:tasks.workunit.client.1.smithi098.stdout:7/463: dread d3/d10/d16/d17/d33/d1f/d2d/f31 [0,4194304] 0 2024-09-20T19:05:55.781 INFO:tasks.workunit.client.0.smithi027.stdout:2/242: mknod d3/d24/c3e 0 2024-09-20T19:05:55.782 INFO:tasks.workunit.client.1.smithi098.stdout:7/464: dread - d3/d10/d16/f6c zero size 2024-09-20T19:05:55.782 INFO:tasks.workunit.client.0.smithi027.stdout:2/243: dread - d3/d13/f39 zero size 2024-09-20T19:05:55.783 INFO:tasks.workunit.client.1.smithi098.stdout:2/671: dread d3/d16/d1d/d2b/f56 [0,4194304] 0 2024-09-20T19:05:55.783 INFO:tasks.workunit.client.0.smithi027.stdout:2/244: read d3/d13/f2b [2134010,100722] 0 2024-09-20T19:05:55.784 INFO:tasks.workunit.client.0.smithi027.stdout:3/337: write d0/d1/f3f [326732,84974] 0 2024-09-20T19:05:55.784 INFO:tasks.workunit.client.0.smithi027.stdout:6/252: write d4/f2d [1766890,109795] 0 2024-09-20T19:05:55.786 INFO:tasks.workunit.client.1.smithi098.stdout:9/427: stat d4/de/f3d 0 2024-09-20T19:05:55.788 INFO:tasks.workunit.client.1.smithi098.stdout:7/465: dread d3/f6a [0,4194304] 0 2024-09-20T19:05:55.795 INFO:tasks.workunit.client.0.smithi027.stdout:7/289: dwrite d3/d8/da/d2e/f3f [0,4194304] 0 2024-09-20T19:05:55.797 INFO:tasks.workunit.client.0.smithi027.stdout:9/437: creat d0/d9/df/d1c/d6a/d6d/dd/d66/f8e x:0 0 0 2024-09-20T19:05:55.797 INFO:tasks.workunit.client.0.smithi027.stdout:9/438: stat d0/d9/df/c3b 0 2024-09-20T19:05:55.800 INFO:tasks.workunit.client.1.smithi098.stdout:2/672: mknod d3/d16/d1d/d2b/d46/dc0/cdd 0 2024-09-20T19:05:55.802 INFO:tasks.workunit.client.1.smithi098.stdout:2/673: write d3/d16/d1d/d2b/d46/fd5 [336591,12981] 0 2024-09-20T19:05:55.802 INFO:tasks.workunit.client.0.smithi027.stdout:2/245: symlink d3/d13/l3f 0 2024-09-20T19:05:55.802 INFO:tasks.workunit.client.1.smithi098.stdout:2/674: stat d3/d16/d1d/d2b/d99/f9d 0 2024-09-20T19:05:55.804 INFO:tasks.workunit.client.0.smithi027.stdout:3/338: mkdir d0/d1/d13/d15/d76 0 2024-09-20T19:05:55.807 INFO:tasks.workunit.client.0.smithi027.stdout:6/253: rename d4/d1b/d2b/c3b to d4/d1b/d2b/d33/c43 0 2024-09-20T19:05:55.807 INFO:tasks.workunit.client.1.smithi098.stdout:9/428: symlink d4/de/d27/d4a/d21/d25/l91 0 2024-09-20T19:05:55.807 INFO:tasks.workunit.client.1.smithi098.stdout:0/242: write d0/d6/f7 [3113695,111746] 0 2024-09-20T19:05:55.808 INFO:tasks.workunit.client.0.smithi027.stdout:3/339: chown d0/d1/d13/f49 1 1 2024-09-20T19:05:55.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/466: creat d3/d10/d16/d17/d33/d37/f98 x:0 0 0 2024-09-20T19:05:55.810 INFO:tasks.workunit.client.0.smithi027.stdout:7/290: dwrite d3/d8/da/f4e [0,4194304] 0 2024-09-20T19:05:55.813 INFO:tasks.workunit.client.0.smithi027.stdout:6/254: rename d4/d15 to d4/d15/d37/d44 22 2024-09-20T19:05:55.814 INFO:tasks.workunit.client.0.smithi027.stdout:3/340: read d0/d1/d13/d3c/f62 [42185,88429] 0 2024-09-20T19:05:55.815 INFO:tasks.workunit.client.1.smithi098.stdout:2/675: rmdir d3/d16/d1d/d2b 39 2024-09-20T19:05:55.816 INFO:tasks.workunit.client.0.smithi027.stdout:1/303: symlink d2/d8/d3b/d4b/l57 0 2024-09-20T19:05:55.816 INFO:tasks.workunit.client.1.smithi098.stdout:9/429: creat d4/de/d27/d88/f92 x:0 0 0 2024-09-20T19:05:55.817 INFO:tasks.workunit.client.1.smithi098.stdout:6/277: dread d0/de/d1b/d37/d44/f13 [4194304,4194304] 0 2024-09-20T19:05:55.818 INFO:tasks.workunit.client.0.smithi027.stdout:8/321: link d2/d14/f27 d2/d14/d13/d2e/d6c/f6e 0 2024-09-20T19:05:55.818 INFO:tasks.workunit.client.1.smithi098.stdout:4/413: dwrite d3/d6/d3e/d3c/d6b/f74 [0,4194304] 0 2024-09-20T19:05:55.819 INFO:tasks.workunit.client.1.smithi098.stdout:0/243: creat d0/d15/d38/f44 x:0 0 0 2024-09-20T19:05:55.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/430: chown d4/de/d27/d4a 17809624 1 2024-09-20T19:05:55.819 INFO:tasks.workunit.client.0.smithi027.stdout:9/439: dwrite d0/d9/df/d1c/d6a/d6d/dd/d58/f8a [0,4194304] 0 2024-09-20T19:05:55.820 INFO:tasks.workunit.client.0.smithi027.stdout:0/342: link d2/d14/f4c d2/d20/d52/d51/f7a 0 2024-09-20T19:05:55.822 INFO:tasks.workunit.client.0.smithi027.stdout:2/246: dwrite d3/d24/f38 [0,4194304] 0 2024-09-20T19:05:55.835 INFO:tasks.workunit.client.0.smithi027.stdout:3/341: creat d0/d1/d5e/f77 x:0 0 0 2024-09-20T19:05:55.836 INFO:tasks.workunit.client.0.smithi027.stdout:6/255: dwrite d4/f42 [0,4194304] 0 2024-09-20T19:05:55.838 INFO:tasks.workunit.client.0.smithi027.stdout:0/343: symlink d2/d48/l7b 0 2024-09-20T19:05:55.844 INFO:tasks.workunit.client.0.smithi027.stdout:9/440: creat d0/d9/d3d/d5a/f8f x:0 0 0 2024-09-20T19:05:55.846 INFO:tasks.workunit.client.0.smithi027.stdout:1/304: dwrite d2/d1b/d3a/f35 [0,4194304] 0 2024-09-20T19:05:55.848 INFO:tasks.workunit.client.0.smithi027.stdout:2/247: dread d3/d13/f25 [0,4194304] 0 2024-09-20T19:05:55.849 INFO:tasks.workunit.client.0.smithi027.stdout:6/256: creat d4/d15/d37/f45 x:0 0 0 2024-09-20T19:05:55.849 INFO:tasks.workunit.client.0.smithi027.stdout:1/305: write d2/d1b/f1e [7714956,25806] 0 2024-09-20T19:05:55.852 INFO:tasks.workunit.client.0.smithi027.stdout:1/306: dread - d2/d1b/d3a/f4e zero size 2024-09-20T19:05:55.854 INFO:tasks.workunit.client.0.smithi027.stdout:6/257: mkdir d4/d1b/d2b/d46 0 2024-09-20T19:05:55.854 INFO:tasks.workunit.client.0.smithi027.stdout:1/307: write d2/d1b/d3a/f35 [7239041,43667] 0 2024-09-20T19:05:55.856 INFO:tasks.workunit.client.0.smithi027.stdout:2/248: creat d3/d13/d3c/f40 x:0 0 0 2024-09-20T19:05:55.860 INFO:tasks.workunit.client.0.smithi027.stdout:6/258: rename d4/f14 to d4/d15/d37/f47 0 2024-09-20T19:05:55.860 INFO:tasks.workunit.client.0.smithi027.stdout:5/360: sync 2024-09-20T19:05:55.860 INFO:tasks.workunit.client.0.smithi027.stdout:1/308: creat d2/d8/d2b/f58 x:0 0 0 2024-09-20T19:05:55.861 INFO:tasks.workunit.client.0.smithi027.stdout:2/249: mknod d3/d13/c41 0 2024-09-20T19:05:55.862 INFO:tasks.workunit.client.0.smithi027.stdout:0/344: write d2/d14/f3f [666961,60087] 0 2024-09-20T19:05:55.862 INFO:tasks.workunit.client.0.smithi027.stdout:8/322: write d2/d14/d13/d2e/d6c/f6e [4932093,8522] 0 2024-09-20T19:05:55.867 INFO:tasks.workunit.client.0.smithi027.stdout:2/250: creat d3/d2f/f42 x:0 0 0 2024-09-20T19:05:55.869 INFO:tasks.workunit.client.0.smithi027.stdout:7/291: dread d3/d8/da/dc/f21 [4194304,4194304] 0 2024-09-20T19:05:55.870 INFO:tasks.workunit.client.0.smithi027.stdout:6/259: dread d4/d15/d37/d39/f3f [0,4194304] 0 2024-09-20T19:05:55.871 INFO:tasks.workunit.client.1.smithi098.stdout:0/244: mkdir d0/d6/d28/d31/d45 0 2024-09-20T19:05:55.871 INFO:tasks.workunit.client.0.smithi027.stdout:1/309: mknod d2/d1b/d56/c59 0 2024-09-20T19:05:55.872 INFO:tasks.workunit.client.0.smithi027.stdout:7/292: truncate d3/d8/da/f4e 4241041 0 2024-09-20T19:05:55.873 INFO:tasks.workunit.client.1.smithi098.stdout:0/245: truncate d0/d15/d38/f44 783266 0 2024-09-20T19:05:55.873 INFO:tasks.workunit.client.1.smithi098.stdout:6/278: dread d0/de/d1b/d37/f45 [0,4194304] 0 2024-09-20T19:05:55.875 INFO:tasks.workunit.client.1.smithi098.stdout:7/467: symlink d3/d10/d16/l99 0 2024-09-20T19:05:55.877 INFO:tasks.workunit.client.1.smithi098.stdout:7/468: chown d3/d10/d16/d17/l70 1381 1 2024-09-20T19:05:55.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/279: dread d0/de/d1b/d37/f40 [0,4194304] 0 2024-09-20T19:05:55.880 INFO:tasks.workunit.client.1.smithi098.stdout:4/414: rename d3/d4f/d69 to d3/d6/d11/d1e/d2a/d45/d91 0 2024-09-20T19:05:55.881 INFO:tasks.workunit.client.1.smithi098.stdout:9/431: mkdir d4/de/d27/d4a/d8e/d93 0 2024-09-20T19:05:55.881 INFO:tasks.workunit.client.0.smithi027.stdout:2/251: creat d3/de/f43 x:0 0 0 2024-09-20T19:05:55.882 INFO:tasks.workunit.client.1.smithi098.stdout:2/676: dread d3/d51/d68/fb1 [0,4194304] 0 2024-09-20T19:05:55.883 INFO:tasks.workunit.client.0.smithi027.stdout:6/260: truncate d4/d6/f19 1669110 0 2024-09-20T19:05:55.884 INFO:tasks.workunit.client.1.smithi098.stdout:7/469: creat d3/d10/d16/d17/d33/d1f/d28/d66/f9a x:0 0 0 2024-09-20T19:05:55.885 INFO:tasks.workunit.client.1.smithi098.stdout:4/415: dread d3/d6/f32 [0,4194304] 0 2024-09-20T19:05:55.885 INFO:tasks.workunit.client.0.smithi027.stdout:0/345: dwrite d2/d20/d52/f58 [0,4194304] 0 2024-09-20T19:05:55.885 INFO:tasks.workunit.client.1.smithi098.stdout:6/280: creat d0/de/d1b/d37/d44/d24/f52 x:0 0 0 2024-09-20T19:05:55.886 INFO:tasks.workunit.client.1.smithi098.stdout:7/470: fdatasync d3/d10/d16/d17/d33/d1f/d28/d7d/f3f 0 2024-09-20T19:05:55.887 INFO:tasks.workunit.client.0.smithi027.stdout:2/252: mknod d3/d13/d3c/c44 0 2024-09-20T19:05:55.887 INFO:tasks.workunit.client.0.smithi027.stdout:9/441: dread d0/d9/df/d1b/f23 [0,4194304] 0 2024-09-20T19:05:55.888 INFO:tasks.workunit.client.1.smithi098.stdout:7/471: write d3/d10/d16/d17/d33/d1f/f44 [758512,29199] 0 2024-09-20T19:05:55.889 INFO:tasks.workunit.client.0.smithi027.stdout:8/323: dread d2/d3/f31 [0,4194304] 0 2024-09-20T19:05:55.892 INFO:tasks.workunit.client.0.smithi027.stdout:1/310: dread d2/f13 [4194304,4194304] 0 2024-09-20T19:05:55.892 INFO:tasks.workunit.client.0.smithi027.stdout:8/324: write d2/d3/f41 [467793,19519] 0 2024-09-20T19:05:55.894 INFO:tasks.workunit.client.0.smithi027.stdout:1/311: read d2/d8/d3b/d4b/f54 [672506,70018] 0 2024-09-20T19:05:55.895 INFO:tasks.workunit.client.0.smithi027.stdout:7/293: dread d3/f2f [0,4194304] 0 2024-09-20T19:05:55.897 INFO:tasks.workunit.client.0.smithi027.stdout:2/253: write d3/d13/f25 [45144,19252] 0 2024-09-20T19:05:55.898 INFO:tasks.workunit.client.1.smithi098.stdout:0/246: link d0/db/d1d/c3c d0/d6/c46 0 2024-09-20T19:05:55.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/472: fsync d3/d10/d16/d17/d7c/f92 0 2024-09-20T19:05:55.900 INFO:tasks.workunit.client.1.smithi098.stdout:2/677: fsync d3/d16/d1d/d2b/d46/d74/d7b/f91 0 2024-09-20T19:05:55.901 INFO:tasks.workunit.client.1.smithi098.stdout:7/473: write d3/d10/d18/f63 [606765,80858] 0 2024-09-20T19:05:55.903 INFO:tasks.workunit.client.1.smithi098.stdout:4/416: mknod d3/d6/d3e/d3c/d6b/d73/c92 0 2024-09-20T19:05:55.903 INFO:tasks.workunit.client.1.smithi098.stdout:2/678: truncate d3/d51/d9f/dbc/fdc 169398 0 2024-09-20T19:05:55.904 INFO:tasks.workunit.client.1.smithi098.stdout:7/474: read d3/d10/d16/d17/d33/d1f/d28/f61 [2756418,81345] 0 2024-09-20T19:05:55.904 INFO:tasks.workunit.client.1.smithi098.stdout:4/417: stat d3/d6/d11/d1e/d2a/d45/d91 0 2024-09-20T19:05:55.905 INFO:tasks.workunit.client.0.smithi027.stdout:8/325: write d2/d3/d6/d21/d33/f5a [933809,124867] 0 2024-09-20T19:05:55.906 INFO:tasks.workunit.client.0.smithi027.stdout:8/326: stat d2/d3/f41 0 2024-09-20T19:05:55.906 INFO:tasks.workunit.client.0.smithi027.stdout:8/327: chown d2/d14/d13/d2e/d6c 8902894 1 2024-09-20T19:05:55.907 INFO:tasks.workunit.client.0.smithi027.stdout:8/328: readlink d2/d3/l5 0 2024-09-20T19:05:55.908 INFO:tasks.workunit.client.0.smithi027.stdout:1/312: creat d2/d1b/d3a/f5a x:0 0 0 2024-09-20T19:05:55.909 INFO:tasks.workunit.client.0.smithi027.stdout:8/329: write d2/d14/d13/d2e/f4d [340418,23485] 0 2024-09-20T19:05:55.911 INFO:tasks.workunit.client.0.smithi027.stdout:7/294: fsync d3/d8/da/dc/f63 0 2024-09-20T19:05:55.911 INFO:tasks.workunit.client.1.smithi098.stdout:2/679: dread d3/d16/d1d/f39 [0,4194304] 0 2024-09-20T19:05:55.912 INFO:tasks.workunit.client.0.smithi027.stdout:7/295: fdatasync d3/d8/d26/d45/f52 0 2024-09-20T19:05:55.913 INFO:tasks.workunit.client.1.smithi098.stdout:9/432: dwrite d4/de/f3f [0,4194304] 0 2024-09-20T19:05:55.914 INFO:tasks.workunit.client.0.smithi027.stdout:2/254: fdatasync d3/d13/f2b 0 2024-09-20T19:05:55.917 INFO:tasks.workunit.client.0.smithi027.stdout:2/255: rename d3/d13 to d3/d13/d45 22 2024-09-20T19:05:55.918 INFO:tasks.workunit.client.0.smithi027.stdout:6/261: link d4/d6/l20 d4/d15/l48 0 2024-09-20T19:05:55.918 INFO:tasks.workunit.client.1.smithi098.stdout:0/247: write d0/d15/f1e [1265957,18785] 0 2024-09-20T19:05:55.922 INFO:tasks.workunit.client.0.smithi027.stdout:8/330: dwrite d2/d3/d6/f3e [0,4194304] 0 2024-09-20T19:05:55.924 INFO:tasks.workunit.client.1.smithi098.stdout:4/418: rename d3/d6/d3e/d3c/c51 to d3/d6/d11/d59/c93 0 2024-09-20T19:05:55.926 INFO:tasks.workunit.client.0.smithi027.stdout:0/346: dwrite d2/d20/d52/fd [0,4194304] 0 2024-09-20T19:05:55.926 INFO:tasks.workunit.client.0.smithi027.stdout:8/331: write d2/d3/f30 [3340689,87160] 0 2024-09-20T19:05:55.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/248: truncate d0/d6/f12 70066 0 2024-09-20T19:05:55.929 INFO:tasks.workunit.client.1.smithi098.stdout:2/680: creat d3/dd9/fde x:0 0 0 2024-09-20T19:05:55.931 INFO:tasks.workunit.client.1.smithi098.stdout:9/433: mkdir d4/d74/d8a/d94 0 2024-09-20T19:05:55.931 INFO:tasks.workunit.client.0.smithi027.stdout:6/262: dwrite d4/f9 [0,4194304] 0 2024-09-20T19:05:55.932 INFO:tasks.workunit.client.0.smithi027.stdout:2/256: creat d3/de/f46 x:0 0 0 2024-09-20T19:05:55.934 INFO:tasks.workunit.client.0.smithi027.stdout:1/313: symlink d2/d8/d3b/d4b/l5b 0 2024-09-20T19:05:55.935 INFO:tasks.workunit.client.0.smithi027.stdout:1/314: fdatasync d2/f50 0 2024-09-20T19:05:55.937 INFO:tasks.workunit.client.1.smithi098.stdout:2/681: dwrite d3/db0/f6a [0,4194304] 0 2024-09-20T19:05:55.940 INFO:tasks.workunit.client.0.smithi027.stdout:7/296: link d3/f9 d3/d8/da/d51/f66 0 2024-09-20T19:05:55.940 INFO:tasks.workunit.client.0.smithi027.stdout:2/257: creat d3/d1c/f47 x:0 0 0 2024-09-20T19:05:55.941 INFO:tasks.workunit.client.1.smithi098.stdout:9/434: dwrite d4/de/d27/f7a [0,4194304] 0 2024-09-20T19:05:55.941 INFO:tasks.workunit.client.1.smithi098.stdout:7/475: link d3/d10/d16/d17/d33/d1f/d28/d66/c81 d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/c9b 0 2024-09-20T19:05:55.942 INFO:tasks.workunit.client.0.smithi027.stdout:2/258: fsync d3/d13/f39 0 2024-09-20T19:05:55.943 INFO:tasks.workunit.client.1.smithi098.stdout:9/435: chown d4/de/d27/d88/c90 25 1 2024-09-20T19:05:55.943 INFO:tasks.workunit.client.0.smithi027.stdout:6/263: creat d4/d15/d2c/f49 x:0 0 0 2024-09-20T19:05:55.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/419: link d3/d6/d5b/l61 d3/d6/d11/d1e/l94 0 2024-09-20T19:05:55.945 INFO:tasks.workunit.client.1.smithi098.stdout:9/436: write d4/de/d24/f8b [119038,128777] 0 2024-09-20T19:05:55.953 INFO:tasks.workunit.client.0.smithi027.stdout:7/297: symlink d3/d8/d26/d45/d56/l67 0 2024-09-20T19:05:55.953 INFO:tasks.workunit.client.0.smithi027.stdout:2/259: mkdir d3/d13/d3c/d48 0 2024-09-20T19:05:55.954 INFO:tasks.workunit.client.1.smithi098.stdout:4/420: dwrite d3/d7d/f85 [0,4194304] 0 2024-09-20T19:05:55.955 INFO:tasks.workunit.client.1.smithi098.stdout:9/437: rename d4/de/d27/d4a/f67 to d4/de/d27/d4a/d8e/f95 0 2024-09-20T19:05:55.956 INFO:tasks.workunit.client.1.smithi098.stdout:4/421: truncate d3/d6/d3e/d3c/f81 742960 0 2024-09-20T19:05:55.958 INFO:tasks.workunit.client.0.smithi027.stdout:8/332: creat d2/d3/d1b/f6f x:0 0 0 2024-09-20T19:05:55.962 INFO:tasks.workunit.client.0.smithi027.stdout:1/315: creat d2/f5c x:0 0 0 2024-09-20T19:05:55.963 INFO:tasks.workunit.client.1.smithi098.stdout:9/438: mknod d4/de/d27/d4a/d21/d25/c96 0 2024-09-20T19:05:55.964 INFO:tasks.workunit.client.0.smithi027.stdout:1/316: chown d2/d1b/d3a/f4e 183831 1 2024-09-20T19:05:55.964 INFO:tasks.workunit.client.1.smithi098.stdout:4/422: symlink d3/l95 0 2024-09-20T19:05:55.966 INFO:tasks.workunit.client.1.smithi098.stdout:4/423: write d3/d6/d3e/f6e [100951,17717] 0 2024-09-20T19:05:55.967 INFO:tasks.workunit.client.0.smithi027.stdout:8/333: creat d2/d3/d1b/f70 x:0 0 0 2024-09-20T19:05:55.967 INFO:tasks.workunit.client.0.smithi027.stdout:8/334: chown d2/d3 816 1 2024-09-20T19:05:55.968 INFO:tasks.workunit.client.0.smithi027.stdout:8/335: fsync d2/d14/d13/d2e/f53 0 2024-09-20T19:05:55.970 INFO:tasks.workunit.client.1.smithi098.stdout:9/439: dwrite d4/de/f34 [4194304,4194304] 0 2024-09-20T19:05:55.972 INFO:tasks.workunit.client.0.smithi027.stdout:4/249: sync 2024-09-20T19:05:55.973 INFO:tasks.workunit.client.1.smithi098.stdout:4/424: dread d3/d6/d11/d1e/f5d [0,4194304] 0 2024-09-20T19:05:55.973 INFO:tasks.workunit.client.0.smithi027.stdout:4/250: chown d5/d13/d16/d21/d3a 237707903 1 2024-09-20T19:05:55.975 INFO:tasks.workunit.client.0.smithi027.stdout:8/336: dwrite d2/d3/f41 [0,4194304] 0 2024-09-20T19:05:55.984 INFO:tasks.workunit.client.1.smithi098.stdout:9/440: getdents d4/d74/d8a 0 2024-09-20T19:05:55.987 INFO:tasks.workunit.client.0.smithi027.stdout:8/337: unlink d2/d14/d13/d43/c59 0 2024-09-20T19:05:55.991 INFO:tasks.workunit.client.1.smithi098.stdout:9/441: dwrite d4/de/f3f [0,4194304] 0 2024-09-20T19:05:55.993 INFO:tasks.workunit.client.0.smithi027.stdout:8/338: creat d2/d14/d13/f71 x:0 0 0 2024-09-20T19:05:55.993 INFO:tasks.workunit.client.0.smithi027.stdout:6/264: dread d4/d15/d37/f47 [0,4194304] 0 2024-09-20T19:05:55.994 INFO:tasks.workunit.client.1.smithi098.stdout:9/442: dread - d4/de/d27/d39/f53 zero size 2024-09-20T19:05:55.995 INFO:tasks.workunit.client.0.smithi027.stdout:8/339: mkdir d2/d14/d13/d72 0 2024-09-20T19:05:55.997 INFO:tasks.workunit.client.0.smithi027.stdout:6/265: creat d4/d15/d37/f4a x:0 0 0 2024-09-20T19:05:55.998 INFO:tasks.workunit.client.1.smithi098.stdout:2/682: write d3/df/d13/f32 [3785254,72819] 0 2024-09-20T19:05:55.999 INFO:tasks.workunit.client.0.smithi027.stdout:6/266: read - d4/d1b/f3d zero size 2024-09-20T19:05:56.000 INFO:tasks.workunit.client.1.smithi098.stdout:7/476: write d3/d10/d16/d17/d33/d1f/d2d/f77 [2531167,112800] 0 2024-09-20T19:05:56.000 INFO:tasks.workunit.client.0.smithi027.stdout:8/340: mknod d2/d3/d1b/d35/c73 0 2024-09-20T19:05:56.008 INFO:tasks.workunit.client.0.smithi027.stdout:8/341: unlink d2/d65/l40 0 2024-09-20T19:05:56.010 INFO:tasks.workunit.client.0.smithi027.stdout:8/342: write d2/d3/f11 [4115057,57737] 0 2024-09-20T19:05:56.011 INFO:tasks.workunit.client.0.smithi027.stdout:6/267: dwrite f0 [4194304,4194304] 0 2024-09-20T19:05:56.011 INFO:tasks.workunit.client.1.smithi098.stdout:9/443: rmdir d4/de/d27/d4a/d8e/d93 0 2024-09-20T19:05:56.012 INFO:tasks.workunit.client.1.smithi098.stdout:2/683: dwrite d3/d16/d1d/d2b/d46/d74/f7d [0,4194304] 0 2024-09-20T19:05:56.015 INFO:tasks.workunit.client.1.smithi098.stdout:2/684: chown d3/df/caa 14 1 2024-09-20T19:05:56.018 INFO:tasks.workunit.client.0.smithi027.stdout:6/268: mkdir d4/d6/d4b 0 2024-09-20T19:05:56.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/444: creat d4/de/d27/d4a/d58/d5b/f97 x:0 0 0 2024-09-20T19:05:56.020 INFO:tasks.workunit.client.1.smithi098.stdout:4/425: getdents d3 0 2024-09-20T19:05:56.021 INFO:tasks.workunit.client.1.smithi098.stdout:9/445: dread - d4/de/d27/d4a/d58/d5b/f97 zero size 2024-09-20T19:05:56.022 INFO:tasks.workunit.client.1.smithi098.stdout:4/426: read - d3/d6/d11/d1e/f7b zero size 2024-09-20T19:05:56.022 INFO:tasks.workunit.client.0.smithi027.stdout:2/260: dread d3/de/f18 [0,4194304] 0 2024-09-20T19:05:56.024 INFO:tasks.workunit.client.0.smithi027.stdout:2/261: rmdir d3 39 2024-09-20T19:05:56.025 INFO:tasks.workunit.client.1.smithi098.stdout:9/446: creat d4/d74/d8a/f98 x:0 0 0 2024-09-20T19:05:56.026 INFO:tasks.workunit.client.0.smithi027.stdout:1/317: dread d2/d1b/d3a/f35 [4194304,4194304] 0 2024-09-20T19:05:56.026 INFO:tasks.workunit.client.0.smithi027.stdout:8/343: dwrite d2/d3/f5e [0,4194304] 0 2024-09-20T19:05:56.027 INFO:tasks.workunit.client.1.smithi098.stdout:4/427: rename d3/fe to d3/d6/d11/d1e/d2a/d45/d91/f96 0 2024-09-20T19:05:56.030 INFO:tasks.workunit.client.0.smithi027.stdout:8/344: write d2/d65/f3c [2061181,121695] 0 2024-09-20T19:05:56.031 INFO:tasks.workunit.client.1.smithi098.stdout:9/447: unlink d4/de/d27/d39/f70 0 2024-09-20T19:05:56.032 INFO:tasks.workunit.client.0.smithi027.stdout:4/251: write d5/d13/d16/f22 [379866,98743] 0 2024-09-20T19:05:56.032 INFO:tasks.workunit.client.0.smithi027.stdout:2/262: readlink d3/d13/l3f 0 2024-09-20T19:05:56.034 INFO:tasks.workunit.client.0.smithi027.stdout:1/318: stat d2/d8/d3b/d4b/l27 0 2024-09-20T19:05:56.038 INFO:tasks.workunit.client.0.smithi027.stdout:8/345: truncate d2/d14/f20 316443 0 2024-09-20T19:05:56.040 INFO:tasks.workunit.client.0.smithi027.stdout:1/319: fdatasync d2/d8/d3b/d4b/f2c 0 2024-09-20T19:05:56.043 INFO:tasks.workunit.client.0.smithi027.stdout:2/263: getdents d3/de 0 2024-09-20T19:05:56.043 INFO:tasks.workunit.client.0.smithi027.stdout:1/320: write d2/d8/d2b/f4a [340682,21658] 0 2024-09-20T19:05:56.043 INFO:tasks.workunit.client.0.smithi027.stdout:8/346: creat d2/d3/d6/d21/d33/f74 x:0 0 0 2024-09-20T19:05:56.046 INFO:tasks.workunit.client.0.smithi027.stdout:1/321: mknod d2/d8/d2b/d2d/c5d 0 2024-09-20T19:05:56.047 INFO:tasks.workunit.client.1.smithi098.stdout:7/477: dread d3/d10/d16/f39 [0,4194304] 0 2024-09-20T19:05:56.048 INFO:tasks.workunit.client.0.smithi027.stdout:8/347: dread d2/d3/d6/ff [0,4194304] 0 2024-09-20T19:05:56.049 INFO:tasks.workunit.client.0.smithi027.stdout:2/264: rename d3/d13/f19 to d3/d13/f49 0 2024-09-20T19:05:56.050 INFO:tasks.workunit.client.0.smithi027.stdout:8/348: write d2/d14/f3f [861950,115455] 0 2024-09-20T19:05:56.050 INFO:tasks.workunit.client.0.smithi027.stdout:1/322: rename d2/d15 to d2/d8/d2b/d5e 0 2024-09-20T19:05:56.051 INFO:tasks.workunit.client.1.smithi098.stdout:7/478: rmdir d3/d10/d16/d17/d33/d1f/d28 39 2024-09-20T19:05:56.051 INFO:tasks.workunit.client.0.smithi027.stdout:2/265: dread - d3/d1c/f47 zero size 2024-09-20T19:05:56.053 INFO:tasks.workunit.client.0.smithi027.stdout:8/349: fsync d2/d3/d6/d21/d33/f5a 0 2024-09-20T19:05:56.058 INFO:tasks.workunit.client.0.smithi027.stdout:2/266: dwrite d3/f9 [4194304,4194304] 0 2024-09-20T19:05:56.059 INFO:tasks.workunit.client.0.smithi027.stdout:8/350: write d2/d14/d13/d2e/f60 [955922,105086] 0 2024-09-20T19:05:56.065 INFO:tasks.workunit.client.0.smithi027.stdout:8/351: dread - d2/d3/d6/d21/d33/f74 zero size 2024-09-20T19:05:56.066 INFO:tasks.workunit.client.0.smithi027.stdout:6/269: dwrite d4/d6/f19 [0,4194304] 0 2024-09-20T19:05:56.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.061+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08a410d7e0 con 0x7f088c03fc80 2024-09-20T19:05:56.067 INFO:tasks.workunit.client.0.smithi027.stdout:1/323: truncate d2/d8/d41/f43 2568978 0 2024-09-20T19:05:56.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.064+0000 7f0899ffb640 1 -- 172.21.15.27:0/4063576636 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f08a410d7e0 con 0x7f088c03fc80 2024-09-20T19:05:56.069 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "1/2 daemons upgraded", 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "", 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:05:56.070 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:05:56.070 INFO:tasks.workunit.client.0.smithi027.stdout:8/352: chown d2/d3/d1b/d36/l58 29142 1 2024-09-20T19:05:56.071 INFO:tasks.workunit.client.0.smithi027.stdout:1/324: stat d2/d8/d2b/d2d 0 2024-09-20T19:05:56.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.068+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 msgr2=0x7f088c042140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:56.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.068+0000 7f08aaf30640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 0x7f088c042140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08a0000c00 tx=0x7f08a0005a20 comp rx=0 tx=0).stop 2024-09-20T19:05:56.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.068+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 msgr2=0x7f08a419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:56.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.068+0000 7f08aaf30640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f089401fac0 tx=0x7f089401ff80 comp rx=0 tx=0).stop 2024-09-20T19:05:56.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 shutdown_connections 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f088c03fc80 0x7f088c042140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08a41091f0 0x7f08a419e010 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 --2- 172.21.15.27:0/4063576636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08a40732a0 0x7f08a419dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 >> 172.21.15.27:0/4063576636 conn(0x7f08a406ea50 msgr2=0x7f08a4071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.069+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 shutdown_connections 2024-09-20T19:05:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:05:56.070+0000 7f08aaf30640 1 -- 172.21.15.27:0/4063576636 wait complete. 2024-09-20T19:05:56.076 INFO:tasks.workunit.client.0.smithi027.stdout:2/267: dwrite d3/d2f/f33 [0,4194304] 0 2024-09-20T19:05:56.076 INFO:tasks.workunit.client.0.smithi027.stdout:2/268: stat d3 0 2024-09-20T19:05:56.077 INFO:tasks.workunit.client.0.smithi027.stdout:1/325: unlink d2/c3f 0 2024-09-20T19:05:56.078 INFO:tasks.workunit.client.0.smithi027.stdout:2/269: readlink d3/l10 0 2024-09-20T19:05:56.078 INFO:tasks.workunit.client.0.smithi027.stdout:1/326: dread - d2/d8/d2b/f58 zero size 2024-09-20T19:05:56.079 INFO:tasks.workunit.client.0.smithi027.stdout:2/270: dread - d3/d13/d3c/f40 zero size 2024-09-20T19:05:56.081 INFO:tasks.workunit.client.0.smithi027.stdout:8/353: dread d2/d14/d13/d2e/d6c/f6e [0,4194304] 0 2024-09-20T19:05:56.083 INFO:tasks.workunit.client.0.smithi027.stdout:6/270: truncate d4/d15/f2f 3789530 0 2024-09-20T19:05:56.084 INFO:tasks.workunit.client.0.smithi027.stdout:1/327: mknod d2/d8/d2b/d2d/d3e/c5f 0 2024-09-20T19:05:56.085 INFO:tasks.workunit.client.0.smithi027.stdout:8/354: write d2/d3/d6/ff [5158745,27002] 0 2024-09-20T19:05:56.086 INFO:tasks.workunit.client.0.smithi027.stdout:2/271: symlink d3/de/d34/l4a 0 2024-09-20T19:05:56.086 INFO:tasks.workunit.client.0.smithi027.stdout:1/328: write d2/d1b/d3a/f4e [861999,20221] 0 2024-09-20T19:05:56.087 INFO:tasks.workunit.client.0.smithi027.stdout:2/272: chown d3/d13/c41 7 1 2024-09-20T19:05:56.088 INFO:tasks.workunit.client.0.smithi027.stdout:1/329: write d2/d8/f52 [566077,9150] 0 2024-09-20T19:05:56.088 INFO:tasks.workunit.client.0.smithi027.stdout:6/271: rename d4/f2d to d4/d15/d2c/f4c 0 2024-09-20T19:05:56.091 INFO:tasks.workunit.client.0.smithi027.stdout:2/273: write d3/de/f18 [4894081,105495] 0 2024-09-20T19:05:56.092 INFO:tasks.workunit.client.0.smithi027.stdout:8/355: mkdir d2/d3/d6/d6d/d75 0 2024-09-20T19:05:56.094 INFO:tasks.workunit.client.0.smithi027.stdout:2/274: mknod d3/de/d34/c4b 0 2024-09-20T19:05:56.095 INFO:tasks.workunit.client.0.smithi027.stdout:2/275: read - d3/d13/f39 zero size 2024-09-20T19:05:56.096 INFO:tasks.workunit.client.0.smithi027.stdout:6/272: link d4/d6/f2a d4/d1b/d2b/d33/f4d 0 2024-09-20T19:05:56.096 INFO:tasks.workunit.client.0.smithi027.stdout:1/330: getdents d2/d8/d3b/d44 0 2024-09-20T19:05:56.097 INFO:tasks.workunit.client.0.smithi027.stdout:6/273: fdatasync d4/f9 0 2024-09-20T19:05:56.099 INFO:tasks.workunit.client.0.smithi027.stdout:2/276: creat d3/d1c/d31/f4c x:0 0 0 2024-09-20T19:05:56.103 INFO:tasks.workunit.client.0.smithi027.stdout:2/277: truncate d3/de/f1a 2736001 0 2024-09-20T19:05:56.104 INFO:tasks.workunit.client.0.smithi027.stdout:1/331: dwrite d2/d8/d3b/d4b/f2c [0,4194304] 0 2024-09-20T19:05:56.106 INFO:tasks.workunit.client.0.smithi027.stdout:1/332: dread - d2/f5c zero size 2024-09-20T19:05:56.108 INFO:tasks.workunit.client.0.smithi027.stdout:2/278: rename d3/d13/f39 to d3/d13/f4d 0 2024-09-20T19:05:56.110 INFO:tasks.workunit.client.0.smithi027.stdout:1/333: write d2/d8/d2b/d2d/f39 [5045957,95660] 0 2024-09-20T19:05:56.113 INFO:tasks.workunit.client.0.smithi027.stdout:6/274: truncate d4/d6/f11 623752 0 2024-09-20T19:05:56.113 INFO:tasks.workunit.client.0.smithi027.stdout:8/356: dwrite d2/d3/f37 [0,4194304] 0 2024-09-20T19:05:56.114 INFO:tasks.workunit.client.0.smithi027.stdout:1/334: chown d2/d8/d3b/d4b/f54 26998 1 2024-09-20T19:05:56.116 INFO:tasks.workunit.client.0.smithi027.stdout:1/335: dread - d2/d1b/f49 zero size 2024-09-20T19:05:56.119 INFO:tasks.workunit.client.0.smithi027.stdout:6/275: read d4/d1b/d2b/d33/f4d [672451,76874] 0 2024-09-20T19:05:56.121 INFO:tasks.workunit.client.0.smithi027.stdout:2/279: dwrite d3/f9 [4194304,4194304] 0 2024-09-20T19:05:56.121 INFO:tasks.workunit.client.0.smithi027.stdout:1/336: creat d2/d1b/d3a/f60 x:0 0 0 2024-09-20T19:05:56.124 INFO:tasks.workunit.client.0.smithi027.stdout:6/276: read d4/d6/f19 [2263931,32874] 0 2024-09-20T19:05:56.124 INFO:tasks.workunit.client.0.smithi027.stdout:2/280: read - d3/d1c/d31/f4c zero size 2024-09-20T19:05:56.125 INFO:tasks.workunit.client.0.smithi027.stdout:3/342: sync 2024-09-20T19:05:56.128 INFO:tasks.workunit.client.0.smithi027.stdout:3/343: chown d0/d19/f1a 3597 1 2024-09-20T19:05:56.129 INFO:tasks.workunit.client.0.smithi027.stdout:1/337: mkdir d2/d61 0 2024-09-20T19:05:56.130 INFO:tasks.workunit.client.0.smithi027.stdout:8/357: dwrite d2/d65/f4b [0,4194304] 0 2024-09-20T19:05:56.131 INFO:tasks.workunit.client.0.smithi027.stdout:2/281: chown d3/d1c/d26/d2a/c3b 7 1 2024-09-20T19:05:56.133 INFO:tasks.workunit.client.1.smithi098.stdout:7/479: creat d3/d10/d16/d90/f9c x:0 0 0 2024-09-20T19:05:56.135 INFO:tasks.workunit.client.1.smithi098.stdout:9/448: write d4/de/d27/d4a/d21/d25/d51/f55 [147245,79459] 0 2024-09-20T19:05:56.137 INFO:tasks.workunit.client.1.smithi098.stdout:2/685: dwrite d3/f6d [0,4194304] 0 2024-09-20T19:05:56.138 INFO:tasks.workunit.client.0.smithi027.stdout:6/277: dwrite d4/d1b/f1e [0,4194304] 0 2024-09-20T19:05:56.142 INFO:tasks.workunit.client.0.smithi027.stdout:8/358: dwrite d2/d14/d13/d2e/d6c/f6e [0,4194304] 0 2024-09-20T19:05:56.143 INFO:tasks.workunit.client.0.smithi027.stdout:6/278: creat d4/d1b/d2b/f4e x:0 0 0 2024-09-20T19:05:56.145 INFO:tasks.workunit.client.0.smithi027.stdout:8/359: truncate d2/d3/d6/d21/d33/f74 787472 0 2024-09-20T19:05:56.146 INFO:tasks.workunit.client.0.smithi027.stdout:8/360: fsync d2/d3/f41 0 2024-09-20T19:05:56.146 INFO:tasks.workunit.client.0.smithi027.stdout:6/279: creat d4/d15/f4f x:0 0 0 2024-09-20T19:05:56.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/428: mkdir d3/d5e/d97 0 2024-09-20T19:05:56.152 INFO:tasks.workunit.client.1.smithi098.stdout:9/449: dread d4/de/d24/d35/f43 [0,4194304] 0 2024-09-20T19:05:56.152 INFO:tasks.workunit.client.0.smithi027.stdout:8/361: creat d2/d14/d13/d51/f76 x:0 0 0 2024-09-20T19:05:56.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/480: dread d3/f12 [0,4194304] 0 2024-09-20T19:05:56.161 INFO:tasks.workunit.client.1.smithi098.stdout:9/450: dwrite d4/de/d27/f7a [0,4194304] 0 2024-09-20T19:05:56.161 INFO:tasks.workunit.client.1.smithi098.stdout:4/429: fdatasync d3/d6/d11/d59/d50/f63 0 2024-09-20T19:05:56.162 INFO:tasks.workunit.client.1.smithi098.stdout:7/481: chown d3/d4c/f7f 338218 1 2024-09-20T19:05:56.162 INFO:tasks.workunit.client.0.smithi027.stdout:3/344: write d0/d1/f30 [2158928,127662] 0 2024-09-20T19:05:56.163 INFO:tasks.workunit.client.0.smithi027.stdout:6/280: creat d4/d6/d4b/f50 x:0 0 0 2024-09-20T19:05:56.163 INFO:tasks.workunit.client.1.smithi098.stdout:7/482: chown d3/d10/d18/c59 59281 1 2024-09-20T19:05:56.164 INFO:tasks.workunit.client.0.smithi027.stdout:6/281: dread - d4/d1b/d2b/f4e zero size 2024-09-20T19:05:56.164 INFO:tasks.workunit.client.1.smithi098.stdout:4/430: dread d3/d6/d3e/d3c/f81 [0,4194304] 0 2024-09-20T19:05:56.166 INFO:tasks.workunit.client.0.smithi027.stdout:8/362: mkdir d2/d14/d13/d2e/d6c/d77 0 2024-09-20T19:05:56.166 INFO:tasks.workunit.client.0.smithi027.stdout:3/345: readlink d0/d19/d54/l71 0 2024-09-20T19:05:56.167 INFO:tasks.workunit.client.0.smithi027.stdout:3/346: chown d0 4607506 1 2024-09-20T19:05:56.168 INFO:tasks.workunit.client.0.smithi027.stdout:8/363: write d2/d3/d6/d21/f28 [1334891,122626] 0 2024-09-20T19:05:56.169 INFO:tasks.workunit.client.0.smithi027.stdout:6/282: symlink d4/d6/l51 0 2024-09-20T19:05:56.170 INFO:tasks.workunit.client.0.smithi027.stdout:6/283: chown d4/d1b/f35 12852 1 2024-09-20T19:05:56.171 INFO:tasks.workunit.client.1.smithi098.stdout:4/431: mkdir d3/d6/d3e/d3c/d6b/d73/d98 0 2024-09-20T19:05:56.171 INFO:tasks.workunit.client.1.smithi098.stdout:4/432: chown d3/d6/d8c 4 1 2024-09-20T19:05:56.173 INFO:tasks.workunit.client.1.smithi098.stdout:4/433: write d3/d6/d11/d59/d50/f63 [1320145,23832] 0 2024-09-20T19:05:56.174 INFO:tasks.workunit.client.1.smithi098.stdout:7/483: rename d3/d10/d18 to d3/d9d 0 2024-09-20T19:05:56.176 INFO:tasks.workunit.client.0.smithi027.stdout:6/284: rename d4/d15/d2c/f32 to d4/f52 0 2024-09-20T19:05:56.177 INFO:tasks.workunit.client.0.smithi027.stdout:6/285: read d4/d6/f2a [1406557,13768] 0 2024-09-20T19:05:56.177 INFO:tasks.workunit.client.1.smithi098.stdout:4/434: unlink d3/d6/d11/d64/f82 0 2024-09-20T19:05:56.178 INFO:tasks.workunit.client.0.smithi027.stdout:8/364: getdents d2/d14/d13/d2e/d6c/d77 0 2024-09-20T19:05:56.178 INFO:tasks.workunit.client.0.smithi027.stdout:6/286: fdatasync d4/f7 0 2024-09-20T19:05:56.178 INFO:tasks.workunit.client.0.smithi027.stdout:8/365: chown d2/f39 1 1 2024-09-20T19:05:56.178 INFO:tasks.workunit.client.1.smithi098.stdout:7/484: symlink d3/d10/d16/d17/d7c/l9e 0 2024-09-20T19:05:56.179 INFO:tasks.workunit.client.0.smithi027.stdout:8/366: write d2/d3/d6/ff [792826,28020] 0 2024-09-20T19:05:56.180 INFO:tasks.workunit.client.1.smithi098.stdout:4/435: readlink d3/d6/d5b/l61 0 2024-09-20T19:05:56.181 INFO:tasks.workunit.client.1.smithi098.stdout:7/485: rmdir d3/d4c 39 2024-09-20T19:05:56.181 INFO:tasks.workunit.client.1.smithi098.stdout:4/436: write d3/d6/f34 [1445827,118864] 0 2024-09-20T19:05:56.183 INFO:tasks.workunit.client.0.smithi027.stdout:6/287: rmdir d4/d15/d2c 39 2024-09-20T19:05:56.184 INFO:tasks.workunit.client.0.smithi027.stdout:6/288: dread - d4/d15/f4f zero size 2024-09-20T19:05:56.186 INFO:tasks.workunit.client.1.smithi098.stdout:4/437: rename d3/d2e/c44 to d3/d6/d11/d1e/c99 0 2024-09-20T19:05:56.186 INFO:tasks.workunit.client.0.smithi027.stdout:8/367: dwrite d2/d3/d1b/f70 [0,4194304] 0 2024-09-20T19:05:56.187 INFO:tasks.workunit.client.0.smithi027.stdout:8/368: readlink d2/d14/d13/d43/d5d/l69 0 2024-09-20T19:05:56.189 INFO:tasks.workunit.client.1.smithi098.stdout:7/486: rename d3/d10/c15 to d3/d10/d16/d17/d33/d1f/d28/d7d/c9f 0 2024-09-20T19:05:56.190 INFO:tasks.workunit.client.1.smithi098.stdout:7/487: dread - d3/d10/d16/d17/d33/d1f/d2d/f53 zero size 2024-09-20T19:05:56.191 INFO:tasks.workunit.client.1.smithi098.stdout:4/438: creat d3/d7d/f9a x:0 0 0 2024-09-20T19:05:56.193 INFO:tasks.workunit.client.0.smithi027.stdout:8/369: unlink d2/d14/d13/f5c 0 2024-09-20T19:05:56.196 INFO:tasks.workunit.client.1.smithi098.stdout:7/488: chown d3/d10/d16/l47 13624103 1 2024-09-20T19:05:56.197 INFO:tasks.workunit.client.0.smithi027.stdout:8/370: mknod d2/d3/d1b/d35/c78 0 2024-09-20T19:05:56.197 INFO:tasks.workunit.client.0.smithi027.stdout:8/371: chown d2/d14/c52 884576 1 2024-09-20T19:05:56.199 INFO:tasks.workunit.client.1.smithi098.stdout:7/489: unlink d3/d10/d16/l47 0 2024-09-20T19:05:56.200 INFO:tasks.workunit.client.1.smithi098.stdout:7/490: fdatasync d3/d10/d16/d17/d33/d1f/f44 0 2024-09-20T19:05:56.206 INFO:tasks.workunit.client.1.smithi098.stdout:9/451: write d4/f10 [2751631,52141] 0 2024-09-20T19:05:56.209 INFO:tasks.workunit.client.1.smithi098.stdout:2/686: dwrite d3/d16/d1a/fb8 [0,4194304] 0 2024-09-20T19:05:56.211 INFO:tasks.workunit.client.1.smithi098.stdout:7/491: rename d3/d9d to d3/d10/d16/d17/d33/d37/da0 0 2024-09-20T19:05:56.212 INFO:tasks.workunit.client.0.smithi027.stdout:3/347: dwrite d0/d19/d54/f67 [0,4194304] 0 2024-09-20T19:05:56.216 INFO:tasks.workunit.client.1.smithi098.stdout:9/452: link d4/de/d27/d4a/d58/d5b/f97 d4/de/d27/d6c/d73/f99 0 2024-09-20T19:05:56.217 INFO:tasks.workunit.client.1.smithi098.stdout:9/453: dread - d4/de/f7f zero size 2024-09-20T19:05:56.223 INFO:tasks.workunit.client.1.smithi098.stdout:7/492: creat d3/d4c/fa1 x:0 0 0 2024-09-20T19:05:56.224 INFO:tasks.workunit.client.0.smithi027.stdout:6/289: write d4/d6/fa [1706437,21822] 0 2024-09-20T19:05:56.225 INFO:tasks.workunit.client.1.smithi098.stdout:2/687: fsync d3/d16/d1d/d4f/d8b/d38/fc2 0 2024-09-20T19:05:56.225 INFO:tasks.workunit.client.1.smithi098.stdout:7/493: dread - d3/d10/d16/d17/f7e zero size 2024-09-20T19:05:56.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/454: dwrite d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:05:56.227 INFO:tasks.workunit.client.1.smithi098.stdout:2/688: dread d3/d51/d9f/dbc/fdc [0,4194304] 0 2024-09-20T19:05:56.228 INFO:tasks.workunit.client.1.smithi098.stdout:7/494: dread d3/f8 [0,4194304] 0 2024-09-20T19:05:56.229 INFO:tasks.workunit.client.1.smithi098.stdout:7/495: stat d3/d76/d86 0 2024-09-20T19:05:56.230 INFO:tasks.workunit.client.1.smithi098.stdout:2/689: read d3/d16/d1d/d4f/d8b/d38/f44 [892761,113550] 0 2024-09-20T19:05:56.232 INFO:tasks.workunit.client.1.smithi098.stdout:2/690: chown d3/d16/d1d/d2b/d46/d74/d7b/c9e 362 1 2024-09-20T19:05:56.233 INFO:tasks.workunit.client.1.smithi098.stdout:7/496: rmdir d3/d10/d16/d17/d7c 39 2024-09-20T19:05:56.233 INFO:tasks.workunit.client.1.smithi098.stdout:4/439: write d3/d6/f18 [3910364,83324] 0 2024-09-20T19:05:56.234 INFO:tasks.workunit.client.1.smithi098.stdout:2/691: write d3/df/d13/f33 [6067176,62860] 0 2024-09-20T19:05:56.236 INFO:tasks.workunit.client.1.smithi098.stdout:4/440: rmdir d3/d6/d11 39 2024-09-20T19:05:56.239 INFO:tasks.workunit.client.1.smithi098.stdout:2/692: dread d3/f15 [0,4194304] 0 2024-09-20T19:05:56.243 INFO:tasks.workunit.client.1.smithi098.stdout:4/441: dread d3/d6/d11/d1e/f54 [0,4194304] 0 2024-09-20T19:05:56.244 INFO:tasks.workunit.client.1.smithi098.stdout:4/442: write d3/d6/f13 [1591952,64487] 0 2024-09-20T19:05:56.246 INFO:tasks.workunit.client.0.smithi027.stdout:9/442: sync 2024-09-20T19:05:56.247 INFO:tasks.workunit.client.0.smithi027.stdout:5/361: sync 2024-09-20T19:05:56.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/443: dwrite d3/d6/d5b/f65 [4194304,4194304] 0 2024-09-20T19:05:56.252 INFO:tasks.workunit.client.1.smithi098.stdout:4/444: write d3/d6/d11/d59/d50/f63 [2391535,24840] 0 2024-09-20T19:05:56.256 INFO:tasks.workunit.client.1.smithi098.stdout:4/445: rename d3/d6/fd to d3/d6/d11/d57/f9b 0 2024-09-20T19:05:56.259 INFO:tasks.workunit.client.0.smithi027.stdout:9/443: fsync d0/f47 0 2024-09-20T19:05:56.259 INFO:tasks.workunit.client.0.smithi027.stdout:5/362: fdatasync d4/f11 0 2024-09-20T19:05:56.260 INFO:tasks.workunit.client.1.smithi098.stdout:4/446: mknod d3/d6/d11/d59/d50/d58/d71/c9c 0 2024-09-20T19:05:56.260 INFO:tasks.workunit.client.1.smithi098.stdout:4/447: chown d3/d2e/d88 58223 1 2024-09-20T19:05:56.261 INFO:tasks.workunit.client.1.smithi098.stdout:4/448: rmdir d3/d2e 39 2024-09-20T19:05:56.263 INFO:tasks.workunit.client.1.smithi098.stdout:2/693: dread d3/d51/d9f/fc6 [0,4194304] 0 2024-09-20T19:05:56.263 INFO:tasks.workunit.client.0.smithi027.stdout:5/363: creat d4/da/de/d3e/d44/f76 x:0 0 0 2024-09-20T19:05:56.268 INFO:tasks.workunit.client.1.smithi098.stdout:4/449: creat d3/d6/d11/d59/d50/d58/f9d x:0 0 0 2024-09-20T19:05:56.270 INFO:tasks.workunit.client.1.smithi098.stdout:4/450: dread d3/d6/d3e/f6e [0,4194304] 0 2024-09-20T19:05:56.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/451: dwrite d3/d6/d3e/f56 [0,4194304] 0 2024-09-20T19:05:56.281 INFO:tasks.workunit.client.1.smithi098.stdout:4/452: symlink d3/d6/d11/d1e/l9e 0 2024-09-20T19:05:56.283 INFO:tasks.workunit.client.1.smithi098.stdout:4/453: fsync d3/d6/d3e/d3c/f5a 0 2024-09-20T19:05:56.285 INFO:tasks.workunit.client.1.smithi098.stdout:2/694: dread d3/d16/d1a/f27 [0,4194304] 0 2024-09-20T19:05:56.285 INFO:tasks.workunit.client.1.smithi098.stdout:2/695: dread - d3/db0/dcc/fce zero size 2024-09-20T19:05:56.288 INFO:tasks.workunit.client.1.smithi098.stdout:4/454: dread d3/d6/d11/d57/d7f/f87 [0,4194304] 0 2024-09-20T19:05:56.290 INFO:tasks.workunit.client.1.smithi098.stdout:4/455: mkdir d3/d5e/d9f 0 2024-09-20T19:05:56.292 INFO:tasks.workunit.client.1.smithi098.stdout:4/456: creat d3/d5e/d9f/fa0 x:0 0 0 2024-09-20T19:05:56.296 INFO:tasks.workunit.client.1.smithi098.stdout:4/457: creat d3/d6/d11/fa1 x:0 0 0 2024-09-20T19:05:56.298 INFO:tasks.workunit.client.1.smithi098.stdout:2/696: write d3/db0/f4d [945957,3215] 0 2024-09-20T19:05:56.301 INFO:tasks.workunit.client.1.smithi098.stdout:4/458: creat d3/d2e/d88/fa2 x:0 0 0 2024-09-20T19:05:56.302 INFO:tasks.workunit.client.1.smithi098.stdout:4/459: fsync d3/d6/d11/d59/d50/d58/f9d 0 2024-09-20T19:05:56.304 INFO:tasks.workunit.client.1.smithi098.stdout:2/697: dwrite d3/d16/d1d/d4f/d8b/f7e [0,4194304] 0 2024-09-20T19:05:56.306 INFO:tasks.workunit.client.1.smithi098.stdout:2/698: write d3/d16/d1d/d2b/fb4 [751051,91958] 0 2024-09-20T19:05:56.307 INFO:tasks.workunit.client.1.smithi098.stdout:4/460: rename d3/d6/d3e to d3/d7d/da3 0 2024-09-20T19:05:56.307 INFO:tasks.workunit.client.1.smithi098.stdout:2/699: readlink d3/d16/d1d/d4f/d8b/d38/l59 0 2024-09-20T19:05:56.308 INFO:tasks.workunit.client.1.smithi098.stdout:4/461: write d3/d6/d11/d59/d50/f75 [9398,124252] 0 2024-09-20T19:05:56.310 INFO:tasks.workunit.client.1.smithi098.stdout:2/700: creat d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fdf x:0 0 0 2024-09-20T19:05:56.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/462: unlink d3/d7d/da3/d3c/d6b/d73/c92 0 2024-09-20T19:05:56.312 INFO:tasks.workunit.client.1.smithi098.stdout:4/463: fdatasync d3/d6/d11/d64/f8f 0 2024-09-20T19:05:56.313 INFO:tasks.workunit.client.1.smithi098.stdout:2/701: creat d3/d16/d1d/db5/fe0 x:0 0 0 2024-09-20T19:05:56.313 INFO:tasks.workunit.client.1.smithi098.stdout:2/702: chown d3/d16/d1a/c4a 35689888 1 2024-09-20T19:05:56.314 INFO:tasks.workunit.client.1.smithi098.stdout:2/703: readlink d3/d16/d1d/d2b/d46/dc0/lc4 0 2024-09-20T19:05:56.315 INFO:tasks.workunit.client.1.smithi098.stdout:4/464: mkdir d3/d6/da4 0 2024-09-20T19:05:56.315 INFO:tasks.workunit.client.1.smithi098.stdout:2/704: write d3/f3c [4924930,67443] 0 2024-09-20T19:05:56.318 INFO:tasks.workunit.client.1.smithi098.stdout:4/465: symlink d3/d6/d11/d57/d7f/d84/la5 0 2024-09-20T19:05:56.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:56 smithi027 ceph-mon[28196]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:56.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:56 smithi027 ceph-mon[28196]: pgmap v6: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 219 MiB/s wr, 368 op/s 2024-09-20T19:05:56.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:56 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1567113184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:05:56.321 INFO:tasks.workunit.client.1.smithi098.stdout:4/466: creat d3/d7d/da3/d3c/fa6 x:0 0 0 2024-09-20T19:05:56.322 INFO:tasks.workunit.client.1.smithi098.stdout:4/467: truncate d3/d6/d11/d59/d50/f8d 262943 0 2024-09-20T19:05:56.322 INFO:tasks.workunit.client.0.smithi027.stdout:9/444: truncate d0/d9/df/d1c/d6a/d6d/dd/f5b 3659869 0 2024-09-20T19:05:56.322 INFO:tasks.workunit.client.0.smithi027.stdout:5/364: truncate d4/da/d1a/f4f 406127 0 2024-09-20T19:05:56.323 INFO:tasks.workunit.client.0.smithi027.stdout:3/348: dread d0/d19/f6c [0,4194304] 0 2024-09-20T19:05:56.324 INFO:tasks.workunit.client.1.smithi098.stdout:4/468: mkdir d3/d5e/d9f/da7 0 2024-09-20T19:05:56.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/469: symlink d3/d5e/d97/la8 0 2024-09-20T19:05:56.329 INFO:tasks.workunit.client.1.smithi098.stdout:4/470: write d3/d6/d11/d59/d50/f76 [1006553,85423] 0 2024-09-20T19:05:56.330 INFO:tasks.workunit.client.0.smithi027.stdout:5/365: rename d4/d1f/f24 to d4/da/de/d3e/d44/f77 0 2024-09-20T19:05:56.332 INFO:tasks.workunit.client.1.smithi098.stdout:4/471: rename d3/d7d/da3/d3c/f81 to d3/d6/da4/fa9 0 2024-09-20T19:05:56.332 INFO:tasks.workunit.client.1.smithi098.stdout:4/472: chown d3/d6/l49 3951 1 2024-09-20T19:05:56.335 INFO:tasks.workunit.client.0.smithi027.stdout:5/366: mknod d4/da/d1a/c78 0 2024-09-20T19:05:56.335 INFO:tasks.workunit.client.1.smithi098.stdout:4/473: stat d3/d6/d11/d59/l78 0 2024-09-20T19:05:56.338 INFO:tasks.workunit.client.0.smithi027.stdout:9/445: link d0/d9/d3d/d4f/c78 d0/d9/df/d1c/c90 0 2024-09-20T19:05:56.339 INFO:tasks.workunit.client.1.smithi098.stdout:2/705: dread d3/d16/d1d/d2b/d46/f50 [0,4194304] 0 2024-09-20T19:05:56.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/706: chown d3/d16/d1d/d2b/d46/d74/d7b/f9c 6152 1 2024-09-20T19:05:56.341 INFO:tasks.workunit.client.0.smithi027.stdout:9/446: write d0/d9/df/d1b/d64/f6c [896906,42814] 0 2024-09-20T19:05:56.343 INFO:tasks.workunit.client.0.smithi027.stdout:9/447: write d0/d9/df/d1c/d6a/d6d/dd/f29 [230696,13106] 0 2024-09-20T19:05:56.344 INFO:tasks.workunit.client.0.smithi027.stdout:5/367: mkdir d4/da/de/d3e/d69/d6a/d79 0 2024-09-20T19:05:56.345 INFO:tasks.workunit.client.0.smithi027.stdout:3/349: dread d0/d19/f1a [0,4194304] 0 2024-09-20T19:05:56.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/707: mknod d3/d16/d1d/d2b/d99/da2/ce1 0 2024-09-20T19:05:56.346 INFO:tasks.workunit.client.0.smithi027.stdout:3/350: readlink d0/d1/d13/d15/l24 0 2024-09-20T19:05:56.347 INFO:tasks.workunit.client.0.smithi027.stdout:9/448: symlink d0/d9/df/d1c/d6a/d6d/dd/d66/d79/l91 0 2024-09-20T19:05:56.348 INFO:tasks.workunit.client.1.smithi098.stdout:2/708: mknod d3/d16/d96/ce2 0 2024-09-20T19:05:56.349 INFO:tasks.workunit.client.1.smithi098.stdout:4/474: dread d3/d6/d11/d57/d7f/f8b [0,4194304] 0 2024-09-20T19:05:56.351 INFO:tasks.workunit.client.0.smithi027.stdout:9/449: mknod d0/d9/d3d/d4f/c92 0 2024-09-20T19:05:56.352 INFO:tasks.workunit.client.0.smithi027.stdout:5/368: mkdir d4/d7a 0 2024-09-20T19:05:56.354 INFO:tasks.workunit.client.1.smithi098.stdout:4/475: rename d3/d5e/d97/la8 to d3/d6/d11/d59/d50/d58/laa 0 2024-09-20T19:05:56.355 INFO:tasks.workunit.client.1.smithi098.stdout:4/476: dread d3/d6/d11/d59/d50/f8d [0,4194304] 0 2024-09-20T19:05:56.357 INFO:tasks.workunit.client.0.smithi027.stdout:5/369: dread d4/da/de/d3e/d69/d75/f62 [0,4194304] 0 2024-09-20T19:05:56.358 INFO:tasks.workunit.client.0.smithi027.stdout:7/298: sync 2024-09-20T19:05:56.359 INFO:tasks.workunit.client.0.smithi027.stdout:0/347: sync 2024-09-20T19:05:56.359 INFO:tasks.workunit.client.0.smithi027.stdout:9/450: dwrite d0/d9/df/d1c/f69 [0,4194304] 0 2024-09-20T19:05:56.359 INFO:tasks.workunit.client.1.smithi098.stdout:4/477: rename d3/d2e/d88 to d3/d6/d11/d59/d50/d58/dab 0 2024-09-20T19:05:56.360 INFO:tasks.workunit.client.0.smithi027.stdout:9/451: truncate d0/f75 845664 0 2024-09-20T19:05:56.361 INFO:tasks.workunit.client.0.smithi027.stdout:5/370: unlink d4/da/d1a/f4a 0 2024-09-20T19:05:56.362 INFO:tasks.workunit.client.0.smithi027.stdout:3/351: write d0/f11 [2962421,13516] 0 2024-09-20T19:05:56.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/478: mknod d3/d6/d11/cac 0 2024-09-20T19:05:56.373 INFO:tasks.workunit.client.0.smithi027.stdout:0/348: dwrite d2/d20/d52/f42 [0,4194304] 0 2024-09-20T19:05:56.374 INFO:tasks.workunit.client.0.smithi027.stdout:5/371: getdents d4/da/de/d3e/d44 0 2024-09-20T19:05:56.377 INFO:tasks.workunit.client.0.smithi027.stdout:7/299: dwrite d3/d8/da/f46 [0,4194304] 0 2024-09-20T19:05:56.379 INFO:tasks.workunit.client.0.smithi027.stdout:9/452: dwrite d0/d9/df/d1c/d6a/d6d/f13 [0,4194304] 0 2024-09-20T19:05:56.381 INFO:tasks.workunit.client.0.smithi027.stdout:5/372: creat d4/da/de/d3e/d61/f7b x:0 0 0 2024-09-20T19:05:56.382 INFO:tasks.workunit.client.0.smithi027.stdout:7/300: write d3/d8/d26/d45/f52 [851813,53331] 0 2024-09-20T19:05:56.382 INFO:tasks.workunit.client.0.smithi027.stdout:3/352: dread d0/d1/d13/d3c/f42 [0,4194304] 0 2024-09-20T19:05:56.388 INFO:tasks.workunit.client.0.smithi027.stdout:3/353: dread - d0/d1/d13/d15/d55/f6a zero size 2024-09-20T19:05:56.390 INFO:tasks.workunit.client.0.smithi027.stdout:5/373: rename d4/f63 to d4/da/de/d3e/d69/f7c 0 2024-09-20T19:05:56.391 INFO:tasks.workunit.client.0.smithi027.stdout:3/354: read d0/d1/f3f [203612,102729] 0 2024-09-20T19:05:56.392 INFO:tasks.workunit.client.0.smithi027.stdout:5/374: symlink d4/da/de/d3e/d69/l7d 0 2024-09-20T19:05:56.394 INFO:tasks.workunit.client.0.smithi027.stdout:5/375: write d4/da/fc [3410316,52527] 0 2024-09-20T19:05:56.394 INFO:tasks.workunit.client.0.smithi027.stdout:9/453: mknod d0/d9/df/d1c/d6a/d6d/dd/d66/d79/c93 0 2024-09-20T19:05:56.396 INFO:tasks.workunit.client.0.smithi027.stdout:3/355: symlink d0/d1/d13/d15/d55/l78 0 2024-09-20T19:05:56.398 INFO:tasks.workunit.client.0.smithi027.stdout:7/301: rename d3/d8/da/dc/c40 to d3/d8/d26/d45/d56/c68 0 2024-09-20T19:05:56.399 INFO:tasks.workunit.client.0.smithi027.stdout:5/376: mknod d4/da/d1a/c7e 0 2024-09-20T19:05:56.400 INFO:tasks.workunit.client.0.smithi027.stdout:7/302: write d3/d8/da/f28 [4517109,28488] 0 2024-09-20T19:05:56.401 INFO:tasks.workunit.client.0.smithi027.stdout:3/356: symlink d0/l79 0 2024-09-20T19:05:56.401 INFO:tasks.workunit.client.0.smithi027.stdout:5/377: write d4/da/f29 [184301,70494] 0 2024-09-20T19:05:56.403 INFO:tasks.workunit.client.0.smithi027.stdout:3/357: read d0/d1/d13/f37 [28979,50315] 0 2024-09-20T19:05:56.403 INFO:tasks.workunit.client.0.smithi027.stdout:5/378: readlink d4/l2f 0 2024-09-20T19:05:56.403 INFO:tasks.workunit.client.0.smithi027.stdout:7/303: dread d3/f2f [0,4194304] 0 2024-09-20T19:05:56.405 INFO:tasks.workunit.client.0.smithi027.stdout:5/379: write d4/da/d50/f54 [1478242,68214] 0 2024-09-20T19:05:56.407 INFO:tasks.workunit.client.0.smithi027.stdout:7/304: chown d3/d8/da/dc/c22 41174 1 2024-09-20T19:05:56.408 INFO:tasks.workunit.client.0.smithi027.stdout:5/380: rename d4/da/d50 to d4/d1f/d7f 0 2024-09-20T19:05:56.409 INFO:tasks.workunit.client.0.smithi027.stdout:7/305: write d3/d8/d26/d45/d56/f5b [649280,95396] 0 2024-09-20T19:05:56.409 INFO:tasks.workunit.client.0.smithi027.stdout:5/381: chown d4/da/c38 12 1 2024-09-20T19:05:56.411 INFO:tasks.workunit.client.0.smithi027.stdout:5/382: write d4/da/de/d3e/d61/f5e [9038786,40224] 0 2024-09-20T19:05:56.411 INFO:tasks.workunit.client.0.smithi027.stdout:7/306: chown d3/f36 77 1 2024-09-20T19:05:56.414 INFO:tasks.workunit.client.0.smithi027.stdout:5/383: creat d4/d1f/d7f/f80 x:0 0 0 2024-09-20T19:05:56.415 INFO:tasks.workunit.client.0.smithi027.stdout:0/349: truncate d2/f9 10168704 0 2024-09-20T19:05:56.416 INFO:tasks.workunit.client.0.smithi027.stdout:7/307: mknod d3/d8/d26/d65/c69 0 2024-09-20T19:05:56.416 INFO:tasks.workunit.client.0.smithi027.stdout:5/384: write d4/da/de/f40 [160695,125948] 0 2024-09-20T19:05:56.417 INFO:tasks.workunit.client.0.smithi027.stdout:0/350: truncate d2/d20/d52/f42 4450040 0 2024-09-20T19:05:56.420 INFO:tasks.workunit.client.0.smithi027.stdout:0/351: link d2/d14/d1b/l56 d2/d14/d1b/d39/l7c 0 2024-09-20T19:05:56.421 INFO:tasks.workunit.client.0.smithi027.stdout:5/385: link d4/da/de/d3e/d69/d75/d3d/c4b d4/d1f/d28/c81 0 2024-09-20T19:05:56.422 INFO:tasks.workunit.client.0.smithi027.stdout:9/454: dread d0/d9/df/d1c/d6a/d6d/dd/f5b [0,4194304] 0 2024-09-20T19:05:56.425 INFO:tasks.workunit.client.0.smithi027.stdout:9/455: creat d0/d2e/f94 x:0 0 0 2024-09-20T19:05:56.429 INFO:tasks.workunit.client.0.smithi027.stdout:5/386: dwrite d4/da/de/d3e/d69/f7c [0,4194304] 0 2024-09-20T19:05:56.430 INFO:tasks.workunit.client.0.smithi027.stdout:5/387: readlink d4/l2f 0 2024-09-20T19:05:56.465 INFO:tasks.workunit.client.1.smithi098.stdout:3/319: sync 2024-09-20T19:05:56.465 INFO:tasks.workunit.client.1.smithi098.stdout:5/350: sync 2024-09-20T19:05:56.467 INFO:tasks.workunit.client.1.smithi098.stdout:5/351: creat d1/d1b/f6f x:0 0 0 2024-09-20T19:05:56.468 INFO:tasks.workunit.client.1.smithi098.stdout:3/320: mknod d4/d19/d1d/d2f/d4e/c63 0 2024-09-20T19:05:56.468 INFO:tasks.workunit.client.1.smithi098.stdout:5/352: chown d1/d17/d25/f48 957031 1 2024-09-20T19:05:56.468 INFO:tasks.workunit.client.1.smithi098.stdout:5/353: chown d1/d17/d25 137491713 1 2024-09-20T19:05:56.469 INFO:tasks.workunit.client.1.smithi098.stdout:5/354: readlink d1/d1b/l30 0 2024-09-20T19:05:56.471 INFO:tasks.workunit.client.1.smithi098.stdout:3/321: link d4/d19/d1d/d2f/d4e/c63 d4/d38/d48/d60/c64 0 2024-09-20T19:05:56.474 INFO:tasks.workunit.client.0.smithi027.stdout:4/252: sync 2024-09-20T19:05:56.474 INFO:tasks.workunit.client.0.smithi027.stdout:1/338: sync 2024-09-20T19:05:56.474 INFO:tasks.workunit.client.0.smithi027.stdout:5/388: creat d4/f82 x:0 0 0 2024-09-20T19:05:56.475 INFO:tasks.workunit.client.1.smithi098.stdout:5/355: dwrite d1/d17/d25/f3d [0,4194304] 0 2024-09-20T19:05:56.475 INFO:tasks.workunit.client.1.smithi098.stdout:3/322: unlink d4/f10 0 2024-09-20T19:05:56.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:56 smithi098 ceph-mon[35737]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:56.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:56 smithi098 ceph-mon[35737]: pgmap v6: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 219 MiB/s wr, 368 op/s 2024-09-20T19:05:56.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:56 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1567113184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:05:56.475 INFO:tasks.workunit.client.1.smithi098.stdout:5/356: write d1/d17/d25/f58 [10504,18988] 0 2024-09-20T19:05:56.478 INFO:tasks.workunit.client.0.smithi027.stdout:0/352: dread d2/d14/d1b/f2b [4194304,4194304] 0 2024-09-20T19:05:56.478 INFO:tasks.workunit.client.0.smithi027.stdout:5/389: read d4/da/f48 [201565,18755] 0 2024-09-20T19:05:56.479 INFO:tasks.workunit.client.0.smithi027.stdout:1/339: write d2/d1b/f2e [3637421,112228] 0 2024-09-20T19:05:56.480 INFO:tasks.workunit.client.1.smithi098.stdout:5/357: dread d1/d17/f1a [0,4194304] 0 2024-09-20T19:05:56.481 INFO:tasks.workunit.client.1.smithi098.stdout:5/358: stat d1/d17/d5e 0 2024-09-20T19:05:56.481 INFO:tasks.workunit.client.0.smithi027.stdout:4/253: creat d5/d13/d36/d48/d3f/d4c/f55 x:0 0 0 2024-09-20T19:05:56.482 INFO:tasks.workunit.client.0.smithi027.stdout:5/390: chown d4/da/f2c 1226135 1 2024-09-20T19:05:56.482 INFO:tasks.workunit.client.1.smithi098.stdout:5/359: write d1/d17/d25/f58 [883606,24290] 0 2024-09-20T19:05:56.483 INFO:tasks.workunit.client.0.smithi027.stdout:0/353: unlink d2/f10 0 2024-09-20T19:05:56.483 INFO:tasks.workunit.client.1.smithi098.stdout:5/360: stat d1/d17/d25/f3b 0 2024-09-20T19:05:56.484 INFO:tasks.workunit.client.0.smithi027.stdout:5/391: readlink d4/l2f 0 2024-09-20T19:05:56.485 INFO:tasks.workunit.client.0.smithi027.stdout:9/456: dwrite d0/d9/df/d1b/f3e [0,4194304] 0 2024-09-20T19:05:56.486 INFO:tasks.workunit.client.0.smithi027.stdout:1/340: mknod d2/d1b/c62 0 2024-09-20T19:05:56.486 INFO:tasks.workunit.client.0.smithi027.stdout:0/354: dread - d2/d14/d1d/f6c zero size 2024-09-20T19:05:56.487 INFO:tasks.workunit.client.1.smithi098.stdout:5/361: mknod d1/d17/d5e/c70 0 2024-09-20T19:05:56.488 INFO:tasks.workunit.client.0.smithi027.stdout:0/355: dread - d2/d14/d1d/f6c zero size 2024-09-20T19:05:56.490 INFO:tasks.workunit.client.0.smithi027.stdout:0/356: dread - d2/d14/d1b/d39/f57 zero size 2024-09-20T19:05:56.493 INFO:tasks.workunit.client.0.smithi027.stdout:9/457: unlink d0/d9/df/d1c/d6a/d6d/c70 0 2024-09-20T19:05:56.499 INFO:tasks.workunit.client.1.smithi098.stdout:3/323: dwrite d4/d19/d1d/d2f/f53 [0,4194304] 0 2024-09-20T19:05:56.503 INFO:tasks.workunit.client.1.smithi098.stdout:5/362: getdents d1 0 2024-09-20T19:05:56.504 INFO:tasks.workunit.client.1.smithi098.stdout:5/363: fdatasync d1/d17/d25/f3b 0 2024-09-20T19:05:56.504 INFO:tasks.workunit.client.0.smithi027.stdout:9/458: fsync d0/d9/df/d1c/d6a/d6d/dd/f5b 0 2024-09-20T19:05:56.505 INFO:tasks.workunit.client.0.smithi027.stdout:9/459: readlink d0/d9/l4e 0 2024-09-20T19:05:56.506 INFO:tasks.workunit.client.0.smithi027.stdout:9/460: write d0/d9/df/d1b/d64/f6c [1252610,63312] 0 2024-09-20T19:05:56.509 INFO:tasks.workunit.client.0.smithi027.stdout:4/254: truncate d5/d13/d16/d21/f2e 289671 0 2024-09-20T19:05:56.509 INFO:tasks.workunit.client.0.smithi027.stdout:0/357: getdents d2/d48/d6b/d79 0 2024-09-20T19:05:56.509 INFO:tasks.workunit.client.0.smithi027.stdout:1/341: truncate d2/d8/f20 940501 0 2024-09-20T19:05:56.510 INFO:tasks.workunit.client.0.smithi027.stdout:5/392: dread d4/d1f/d28/f34 [0,4194304] 0 2024-09-20T19:05:56.511 INFO:tasks.workunit.client.0.smithi027.stdout:4/255: write d5/d13/d16/f46 [708167,37546] 0 2024-09-20T19:05:56.513 INFO:tasks.workunit.client.0.smithi027.stdout:0/358: truncate d2/d14/d1b/d39/f74 1038275 0 2024-09-20T19:05:56.514 INFO:tasks.workunit.client.1.smithi098.stdout:5/364: rmdir d1/d17/d35/d60 0 2024-09-20T19:05:56.515 INFO:tasks.workunit.client.1.smithi098.stdout:3/324: rename d4/d38/f41 to d4/da/f65 0 2024-09-20T19:05:56.516 INFO:tasks.workunit.client.1.smithi098.stdout:5/365: rmdir d1/d1b/d40 39 2024-09-20T19:05:56.519 INFO:tasks.workunit.client.1.smithi098.stdout:5/366: mkdir d1/d71 0 2024-09-20T19:05:56.520 INFO:tasks.workunit.client.0.smithi027.stdout:4/256: fsync d5/d11/d1a/d2a/f41 0 2024-09-20T19:05:56.523 INFO:tasks.workunit.client.1.smithi098.stdout:3/325: dwrite d4/d19/d1d/f4c [0,4194304] 0 2024-09-20T19:05:56.523 INFO:tasks.workunit.client.0.smithi027.stdout:9/461: getdents d0/d9/df/d1c 0 2024-09-20T19:05:56.526 INFO:tasks.workunit.client.0.smithi027.stdout:0/359: creat d2/d20/d52/d51/f7d x:0 0 0 2024-09-20T19:05:56.526 INFO:tasks.workunit.client.0.smithi027.stdout:9/462: truncate d0/d9/df/f21 3802338 0 2024-09-20T19:05:56.527 INFO:tasks.workunit.client.0.smithi027.stdout:0/360: readlink d2/d20/d52/l50 0 2024-09-20T19:05:56.531 INFO:tasks.workunit.client.0.smithi027.stdout:1/342: dread d2/f13 [0,4194304] 0 2024-09-20T19:05:56.533 INFO:tasks.workunit.client.0.smithi027.stdout:9/463: symlink d0/d9/df/d1b/d64/l95 0 2024-09-20T19:05:56.534 INFO:tasks.workunit.client.0.smithi027.stdout:4/257: creat d5/d11/d51/f56 x:0 0 0 2024-09-20T19:05:56.536 INFO:tasks.workunit.client.1.smithi098.stdout:3/326: creat d4/d19/d1d/d2f/f66 x:0 0 0 2024-09-20T19:05:56.536 INFO:tasks.workunit.client.0.smithi027.stdout:5/393: dread d4/da/f2c [0,4194304] 0 2024-09-20T19:05:56.537 INFO:tasks.workunit.client.0.smithi027.stdout:5/394: chown d4/da 44411587 1 2024-09-20T19:05:56.537 INFO:tasks.workunit.client.1.smithi098.stdout:5/367: chown d1/d17/d25 59253 1 2024-09-20T19:05:56.537 INFO:tasks.workunit.client.0.smithi027.stdout:5/395: read - d4/d1f/f64 zero size 2024-09-20T19:05:56.538 INFO:tasks.workunit.client.0.smithi027.stdout:5/396: stat d4/d1f 0 2024-09-20T19:05:56.538 INFO:tasks.workunit.client.0.smithi027.stdout:1/343: symlink d2/d8/d2b/l63 0 2024-09-20T19:05:56.542 INFO:tasks.workunit.client.1.smithi098.stdout:3/327: dwrite d4/d19/d1d/d22/f36 [0,4194304] 0 2024-09-20T19:05:56.542 INFO:tasks.workunit.client.1.smithi098.stdout:5/368: rename d1/d17/d25/l45 to d1/d17/d35/d54/d68/l72 0 2024-09-20T19:05:56.545 INFO:tasks.workunit.client.0.smithi027.stdout:5/397: dwrite d4/da/de/d3e/f59 [0,4194304] 0 2024-09-20T19:05:56.548 INFO:tasks.workunit.client.0.smithi027.stdout:1/344: symlink d2/d1b/d56/l64 0 2024-09-20T19:05:56.549 INFO:tasks.workunit.client.1.smithi098.stdout:5/369: mknod d1/d46/c73 0 2024-09-20T19:05:56.549 INFO:tasks.workunit.client.0.smithi027.stdout:1/345: stat d2/d1b/f49 0 2024-09-20T19:05:56.549 INFO:tasks.workunit.client.1.smithi098.stdout:5/370: chown d1/d46/c73 100485 1 2024-09-20T19:05:56.551 INFO:tasks.workunit.client.1.smithi098.stdout:3/328: creat d4/d19/d1d/d2f/d3e/f67 x:0 0 0 2024-09-20T19:05:56.552 INFO:tasks.workunit.client.0.smithi027.stdout:0/361: rmdir d2/d14/d1d/d77 0 2024-09-20T19:05:56.552 INFO:tasks.workunit.client.0.smithi027.stdout:9/464: write d0/d9/df/d1c/f72 [1844039,122159] 0 2024-09-20T19:05:56.554 INFO:tasks.workunit.client.1.smithi098.stdout:5/371: truncate d1/d17/d25/f3d 2729751 0 2024-09-20T19:05:56.557 INFO:tasks.workunit.client.0.smithi027.stdout:8/372: sync 2024-09-20T19:05:56.557 INFO:tasks.workunit.client.0.smithi027.stdout:2/282: sync 2024-09-20T19:05:56.557 INFO:tasks.workunit.client.0.smithi027.stdout:0/362: mknod d2/d14/d1d/d2e/c7e 0 2024-09-20T19:05:56.557 INFO:tasks.workunit.client.1.smithi098.stdout:5/372: dread d1/f2c [0,4194304] 0 2024-09-20T19:05:56.558 INFO:tasks.workunit.client.1.smithi098.stdout:3/329: creat d4/d25/f68 x:0 0 0 2024-09-20T19:05:56.561 INFO:tasks.workunit.client.1.smithi098.stdout:3/330: chown d4/f1c 144 1 2024-09-20T19:05:56.561 INFO:tasks.workunit.client.0.smithi027.stdout:9/465: symlink d0/d9/df/l96 0 2024-09-20T19:05:56.561 INFO:tasks.workunit.client.1.smithi098.stdout:3/331: read - d4/d19/d1d/d2f/f66 zero size 2024-09-20T19:05:56.563 INFO:tasks.workunit.client.0.smithi027.stdout:1/346: dwrite d2/d8/d2b/f58 [0,4194304] 0 2024-09-20T19:05:56.565 INFO:tasks.workunit.client.1.smithi098.stdout:3/332: symlink d4/d19/d1d/d2f/d4e/l69 0 2024-09-20T19:05:56.566 INFO:tasks.workunit.client.1.smithi098.stdout:3/333: write d4/d38/f56 [432426,2941] 0 2024-09-20T19:05:56.566 INFO:tasks.workunit.client.0.smithi027.stdout:8/373: unlink d2/d3/l45 0 2024-09-20T19:05:56.568 INFO:tasks.workunit.client.0.smithi027.stdout:5/398: dread d4/da/f48 [0,4194304] 0 2024-09-20T19:05:56.568 INFO:tasks.workunit.client.0.smithi027.stdout:2/283: dread d3/d13/f25 [0,4194304] 0 2024-09-20T19:05:56.568 INFO:tasks.workunit.client.0.smithi027.stdout:0/363: symlink d2/d14/d1b/d39/l7f 0 2024-09-20T19:05:56.574 INFO:tasks.workunit.client.0.smithi027.stdout:2/284: creat d3/de/d34/f4e x:0 0 0 2024-09-20T19:05:56.576 INFO:tasks.workunit.client.0.smithi027.stdout:1/347: fsync d2/d8/d41/f43 0 2024-09-20T19:05:56.576 INFO:tasks.workunit.client.0.smithi027.stdout:8/374: mkdir d2/d3/d6/d21/d33/d79 0 2024-09-20T19:05:56.577 INFO:tasks.workunit.client.0.smithi027.stdout:0/364: dread d2/d20/d52/fd [0,4194304] 0 2024-09-20T19:05:56.581 INFO:tasks.workunit.client.0.smithi027.stdout:8/375: mkdir d2/d14/d13/d43/d7a 0 2024-09-20T19:05:56.582 INFO:tasks.workunit.client.0.smithi027.stdout:4/258: truncate d5/d13/d16/d21/d3a/f4e 3136266 0 2024-09-20T19:05:56.586 INFO:tasks.workunit.client.0.smithi027.stdout:8/376: rmdir d2/d14/d13 39 2024-09-20T19:05:56.586 INFO:tasks.workunit.client.0.smithi027.stdout:8/377: chown d2/d3 107941 1 2024-09-20T19:05:56.587 INFO:tasks.workunit.client.0.smithi027.stdout:2/285: dwrite d3/d13/d3c/f40 [0,4194304] 0 2024-09-20T19:05:56.587 INFO:tasks.workunit.client.0.smithi027.stdout:1/348: rename d2/d1b/l55 to d2/d8/d2b/d2d/d3e/l65 0 2024-09-20T19:05:56.588 INFO:tasks.workunit.client.0.smithi027.stdout:1/349: readlink d2/d8/d3b/d4b/l3d 0 2024-09-20T19:05:56.589 INFO:tasks.workunit.client.1.smithi098.stdout:3/334: getdents d4/d19/d1d/d2f/d4e 0 2024-09-20T19:05:56.589 INFO:tasks.workunit.client.1.smithi098.stdout:3/335: stat d4/d25/d40/d4b 0 2024-09-20T19:05:56.591 INFO:tasks.workunit.client.0.smithi027.stdout:0/365: getdents d2/d49 0 2024-09-20T19:05:56.592 INFO:tasks.workunit.client.0.smithi027.stdout:2/286: mknod d3/de/c4f 0 2024-09-20T19:05:56.593 INFO:tasks.workunit.client.1.smithi098.stdout:3/336: mknod d4/d19/d1d/d2f/d4e/c6a 0 2024-09-20T19:05:56.595 INFO:tasks.workunit.client.0.smithi027.stdout:0/366: dread d2/d14/d1b/d39/f74 [0,4194304] 0 2024-09-20T19:05:56.595 INFO:tasks.workunit.client.0.smithi027.stdout:1/350: rmdir d2/d8/d2b 39 2024-09-20T19:05:56.596 INFO:tasks.workunit.client.0.smithi027.stdout:9/466: dread d0/f12 [0,4194304] 0 2024-09-20T19:05:56.596 INFO:tasks.workunit.client.0.smithi027.stdout:4/259: symlink d5/d11/d17/d53/l57 0 2024-09-20T19:05:56.597 INFO:tasks.workunit.client.0.smithi027.stdout:1/351: readlink d2/d1b/l38 0 2024-09-20T19:05:56.599 INFO:tasks.workunit.client.0.smithi027.stdout:9/467: chown d0/d9/df/d1c/d6a/d6d/dd/d66 850087381 1 2024-09-20T19:05:56.599 INFO:tasks.workunit.client.1.smithi098.stdout:3/337: creat d4/d38/d48/d60/f6b x:0 0 0 2024-09-20T19:05:56.599 INFO:tasks.workunit.client.1.smithi098.stdout:5/373: write d1/d17/d25/f3d [1281033,7126] 0 2024-09-20T19:05:56.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/468: chown d0/d9/df/d1c/d6a/f83 4711386 1 2024-09-20T19:05:56.603 INFO:tasks.workunit.client.0.smithi027.stdout:1/352: chown d2/d8/d2b/d2d/d3e 985754348 1 2024-09-20T19:05:56.603 INFO:tasks.workunit.client.1.smithi098.stdout:5/374: unlink d1/d46/c49 0 2024-09-20T19:05:56.603 INFO:tasks.workunit.client.1.smithi098.stdout:3/338: dread d4/f1c [0,4194304] 0 2024-09-20T19:05:56.606 INFO:tasks.workunit.client.0.smithi027.stdout:0/367: fsync d2/f9 0 2024-09-20T19:05:56.607 INFO:tasks.workunit.client.0.smithi027.stdout:4/260: symlink d5/d11/l58 0 2024-09-20T19:05:56.608 INFO:tasks.workunit.client.1.smithi098.stdout:5/375: symlink d1/d17/d35/d54/d68/l74 0 2024-09-20T19:05:56.611 INFO:tasks.workunit.client.0.smithi027.stdout:1/353: unlink d2/d8/c53 0 2024-09-20T19:05:56.613 INFO:tasks.workunit.client.0.smithi027.stdout:8/378: dread d2/d3/d1b/f26 [0,4194304] 0 2024-09-20T19:05:56.614 INFO:tasks.workunit.client.1.smithi098.stdout:3/339: creat d4/da/f6c x:0 0 0 2024-09-20T19:05:56.617 INFO:tasks.workunit.client.0.smithi027.stdout:4/261: mkdir d5/d13/d36/d59 0 2024-09-20T19:05:56.617 INFO:tasks.workunit.client.0.smithi027.stdout:4/262: fdatasync d5/d11/d17/d1b/f2b 0 2024-09-20T19:05:56.618 INFO:tasks.workunit.client.0.smithi027.stdout:9/469: mkdir d0/d97 0 2024-09-20T19:05:56.620 INFO:tasks.workunit.client.0.smithi027.stdout:1/354: readlink d2/d8/d2b/d2d/l45 0 2024-09-20T19:05:56.621 INFO:tasks.workunit.client.0.smithi027.stdout:2/287: getdents d3/d2f 0 2024-09-20T19:05:56.621 INFO:tasks.workunit.client.1.smithi098.stdout:5/376: dread d1/d17/f1e [0,4194304] 0 2024-09-20T19:05:56.622 INFO:tasks.workunit.client.0.smithi027.stdout:9/470: chown d0/d9/df/d1c/d6a/d6d/dd/f5b 1805 1 2024-09-20T19:05:56.623 INFO:tasks.workunit.client.0.smithi027.stdout:1/355: readlink d2/d8/d2b/l51 0 2024-09-20T19:05:56.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/377: read d1/d17/d25/f58 [212295,44355] 0 2024-09-20T19:05:56.624 INFO:tasks.workunit.client.0.smithi027.stdout:0/368: rename d2/f9 to d2/d48/d6b/f80 0 2024-09-20T19:05:56.625 INFO:tasks.workunit.client.1.smithi098.stdout:5/378: symlink d1/d17/d35/l75 0 2024-09-20T19:05:56.628 INFO:tasks.workunit.client.1.smithi098.stdout:5/379: mknod d1/d71/c76 0 2024-09-20T19:05:56.629 INFO:tasks.workunit.client.0.smithi027.stdout:2/288: mknod d3/d13/d3c/c50 0 2024-09-20T19:05:56.630 INFO:tasks.workunit.client.1.smithi098.stdout:5/380: truncate d1/d17/d35/f6a 679871 0 2024-09-20T19:05:56.631 INFO:tasks.workunit.client.0.smithi027.stdout:0/369: write d2/d20/d52/d29/f65 [3923381,55522] 0 2024-09-20T19:05:56.632 INFO:tasks.workunit.client.0.smithi027.stdout:8/379: dwrite d2/d14/d13/d43/f5b [0,4194304] 0 2024-09-20T19:05:56.632 INFO:tasks.workunit.client.0.smithi027.stdout:1/356: creat d2/f66 x:0 0 0 2024-09-20T19:05:56.635 INFO:tasks.workunit.client.0.smithi027.stdout:9/471: link d0/d9/d3d/d5a/f82 d0/d9/f98 0 2024-09-20T19:05:56.635 INFO:tasks.workunit.client.1.smithi098.stdout:3/340: dread d4/da/fb [0,4194304] 0 2024-09-20T19:05:56.636 INFO:tasks.workunit.client.0.smithi027.stdout:2/289: mknod d3/d24/c51 0 2024-09-20T19:05:56.637 INFO:tasks.workunit.client.1.smithi098.stdout:8/436: sync 2024-09-20T19:05:56.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/348: sync 2024-09-20T19:05:56.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/349: readlink d1/d3/df/l26 0 2024-09-20T19:05:56.638 INFO:tasks.workunit.client.0.smithi027.stdout:1/357: rmdir d2/d1b/d56 39 2024-09-20T19:05:56.638 INFO:tasks.workunit.client.0.smithi027.stdout:4/263: dread d5/d11/f4d [0,4194304] 0 2024-09-20T19:05:56.639 INFO:tasks.workunit.client.0.smithi027.stdout:1/358: chown d2/d8 1 1 2024-09-20T19:05:56.639 INFO:tasks.workunit.client.0.smithi027.stdout:4/264: write d5/d13/f30 [2303760,31201] 0 2024-09-20T19:05:56.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/381: dread d1/d17/d25/f58 [0,4194304] 0 2024-09-20T19:05:56.641 INFO:tasks.workunit.client.0.smithi027.stdout:1/359: write d2/d8/d2b/d2d/f39 [2953931,68120] 0 2024-09-20T19:05:56.645 INFO:tasks.workunit.client.0.smithi027.stdout:4/265: dread d5/d13/d16/f22 [0,4194304] 0 2024-09-20T19:05:56.646 INFO:tasks.workunit.client.1.smithi098.stdout:8/437: dwrite d7/de/d11/d19/d30/d82/f8e [0,4194304] 0 2024-09-20T19:05:56.647 INFO:tasks.workunit.client.0.smithi027.stdout:2/290: mkdir d3/de/d34/d52 0 2024-09-20T19:05:56.647 INFO:tasks.workunit.client.0.smithi027.stdout:2/291: dread - d3/de/f43 zero size 2024-09-20T19:05:56.648 INFO:tasks.workunit.client.1.smithi098.stdout:5/382: symlink d1/d17/d35/l77 0 2024-09-20T19:05:56.650 INFO:tasks.workunit.client.1.smithi098.stdout:5/383: dread d1/d17/f1a [0,4194304] 0 2024-09-20T19:05:56.651 INFO:tasks.workunit.client.0.smithi027.stdout:0/370: dread d2/d20/f47 [0,4194304] 0 2024-09-20T19:05:56.652 INFO:tasks.workunit.client.0.smithi027.stdout:8/380: mknod d2/d14/d13/d43/d7a/c7b 0 2024-09-20T19:05:56.654 INFO:tasks.workunit.client.0.smithi027.stdout:0/371: dread - d2/d20/d52/f6e zero size 2024-09-20T19:05:56.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/438: truncate d7/de/d11/d19/d30/d55/f66 548828 0 2024-09-20T19:05:56.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/341: rename d4/f18 to d4/d19/d1d/f6d 0 2024-09-20T19:05:56.658 INFO:tasks.workunit.client.0.smithi027.stdout:2/292: dwrite d3/d1c/f2d [0,4194304] 0 2024-09-20T19:05:56.659 INFO:tasks.workunit.client.0.smithi027.stdout:9/472: mknod d0/d9/c99 0 2024-09-20T19:05:56.660 INFO:tasks.workunit.client.0.smithi027.stdout:8/381: dread d2/d3/d1b/f70 [0,4194304] 0 2024-09-20T19:05:56.661 INFO:tasks.workunit.client.1.smithi098.stdout:5/384: mknod d1/d46/d69/c78 0 2024-09-20T19:05:56.661 INFO:tasks.workunit.client.0.smithi027.stdout:9/473: write d0/d9/df/d1b/d64/f6f [779414,9115] 0 2024-09-20T19:05:56.663 INFO:tasks.workunit.client.1.smithi098.stdout:8/439: mkdir d7/de/d11/d19/d30/d55/d9d 0 2024-09-20T19:05:56.664 INFO:tasks.workunit.client.0.smithi027.stdout:4/266: mknod d5/d11/d1a/d2a/c5a 0 2024-09-20T19:05:56.668 INFO:tasks.workunit.client.1.smithi098.stdout:1/350: rename d1/f10 to d1/d3/d2e/f67 0 2024-09-20T19:05:56.669 INFO:tasks.workunit.client.1.smithi098.stdout:1/351: write d1/d3/f1b [5012933,167] 0 2024-09-20T19:05:56.672 INFO:tasks.workunit.client.1.smithi098.stdout:8/440: unlink d7/de/d11/d1f/d77/f86 0 2024-09-20T19:05:56.673 INFO:tasks.workunit.client.0.smithi027.stdout:2/293: creat d3/d1c/d26/d2a/f53 x:0 0 0 2024-09-20T19:05:56.674 INFO:tasks.workunit.client.1.smithi098.stdout:1/352: fdatasync d1/d3/df/f23 0 2024-09-20T19:05:56.675 INFO:tasks.workunit.client.1.smithi098.stdout:1/353: dread - d1/d3/df/d4a/f5c zero size 2024-09-20T19:05:56.675 INFO:tasks.workunit.client.1.smithi098.stdout:8/441: readlink d7/de/d11/d19/d30/d55/l91 0 2024-09-20T19:05:56.677 INFO:tasks.workunit.client.0.smithi027.stdout:9/474: mkdir d0/d9/df/d1c/d6a/d9a 0 2024-09-20T19:05:56.678 INFO:tasks.workunit.client.1.smithi098.stdout:8/442: fsync f1 0 2024-09-20T19:05:56.681 INFO:tasks.workunit.client.0.smithi027.stdout:2/294: rename d3/d13/d3c/f40 to d3/d1c/f54 0 2024-09-20T19:05:56.682 INFO:tasks.workunit.client.1.smithi098.stdout:8/443: fsync d7/f3a 0 2024-09-20T19:05:56.683 INFO:tasks.workunit.client.0.smithi027.stdout:1/360: link d2/l12 d2/d8/d3b/d44/l67 0 2024-09-20T19:05:56.684 INFO:tasks.workunit.client.0.smithi027.stdout:1/361: write d2/f13 [12992084,123419] 0 2024-09-20T19:05:56.684 INFO:tasks.workunit.client.1.smithi098.stdout:1/354: getdents d1/d3/df/d34/d43 0 2024-09-20T19:05:56.685 INFO:tasks.workunit.client.0.smithi027.stdout:4/267: link d5/d11/d51/f56 d5/d13/d36/d59/f5b 0 2024-09-20T19:05:56.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/444: fsync d7/de/d11/d19/f4c 0 2024-09-20T19:05:56.689 INFO:tasks.workunit.client.1.smithi098.stdout:1/355: mkdir d1/d3/d2e/d68 0 2024-09-20T19:05:56.692 INFO:tasks.workunit.client.0.smithi027.stdout:2/295: unlink d3/d13/l3f 0 2024-09-20T19:05:56.692 INFO:tasks.workunit.client.0.smithi027.stdout:1/362: dwrite d2/d8/d2b/d5e/f29 [4194304,4194304] 0 2024-09-20T19:05:56.693 INFO:tasks.workunit.client.0.smithi027.stdout:1/363: fsync d2/d8/d2b/f4a 0 2024-09-20T19:05:56.699 INFO:tasks.workunit.client.1.smithi098.stdout:1/356: mknod d1/d3/d2e/c69 0 2024-09-20T19:05:56.701 INFO:tasks.workunit.client.0.smithi027.stdout:4/268: creat d5/d13/f5c x:0 0 0 2024-09-20T19:05:56.702 INFO:tasks.workunit.client.1.smithi098.stdout:3/342: fsync d4/da/f32 0 2024-09-20T19:05:56.703 INFO:tasks.workunit.client.0.smithi027.stdout:2/296: mknod d3/d13/c55 0 2024-09-20T19:05:56.703 INFO:tasks.workunit.client.0.smithi027.stdout:3/358: sync 2024-09-20T19:05:56.703 INFO:tasks.workunit.client.0.smithi027.stdout:6/290: sync 2024-09-20T19:05:56.703 INFO:tasks.workunit.client.0.smithi027.stdout:7/308: sync 2024-09-20T19:05:56.704 INFO:tasks.workunit.client.0.smithi027.stdout:2/297: fsync d3/d2f/f33 0 2024-09-20T19:05:56.704 INFO:tasks.workunit.client.0.smithi027.stdout:6/291: chown d4/d15 1 1 2024-09-20T19:05:56.705 INFO:tasks.workunit.client.0.smithi027.stdout:2/298: fsync d3/d2f/f42 0 2024-09-20T19:05:56.706 INFO:tasks.workunit.client.0.smithi027.stdout:8/382: getdents d2/d14/d13 0 2024-09-20T19:05:56.706 INFO:tasks.workunit.client.0.smithi027.stdout:7/309: write d3/d8/da/dc/f63 [781646,11120] 0 2024-09-20T19:05:56.707 INFO:tasks.workunit.client.0.smithi027.stdout:1/364: symlink d2/d8/d2b/d2d/l68 0 2024-09-20T19:05:56.708 INFO:tasks.workunit.client.1.smithi098.stdout:1/357: mknod d1/d3/c6a 0 2024-09-20T19:05:56.710 INFO:tasks.workunit.client.1.smithi098.stdout:3/343: rename d4/d19/d1d/d2f/d4e/l69 to d4/d19/d1d/d2f/d4e/l6e 0 2024-09-20T19:05:56.711 INFO:tasks.workunit.client.0.smithi027.stdout:0/372: truncate d2/d20/d52/fd 1435726 0 2024-09-20T19:05:56.713 INFO:tasks.workunit.client.0.smithi027.stdout:3/359: mkdir d0/d19/d54/d7a 0 2024-09-20T19:05:56.715 INFO:tasks.workunit.client.1.smithi098.stdout:1/358: creat d1/d3/df/d34/d43/d65/f6b x:0 0 0 2024-09-20T19:05:56.716 INFO:tasks.workunit.client.1.smithi098.stdout:1/359: stat d1/d3/df/d4a/f63 0 2024-09-20T19:05:56.717 INFO:tasks.workunit.client.0.smithi027.stdout:8/383: creat d2/d14/d13/f7c x:0 0 0 2024-09-20T19:05:56.717 INFO:tasks.workunit.client.1.smithi098.stdout:8/445: write d7/de/d11/d19/f4c [7920038,100102] 0 2024-09-20T19:05:56.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/344: creat d4/d38/f6f x:0 0 0 2024-09-20T19:05:56.720 INFO:tasks.workunit.client.0.smithi027.stdout:7/310: unlink d3/d8/da/d51/f66 0 2024-09-20T19:05:56.722 INFO:tasks.workunit.client.0.smithi027.stdout:1/365: unlink d2/d8/lb 0 2024-09-20T19:05:56.723 INFO:tasks.workunit.client.0.smithi027.stdout:4/269: dread f4 [0,4194304] 0 2024-09-20T19:05:56.724 INFO:tasks.workunit.client.0.smithi027.stdout:9/475: truncate d0/f12 2849162 0 2024-09-20T19:05:56.724 INFO:tasks.workunit.client.1.smithi098.stdout:3/345: chown d4/f34 54022 1 2024-09-20T19:05:56.726 INFO:tasks.workunit.client.0.smithi027.stdout:0/373: rename d2/d20/d52/f35 to d2/d14/d1b/d39/f81 0 2024-09-20T19:05:56.726 INFO:tasks.workunit.client.0.smithi027.stdout:8/384: dwrite d2/d14/d13/d2e/d6c/f6e [0,4194304] 0 2024-09-20T19:05:56.727 INFO:tasks.workunit.client.1.smithi098.stdout:1/360: mknod d1/d3/df/d34/c6c 0 2024-09-20T19:05:56.728 INFO:tasks.workunit.client.1.smithi098.stdout:1/361: write d1/d3/df/f23 [2967553,53655] 0 2024-09-20T19:05:56.728 INFO:tasks.workunit.client.0.smithi027.stdout:3/360: mknod d0/d38/c7b 0 2024-09-20T19:05:56.731 INFO:tasks.workunit.client.0.smithi027.stdout:9/476: dread d0/f75 [0,4194304] 0 2024-09-20T19:05:56.731 INFO:tasks.workunit.client.0.smithi027.stdout:2/299: symlink d3/d13/d3c/d48/l56 0 2024-09-20T19:05:56.732 INFO:tasks.workunit.client.0.smithi027.stdout:8/385: read d2/d2a/f2f [2324027,65007] 0 2024-09-20T19:05:56.733 INFO:tasks.workunit.client.1.smithi098.stdout:1/362: mkdir d1/d3/df/d4a/d6d 0 2024-09-20T19:05:56.734 INFO:tasks.workunit.client.0.smithi027.stdout:0/374: truncate d2/d20/d52/f6e 397086 0 2024-09-20T19:05:56.734 INFO:tasks.workunit.client.0.smithi027.stdout:7/311: dwrite d3/d8/d26/f5c [0,4194304] 0 2024-09-20T19:05:56.744 INFO:tasks.workunit.client.0.smithi027.stdout:1/366: dwrite d2/f13 [4194304,4194304] 0 2024-09-20T19:05:56.745 INFO:tasks.workunit.client.0.smithi027.stdout:7/312: mknod d3/d5e/c6a 0 2024-09-20T19:05:56.748 INFO:tasks.workunit.client.0.smithi027.stdout:0/375: creat d2/d20/d52/d51/f82 x:0 0 0 2024-09-20T19:05:56.749 INFO:tasks.workunit.client.1.smithi098.stdout:3/346: dread d4/d19/d1d/f6d [0,4194304] 0 2024-09-20T19:05:56.749 INFO:tasks.workunit.client.0.smithi027.stdout:8/386: mknod d2/d14/d13/d2e/d6c/c7d 0 2024-09-20T19:05:56.752 INFO:tasks.workunit.client.0.smithi027.stdout:0/376: fsync d2/d14/f3f 0 2024-09-20T19:05:56.752 INFO:tasks.workunit.client.0.smithi027.stdout:3/361: creat d0/d1/d13/d64/f7c x:0 0 0 2024-09-20T19:05:56.753 INFO:tasks.workunit.client.1.smithi098.stdout:3/347: mknod d4/d38/d48/c70 0 2024-09-20T19:05:56.753 INFO:tasks.workunit.client.0.smithi027.stdout:1/367: mknod d2/d8/d41/c69 0 2024-09-20T19:05:56.758 INFO:tasks.workunit.client.0.smithi027.stdout:9/477: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/f86 [0,4194304] 0 2024-09-20T19:05:56.758 INFO:tasks.workunit.client.1.smithi098.stdout:3/348: rename d4/d19/d1d/d22/l43 to d4/da/d50/l71 0 2024-09-20T19:05:56.760 INFO:tasks.workunit.client.0.smithi027.stdout:9/478: stat d0/d9/d3d/d4f/c73 0 2024-09-20T19:05:56.760 INFO:tasks.workunit.client.0.smithi027.stdout:3/362: truncate d0/d1/d13/d64/f7c 617319 0 2024-09-20T19:05:56.760 INFO:tasks.workunit.client.0.smithi027.stdout:7/313: dwrite d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:56.760 INFO:tasks.workunit.client.0.smithi027.stdout:9/479: dread - d0/f7d zero size 2024-09-20T19:05:56.761 INFO:tasks.workunit.client.0.smithi027.stdout:7/314: read d3/f2f [764165,53022] 0 2024-09-20T19:05:56.761 INFO:tasks.workunit.client.0.smithi027.stdout:8/387: symlink d2/d14/d13/d51/l7e 0 2024-09-20T19:05:56.763 INFO:tasks.workunit.client.0.smithi027.stdout:0/377: mknod d2/d48/c83 0 2024-09-20T19:05:56.763 INFO:tasks.workunit.client.0.smithi027.stdout:0/378: chown d2/d20/d52/c3a 538660 1 2024-09-20T19:05:56.767 INFO:tasks.workunit.client.1.smithi098.stdout:1/363: dread d1/d3/df/f23 [0,4194304] 0 2024-09-20T19:05:56.771 INFO:tasks.workunit.client.0.smithi027.stdout:1/368: dread d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:56.772 INFO:tasks.workunit.client.0.smithi027.stdout:9/480: unlink d0/d9/l2b 0 2024-09-20T19:05:56.774 INFO:tasks.workunit.client.1.smithi098.stdout:1/364: unlink d1/f16 0 2024-09-20T19:05:56.774 INFO:tasks.workunit.client.1.smithi098.stdout:8/446: write d7/de/d11/d19/f4e [238618,54769] 0 2024-09-20T19:05:56.774 INFO:tasks.workunit.client.1.smithi098.stdout:1/365: fsync d1/d3/f2c 0 2024-09-20T19:05:56.775 INFO:tasks.workunit.client.0.smithi027.stdout:3/363: dwrite d0/d19/f6c [0,4194304] 0 2024-09-20T19:05:56.777 INFO:tasks.workunit.client.0.smithi027.stdout:8/388: creat d2/d14/d13/d43/f7f x:0 0 0 2024-09-20T19:05:56.778 INFO:tasks.workunit.client.1.smithi098.stdout:8/447: fdatasync d7/fb 0 2024-09-20T19:05:56.780 INFO:tasks.workunit.client.0.smithi027.stdout:0/379: rename d2/d14 to d2/d48/d6b/d79/d84 0 2024-09-20T19:05:56.782 INFO:tasks.workunit.client.0.smithi027.stdout:1/369: dwrite d2/d8/d2b/f58 [4194304,4194304] 0 2024-09-20T19:05:56.787 INFO:tasks.workunit.client.0.smithi027.stdout:0/380: truncate d2/d48/d6b/d79/d84/d1b/f5f 949707 0 2024-09-20T19:05:56.788 INFO:tasks.workunit.client.1.smithi098.stdout:8/448: dwrite d7/de/f54 [0,4194304] 0 2024-09-20T19:05:56.789 INFO:tasks.workunit.client.0.smithi027.stdout:9/481: creat d0/d9/d3d/d4f/f9b x:0 0 0 2024-09-20T19:05:56.790 INFO:tasks.workunit.client.0.smithi027.stdout:8/389: dwrite d2/d65/f4b [0,4194304] 0 2024-09-20T19:05:56.791 INFO:tasks.workunit.client.0.smithi027.stdout:2/300: write d3/d24/f28 [409489,97609] 0 2024-09-20T19:05:56.792 INFO:tasks.workunit.client.0.smithi027.stdout:8/390: chown d2/d14/f27 21651576 1 2024-09-20T19:05:56.793 INFO:tasks.workunit.client.0.smithi027.stdout:2/301: dread - d3/de/f46 zero size 2024-09-20T19:05:56.793 INFO:tasks.workunit.client.0.smithi027.stdout:9/482: chown d0/d9/df/d1b/d64/c87 105249966 1 2024-09-20T19:05:56.801 INFO:tasks.workunit.client.0.smithi027.stdout:4/270: write d5/d13/d16/d21/f2e [814511,26523] 0 2024-09-20T19:05:56.804 INFO:tasks.workunit.client.1.smithi098.stdout:1/366: getdents d1/d3/df/d34/d43/d53 0 2024-09-20T19:05:56.804 INFO:tasks.workunit.client.0.smithi027.stdout:4/271: fdatasync d5/d13/d36/d48/d3f/d4c/f55 0 2024-09-20T19:05:56.805 INFO:tasks.workunit.client.0.smithi027.stdout:0/381: symlink d2/d48/d6b/d79/l85 0 2024-09-20T19:05:56.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/449: rmdir d7/de/d11/d1f/d57/d9b 0 2024-09-20T19:05:56.811 INFO:tasks.workunit.client.0.smithi027.stdout:7/315: link d3/f12 d3/d8/d1c/d61/f6b 0 2024-09-20T19:05:56.813 INFO:tasks.workunit.client.0.smithi027.stdout:7/316: chown d3/d8/da/dc/f63 5 1 2024-09-20T19:05:56.813 INFO:tasks.workunit.client.0.smithi027.stdout:0/382: dwrite d2/d20/d52/f6e [0,4194304] 0 2024-09-20T19:05:56.815 INFO:tasks.workunit.client.0.smithi027.stdout:4/272: symlink d5/d13/d36/d48/d3f/d4c/l5d 0 2024-09-20T19:05:56.816 INFO:tasks.workunit.client.0.smithi027.stdout:4/273: stat d5/d11/d1a 0 2024-09-20T19:05:56.817 INFO:tasks.workunit.client.0.smithi027.stdout:8/391: mkdir d2/d3/d6/d21/d80 0 2024-09-20T19:05:56.820 INFO:tasks.workunit.client.0.smithi027.stdout:4/274: truncate d5/d11/d17/d1b/f3c 950677 0 2024-09-20T19:05:56.822 INFO:tasks.workunit.client.0.smithi027.stdout:1/370: getdents d2/d8/d3b/d44 0 2024-09-20T19:05:56.825 INFO:tasks.workunit.client.0.smithi027.stdout:8/392: symlink d2/d14/d13/d2e/d6c/d77/l81 0 2024-09-20T19:05:56.825 INFO:tasks.workunit.client.0.smithi027.stdout:7/317: truncate d3/f9 3291737 0 2024-09-20T19:05:56.826 INFO:tasks.workunit.client.0.smithi027.stdout:1/371: mknod d2/c6a 0 2024-09-20T19:05:56.828 INFO:tasks.workunit.client.0.smithi027.stdout:9/483: rename d0/d9/d3d to d0/d9/df/d1b/d9c 0 2024-09-20T19:05:56.829 INFO:tasks.workunit.client.0.smithi027.stdout:8/393: symlink d2/d14/l82 0 2024-09-20T19:05:56.830 INFO:tasks.workunit.client.0.smithi027.stdout:3/364: write d0/f5 [1459303,80169] 0 2024-09-20T19:05:56.831 INFO:tasks.workunit.client.0.smithi027.stdout:9/484: write d0/d9/df/f74 [750930,127694] 0 2024-09-20T19:05:56.833 INFO:tasks.workunit.client.0.smithi027.stdout:2/302: rename d3/de/f43 to d3/d1c/d26/f57 0 2024-09-20T19:05:56.834 INFO:tasks.workunit.client.0.smithi027.stdout:1/372: getdents d2/d61 0 2024-09-20T19:05:56.835 INFO:tasks.workunit.client.1.smithi098.stdout:8/450: write d7/de/d11/d19/f36 [5105672,113295] 0 2024-09-20T19:05:56.835 INFO:tasks.workunit.client.1.smithi098.stdout:1/367: write d1/d3/d2e/f67 [4793243,110659] 0 2024-09-20T19:05:56.836 INFO:tasks.workunit.client.0.smithi027.stdout:3/365: write d0/d1/d13/d15/d55/f72 [183785,37455] 0 2024-09-20T19:05:56.838 INFO:tasks.workunit.client.0.smithi027.stdout:2/303: write d3/d1c/f23 [3004598,71322] 0 2024-09-20T19:05:56.838 INFO:tasks.workunit.client.1.smithi098.stdout:1/368: creat d1/d3/df/d34/d43/f6e x:0 0 0 2024-09-20T19:05:56.839 INFO:tasks.workunit.client.1.smithi098.stdout:1/369: dread - d1/d3/df/d34/d43/f6e zero size 2024-09-20T19:05:56.840 INFO:tasks.workunit.client.1.smithi098.stdout:1/370: chown d1/d3/f2c 57905 1 2024-09-20T19:05:56.840 INFO:tasks.workunit.client.0.smithi027.stdout:7/318: dwrite d3/d8/d26/d45/f52 [0,4194304] 0 2024-09-20T19:05:56.842 INFO:tasks.workunit.client.0.smithi027.stdout:1/373: chown d2/d1b/f4f 20 1 2024-09-20T19:05:56.842 INFO:tasks.workunit.client.1.smithi098.stdout:0/249: sync 2024-09-20T19:05:56.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/281: sync 2024-09-20T19:05:56.843 INFO:tasks.workunit.client.1.smithi098.stdout:0/250: chown d0/d15/l24 2514 1 2024-09-20T19:05:56.843 INFO:tasks.workunit.client.0.smithi027.stdout:9/485: fsync d0/d9/df/d1b/d9c/d5a/f63 0 2024-09-20T19:05:56.844 INFO:tasks.workunit.client.1.smithi098.stdout:6/282: write d0/de/d1b/f1c [3995773,129698] 0 2024-09-20T19:05:56.847 INFO:tasks.workunit.client.0.smithi027.stdout:0/383: write d2/d48/d6b/d79/d84/f4c [447770,3885] 0 2024-09-20T19:05:56.849 INFO:tasks.workunit.client.0.smithi027.stdout:1/374: chown d2/cd 32105 1 2024-09-20T19:05:56.849 INFO:tasks.workunit.client.1.smithi098.stdout:1/371: dwrite d1/d3/df/d34/d43/f6e [0,4194304] 0 2024-09-20T19:05:56.851 INFO:tasks.workunit.client.0.smithi027.stdout:7/319: write d3/d1a/f3a [2196588,87663] 0 2024-09-20T19:05:56.851 INFO:tasks.workunit.client.0.smithi027.stdout:2/304: chown d3/d13/d3c/c44 11 1 2024-09-20T19:05:56.854 INFO:tasks.workunit.client.0.smithi027.stdout:8/394: truncate d2/d3/f31 968514 0 2024-09-20T19:05:56.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/251: rename d0/d6/f7 to d0/f47 0 2024-09-20T19:05:56.856 INFO:tasks.workunit.client.0.smithi027.stdout:4/275: dread d5/d11/d1a/d2a/f41 [0,4194304] 0 2024-09-20T19:05:56.857 INFO:tasks.workunit.client.0.smithi027.stdout:8/395: write d2/d14/d13/f1d [3551007,65901] 0 2024-09-20T19:05:56.857 INFO:tasks.workunit.client.0.smithi027.stdout:3/366: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:56.858 INFO:tasks.workunit.client.0.smithi027.stdout:3/367: stat d0/c3 0 2024-09-20T19:05:56.859 INFO:tasks.workunit.client.1.smithi098.stdout:6/283: dwrite d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:05:56.861 INFO:tasks.workunit.client.1.smithi098.stdout:0/252: write d0/db/d1d/f3f [50271,71605] 0 2024-09-20T19:05:56.861 INFO:tasks.workunit.client.0.smithi027.stdout:1/375: creat d2/d8/d3b/d44/f6b x:0 0 0 2024-09-20T19:05:56.862 INFO:tasks.workunit.client.0.smithi027.stdout:3/368: read d0/d1/d13/d15/f29 [503760,38050] 0 2024-09-20T19:05:56.863 INFO:tasks.workunit.client.0.smithi027.stdout:2/305: dwrite d3/d24/f38 [0,4194304] 0 2024-09-20T19:05:56.864 INFO:tasks.workunit.client.1.smithi098.stdout:1/372: dwrite d1/d3/df/d34/d43/f56 [0,4194304] 0 2024-09-20T19:05:56.865 INFO:tasks.workunit.client.0.smithi027.stdout:5/399: sync 2024-09-20T19:05:56.865 INFO:tasks.workunit.client.0.smithi027.stdout:6/292: sync 2024-09-20T19:05:56.866 INFO:tasks.workunit.client.1.smithi098.stdout:8/451: dwrite d7/de/d11/d19/d30/d59/d80/f8a [0,4194304] 0 2024-09-20T19:05:56.868 INFO:tasks.workunit.client.0.smithi027.stdout:3/369: write d0/d1/d5e/d1d/f69 [769304,47238] 0 2024-09-20T19:05:56.869 INFO:tasks.workunit.client.1.smithi098.stdout:6/284: mknod d0/de/d1b/d37/d44/d24/d29/d2b/c53 0 2024-09-20T19:05:56.870 INFO:tasks.workunit.client.1.smithi098.stdout:8/452: dread - d7/de/d11/f58 zero size 2024-09-20T19:05:56.871 INFO:tasks.workunit.client.1.smithi098.stdout:8/453: read - d7/de/d11/f58 zero size 2024-09-20T19:05:56.872 INFO:tasks.workunit.client.1.smithi098.stdout:6/285: readlink d0/de/d1b/l20 0 2024-09-20T19:05:56.874 INFO:tasks.workunit.client.0.smithi027.stdout:8/396: chown d2/d14/c17 364349 1 2024-09-20T19:05:56.875 INFO:tasks.workunit.client.1.smithi098.stdout:0/253: truncate d0/d6/f12 1012176 0 2024-09-20T19:05:56.875 INFO:tasks.workunit.client.1.smithi098.stdout:6/286: write d0/de/d1b/f39 [784865,56789] 0 2024-09-20T19:05:56.876 INFO:tasks.workunit.client.0.smithi027.stdout:8/397: chown d2/d2a/f2f 4 1 2024-09-20T19:05:56.876 INFO:tasks.workunit.client.0.smithi027.stdout:9/486: write d0/d9/df/d1b/d9c/d5a/f82 [108928,45697] 0 2024-09-20T19:05:56.877 INFO:tasks.workunit.client.1.smithi098.stdout:1/373: fsync d1/d3/f2d 0 2024-09-20T19:05:56.877 INFO:tasks.workunit.client.1.smithi098.stdout:6/287: write d0/de/d1b/f1f [17137,33800] 0 2024-09-20T19:05:56.878 INFO:tasks.workunit.client.0.smithi027.stdout:9/487: chown d0/f5 41778615 1 2024-09-20T19:05:56.882 INFO:tasks.workunit.client.1.smithi098.stdout:0/254: fsync d0/f47 0 2024-09-20T19:05:56.885 INFO:tasks.workunit.client.0.smithi027.stdout:1/376: symlink d2/d8/d3b/l6c 0 2024-09-20T19:05:56.885 INFO:tasks.workunit.client.1.smithi098.stdout:1/374: dwrite d1/d3/f2c [0,4194304] 0 2024-09-20T19:05:56.888 INFO:tasks.workunit.client.1.smithi098.stdout:6/288: readlink d0/de/d1b/d37/d44/dc/l4e 0 2024-09-20T19:05:56.888 INFO:tasks.workunit.client.0.smithi027.stdout:2/306: unlink d3/de/c4f 0 2024-09-20T19:05:56.890 INFO:tasks.workunit.client.0.smithi027.stdout:3/370: mkdir d0/d1/d5e/d1d/d7d 0 2024-09-20T19:05:56.892 INFO:tasks.workunit.client.0.smithi027.stdout:3/371: chown d0/d19/d54/l71 5976036 1 2024-09-20T19:05:56.895 INFO:tasks.workunit.client.1.smithi098.stdout:0/255: unlink d0/d6/d28/c43 0 2024-09-20T19:05:56.896 INFO:tasks.workunit.client.0.smithi027.stdout:1/377: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:56.896 INFO:tasks.workunit.client.0.smithi027.stdout:8/398: rmdir d2/d3/d1b/d36 39 2024-09-20T19:05:56.896 INFO:tasks.workunit.client.0.smithi027.stdout:3/372: chown d0/d1/d13/d15/l24 0 1 2024-09-20T19:05:56.899 INFO:tasks.workunit.client.1.smithi098.stdout:0/256: rename d0/d6/c8 to d0/d6/d28/c48 0 2024-09-20T19:05:56.899 INFO:tasks.workunit.client.0.smithi027.stdout:3/373: write d0/d1/d5e/f2c [1670740,91609] 0 2024-09-20T19:05:56.900 INFO:tasks.workunit.client.1.smithi098.stdout:8/454: write d7/de/d11/d1d/f95 [1090615,12177] 0 2024-09-20T19:05:56.901 INFO:tasks.workunit.client.1.smithi098.stdout:1/375: mknod d1/d3/df/d34/c6f 0 2024-09-20T19:05:56.902 INFO:tasks.workunit.client.0.smithi027.stdout:0/384: dwrite d2/d48/d6b/d79/d84/d1b/f24 [0,4194304] 0 2024-09-20T19:05:56.903 INFO:tasks.workunit.client.1.smithi098.stdout:0/257: symlink d0/d15/l49 0 2024-09-20T19:05:56.904 INFO:tasks.workunit.client.1.smithi098.stdout:1/376: chown d1/d3/df/d34/c6f 692 1 2024-09-20T19:05:56.905 INFO:tasks.workunit.client.1.smithi098.stdout:1/377: chown d1/d3/d2e/d61 0 1 2024-09-20T19:05:56.905 INFO:tasks.workunit.client.0.smithi027.stdout:2/307: symlink d3/de/l58 0 2024-09-20T19:05:56.906 INFO:tasks.workunit.client.1.smithi098.stdout:1/378: chown d1/d3/f1b 118 1 2024-09-20T19:05:56.909 INFO:tasks.workunit.client.0.smithi027.stdout:8/399: dread d2/d14/d13/f22 [0,4194304] 0 2024-09-20T19:05:56.909 INFO:tasks.workunit.client.0.smithi027.stdout:6/293: mkdir d4/d1b/d2b/d46/d53 0 2024-09-20T19:05:56.909 INFO:tasks.workunit.client.0.smithi027.stdout:5/400: dread d4/f11 [0,4194304] 0 2024-09-20T19:05:56.912 INFO:tasks.workunit.client.0.smithi027.stdout:8/400: truncate d2/d3/d6/d21/d33/f5a 1774344 0 2024-09-20T19:05:56.913 INFO:tasks.workunit.client.1.smithi098.stdout:1/379: creat d1/d3/df/d4a/d6d/f70 x:0 0 0 2024-09-20T19:05:56.913 INFO:tasks.workunit.client.1.smithi098.stdout:1/380: write d1/d3/f1b [3906123,121661] 0 2024-09-20T19:05:56.913 INFO:tasks.workunit.client.0.smithi027.stdout:3/374: creat d0/d1/d13/d3c/f7e x:0 0 0 2024-09-20T19:05:56.914 INFO:tasks.workunit.client.1.smithi098.stdout:0/258: creat d0/f4a x:0 0 0 2024-09-20T19:05:56.915 INFO:tasks.workunit.client.0.smithi027.stdout:7/320: getdents d3/d24 0 2024-09-20T19:05:56.915 INFO:tasks.workunit.client.0.smithi027.stdout:7/321: readlink d3/l4 0 2024-09-20T19:05:56.915 INFO:tasks.workunit.client.0.smithi027.stdout:2/308: rmdir d3/d24 39 2024-09-20T19:05:56.916 INFO:tasks.workunit.client.1.smithi098.stdout:1/381: mkdir d1/d3/d2e/d71 0 2024-09-20T19:05:56.917 INFO:tasks.workunit.client.0.smithi027.stdout:5/401: write d4/f43 [3701525,73383] 0 2024-09-20T19:05:56.919 INFO:tasks.workunit.client.1.smithi098.stdout:1/382: truncate d1/d3/f9 540765 0 2024-09-20T19:05:56.921 INFO:tasks.workunit.client.0.smithi027.stdout:8/401: creat d2/d3/f83 x:0 0 0 2024-09-20T19:05:56.922 INFO:tasks.workunit.client.0.smithi027.stdout:3/375: mkdir d0/d1/d13/d15/d6f/d7f 0 2024-09-20T19:05:56.922 INFO:tasks.workunit.client.1.smithi098.stdout:1/383: mknod d1/d3/df/d34/d43/c72 0 2024-09-20T19:05:56.923 INFO:tasks.workunit.client.1.smithi098.stdout:1/384: chown d1/f25 3313906 1 2024-09-20T19:05:56.923 INFO:tasks.workunit.client.0.smithi027.stdout:7/322: creat d3/d1a/f6c x:0 0 0 2024-09-20T19:05:56.923 INFO:tasks.workunit.client.1.smithi098.stdout:1/385: readlink d1/d3/d2e/l5a 0 2024-09-20T19:05:56.924 INFO:tasks.workunit.client.0.smithi027.stdout:2/309: mknod d3/d1c/d31/c59 0 2024-09-20T19:05:56.925 INFO:tasks.workunit.client.0.smithi027.stdout:7/323: stat d3/d24/f2c 0 2024-09-20T19:05:56.926 INFO:tasks.workunit.client.0.smithi027.stdout:9/488: link d0/d9/df/d1b/d64/l71 d0/d9/df/d1b/d9c/l9d 0 2024-09-20T19:05:56.927 INFO:tasks.workunit.client.0.smithi027.stdout:1/378: link d2/d8/d3b/d4b/l57 d2/d61/l6d 0 2024-09-20T19:05:56.928 INFO:tasks.workunit.client.1.smithi098.stdout:1/386: link d1/d3/df/d34/d43/f56 d1/d3/df/d34/d43/d65/f73 0 2024-09-20T19:05:56.929 INFO:tasks.workunit.client.0.smithi027.stdout:3/376: fsync d0/d19/f6c 0 2024-09-20T19:05:56.931 INFO:tasks.workunit.client.1.smithi098.stdout:1/387: creat d1/d3/df/d34/d43/d53/f74 x:0 0 0 2024-09-20T19:05:56.932 INFO:tasks.workunit.client.0.smithi027.stdout:8/402: dwrite d2/d14/d13/d43/f5b [0,4194304] 0 2024-09-20T19:05:56.933 INFO:tasks.workunit.client.0.smithi027.stdout:7/324: unlink d3/d8/da/dc/l3c 0 2024-09-20T19:05:56.934 INFO:tasks.workunit.client.0.smithi027.stdout:6/294: getdents d4/d6 0 2024-09-20T19:05:56.935 INFO:tasks.workunit.client.1.smithi098.stdout:8/455: dread d7/de/d11/d19/d30/f70 [0,4194304] 0 2024-09-20T19:05:56.936 INFO:tasks.workunit.client.0.smithi027.stdout:8/403: readlink d2/d65/l42 0 2024-09-20T19:05:56.939 INFO:tasks.workunit.client.0.smithi027.stdout:1/379: fsync d2/d1b/d3a/f60 0 2024-09-20T19:05:56.940 INFO:tasks.workunit.client.1.smithi098.stdout:8/456: fdatasync d7/de/d11/d1f/d57/d72/f75 0 2024-09-20T19:05:56.941 INFO:tasks.workunit.client.1.smithi098.stdout:8/457: chown d7/de/f92 12 1 2024-09-20T19:05:56.941 INFO:tasks.workunit.client.0.smithi027.stdout:1/380: write d2/f66 [194504,9084] 0 2024-09-20T19:05:56.942 INFO:tasks.workunit.client.1.smithi098.stdout:1/388: getdents d1/d3/df/d4a 0 2024-09-20T19:05:56.944 INFO:tasks.workunit.client.0.smithi027.stdout:6/295: dwrite d4/d6/fa [0,4194304] 0 2024-09-20T19:05:56.946 INFO:tasks.workunit.client.1.smithi098.stdout:8/458: rename d7/de/d11/f60 to d7/de/d11/d1f/d9c/f9e 0 2024-09-20T19:05:56.946 INFO:tasks.workunit.client.0.smithi027.stdout:1/381: truncate d2/d1b/f49 223952 0 2024-09-20T19:05:56.947 INFO:tasks.workunit.client.0.smithi027.stdout:5/402: link d4/da/de/d3e/d69/d75/d3d/l5b d4/da/de/d3e/l83 0 2024-09-20T19:05:56.948 INFO:tasks.workunit.client.1.smithi098.stdout:1/389: creat d1/d3/df/d34/d43/d65/f75 x:0 0 0 2024-09-20T19:05:56.951 INFO:tasks.workunit.client.0.smithi027.stdout:9/489: dread d0/d9/df/f2a [0,4194304] 0 2024-09-20T19:05:56.952 INFO:tasks.workunit.client.1.smithi098.stdout:0/259: dwrite d0/db/fd [0,4194304] 0 2024-09-20T19:05:56.954 INFO:tasks.workunit.client.0.smithi027.stdout:2/310: getdents d3/d13 0 2024-09-20T19:05:56.959 INFO:tasks.workunit.client.1.smithi098.stdout:0/260: mknod d0/db/d32/c4b 0 2024-09-20T19:05:56.960 INFO:tasks.workunit.client.0.smithi027.stdout:1/382: unlink d2/d8/d3b/d4b/f54 0 2024-09-20T19:05:56.961 INFO:tasks.workunit.client.1.smithi098.stdout:8/459: mknod d7/de/d11/d19/d30/d59/d80/c9f 0 2024-09-20T19:05:56.961 INFO:tasks.workunit.client.0.smithi027.stdout:5/403: rmdir d4/d1f/d28 39 2024-09-20T19:05:56.962 INFO:tasks.workunit.client.1.smithi098.stdout:1/390: creat d1/d3/d2e/d71/f76 x:0 0 0 2024-09-20T19:05:56.963 INFO:tasks.workunit.client.0.smithi027.stdout:8/404: creat d2/d3/d6/d6d/d75/f84 x:0 0 0 2024-09-20T19:05:56.964 INFO:tasks.workunit.client.1.smithi098.stdout:0/261: rename d0/d6/d19/l29 to d0/db/d1d/l4c 0 2024-09-20T19:05:56.965 INFO:tasks.workunit.client.0.smithi027.stdout:9/490: creat d0/d9/df/f9e x:0 0 0 2024-09-20T19:05:56.966 INFO:tasks.workunit.client.1.smithi098.stdout:8/460: write d7/de/d11/d19/d30/f70 [3581844,45693] 0 2024-09-20T19:05:56.966 INFO:tasks.workunit.client.0.smithi027.stdout:7/325: creat d3/f6d x:0 0 0 2024-09-20T19:05:56.967 INFO:tasks.workunit.client.1.smithi098.stdout:8/461: dread - d7/de/d11/f6b zero size 2024-09-20T19:05:56.967 INFO:tasks.workunit.client.1.smithi098.stdout:1/391: mkdir d1/d3/df/d34/d52/d77 0 2024-09-20T19:05:56.969 INFO:tasks.workunit.client.0.smithi027.stdout:6/296: write d4/d15/d2c/f4c [1351291,22589] 0 2024-09-20T19:05:56.970 INFO:tasks.workunit.client.0.smithi027.stdout:1/383: creat d2/d8/d2b/d2d/d3e/f6e x:0 0 0 2024-09-20T19:05:56.971 INFO:tasks.workunit.client.0.smithi027.stdout:1/384: chown d2/d8/d3b/l6c 13256 1 2024-09-20T19:05:56.972 INFO:tasks.workunit.client.1.smithi098.stdout:8/462: rename d7/fb to d7/de/d11/d19/d30/d55/d9d/fa0 0 2024-09-20T19:05:56.974 INFO:tasks.workunit.client.0.smithi027.stdout:8/405: symlink d2/d14/d13/d2e/d6c/l85 0 2024-09-20T19:05:56.977 INFO:tasks.workunit.client.0.smithi027.stdout:9/491: mknod d0/d9/df/d1c/d6a/d6d/dd/d66/c9f 0 2024-09-20T19:05:56.977 INFO:tasks.workunit.client.1.smithi098.stdout:8/463: dwrite d7/f1c [0,4194304] 0 2024-09-20T19:05:56.978 INFO:tasks.workunit.client.0.smithi027.stdout:6/297: dwrite d4/d15/d2c/f49 [0,4194304] 0 2024-09-20T19:05:56.980 INFO:tasks.workunit.client.0.smithi027.stdout:6/298: dread - d4/f41 zero size 2024-09-20T19:05:56.980 INFO:tasks.workunit.client.0.smithi027.stdout:7/326: symlink d3/d8/da/d2e/d39/l6e 0 2024-09-20T19:05:56.980 INFO:tasks.workunit.client.1.smithi098.stdout:8/464: write d7/de/d11/d1f/d57/d72/f79 [560658,112171] 0 2024-09-20T19:05:56.986 INFO:tasks.workunit.client.1.smithi098.stdout:8/465: truncate d7/f3a 1631378 0 2024-09-20T19:05:56.989 INFO:tasks.workunit.client.0.smithi027.stdout:3/377: truncate d0/f5 1891351 0 2024-09-20T19:05:56.990 INFO:tasks.workunit.client.0.smithi027.stdout:3/378: stat d0/d1/d13/d15/c4c 0 2024-09-20T19:05:56.991 INFO:tasks.workunit.client.1.smithi098.stdout:8/466: creat d7/de/d11/d19/d30/d59/d80/fa1 x:0 0 0 2024-09-20T19:05:56.996 INFO:tasks.workunit.client.0.smithi027.stdout:9/492: mkdir d0/d9/df/d1b/d9c/d4f/d8d/da0 0 2024-09-20T19:05:56.997 INFO:tasks.workunit.client.0.smithi027.stdout:7/327: symlink d3/d24/l6f 0 2024-09-20T19:05:56.998 INFO:tasks.workunit.client.1.smithi098.stdout:8/467: mkdir d7/da2 0 2024-09-20T19:05:56.998 INFO:tasks.workunit.client.0.smithi027.stdout:9/493: write d0/d9/df/f50 [390956,6724] 0 2024-09-20T19:05:56.999 INFO:tasks.workunit.client.1.smithi098.stdout:8/468: rename d7 to d7/de/d35/da3 22 2024-09-20T19:05:56.999 INFO:tasks.workunit.client.0.smithi027.stdout:9/494: chown d0/d9/df/d1b/c18 2007774 1 2024-09-20T19:05:57.000 INFO:tasks.workunit.client.0.smithi027.stdout:6/299: unlink d4/d1b/f1e 0 2024-09-20T19:05:57.002 INFO:tasks.workunit.client.1.smithi098.stdout:8/469: readlink d7/de/l18 0 2024-09-20T19:05:57.004 INFO:tasks.workunit.client.0.smithi027.stdout:5/404: rmdir d4/da/de/d3e/d69/d6a/d79 0 2024-09-20T19:05:57.006 INFO:tasks.workunit.client.0.smithi027.stdout:3/379: fsync d0/d1/f2e 0 2024-09-20T19:05:57.008 INFO:tasks.workunit.client.0.smithi027.stdout:8/406: fsync d2/d3/d1b/d36/f4c 0 2024-09-20T19:05:57.008 INFO:tasks.workunit.client.0.smithi027.stdout:6/300: dread d4/d15/d2c/f4c [0,4194304] 0 2024-09-20T19:05:57.010 INFO:tasks.workunit.client.1.smithi098.stdout:0/262: dwrite d0/d6/f16 [0,4194304] 0 2024-09-20T19:05:57.011 INFO:tasks.workunit.client.0.smithi027.stdout:6/301: write d4/d15/d37/f40 [691705,85312] 0 2024-09-20T19:05:57.015 INFO:tasks.workunit.client.0.smithi027.stdout:6/302: chown d4/d15/d2c 65 1 2024-09-20T19:05:57.016 INFO:tasks.workunit.client.1.smithi098.stdout:0/263: fdatasync d0/d6/fe 0 2024-09-20T19:05:57.016 INFO:tasks.workunit.client.0.smithi027.stdout:5/405: dwrite d4/d1f/d7f/f80 [0,4194304] 0 2024-09-20T19:05:57.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/264: stat d0/db/d1d 0 2024-09-20T19:05:57.017 INFO:tasks.workunit.client.0.smithi027.stdout:5/406: stat d4/da/d1a/c78 0 2024-09-20T19:05:57.019 INFO:tasks.workunit.client.0.smithi027.stdout:9/495: rename d0/d9/df/d1c/d6a/d6d/dd/d66/f8b to d0/d9/df/d1b/d9c/d4f/fa1 0 2024-09-20T19:05:57.020 INFO:tasks.workunit.client.1.smithi098.stdout:8/470: getdents d7/de/d11/d1f/d57/d72 0 2024-09-20T19:05:57.020 INFO:tasks.workunit.client.0.smithi027.stdout:2/311: write d3/d13/f49 [4887801,17409] 0 2024-09-20T19:05:57.024 INFO:tasks.workunit.client.1.smithi098.stdout:0/265: dwrite d0/db/d1d/f26 [0,4194304] 0 2024-09-20T19:05:57.028 INFO:tasks.workunit.client.1.smithi098.stdout:8/471: fdatasync d7/f10 0 2024-09-20T19:05:57.030 INFO:tasks.workunit.client.0.smithi027.stdout:3/380: dread d0/d19/d54/f67 [0,4194304] 0 2024-09-20T19:05:57.030 INFO:tasks.workunit.client.1.smithi098.stdout:8/472: truncate d7/de/f92 1010096 0 2024-09-20T19:05:57.030 INFO:tasks.workunit.client.0.smithi027.stdout:8/407: mkdir d2/d14/d13/d43/d5d/d86 0 2024-09-20T19:05:57.033 INFO:tasks.workunit.client.1.smithi098.stdout:0/266: dwrite d0/d15/f1e [0,4194304] 0 2024-09-20T19:05:57.033 INFO:tasks.workunit.client.1.smithi098.stdout:0/267: readlink d0/l9 0 2024-09-20T19:05:57.034 INFO:tasks.workunit.client.0.smithi027.stdout:5/407: symlink d4/da/d1a/l84 0 2024-09-20T19:05:57.037 INFO:tasks.workunit.client.1.smithi098.stdout:8/473: creat d7/de/d11/d1f/d77/fa4 x:0 0 0 2024-09-20T19:05:57.039 INFO:tasks.workunit.client.0.smithi027.stdout:6/303: rename d4/d6/f19 to d4/d15/d37/d39/f54 0 2024-09-20T19:05:57.040 INFO:tasks.workunit.client.0.smithi027.stdout:9/496: mkdir d0/d9/df/da2 0 2024-09-20T19:05:57.042 INFO:tasks.workunit.client.1.smithi098.stdout:8/474: mkdir d7/de/d11/d19/d30/d59/d80/da5 0 2024-09-20T19:05:57.043 INFO:tasks.workunit.client.0.smithi027.stdout:1/385: getdents d2/d8 0 2024-09-20T19:05:57.045 INFO:tasks.workunit.client.0.smithi027.stdout:2/312: mknod d3/d1c/d31/c5a 0 2024-09-20T19:05:57.047 INFO:tasks.workunit.client.0.smithi027.stdout:2/313: chown d3/d1c/d26 38559 1 2024-09-20T19:05:57.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/475: creat d7/de/d11/d19/d30/d59/fa6 x:0 0 0 2024-09-20T19:05:57.048 INFO:tasks.workunit.client.0.smithi027.stdout:6/304: dwrite d4/f7 [8388608,4194304] 0 2024-09-20T19:05:57.048 INFO:tasks.workunit.client.0.smithi027.stdout:2/314: stat d3/f9 0 2024-09-20T19:05:57.053 INFO:tasks.workunit.client.0.smithi027.stdout:3/381: mkdir d0/d80 0 2024-09-20T19:05:57.056 INFO:tasks.workunit.client.0.smithi027.stdout:7/328: dwrite d3/f2f [0,4194304] 0 2024-09-20T19:05:57.056 INFO:tasks.workunit.client.0.smithi027.stdout:8/408: truncate d2/d3/f41 687692 0 2024-09-20T19:05:57.057 INFO:tasks.workunit.client.1.smithi098.stdout:8/476: creat d7/de/d11/fa7 x:0 0 0 2024-09-20T19:05:57.057 INFO:tasks.workunit.client.0.smithi027.stdout:6/305: dread d4/d1b/f29 [0,4194304] 0 2024-09-20T19:05:57.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/477: fsync d7/de/d35/f5a 0 2024-09-20T19:05:57.058 INFO:tasks.workunit.client.0.smithi027.stdout:2/315: symlink d3/d1c/d26/d2a/l5b 0 2024-09-20T19:05:57.058 INFO:tasks.workunit.client.0.smithi027.stdout:6/306: dread - d4/d15/f4f zero size 2024-09-20T19:05:57.059 INFO:tasks.workunit.client.0.smithi027.stdout:6/307: stat d4/d15/l24 0 2024-09-20T19:05:57.061 INFO:tasks.workunit.client.0.smithi027.stdout:9/497: creat d0/d97/fa3 x:0 0 0 2024-09-20T19:05:57.062 INFO:tasks.workunit.client.1.smithi098.stdout:8/478: creat d7/de/d11/d19/d30/d55/fa8 x:0 0 0 2024-09-20T19:05:57.063 INFO:tasks.workunit.client.0.smithi027.stdout:9/498: write d0/d9/df/f50 [1700256,28151] 0 2024-09-20T19:05:57.064 INFO:tasks.workunit.client.0.smithi027.stdout:3/382: rename d0/c52 to d0/d38/c81 0 2024-09-20T19:05:57.065 INFO:tasks.workunit.client.0.smithi027.stdout:9/499: readlink d0/d9/df/d1c/d6a/d6d/dd/d66/d79/l85 0 2024-09-20T19:05:57.065 INFO:tasks.workunit.client.1.smithi098.stdout:8/479: mkdir d7/de/d11/d19/d30/d55/da9 0 2024-09-20T19:05:57.066 INFO:tasks.workunit.client.0.smithi027.stdout:8/409: mknod d2/d14/d13/d43/c87 0 2024-09-20T19:05:57.067 INFO:tasks.workunit.client.0.smithi027.stdout:7/329: symlink d3/d8/da/d2e/l70 0 2024-09-20T19:05:57.068 INFO:tasks.workunit.client.0.smithi027.stdout:7/330: fsync d3/d8/da/f44 0 2024-09-20T19:05:57.069 INFO:tasks.workunit.client.0.smithi027.stdout:2/316: symlink d3/d13/d3c/d48/l5c 0 2024-09-20T19:05:57.071 INFO:tasks.workunit.client.1.smithi098.stdout:8/480: rename d7/d88 to d7/de/d11/d1f/d57/daa 0 2024-09-20T19:05:57.072 INFO:tasks.workunit.client.1.smithi098.stdout:8/481: write d7/de/d11/d19/d30/d82/f8e [1608177,40161] 0 2024-09-20T19:05:57.073 INFO:tasks.workunit.client.1.smithi098.stdout:0/268: truncate d0/db/d32/f3a 257695 0 2024-09-20T19:05:57.073 INFO:tasks.workunit.client.0.smithi027.stdout:8/410: dwrite d2/d3/d6/d21/f4e [0,4194304] 0 2024-09-20T19:05:57.073 INFO:tasks.workunit.client.0.smithi027.stdout:6/308: mknod d4/d1b/c55 0 2024-09-20T19:05:57.075 INFO:tasks.workunit.client.1.smithi098.stdout:0/269: dread d0/db/d1d/f21 [4194304,4194304] 0 2024-09-20T19:05:57.080 INFO:tasks.workunit.client.1.smithi098.stdout:8/482: symlink d7/de/d11/d1f/d57/lab 0 2024-09-20T19:05:57.083 INFO:tasks.workunit.client.1.smithi098.stdout:0/270: creat d0/db/d1d/f4d x:0 0 0 2024-09-20T19:05:57.086 INFO:tasks.workunit.client.0.smithi027.stdout:3/383: truncate d0/d1/d13/f37 652701 0 2024-09-20T19:05:57.087 INFO:tasks.workunit.client.1.smithi098.stdout:0/271: dread d0/db/d1d/f26 [0,4194304] 0 2024-09-20T19:05:57.090 INFO:tasks.workunit.client.1.smithi098.stdout:8/483: creat d7/de/d11/d19/d30/d55/da9/fac x:0 0 0 2024-09-20T19:05:57.093 INFO:tasks.workunit.client.0.smithi027.stdout:2/317: creat d3/d1c/d26/d2a/f5d x:0 0 0 2024-09-20T19:05:57.094 INFO:tasks.workunit.client.0.smithi027.stdout:2/318: readlink d3/de/l2e 0 2024-09-20T19:05:57.095 INFO:tasks.workunit.client.0.smithi027.stdout:2/319: dread - d3/d1c/d26/f57 zero size 2024-09-20T19:05:57.097 INFO:tasks.workunit.client.0.smithi027.stdout:8/411: mkdir d2/d14/d13/d2e/d6c/d77/d88 0 2024-09-20T19:05:57.099 INFO:tasks.workunit.client.1.smithi098.stdout:8/484: fsync d7/de/d11/d19/d30/d55/d9d/fa0 0 2024-09-20T19:05:57.099 INFO:tasks.workunit.client.0.smithi027.stdout:7/331: dread d3/d1a/f3a [0,4194304] 0 2024-09-20T19:05:57.099 INFO:tasks.workunit.client.1.smithi098.stdout:8/485: fsync d7/de/d11/d19/f4a 0 2024-09-20T19:05:57.100 INFO:tasks.workunit.client.0.smithi027.stdout:6/309: rename d4/f52 to d4/d6/f56 0 2024-09-20T19:05:57.101 INFO:tasks.workunit.client.0.smithi027.stdout:6/310: readlink d4/d15/l21 0 2024-09-20T19:05:57.101 INFO:tasks.workunit.client.1.smithi098.stdout:8/486: truncate d7/de/d11/d19/d47/f63 4258937 0 2024-09-20T19:05:57.104 INFO:tasks.workunit.client.0.smithi027.stdout:5/408: creat d4/d1f/d28/f85 x:0 0 0 2024-09-20T19:05:57.105 INFO:tasks.workunit.client.0.smithi027.stdout:1/386: getdents d2/d8/d2b/d2d/d3e 0 2024-09-20T19:05:57.106 INFO:tasks.workunit.client.1.smithi098.stdout:8/487: mknod d7/de/d11/d19/d30/d55/d9d/cad 0 2024-09-20T19:05:57.107 INFO:tasks.workunit.client.1.smithi098.stdout:8/488: read - d7/de/d11/d19/d30/d68/f6c zero size 2024-09-20T19:05:57.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/489: chown d7/de/d11/f7a 323 1 2024-09-20T19:05:57.108 INFO:tasks.workunit.client.0.smithi027.stdout:9/500: mkdir d0/d9/df/d1b/d9c/da4 0 2024-09-20T19:05:57.109 INFO:tasks.workunit.client.1.smithi098.stdout:0/272: getdents d0/d15/d38 0 2024-09-20T19:05:57.112 INFO:tasks.workunit.client.0.smithi027.stdout:1/387: dwrite d2/d1b/f4f [0,4194304] 0 2024-09-20T19:05:57.112 INFO:tasks.workunit.client.0.smithi027.stdout:7/332: creat d3/d8/d26/f71 x:0 0 0 2024-09-20T19:05:57.113 INFO:tasks.workunit.client.0.smithi027.stdout:7/333: dread - d3/f6d zero size 2024-09-20T19:05:57.113 INFO:tasks.workunit.client.0.smithi027.stdout:6/311: unlink d4/d1b/d2b/f4e 0 2024-09-20T19:05:57.117 INFO:tasks.workunit.client.0.smithi027.stdout:9/501: unlink d0/d9/l22 0 2024-09-20T19:05:57.119 INFO:tasks.workunit.client.0.smithi027.stdout:3/384: getdents d0/d1/d13/d15/d55/d70 0 2024-09-20T19:05:57.122 INFO:tasks.workunit.client.0.smithi027.stdout:6/312: symlink d4/l57 0 2024-09-20T19:05:57.123 INFO:tasks.workunit.client.0.smithi027.stdout:5/409: unlink d4/f30 0 2024-09-20T19:05:57.123 INFO:tasks.workunit.client.0.smithi027.stdout:1/388: dwrite d2/f66 [0,4194304] 0 2024-09-20T19:05:57.126 INFO:tasks.workunit.client.0.smithi027.stdout:7/334: dwrite d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:57.127 INFO:tasks.workunit.client.0.smithi027.stdout:1/389: truncate d2/d1b/f49 856962 0 2024-09-20T19:05:57.129 INFO:tasks.workunit.client.0.smithi027.stdout:6/313: creat d4/d1b/d2b/f58 x:0 0 0 2024-09-20T19:05:57.130 INFO:tasks.workunit.client.0.smithi027.stdout:2/320: dread d3/ff [0,4194304] 0 2024-09-20T19:05:57.132 INFO:tasks.workunit.client.0.smithi027.stdout:9/502: creat d0/d9/df/d1b/d9c/d4f/d8d/da0/fa5 x:0 0 0 2024-09-20T19:05:57.133 INFO:tasks.workunit.client.0.smithi027.stdout:6/314: chown d4/d15/d2c/f49 124768 1 2024-09-20T19:05:57.133 INFO:tasks.workunit.client.0.smithi027.stdout:2/321: chown d3/d2f/f42 6858 1 2024-09-20T19:05:57.134 INFO:tasks.workunit.client.0.smithi027.stdout:6/315: readlink d4/d15/l26 0 2024-09-20T19:05:57.135 INFO:tasks.workunit.client.0.smithi027.stdout:1/390: rename d2/d8/d2b/d5e/f29 to d2/d8/d3b/f6f 0 2024-09-20T19:05:57.138 INFO:tasks.workunit.client.0.smithi027.stdout:7/335: dwrite d3/d8/d26/d45/d56/f5b [0,4194304] 0 2024-09-20T19:05:57.145 INFO:tasks.workunit.client.0.smithi027.stdout:2/322: symlink d3/d13/d3c/l5e 0 2024-09-20T19:05:57.147 INFO:tasks.workunit.client.0.smithi027.stdout:6/316: symlink d4/d1b/l59 0 2024-09-20T19:05:57.148 INFO:tasks.workunit.client.0.smithi027.stdout:6/317: fdatasync d4/d1b/f35 0 2024-09-20T19:05:57.149 INFO:tasks.workunit.client.0.smithi027.stdout:9/503: mknod d0/d9/df/d1c/d6a/d6d/ca6 0 2024-09-20T19:05:57.149 INFO:tasks.workunit.client.0.smithi027.stdout:9/504: readlink d0/d2e/l31 0 2024-09-20T19:05:57.151 INFO:tasks.workunit.client.0.smithi027.stdout:9/505: truncate d0/d9/df/f9e 654445 0 2024-09-20T19:05:57.151 INFO:tasks.workunit.client.0.smithi027.stdout:1/391: chown d2/d8/d2b/d2d/d3e/l65 282025 1 2024-09-20T19:05:57.151 INFO:tasks.workunit.client.0.smithi027.stdout:9/506: chown d0/d9/c55 197063907 1 2024-09-20T19:05:57.152 INFO:tasks.workunit.client.0.smithi027.stdout:7/336: creat d3/d8/da/d51/f72 x:0 0 0 2024-09-20T19:05:57.153 INFO:tasks.workunit.client.0.smithi027.stdout:9/507: rename d0/d9/df/d1b/d9c/da4 to d0/d9/df/d1b/d9c/da4/da7 22 2024-09-20T19:05:57.156 INFO:tasks.workunit.client.0.smithi027.stdout:9/508: write d0/d9/df/d1c/f7f [134016,57255] 0 2024-09-20T19:05:57.156 INFO:tasks.workunit.client.0.smithi027.stdout:6/318: rmdir d4 39 2024-09-20T19:05:57.157 INFO:tasks.workunit.client.0.smithi027.stdout:1/392: truncate d2/d8/f20 1676006 0 2024-09-20T19:05:57.158 INFO:tasks.workunit.client.0.smithi027.stdout:7/337: creat d3/d8/d26/f73 x:0 0 0 2024-09-20T19:05:57.160 INFO:tasks.workunit.client.0.smithi027.stdout:6/319: chown d4/d15/l48 0 1 2024-09-20T19:05:57.162 INFO:tasks.workunit.client.0.smithi027.stdout:7/338: symlink d3/d8/d1c/l74 0 2024-09-20T19:05:57.163 INFO:tasks.workunit.client.0.smithi027.stdout:2/323: rmdir d3/de/d34/d52 0 2024-09-20T19:05:57.164 INFO:tasks.workunit.client.0.smithi027.stdout:6/320: mkdir d4/d15/d37/d5a 0 2024-09-20T19:05:57.165 INFO:tasks.workunit.client.0.smithi027.stdout:9/509: mknod d0/d9/df/d1c/d6a/d6d/dd/ca8 0 2024-09-20T19:05:57.166 INFO:tasks.workunit.client.0.smithi027.stdout:5/410: dread d4/da/de/d3e/d44/f4c [0,4194304] 0 2024-09-20T19:05:57.166 INFO:tasks.workunit.client.0.smithi027.stdout:7/339: mkdir d3/d8/da/d51/d75 0 2024-09-20T19:05:57.168 INFO:tasks.workunit.client.0.smithi027.stdout:2/324: chown d3/de/f1a 0 1 2024-09-20T19:05:57.168 INFO:tasks.workunit.client.0.smithi027.stdout:9/510: symlink d0/d9/la9 0 2024-09-20T19:05:57.169 INFO:tasks.workunit.client.0.smithi027.stdout:6/321: truncate d4/d1b/d2b/d33/f4d 2109158 0 2024-09-20T19:05:57.170 INFO:tasks.workunit.client.0.smithi027.stdout:2/325: mknod d3/d1c/c5f 0 2024-09-20T19:05:57.173 INFO:tasks.workunit.client.0.smithi027.stdout:2/326: chown d3/d1c/d26/d2a/f53 131239 1 2024-09-20T19:05:57.173 INFO:tasks.workunit.client.0.smithi027.stdout:3/385: dwrite d0/d1/d13/f37 [0,4194304] 0 2024-09-20T19:05:57.175 INFO:tasks.workunit.client.0.smithi027.stdout:6/322: chown d4/d6/f2a 49492151 1 2024-09-20T19:05:57.177 INFO:tasks.workunit.client.0.smithi027.stdout:6/323: write d4/d6/fa [1692499,70660] 0 2024-09-20T19:05:57.177 INFO:tasks.workunit.client.0.smithi027.stdout:2/327: write d3/d24/f38 [3219979,42207] 0 2024-09-20T19:05:57.180 INFO:tasks.workunit.client.0.smithi027.stdout:7/340: getdents d3/d8/d26/d45/d56 0 2024-09-20T19:05:57.182 INFO:tasks.workunit.client.0.smithi027.stdout:3/386: symlink d0/d1/d13/d15/d6f/d7f/l82 0 2024-09-20T19:05:57.184 INFO:tasks.workunit.client.0.smithi027.stdout:9/511: dwrite d0/d9/df/d1c/d6a/d6d/f62 [0,4194304] 0 2024-09-20T19:05:57.184 INFO:tasks.workunit.client.0.smithi027.stdout:2/328: creat d3/d24/f60 x:0 0 0 2024-09-20T19:05:57.187 INFO:tasks.workunit.client.0.smithi027.stdout:6/324: rename d4/d6/d4b/f50 to d4/d15/d2c/f5b 0 2024-09-20T19:05:57.188 INFO:tasks.workunit.client.0.smithi027.stdout:5/411: truncate d4/da/de/f66 1996109 0 2024-09-20T19:05:57.189 INFO:tasks.workunit.client.0.smithi027.stdout:3/387: creat d0/d1/d13/d15/d6f/f83 x:0 0 0 2024-09-20T19:05:57.190 INFO:tasks.workunit.client.0.smithi027.stdout:5/412: dread - d4/da/de/d3e/d61/f7b zero size 2024-09-20T19:05:57.191 INFO:tasks.workunit.client.0.smithi027.stdout:3/388: fdatasync d0/d1/d5e/d1d/f4e 0 2024-09-20T19:05:57.192 INFO:tasks.workunit.client.0.smithi027.stdout:7/341: rmdir d3/d8/da/d51/d75 0 2024-09-20T19:05:57.193 INFO:tasks.workunit.client.0.smithi027.stdout:6/325: dread d4/d1b/f29 [0,4194304] 0 2024-09-20T19:05:57.194 INFO:tasks.workunit.client.0.smithi027.stdout:9/512: symlink d0/d9/df/d1c/d6a/d9a/laa 0 2024-09-20T19:05:57.196 INFO:tasks.workunit.client.0.smithi027.stdout:3/389: dread d0/d1/d5e/d1d/f69 [0,4194304] 0 2024-09-20T19:05:57.197 INFO:tasks.workunit.client.0.smithi027.stdout:7/342: mknod d3/d8/d26/d65/c76 0 2024-09-20T19:05:57.200 INFO:tasks.workunit.client.0.smithi027.stdout:9/513: creat d0/d9/df/d1c/d6a/d9a/fab x:0 0 0 2024-09-20T19:05:57.200 INFO:tasks.workunit.client.0.smithi027.stdout:7/343: chown d3/d1a/l4f 3221862 1 2024-09-20T19:05:57.202 INFO:tasks.workunit.client.0.smithi027.stdout:7/344: readlink d3/d24/l27 0 2024-09-20T19:05:57.202 INFO:tasks.workunit.client.0.smithi027.stdout:9/514: fdatasync d0/d9/df/d1b/f8 0 2024-09-20T19:05:57.206 INFO:tasks.workunit.client.0.smithi027.stdout:6/326: dwrite d4/f41 [0,4194304] 0 2024-09-20T19:05:57.206 INFO:tasks.workunit.client.0.smithi027.stdout:5/413: dwrite d4/da/de/d3e/d69/d75/f62 [0,4194304] 0 2024-09-20T19:05:57.206 INFO:tasks.workunit.client.0.smithi027.stdout:7/345: symlink d3/d8/da/l77 0 2024-09-20T19:05:57.207 INFO:tasks.workunit.client.0.smithi027.stdout:9/515: fdatasync d0/d9/df/d1c/d6a/d6d/dd/f29 0 2024-09-20T19:05:57.211 INFO:tasks.workunit.client.0.smithi027.stdout:6/327: chown d4/d1b/d2b/d46/d53 107968 1 2024-09-20T19:05:57.211 INFO:tasks.workunit.client.0.smithi027.stdout:3/390: dread d0/d1/d13/d15/f29 [0,4194304] 0 2024-09-20T19:05:57.213 INFO:tasks.workunit.client.0.smithi027.stdout:2/329: dread d3/d2f/f33 [0,4194304] 0 2024-09-20T19:05:57.213 INFO:tasks.workunit.client.0.smithi027.stdout:5/414: unlink d4/da/de/d3e/d61/f7b 0 2024-09-20T19:05:57.215 INFO:tasks.workunit.client.0.smithi027.stdout:9/516: write d0/d9/df/d1c/f69 [1264216,129337] 0 2024-09-20T19:05:57.216 INFO:tasks.workunit.client.0.smithi027.stdout:2/330: dread - d3/d13/f4d zero size 2024-09-20T19:05:57.220 INFO:tasks.workunit.client.0.smithi027.stdout:7/346: dwrite d3/f6d [0,4194304] 0 2024-09-20T19:05:57.220 INFO:tasks.workunit.client.0.smithi027.stdout:2/331: mknod d3/d1c/d26/d2a/c61 0 2024-09-20T19:05:57.221 INFO:tasks.workunit.client.0.smithi027.stdout:2/332: stat d3/d13/c41 0 2024-09-20T19:05:57.221 INFO:tasks.workunit.client.0.smithi027.stdout:7/347: chown d3/d8/da/d2e/d50 25342 1 2024-09-20T19:05:57.225 INFO:tasks.workunit.client.0.smithi027.stdout:2/333: creat d3/d13/d3c/d48/f62 x:0 0 0 2024-09-20T19:05:57.228 INFO:tasks.workunit.client.0.smithi027.stdout:5/415: dwrite d4/da/de/d3e/d69/d75/f62 [0,4194304] 0 2024-09-20T19:05:57.234 INFO:tasks.workunit.client.0.smithi027.stdout:7/348: getdents d3/d8/d26 0 2024-09-20T19:05:57.235 INFO:tasks.workunit.client.0.smithi027.stdout:5/416: read d4/fd [3297947,51064] 0 2024-09-20T19:05:57.237 INFO:tasks.workunit.client.0.smithi027.stdout:7/349: rmdir d3/d8/d26/d45 39 2024-09-20T19:05:57.237 INFO:tasks.workunit.client.0.smithi027.stdout:7/350: chown d3/f5 21526 1 2024-09-20T19:05:57.241 INFO:tasks.workunit.client.0.smithi027.stdout:7/351: mknod d3/d8/d26/d45/c78 0 2024-09-20T19:05:57.242 INFO:tasks.workunit.client.0.smithi027.stdout:7/352: read d3/f6d [537999,96334] 0 2024-09-20T19:05:57.242 INFO:tasks.workunit.client.0.smithi027.stdout:5/417: creat d4/f86 x:0 0 0 2024-09-20T19:05:57.245 INFO:tasks.workunit.client.0.smithi027.stdout:5/418: write d4/da/de/d3e/d69/d75/f62 [3693803,35579] 0 2024-09-20T19:05:57.246 INFO:tasks.workunit.client.0.smithi027.stdout:7/353: symlink d3/d8/l79 0 2024-09-20T19:05:57.247 INFO:tasks.workunit.client.0.smithi027.stdout:7/354: chown d3/d8/da/d2e/l70 1221058 1 2024-09-20T19:05:57.248 INFO:tasks.workunit.client.0.smithi027.stdout:5/419: mkdir d4/d7a/d87 0 2024-09-20T19:05:57.249 INFO:tasks.workunit.client.0.smithi027.stdout:6/328: write d4/d15/d37/d39/f3f [2130115,86562] 0 2024-09-20T19:05:57.251 INFO:tasks.workunit.client.0.smithi027.stdout:2/334: truncate d3/d1c/f23 1860542 0 2024-09-20T19:05:57.255 INFO:tasks.workunit.client.0.smithi027.stdout:9/517: dread d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:05:57.256 INFO:tasks.workunit.client.0.smithi027.stdout:9/518: stat d0/d9/lb 0 2024-09-20T19:05:57.256 INFO:tasks.workunit.client.0.smithi027.stdout:7/355: dwrite d3/d8/da/dc/f63 [0,4194304] 0 2024-09-20T19:05:57.260 INFO:tasks.workunit.client.0.smithi027.stdout:7/356: write d3/d8/da/d51/f53 [2511967,12083] 0 2024-09-20T19:05:57.275 INFO:tasks.workunit.client.0.smithi027.stdout:6/329: mknod d4/d6/d4b/c5c 0 2024-09-20T19:05:57.280 INFO:tasks.workunit.client.0.smithi027.stdout:5/420: fsync d4/da/de/f66 0 2024-09-20T19:05:57.280 INFO:tasks.workunit.client.0.smithi027.stdout:7/357: creat d3/d1a/f7a x:0 0 0 2024-09-20T19:05:57.281 INFO:tasks.workunit.client.0.smithi027.stdout:7/358: read d3/d8/da/d2e/f55 [121490,54552] 0 2024-09-20T19:05:57.285 INFO:tasks.workunit.client.0.smithi027.stdout:5/421: write d4/da/de/d3e/d44/f77 [1485547,84152] 0 2024-09-20T19:05:57.287 INFO:tasks.workunit.client.0.smithi027.stdout:7/359: mknod d3/d8/da/d2e/d39/c7b 0 2024-09-20T19:05:57.288 INFO:tasks.workunit.client.1.smithi098.stdout:9/455: sync 2024-09-20T19:05:57.289 INFO:tasks.workunit.client.0.smithi027.stdout:5/422: mknod d4/da/de/d3e/d61/c88 0 2024-09-20T19:05:57.289 INFO:tasks.workunit.client.0.smithi027.stdout:5/423: chown d4/d1f/d7f/c73 148059 1 2024-09-20T19:05:57.290 INFO:tasks.workunit.client.0.smithi027.stdout:7/360: symlink d3/d8/da/d51/l7c 0 2024-09-20T19:05:57.293 INFO:tasks.workunit.client.1.smithi098.stdout:9/456: dwrite d4/de/d27/d4a/d21/d25/f59 [0,4194304] 0 2024-09-20T19:05:57.294 INFO:tasks.workunit.client.0.smithi027.stdout:7/361: creat d3/d8/d26/d45/d56/f7d x:0 0 0 2024-09-20T19:05:57.297 INFO:tasks.workunit.client.1.smithi098.stdout:9/457: creat d4/de/d27/d4a/d58/f9a x:0 0 0 2024-09-20T19:05:57.299 INFO:tasks.workunit.client.0.smithi027.stdout:7/362: rename d3/f36 to d3/d1a/f7e 0 2024-09-20T19:05:57.300 INFO:tasks.workunit.client.1.smithi098.stdout:9/458: symlink d4/de/d27/d4a/d21/d25/d51/d7b/l9b 0 2024-09-20T19:05:57.301 INFO:tasks.workunit.client.0.smithi027.stdout:7/363: fdatasync d3/d8/da/d51/f72 0 2024-09-20T19:05:57.303 INFO:tasks.workunit.client.0.smithi027.stdout:7/364: chown d3/f12 4022433 1 2024-09-20T19:05:57.313 INFO:tasks.workunit.client.0.smithi027.stdout:7/365: dwrite d3/d8/da/d2e/f55 [0,4194304] 0 2024-09-20T19:05:57.314 INFO:tasks.workunit.client.0.smithi027.stdout:0/385: sync 2024-09-20T19:05:57.314 INFO:tasks.workunit.client.0.smithi027.stdout:4/276: sync 2024-09-20T19:05:57.315 INFO:tasks.workunit.client.0.smithi027.stdout:7/366: write d3/d8/d26/f3d [497590,87081] 0 2024-09-20T19:05:57.315 INFO:tasks.workunit.client.0.smithi027.stdout:4/277: stat d5/d11/d1a 0 2024-09-20T19:05:57.316 INFO:tasks.workunit.client.1.smithi098.stdout:3/349: sync 2024-09-20T19:05:57.316 INFO:tasks.workunit.client.1.smithi098.stdout:5/385: sync 2024-09-20T19:05:57.316 INFO:tasks.workunit.client.1.smithi098.stdout:4/479: sync 2024-09-20T19:05:57.316 INFO:tasks.workunit.client.1.smithi098.stdout:2/709: sync 2024-09-20T19:05:57.316 INFO:tasks.workunit.client.1.smithi098.stdout:7/497: sync 2024-09-20T19:05:57.319 INFO:tasks.workunit.client.1.smithi098.stdout:3/350: fsync d4/f1b 0 2024-09-20T19:05:57.320 INFO:tasks.workunit.client.0.smithi027.stdout:0/386: mknod d2/c86 0 2024-09-20T19:05:57.321 INFO:tasks.workunit.client.0.smithi027.stdout:0/387: chown d2/d48/d6b/d79/d84/d1b 5 1 2024-09-20T19:05:57.322 INFO:tasks.workunit.client.1.smithi098.stdout:5/386: write d1/f6b [637885,113489] 0 2024-09-20T19:05:57.323 INFO:tasks.workunit.client.0.smithi027.stdout:0/388: write d2/d48/d6b/d79/d84/d1d/d2e/f4d [205485,42352] 0 2024-09-20T19:05:57.324 INFO:tasks.workunit.client.1.smithi098.stdout:4/480: rename d3/d7d/da3/f6e to d3/d7d/fad 0 2024-09-20T19:05:57.324 INFO:tasks.workunit.client.1.smithi098.stdout:5/387: read d1/d17/f1e [810314,120826] 0 2024-09-20T19:05:57.326 INFO:tasks.workunit.client.1.smithi098.stdout:7/498: dwrite d3/d10/d16/d17/d33/d1f/f6d [0,4194304] 0 2024-09-20T19:05:57.326 INFO:tasks.workunit.client.1.smithi098.stdout:4/481: chown d3/d6/d11/l2c 1476 1 2024-09-20T19:05:57.326 INFO:tasks.workunit.client.1.smithi098.stdout:2/710: mkdir d3/d16/d1d/d2b/d46/dc0/de3 0 2024-09-20T19:05:57.328 INFO:tasks.workunit.client.0.smithi027.stdout:7/367: creat d3/d8/d26/f7f x:0 0 0 2024-09-20T19:05:57.330 INFO:tasks.workunit.client.1.smithi098.stdout:4/482: truncate d3/d6/d11/d59/d50/d58/f80 186986 0 2024-09-20T19:05:57.330 INFO:tasks.workunit.client.0.smithi027.stdout:0/389: unlink d2/c86 0 2024-09-20T19:05:57.334 INFO:tasks.workunit.client.1.smithi098.stdout:7/499: dwrite d3/d10/d16/d17/d33/d1f/d2d/f31 [0,4194304] 0 2024-09-20T19:05:57.337 INFO:tasks.workunit.client.1.smithi098.stdout:4/483: dwrite d3/d6/f34 [4194304,4194304] 0 2024-09-20T19:05:57.337 INFO:tasks.workunit.client.0.smithi027.stdout:7/368: dwrite d3/d8/da/d51/f53 [0,4194304] 0 2024-09-20T19:05:57.337 INFO:tasks.workunit.client.0.smithi027.stdout:9/519: write d0/f75 [112604,1112] 0 2024-09-20T19:05:57.338 INFO:tasks.workunit.client.0.smithi027.stdout:0/390: symlink d2/d49/d70/l87 0 2024-09-20T19:05:57.345 INFO:tasks.workunit.client.1.smithi098.stdout:7/500: dwrite d3/f6a [0,4194304] 0 2024-09-20T19:05:57.349 INFO:tasks.workunit.client.0.smithi027.stdout:0/391: readlink d2/d48/d6b/d79/d84/d1b/d39/l7f 0 2024-09-20T19:05:57.350 INFO:tasks.workunit.client.1.smithi098.stdout:7/501: rename d3/d10/d16/d17/l2b to d3/d10/d16/d17/d33/d1f/la2 0 2024-09-20T19:05:57.350 INFO:tasks.workunit.client.1.smithi098.stdout:7/502: read - d3/d76/f83 zero size 2024-09-20T19:05:57.351 INFO:tasks.workunit.client.0.smithi027.stdout:7/369: fsync d3/d8/da/d2e/d39/f4d 0 2024-09-20T19:05:57.352 INFO:tasks.workunit.client.0.smithi027.stdout:9/520: truncate d0/d9/df/d1b/d9c/d4f/f9b 603356 0 2024-09-20T19:05:57.352 INFO:tasks.workunit.client.1.smithi098.stdout:7/503: write d3/d10/d16/f79 [4585378,84107] 0 2024-09-20T19:05:57.354 INFO:tasks.workunit.client.0.smithi027.stdout:0/392: unlink d2/d20/d52/l11 0 2024-09-20T19:05:57.355 INFO:tasks.workunit.client.1.smithi098.stdout:7/504: write d3/d10/d16/d17/d33/d1f/f44 [4281317,123472] 0 2024-09-20T19:05:57.355 INFO:tasks.workunit.client.0.smithi027.stdout:2/335: dwrite d3/de/f1a [0,4194304] 0 2024-09-20T19:05:57.355 INFO:tasks.workunit.client.1.smithi098.stdout:7/505: write d3/d10/f19 [2256634,35136] 0 2024-09-20T19:05:57.357 INFO:tasks.workunit.client.1.smithi098.stdout:7/506: creat d3/d76/d86/fa3 x:0 0 0 2024-09-20T19:05:57.360 INFO:tasks.workunit.client.1.smithi098.stdout:7/507: truncate d3/d10/d16/d17/d7c/f92 795349 0 2024-09-20T19:05:57.361 INFO:tasks.workunit.client.0.smithi027.stdout:2/336: mkdir d3/d1c/d26/d2a/d63 0 2024-09-20T19:05:57.363 INFO:tasks.workunit.client.1.smithi098.stdout:7/508: creat d3/d10/d16/d73/fa4 x:0 0 0 2024-09-20T19:05:57.364 INFO:tasks.workunit.client.1.smithi098.stdout:7/509: chown d3/d10/d16/d17/d33/d4b/l62 152 1 2024-09-20T19:05:57.367 INFO:tasks.workunit.client.0.smithi027.stdout:7/370: dwrite d3/d1a/f42 [4194304,4194304] 0 2024-09-20T19:05:57.371 INFO:tasks.workunit.client.0.smithi027.stdout:0/393: link d2/d48/d6b/d79/d84/d1b/f43 d2/d48/d6b/d79/d84/d1d/f88 0 2024-09-20T19:05:57.372 INFO:tasks.workunit.client.0.smithi027.stdout:7/371: chown d3/d8/d26/f7f 121610 1 2024-09-20T19:05:57.374 INFO:tasks.workunit.client.0.smithi027.stdout:0/394: creat d2/d49/d70/f89 x:0 0 0 2024-09-20T19:05:57.376 INFO:tasks.workunit.client.0.smithi027.stdout:2/337: dread d3/d2f/f33 [0,4194304] 0 2024-09-20T19:05:57.379 INFO:tasks.workunit.client.0.smithi027.stdout:7/372: mkdir d3/d8/d1c/d80 0 2024-09-20T19:05:57.379 INFO:tasks.workunit.client.0.smithi027.stdout:0/395: read d2/d20/d52/f42 [2813530,16802] 0 2024-09-20T19:05:57.381 INFO:tasks.workunit.client.1.smithi098.stdout:5/388: dread d1/d1b/f1c [0,4194304] 0 2024-09-20T19:05:57.383 INFO:tasks.workunit.client.0.smithi027.stdout:2/338: truncate d3/d1c/d26/f57 622604 0 2024-09-20T19:05:57.385 INFO:tasks.workunit.client.0.smithi027.stdout:6/330: dwrite d4/d15/f2f [0,4194304] 0 2024-09-20T19:05:57.386 INFO:tasks.workunit.client.0.smithi027.stdout:7/373: write d3/d8/da/dc/f63 [368967,6883] 0 2024-09-20T19:05:57.389 INFO:tasks.workunit.client.0.smithi027.stdout:2/339: creat d3/de/d34/f64 x:0 0 0 2024-09-20T19:05:57.389 INFO:tasks.workunit.client.0.smithi027.stdout:2/340: stat d3/d2f 0 2024-09-20T19:05:57.390 INFO:tasks.workunit.client.0.smithi027.stdout:7/374: unlink d3/d8/d1c/l2a 0 2024-09-20T19:05:57.390 INFO:tasks.workunit.client.0.smithi027.stdout:2/341: dread - d3/de/d34/f64 zero size 2024-09-20T19:05:57.392 INFO:tasks.workunit.client.0.smithi027.stdout:0/396: rename d2/d20/c2f to d2/d48/d6b/d79/c8a 0 2024-09-20T19:05:57.394 INFO:tasks.workunit.client.0.smithi027.stdout:7/375: mknod d3/d8/da/d2e/d50/c81 0 2024-09-20T19:05:57.398 INFO:tasks.workunit.client.0.smithi027.stdout:6/331: rename d4/d15/l48 to d4/d15/d37/d5a/l5d 0 2024-09-20T19:05:57.399 INFO:tasks.workunit.client.1.smithi098.stdout:4/484: dread d3/d7d/da3/d3c/f5a [0,4194304] 0 2024-09-20T19:05:57.400 INFO:tasks.workunit.client.1.smithi098.stdout:4/485: fdatasync d3/d6/d11/d1e/f26 0 2024-09-20T19:05:57.403 INFO:tasks.workunit.client.0.smithi027.stdout:0/397: rename d2/d49/l60 to d2/d48/d6b/d79/d84/d1d/d2e/l8b 0 2024-09-20T19:05:57.404 INFO:tasks.workunit.client.0.smithi027.stdout:7/376: dwrite d3/d1a/f7a [0,4194304] 0 2024-09-20T19:05:57.405 INFO:tasks.workunit.client.1.smithi098.stdout:4/486: creat d3/d5e/fae x:0 0 0 2024-09-20T19:05:57.407 INFO:tasks.workunit.client.1.smithi098.stdout:4/487: write d3/d2e/f67 [5795357,122380] 0 2024-09-20T19:05:57.409 INFO:tasks.workunit.client.1.smithi098.stdout:4/488: fdatasync d3/d6/f13 0 2024-09-20T19:05:57.409 INFO:tasks.workunit.client.0.smithi027.stdout:6/332: dread d4/d6/fa [0,4194304] 0 2024-09-20T19:05:57.411 INFO:tasks.workunit.client.1.smithi098.stdout:9/459: dwrite d4/de/f3d [0,4194304] 0 2024-09-20T19:05:57.412 INFO:tasks.workunit.client.0.smithi027.stdout:0/398: creat d2/d48/d6b/d79/d84/d1b/f8c x:0 0 0 2024-09-20T19:05:57.412 INFO:tasks.workunit.client.0.smithi027.stdout:7/377: mknod d3/d8/d26/d45/c82 0 2024-09-20T19:05:57.413 INFO:tasks.workunit.client.0.smithi027.stdout:0/399: chown d2/d20/d52/f67 830534698 1 2024-09-20T19:05:57.414 INFO:tasks.workunit.client.0.smithi027.stdout:6/333: rmdir d4/d1b/d2b/d46 39 2024-09-20T19:05:57.416 INFO:tasks.workunit.client.1.smithi098.stdout:2/711: creat d3/fe4 x:0 0 0 2024-09-20T19:05:57.419 INFO:tasks.workunit.client.1.smithi098.stdout:9/460: rename d4/de/d27/d4a/d21/d25/d51/d7b/d7e to d4/de/d27/d4a/d58/d5b/d9c 0 2024-09-20T19:05:57.421 INFO:tasks.workunit.client.0.smithi027.stdout:6/334: dread d4/d15/d2c/f49 [0,4194304] 0 2024-09-20T19:05:57.422 INFO:tasks.workunit.client.1.smithi098.stdout:4/489: dwrite d3/f16 [4194304,4194304] 0 2024-09-20T19:05:57.422 INFO:tasks.workunit.client.0.smithi027.stdout:0/400: truncate d2/d20/d52/fd 2439371 0 2024-09-20T19:05:57.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/351: unlink d4/d19/f20 0 2024-09-20T19:05:57.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/352: fsync d4/d38/f6f 0 2024-09-20T19:05:57.425 INFO:tasks.workunit.client.1.smithi098.stdout:2/712: truncate d3/d16/d1d/d4f/d8b/d38/f95 217912 0 2024-09-20T19:05:57.426 INFO:tasks.workunit.client.1.smithi098.stdout:9/461: truncate d4/de/d27/d39/f53 549862 0 2024-09-20T19:05:57.429 INFO:tasks.workunit.client.1.smithi098.stdout:3/353: symlink d4/d38/l72 0 2024-09-20T19:05:57.430 INFO:tasks.workunit.client.1.smithi098.stdout:7/510: dread d3/d10/f19 [0,4194304] 0 2024-09-20T19:05:57.431 INFO:tasks.workunit.client.1.smithi098.stdout:7/511: rename d3 to d3/d10/d16/d17/d7c/da5 22 2024-09-20T19:05:57.431 INFO:tasks.workunit.client.0.smithi027.stdout:0/401: unlink d2/d20/d52/d51/f82 0 2024-09-20T19:05:57.433 INFO:tasks.workunit.client.0.smithi027.stdout:6/335: symlink d4/d15/l5e 0 2024-09-20T19:05:57.433 INFO:tasks.workunit.client.0.smithi027.stdout:7/378: dread d3/d8/da/d2e/f3f [0,4194304] 0 2024-09-20T19:05:57.435 INFO:tasks.workunit.client.1.smithi098.stdout:9/462: dread - d4/de/d27/d4a/d21/f50 zero size 2024-09-20T19:05:57.435 INFO:tasks.workunit.client.0.smithi027.stdout:0/402: dread d2/d20/d52/f15 [4194304,4194304] 0 2024-09-20T19:05:57.437 INFO:tasks.workunit.client.0.smithi027.stdout:6/336: symlink d4/d6/l5f 0 2024-09-20T19:05:57.438 INFO:tasks.workunit.client.1.smithi098.stdout:7/512: mkdir d3/d10/d16/d73/da6 0 2024-09-20T19:05:57.439 INFO:tasks.workunit.client.1.smithi098.stdout:7/513: fsync d3/d10/d16/f2c 0 2024-09-20T19:05:57.441 INFO:tasks.workunit.client.0.smithi027.stdout:6/337: dwrite d4/f42 [0,4194304] 0 2024-09-20T19:05:57.442 INFO:tasks.workunit.client.0.smithi027.stdout:6/338: readlink d4/l8 0 2024-09-20T19:05:57.442 INFO:tasks.workunit.client.1.smithi098.stdout:9/463: unlink d4/de/d27/f7a 0 2024-09-20T19:05:57.443 INFO:tasks.workunit.client.1.smithi098.stdout:2/713: dread d3/d16/d1d/d2b/d46/d74/f86 [0,4194304] 0 2024-09-20T19:05:57.443 INFO:tasks.workunit.client.0.smithi027.stdout:6/339: write d4/d15/d37/d39/f3f [3730931,39657] 0 2024-09-20T19:05:57.443 INFO:tasks.workunit.client.1.smithi098.stdout:2/714: fdatasync d3/db0/fba 0 2024-09-20T19:05:57.444 INFO:tasks.workunit.client.1.smithi098.stdout:9/464: write d4/de/d27/d4a/d21/f4e [478516,25772] 0 2024-09-20T19:05:57.444 INFO:tasks.workunit.client.1.smithi098.stdout:4/490: link d3/d6/f23 d3/d6/faf 0 2024-09-20T19:05:57.445 INFO:tasks.workunit.client.0.smithi027.stdout:6/340: chown d4/d1b/d2b 25337710 1 2024-09-20T19:05:57.446 INFO:tasks.workunit.client.1.smithi098.stdout:9/465: dread - d4/de/d27/d4a/d21/f50 zero size 2024-09-20T19:05:57.447 INFO:tasks.workunit.client.1.smithi098.stdout:7/514: mkdir d3/d10/d16/d73/da7 0 2024-09-20T19:05:57.448 INFO:tasks.workunit.client.0.smithi027.stdout:5/424: creat d4/f89 x:0 0 0 2024-09-20T19:05:57.449 INFO:tasks.workunit.client.1.smithi098.stdout:9/466: dread d4/de/d24/d35/f43 [0,4194304] 0 2024-09-20T19:05:57.449 INFO:tasks.workunit.client.0.smithi027.stdout:5/425: chown d4/da/c41 15 1 2024-09-20T19:05:57.452 INFO:tasks.workunit.client.1.smithi098.stdout:4/491: dwrite d3/d6/d11/d1e/f26 [4194304,4194304] 0 2024-09-20T19:05:57.453 INFO:tasks.workunit.client.1.smithi098.stdout:4/492: chown d3/d6/d11/d59/d50/f63 318 1 2024-09-20T19:05:57.454 INFO:tasks.workunit.client.1.smithi098.stdout:2/715: mkdir d3/db0/d69/d88/d8a/de5 0 2024-09-20T19:05:57.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/426: chown d4/l58 508 1 2024-09-20T19:05:57.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/427: readlink d4/da/l46 0 2024-09-20T19:05:57.461 INFO:tasks.workunit.client.0.smithi027.stdout:7/379: getdents d3/d8/d26/d45/d56 0 2024-09-20T19:05:57.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/467: creat d4/de/d27/d4a/d21/d25/d51/f9d x:0 0 0 2024-09-20T19:05:57.465 INFO:tasks.workunit.client.1.smithi098.stdout:4/493: symlink d3/d6/d11/d57/d7f/d84/lb0 0 2024-09-20T19:05:57.467 INFO:tasks.workunit.client.0.smithi027.stdout:9/521: dwrite d0/d9/df/d1c/d6a/d6d/dd/f5b [4194304,4194304] 0 2024-09-20T19:05:57.467 INFO:tasks.workunit.client.1.smithi098.stdout:2/716: mknod d3/d16/d1d/d2b/d46/d74/d7b/dcb/ce6 0 2024-09-20T19:05:57.469 INFO:tasks.workunit.client.0.smithi027.stdout:7/380: creat d3/d24/f83 x:0 0 0 2024-09-20T19:05:57.470 INFO:tasks.workunit.client.0.smithi027.stdout:5/428: mknod d4/d7a/d87/c8a 0 2024-09-20T19:05:57.471 INFO:tasks.workunit.client.1.smithi098.stdout:4/494: creat d3/d6/d5b/fb1 x:0 0 0 2024-09-20T19:05:57.472 INFO:tasks.workunit.client.1.smithi098.stdout:2/717: rmdir d3/df/d13 39 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: Standby manager daemon smithi027.tlgpqo started 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/crt"}]: dispatch 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/key"}]: dispatch 2024-09-20T19:05:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:57 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:05:57.476 INFO:tasks.workunit.client.0.smithi027.stdout:7/381: dwrite d3/d8/d1c/f47 [0,4194304] 0 2024-09-20T19:05:57.476 INFO:tasks.workunit.client.1.smithi098.stdout:7/515: rename d3/d10/d16/d73/da7 to d3/d10/d16/d17/d33/d37/da0/da8 0 2024-09-20T19:05:57.478 INFO:tasks.workunit.client.1.smithi098.stdout:7/516: write d3/d4c/f7f [2855353,109917] 0 2024-09-20T19:05:57.479 INFO:tasks.workunit.client.1.smithi098.stdout:4/495: chown d3/d6/d11/d59/c93 25996790 1 2024-09-20T19:05:57.481 INFO:tasks.workunit.client.1.smithi098.stdout:4/496: write d3/d6/f34 [3437581,58500] 0 2024-09-20T19:05:57.481 INFO:tasks.workunit.client.0.smithi027.stdout:5/429: creat d4/da/de/d3e/f8b x:0 0 0 2024-09-20T19:05:57.482 INFO:tasks.workunit.client.0.smithi027.stdout:5/430: chown d4/l58 89745 1 2024-09-20T19:05:57.485 INFO:tasks.workunit.client.1.smithi098.stdout:7/517: dwrite d3/d10/d16/f39 [0,4194304] 0 2024-09-20T19:05:57.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/718: symlink d3/d16/d1d/d2b/d99/da2/le7 0 2024-09-20T19:05:57.489 INFO:tasks.workunit.client.1.smithi098.stdout:7/518: write d3/f64 [2905302,61693] 0 2024-09-20T19:05:57.490 INFO:tasks.workunit.client.1.smithi098.stdout:4/497: dwrite d3/d7d/da3/f56 [0,4194304] 0 2024-09-20T19:05:57.490 INFO:tasks.workunit.client.0.smithi027.stdout:7/382: mkdir d3/d24/d84 0 2024-09-20T19:05:57.492 INFO:tasks.workunit.client.1.smithi098.stdout:4/498: dread d3/d6/d11/d1e/f54 [0,4194304] 0 2024-09-20T19:05:57.492 INFO:tasks.workunit.client.1.smithi098.stdout:4/499: fdatasync d3/d6/d11/fa1 0 2024-09-20T19:05:57.495 INFO:tasks.workunit.client.0.smithi027.stdout:7/383: rmdir d3 39 2024-09-20T19:05:57.500 INFO:tasks.workunit.client.1.smithi098.stdout:2/719: mknod d3/d16/d1d/d2b/d46/ce8 0 2024-09-20T19:05:57.500 INFO:tasks.workunit.client.0.smithi027.stdout:5/431: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:05:57.501 INFO:tasks.workunit.client.1.smithi098.stdout:7/519: creat d3/d10/d16/d73/fa9 x:0 0 0 2024-09-20T19:05:57.502 INFO:tasks.workunit.client.0.smithi027.stdout:5/432: fsync d4/da/de/d3e/d44/f76 0 2024-09-20T19:05:57.503 INFO:tasks.workunit.client.1.smithi098.stdout:7/520: write d3/d10/d16/d17/d33/d1f/f44 [2856225,107272] 0 2024-09-20T19:05:57.504 INFO:tasks.workunit.client.1.smithi098.stdout:9/468: rename d4/de/d27/d39 to d4/de/d27/d4a/d58/d5b/d8f/d9e 0 2024-09-20T19:05:57.507 INFO:tasks.workunit.client.1.smithi098.stdout:2/720: symlink d3/d51/d68/le9 0 2024-09-20T19:05:57.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/500: dwrite d3/d6/d11/d1e/f54 [0,4194304] 0 2024-09-20T19:05:57.512 INFO:tasks.workunit.client.0.smithi027.stdout:7/384: rename d3/d8/d1c/c25 to d3/d8/da/dc/c85 0 2024-09-20T19:05:57.512 INFO:tasks.workunit.client.1.smithi098.stdout:4/501: fdatasync d3/d6/d11/d59/d50/f53 0 2024-09-20T19:05:57.513 INFO:tasks.workunit.client.1.smithi098.stdout:4/502: stat d3/d6/d11/d1e/f54 0 2024-09-20T19:05:57.515 INFO:tasks.workunit.client.1.smithi098.stdout:2/721: dwrite d3/f3c [0,4194304] 0 2024-09-20T19:05:57.516 INFO:tasks.workunit.client.1.smithi098.stdout:4/503: chown d3/d6/d11/l31 70921369 1 2024-09-20T19:05:57.517 INFO:tasks.workunit.client.1.smithi098.stdout:4/504: fdatasync d3/d6/d11/d59/d50/f75 0 2024-09-20T19:05:57.521 INFO:tasks.workunit.client.0.smithi027.stdout:7/385: unlink d3/d1a/f7e 0 2024-09-20T19:05:57.521 INFO:tasks.workunit.client.0.smithi027.stdout:0/403: truncate d2/d48/d6b/d79/d84/d1b/f75 265093 0 2024-09-20T19:05:57.524 INFO:tasks.workunit.client.1.smithi098.stdout:7/521: mkdir d3/daa 0 2024-09-20T19:05:57.526 INFO:tasks.workunit.client.0.smithi027.stdout:8/412: sync 2024-09-20T19:05:57.527 INFO:tasks.workunit.client.0.smithi027.stdout:7/386: creat d3/d8/da/d2e/d50/f86 x:0 0 0 2024-09-20T19:05:57.528 INFO:tasks.workunit.client.0.smithi027.stdout:7/387: fsync d3/d8/d26/f71 0 2024-09-20T19:05:57.528 INFO:tasks.workunit.client.0.smithi027.stdout:7/388: chown d3/d1a/l4f 5587416 1 2024-09-20T19:05:57.529 INFO:tasks.workunit.client.0.smithi027.stdout:7/389: write d3/d8/da/d2e/d39/f3b [1841100,39455] 0 2024-09-20T19:05:57.531 INFO:tasks.workunit.client.1.smithi098.stdout:9/469: creat d4/de/d24/d35/d6d/d78/f9f x:0 0 0 2024-09-20T19:05:57.532 INFO:tasks.workunit.client.0.smithi027.stdout:0/404: unlink d2/d48/d6b/d79/d84/d1d/d2e/l73 0 2024-09-20T19:05:57.533 INFO:tasks.workunit.client.1.smithi098.stdout:7/522: dwrite d3/d10/d16/d17/d7c/f92 [0,4194304] 0 2024-09-20T19:05:57.535 INFO:tasks.workunit.client.1.smithi098.stdout:9/470: dread - d4/de/d27/d4a/d21/d25/d51/f9d zero size 2024-09-20T19:05:57.537 INFO:tasks.workunit.client.0.smithi027.stdout:8/413: symlink d2/d14/d13/d2e/d6c/l89 0 2024-09-20T19:05:57.538 INFO:tasks.workunit.client.0.smithi027.stdout:6/341: dwrite d4/d6/f2a [0,4194304] 0 2024-09-20T19:05:57.539 INFO:tasks.workunit.client.1.smithi098.stdout:7/523: chown d3/d10/d16/d17/d33/l56 13902386 1 2024-09-20T19:05:57.543 INFO:tasks.workunit.client.1.smithi098.stdout:7/524: chown d3/d10/d16/d17/d33/d37/da0/f63 21 1 2024-09-20T19:05:57.544 INFO:tasks.workunit.client.0.smithi027.stdout:7/390: creat d3/d8/da/dc/f87 x:0 0 0 2024-09-20T19:05:57.546 INFO:tasks.workunit.client.0.smithi027.stdout:7/391: truncate d3/d8/da/f4e 4268145 0 2024-09-20T19:05:57.546 INFO:tasks.workunit.client.1.smithi098.stdout:4/505: rename d3/d6/da4 to d3/d6/d11/d59/d50/db2 0 2024-09-20T19:05:57.547 INFO:tasks.workunit.client.0.smithi027.stdout:0/405: mknod d2/d48/c8d 0 2024-09-20T19:05:57.548 INFO:tasks.workunit.client.1.smithi098.stdout:4/506: chown d3/d6/d11/d57 496110 1 2024-09-20T19:05:57.548 INFO:tasks.workunit.client.0.smithi027.stdout:9/522: read d0/f42 [930081,128220] 0 2024-09-20T19:05:57.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/507: chown d3/d6/f32 729996 1 2024-09-20T19:05:57.550 INFO:tasks.workunit.client.0.smithi027.stdout:0/406: read d2/f19 [20754,123869] 0 2024-09-20T19:05:57.552 INFO:tasks.workunit.client.0.smithi027.stdout:9/523: write d0/d9/df/d1b/d9c/d4f/d8d/da0/fa5 [829885,36476] 0 2024-09-20T19:05:57.552 INFO:tasks.workunit.client.0.smithi027.stdout:7/392: dread d3/d8/da/d51/f53 [0,4194304] 0 2024-09-20T19:05:57.552 INFO:tasks.workunit.client.1.smithi098.stdout:2/722: creat d3/d16/d1d/d2b/d46/dc0/de3/fea x:0 0 0 2024-09-20T19:05:57.553 INFO:tasks.workunit.client.0.smithi027.stdout:7/393: read - d3/d8/da/d2e/d39/f4d zero size 2024-09-20T19:05:57.553 INFO:tasks.workunit.client.1.smithi098.stdout:9/471: dread d4/de/d24/f8b [0,4194304] 0 2024-09-20T19:05:57.554 INFO:tasks.workunit.client.1.smithi098.stdout:5/389: write d1/f2 [1367447,41229] 0 2024-09-20T19:05:57.555 INFO:tasks.workunit.client.1.smithi098.stdout:5/390: dread - d1/d46/d69/f6d zero size 2024-09-20T19:05:57.564 INFO:tasks.workunit.client.1.smithi098.stdout:2/723: symlink d3/d16/d1d/d2b/d46/dc0/de3/leb 0 2024-09-20T19:05:57.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/724: stat d3/d16/d1d/d2b/fd2 0 2024-09-20T19:05:57.565 INFO:tasks.workunit.client.0.smithi027.stdout:9/524: write d0/d9/df/f2a [5008600,26722] 0 2024-09-20T19:05:57.566 INFO:tasks.workunit.client.0.smithi027.stdout:9/525: write d0/f5 [4660432,39082] 0 2024-09-20T19:05:57.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/725: readlink d3/d16/d1d/d2b/d46/d74/d82/la9 0 2024-09-20T19:05:57.568 INFO:tasks.workunit.client.1.smithi098.stdout:2/726: write d3/d16/d1d/db5/fe0 [742514,65015] 0 2024-09-20T19:05:57.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:57.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: Standby manager daemon smithi027.tlgpqo started 2024-09-20T19:05:57.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/crt"}]: dispatch 2024-09-20T19:05:57.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:05:57.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/key"}]: dispatch 2024-09-20T19:05:57.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:57 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3793652662' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:05:57.571 INFO:tasks.workunit.client.0.smithi027.stdout:6/342: rename d4/d6/l1a to d4/d1b/d2b/d46/d53/l60 0 2024-09-20T19:05:57.572 INFO:tasks.workunit.client.0.smithi027.stdout:5/433: write d4/da/de/f37 [1717592,52395] 0 2024-09-20T19:05:57.573 INFO:tasks.workunit.client.0.smithi027.stdout:9/526: dwrite d0/d2e/f34 [0,4194304] 0 2024-09-20T19:05:57.574 INFO:tasks.workunit.client.0.smithi027.stdout:5/434: chown d4/da/de/f66 274601 1 2024-09-20T19:05:57.576 INFO:tasks.workunit.client.0.smithi027.stdout:7/394: write d3/d8/d26/f4a [1246388,40690] 0 2024-09-20T19:05:57.578 INFO:tasks.workunit.client.1.smithi098.stdout:5/391: dwrite d1/d17/d25/f58 [0,4194304] 0 2024-09-20T19:05:57.583 INFO:tasks.workunit.client.0.smithi027.stdout:5/435: dwrite d4/f43 [0,4194304] 0 2024-09-20T19:05:57.585 INFO:tasks.workunit.client.1.smithi098.stdout:7/525: link d3/d10/d16/d17/d33/d1f/d28/d7d/c5e d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/cab 0 2024-09-20T19:05:57.591 INFO:tasks.workunit.client.1.smithi098.stdout:5/392: readlink d1/l22 0 2024-09-20T19:05:57.595 INFO:tasks.workunit.client.1.smithi098.stdout:4/508: rename d3/d6/d11/d59 to d3/d7d/da3/d3c/d6b/d73/d98/db3 0 2024-09-20T19:05:57.599 INFO:tasks.workunit.client.1.smithi098.stdout:2/727: link d3/d16/d1d/d2b/d46/dc0/cdd d3/d16/d1d/d4f/cec 0 2024-09-20T19:05:57.600 INFO:tasks.workunit.client.1.smithi098.stdout:2/728: chown d3/d16/d1d/d2b/d46/dc0/de3/leb 3 1 2024-09-20T19:05:57.602 INFO:tasks.workunit.client.0.smithi027.stdout:7/395: write d3/f6d [1547078,23057] 0 2024-09-20T19:05:57.605 INFO:tasks.workunit.client.0.smithi027.stdout:5/436: creat d4/da/de/d3e/d69/d6a/f8c x:0 0 0 2024-09-20T19:05:57.605 INFO:tasks.workunit.client.1.smithi098.stdout:4/509: symlink d3/d7d/da3/d3c/lb4 0 2024-09-20T19:05:57.606 INFO:tasks.workunit.client.1.smithi098.stdout:9/472: write d4/de/d27/d4a/d21/d25/f26 [4812047,31109] 0 2024-09-20T19:05:57.607 INFO:tasks.workunit.client.0.smithi027.stdout:5/437: fdatasync d4/d1f/d28/f3f 0 2024-09-20T19:05:57.607 INFO:tasks.workunit.client.0.smithi027.stdout:0/407: link d2/d48/d6b/d79/d84/d1b/d39/f74 d2/d20/d52/d51/f8e 0 2024-09-20T19:05:57.607 INFO:tasks.workunit.client.1.smithi098.stdout:4/510: write d3/d6/d11/d1e/f26 [562223,23743] 0 2024-09-20T19:05:57.608 INFO:tasks.workunit.client.1.smithi098.stdout:2/729: fsync d3/d16/d1d/d2b/d46/d74/f86 0 2024-09-20T19:05:57.611 INFO:tasks.workunit.client.1.smithi098.stdout:9/473: dread d4/de/f3f [0,4194304] 0 2024-09-20T19:05:57.612 INFO:tasks.workunit.client.0.smithi027.stdout:8/414: dwrite d2/d3/f31 [0,4194304] 0 2024-09-20T19:05:57.612 INFO:tasks.workunit.client.0.smithi027.stdout:6/343: truncate d4/f9 2649509 0 2024-09-20T19:05:57.613 INFO:tasks.workunit.client.0.smithi027.stdout:7/396: dwrite d3/d8/da/f28 [0,4194304] 0 2024-09-20T19:05:57.614 INFO:tasks.workunit.client.0.smithi027.stdout:9/527: creat d0/d9/df/d1b/d9c/da4/fac x:0 0 0 2024-09-20T19:05:57.620 INFO:tasks.workunit.client.1.smithi098.stdout:5/393: write d1/f33 [617581,92608] 0 2024-09-20T19:05:57.620 INFO:tasks.workunit.client.0.smithi027.stdout:0/408: dread d2/d48/d6b/d79/d84/f3f [0,4194304] 0 2024-09-20T19:05:57.621 INFO:tasks.workunit.client.0.smithi027.stdout:9/528: write d0/d9/df/d1b/d9c/d4f/d8d/da0/fa5 [138497,45867] 0 2024-09-20T19:05:57.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/730: mkdir d3/d16/d1a/ded 0 2024-09-20T19:05:57.623 INFO:tasks.workunit.client.0.smithi027.stdout:5/438: dwrite d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:05:57.624 INFO:tasks.workunit.client.1.smithi098.stdout:2/731: chown d3/fa 0 1 2024-09-20T19:05:57.625 INFO:tasks.workunit.client.0.smithi027.stdout:0/409: chown d2/d48/d6b/d79/d84/d1b/f5f 24029927 1 2024-09-20T19:05:57.626 INFO:tasks.workunit.client.0.smithi027.stdout:8/415: dwrite d2/f39 [4194304,4194304] 0 2024-09-20T19:05:57.628 INFO:tasks.workunit.client.1.smithi098.stdout:9/474: rename d4/de/c33 to d4/de/d27/d4a/d58/d81/ca0 0 2024-09-20T19:05:57.629 INFO:tasks.workunit.client.0.smithi027.stdout:0/410: stat d2/d49/d70 0 2024-09-20T19:05:57.629 INFO:tasks.workunit.client.0.smithi027.stdout:9/529: dread - d0/d9/df/d1c/d6a/d6d/dd/d66/f89 zero size 2024-09-20T19:05:57.629 INFO:tasks.workunit.client.0.smithi027.stdout:8/416: truncate d2/d65/f4f 718157 0 2024-09-20T19:05:57.630 INFO:tasks.workunit.client.0.smithi027.stdout:5/439: write d4/da/de/d3e/f8b [938141,10575] 0 2024-09-20T19:05:57.631 INFO:tasks.workunit.client.0.smithi027.stdout:5/440: chown d4/da/de/d3e 5 1 2024-09-20T19:05:57.635 INFO:tasks.workunit.client.1.smithi098.stdout:5/394: dread - d1/d1b/d40/f4c zero size 2024-09-20T19:05:57.636 INFO:tasks.workunit.client.1.smithi098.stdout:5/395: fsync d1/d17/d25/f43 0 2024-09-20T19:05:57.637 INFO:tasks.workunit.client.0.smithi027.stdout:0/411: rmdir d2/d20 39 2024-09-20T19:05:57.638 INFO:tasks.workunit.client.1.smithi098.stdout:4/511: creat d3/d6/d11/fb5 x:0 0 0 2024-09-20T19:05:57.639 INFO:tasks.workunit.client.0.smithi027.stdout:0/412: fdatasync d2/d48/d6b/d79/d84/d1d/f6c 0 2024-09-20T19:05:57.640 INFO:tasks.workunit.client.1.smithi098.stdout:2/732: creat d3/d16/d1a/ded/fee x:0 0 0 2024-09-20T19:05:57.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/396: mkdir d1/d17/d25/d79 0 2024-09-20T19:05:57.643 INFO:tasks.workunit.client.1.smithi098.stdout:4/512: dread d3/d6/d11/d57/d7f/f8b [0,4194304] 0 2024-09-20T19:05:57.644 INFO:tasks.workunit.client.1.smithi098.stdout:5/397: write d1/d17/d35/f41 [575034,98481] 0 2024-09-20T19:05:57.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/475: getdents d4/de/d24/d35/d6d/d78 0 2024-09-20T19:05:57.650 INFO:tasks.workunit.client.0.smithi027.stdout:0/413: symlink d2/d20/d52/l8f 0 2024-09-20T19:05:57.652 INFO:tasks.workunit.client.0.smithi027.stdout:9/530: getdents d0/d9 0 2024-09-20T19:05:57.652 INFO:tasks.workunit.client.0.smithi027.stdout:8/417: getdents d2/d14/d13/d43/d5d 0 2024-09-20T19:05:57.652 INFO:tasks.workunit.client.0.smithi027.stdout:0/414: write d2/d20/d52/d51/f7a [1425312,45586] 0 2024-09-20T19:05:57.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/398: rmdir d1/d17/d59 0 2024-09-20T19:05:57.654 INFO:tasks.workunit.client.1.smithi098.stdout:4/513: dread d3/d6/f23 [0,4194304] 0 2024-09-20T19:05:57.655 INFO:tasks.workunit.client.1.smithi098.stdout:5/399: stat d1/fc 0 2024-09-20T19:05:57.655 INFO:tasks.workunit.client.0.smithi027.stdout:9/531: creat d0/d9/df/d1b/fad x:0 0 0 2024-09-20T19:05:57.656 INFO:tasks.workunit.client.1.smithi098.stdout:4/514: write d3/d6/f13 [2148116,57938] 0 2024-09-20T19:05:57.658 INFO:tasks.workunit.client.0.smithi027.stdout:9/532: read d0/d9/df/d1c/d6a/d6d/dd/d66/f86 [3309856,125718] 0 2024-09-20T19:05:57.658 INFO:tasks.workunit.client.0.smithi027.stdout:0/415: symlink d2/d48/d6b/d79/d84/l90 0 2024-09-20T19:05:57.661 INFO:tasks.workunit.client.1.smithi098.stdout:4/515: creat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/fb6 x:0 0 0 2024-09-20T19:05:57.673 INFO:tasks.workunit.client.1.smithi098.stdout:9/476: dread d4/f8 [0,4194304] 0 2024-09-20T19:05:57.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/477: dwrite d4/de/d48/f4d [0,4194304] 0 2024-09-20T19:05:57.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/478: chown d4/de/d27 998 1 2024-09-20T19:05:57.684 INFO:tasks.workunit.client.0.smithi027.stdout:8/418: dread d2/d3/d1b/d36/f4c [0,4194304] 0 2024-09-20T19:05:57.686 INFO:tasks.workunit.client.0.smithi027.stdout:8/419: write d2/d3/d6/d21/f38 [2166261,36886] 0 2024-09-20T19:05:57.687 INFO:tasks.workunit.client.0.smithi027.stdout:8/420: fdatasync d2/d14/f3f 0 2024-09-20T19:05:57.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/289: sync 2024-09-20T19:05:57.689 INFO:tasks.workunit.client.0.smithi027.stdout:0/416: symlink d2/d20/l91 0 2024-09-20T19:05:57.690 INFO:tasks.workunit.client.0.smithi027.stdout:6/344: write d4/d6/f11 [1652216,8294] 0 2024-09-20T19:05:57.696 INFO:tasks.workunit.client.0.smithi027.stdout:7/397: truncate d3/d8/da/d2e/f3f 2739888 0 2024-09-20T19:05:57.697 INFO:tasks.workunit.client.0.smithi027.stdout:7/398: fsync d3/d8/da/f46 0 2024-09-20T19:05:57.697 INFO:tasks.workunit.client.1.smithi098.stdout:4/516: unlink d3/f36 0 2024-09-20T19:05:57.698 INFO:tasks.workunit.client.0.smithi027.stdout:8/421: creat d2/d14/d13/d2e/d6c/d77/f8a x:0 0 0 2024-09-20T19:05:57.699 INFO:tasks.workunit.client.0.smithi027.stdout:8/422: readlink d2/d14/d13/d51/l7e 0 2024-09-20T19:05:57.699 INFO:tasks.workunit.client.1.smithi098.stdout:2/733: dwrite d3/d16/d1d/d4f/d8b/d38/fc2 [0,4194304] 0 2024-09-20T19:05:57.700 INFO:tasks.workunit.client.0.smithi027.stdout:0/417: mknod d2/d49/d70/c92 0 2024-09-20T19:05:57.702 INFO:tasks.workunit.client.1.smithi098.stdout:6/290: symlink d0/de/d1b/l54 0 2024-09-20T19:05:57.703 INFO:tasks.workunit.client.1.smithi098.stdout:6/291: stat d0/de/d1b/d37/f4b 0 2024-09-20T19:05:57.704 INFO:tasks.workunit.client.0.smithi027.stdout:6/345: symlink d4/d1b/d2b/d46/l61 0 2024-09-20T19:05:57.705 INFO:tasks.workunit.client.1.smithi098.stdout:5/400: write d1/d17/f19 [3172970,14692] 0 2024-09-20T19:05:57.708 INFO:tasks.workunit.client.0.smithi027.stdout:9/533: write d0/fa [38308,117228] 0 2024-09-20T19:05:57.710 INFO:tasks.workunit.client.0.smithi027.stdout:9/534: chown d0/d9/df/d1b/d9c/d4f 20 1 2024-09-20T19:05:57.710 INFO:tasks.workunit.client.1.smithi098.stdout:6/292: fsync d0/de/d1b/d37/d44/dc/fd 0 2024-09-20T19:05:57.711 INFO:tasks.workunit.client.0.smithi027.stdout:8/423: creat d2/d3/d6/d6d/f8b x:0 0 0 2024-09-20T19:05:57.712 INFO:tasks.workunit.client.0.smithi027.stdout:8/424: chown d2/d14/d13/f3b 8489604 1 2024-09-20T19:05:57.713 INFO:tasks.workunit.client.1.smithi098.stdout:4/517: dwrite d3/f7 [0,4194304] 0 2024-09-20T19:05:57.714 INFO:tasks.workunit.client.1.smithi098.stdout:5/401: mknod d1/d1b/d40/c7a 0 2024-09-20T19:05:57.720 INFO:tasks.workunit.client.1.smithi098.stdout:9/479: dwrite d4/de/d24/f8b [0,4194304] 0 2024-09-20T19:05:57.721 INFO:tasks.workunit.client.0.smithi027.stdout:9/535: unlink d0/f5 0 2024-09-20T19:05:57.721 INFO:tasks.workunit.client.0.smithi027.stdout:1/393: sync 2024-09-20T19:05:57.722 INFO:tasks.workunit.client.1.smithi098.stdout:4/518: creat d3/d5e/d9f/fb7 x:0 0 0 2024-09-20T19:05:57.723 INFO:tasks.workunit.client.1.smithi098.stdout:9/480: read d4/de/d24/d35/f32 [364366,97156] 0 2024-09-20T19:05:57.725 INFO:tasks.workunit.client.1.smithi098.stdout:5/402: chown d1/d17/d35/f6a 456830 1 2024-09-20T19:05:57.727 INFO:tasks.workunit.client.0.smithi027.stdout:0/418: mknod d2/d20/d52/c93 0 2024-09-20T19:05:57.729 INFO:tasks.workunit.client.0.smithi027.stdout:7/399: write d3/d8/da/d2e/f55 [4831658,116838] 0 2024-09-20T19:05:57.729 INFO:tasks.workunit.client.0.smithi027.stdout:0/419: chown d2/d48/d6b/d79/d84/l90 6067097 1 2024-09-20T19:05:57.731 INFO:tasks.workunit.client.0.smithi027.stdout:7/400: write d3/d8/da/f28 [3319168,104280] 0 2024-09-20T19:05:57.733 INFO:tasks.workunit.client.0.smithi027.stdout:9/536: symlink d0/d9/df/d1b/d9c/da4/lae 0 2024-09-20T19:05:57.734 INFO:tasks.workunit.client.1.smithi098.stdout:4/519: symlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/db2/lb8 0 2024-09-20T19:05:57.734 INFO:tasks.workunit.client.1.smithi098.stdout:6/293: write d0/de/d1b/d37/d44/dc/f1a [3596078,68776] 0 2024-09-20T19:05:57.736 INFO:tasks.workunit.client.1.smithi098.stdout:4/520: write d3/d6/d5b/fb1 [719644,57252] 0 2024-09-20T19:05:57.736 INFO:tasks.workunit.client.1.smithi098.stdout:9/481: fdatasync f3 0 2024-09-20T19:05:57.737 INFO:tasks.workunit.client.0.smithi027.stdout:9/537: dread - d0/d9/df/d1b/d9c/da4/fac zero size 2024-09-20T19:05:57.738 INFO:tasks.workunit.client.1.smithi098.stdout:9/482: chown d4/de/d27/d4a/d58/d5b/d8f/d9e 6523624 1 2024-09-20T19:05:57.740 INFO:tasks.workunit.client.0.smithi027.stdout:6/346: dwrite d4/d1b/f29 [0,4194304] 0 2024-09-20T19:05:57.741 INFO:tasks.workunit.client.0.smithi027.stdout:0/420: creat d2/d48/d6b/d79/f94 x:0 0 0 2024-09-20T19:05:57.741 INFO:tasks.workunit.client.0.smithi027.stdout:7/401: dwrite d3/d8/d26/d45/d56/f64 [0,4194304] 0 2024-09-20T19:05:57.741 INFO:tasks.workunit.client.1.smithi098.stdout:2/734: dread d3/db0/f57 [0,4194304] 0 2024-09-20T19:05:57.742 INFO:tasks.workunit.client.1.smithi098.stdout:6/294: fsync d0/de/f18 0 2024-09-20T19:05:57.742 INFO:tasks.workunit.client.0.smithi027.stdout:0/421: chown d2/d20/l91 5716687 1 2024-09-20T19:05:57.743 INFO:tasks.workunit.client.0.smithi027.stdout:5/441: sync 2024-09-20T19:05:57.743 INFO:tasks.workunit.client.0.smithi027.stdout:3/391: sync 2024-09-20T19:05:57.744 INFO:tasks.workunit.client.0.smithi027.stdout:6/347: dread - d4/d1b/f3d zero size 2024-09-20T19:05:57.744 INFO:tasks.workunit.client.0.smithi027.stdout:4/278: sync 2024-09-20T19:05:57.744 INFO:tasks.workunit.client.0.smithi027.stdout:2/342: sync 2024-09-20T19:05:57.744 INFO:tasks.workunit.client.0.smithi027.stdout:1/394: link d2/f66 d2/d8/f70 0 2024-09-20T19:05:57.745 INFO:tasks.workunit.client.1.smithi098.stdout:6/295: chown d0/c3c 667 1 2024-09-20T19:05:57.748 INFO:tasks.workunit.client.1.smithi098.stdout:5/403: dwrite d1/d46/d69/f6d [0,4194304] 0 2024-09-20T19:05:57.749 INFO:tasks.workunit.client.0.smithi027.stdout:7/402: dwrite d3/d24/f83 [0,4194304] 0 2024-09-20T19:05:57.750 INFO:tasks.workunit.client.1.smithi098.stdout:6/296: write d0/de/d1b/d37/d44/dc/f1a [793495,58887] 0 2024-09-20T19:05:57.751 INFO:tasks.workunit.client.1.smithi098.stdout:4/521: dread d3/d6/f32 [0,4194304] 0 2024-09-20T19:05:57.758 INFO:tasks.workunit.client.1.smithi098.stdout:2/735: mkdir d3/d16/d1d/d2b/d99/def 0 2024-09-20T19:05:57.759 INFO:tasks.workunit.client.0.smithi027.stdout:9/538: unlink d0/d9/df/d1c/d6a/d9a/laa 0 2024-09-20T19:05:57.762 INFO:tasks.workunit.client.0.smithi027.stdout:6/348: mkdir d4/d1b/d62 0 2024-09-20T19:05:57.763 INFO:tasks.workunit.client.1.smithi098.stdout:5/404: readlink d1/d17/d35/d54/d68/l72 0 2024-09-20T19:05:57.763 INFO:tasks.workunit.client.0.smithi027.stdout:6/349: write d4/d6/f11 [1018990,117347] 0 2024-09-20T19:05:57.765 INFO:tasks.workunit.client.1.smithi098.stdout:4/522: creat d3/d2e/fb9 x:0 0 0 2024-09-20T19:05:57.765 INFO:tasks.workunit.client.1.smithi098.stdout:4/523: chown d3/d2e/fb9 30374894 1 2024-09-20T19:05:57.766 INFO:tasks.workunit.client.0.smithi027.stdout:8/425: getdents d2/d3/d1b/d36 0 2024-09-20T19:05:57.766 INFO:tasks.workunit.client.1.smithi098.stdout:4/524: chown d3/d6/d11 444506 1 2024-09-20T19:05:57.767 INFO:tasks.workunit.client.1.smithi098.stdout:9/483: creat d4/de/d24/fa1 x:0 0 0 2024-09-20T19:05:57.767 INFO:tasks.workunit.client.0.smithi027.stdout:0/422: symlink d2/d48/d6b/d79/d84/d1d/l95 0 2024-09-20T19:05:57.768 INFO:tasks.workunit.client.0.smithi027.stdout:3/392: truncate d0/d1/f3f 399227 0 2024-09-20T19:05:57.768 INFO:tasks.workunit.client.0.smithi027.stdout:3/393: stat d0/d1/d13/l6d 0 2024-09-20T19:05:57.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/525: symlink d3/d5e/lba 0 2024-09-20T19:05:57.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/526: stat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d 0 2024-09-20T19:05:57.772 INFO:tasks.workunit.client.0.smithi027.stdout:4/279: rename d5/fe to d5/d13/d16/d21/d3a/f5e 0 2024-09-20T19:05:57.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/736: symlink d3/db0/d69/lf0 0 2024-09-20T19:05:57.773 INFO:tasks.workunit.client.0.smithi027.stdout:4/280: write d5/d11/d17/d1b/f2b [510457,43849] 0 2024-09-20T19:05:57.774 INFO:tasks.workunit.client.0.smithi027.stdout:9/539: mknod d0/d9/df/d1b/caf 0 2024-09-20T19:05:57.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/737: truncate d3/d16/d1d/d2b/d46/d74/d82/f93 5137351 0 2024-09-20T19:05:57.776 INFO:tasks.workunit.client.0.smithi027.stdout:1/395: mkdir d2/d1b/d56/d71 0 2024-09-20T19:05:57.776 INFO:tasks.workunit.client.1.smithi098.stdout:4/527: mknod d3/cbb 0 2024-09-20T19:05:57.778 INFO:tasks.workunit.client.0.smithi027.stdout:0/423: mknod d2/d48/d6b/d79/d84/d1d/d2e/c96 0 2024-09-20T19:05:57.779 INFO:tasks.workunit.client.0.smithi027.stdout:3/394: rename d0/f5a to d0/d1/d5e/d1d/f84 0 2024-09-20T19:05:57.781 INFO:tasks.workunit.client.0.smithi027.stdout:3/395: chown d0/d1/d13/d15/d6f/l74 31492 1 2024-09-20T19:05:57.781 INFO:tasks.workunit.client.1.smithi098.stdout:4/528: creat d3/d6/d11/d1e/d2a/d45/fbc x:0 0 0 2024-09-20T19:05:57.782 INFO:tasks.workunit.client.0.smithi027.stdout:3/396: truncate d0/d1/d13/d15/d55/f72 455179 0 2024-09-20T19:05:57.782 INFO:tasks.workunit.client.1.smithi098.stdout:2/738: link d3/d16/d1d/db5/lb6 d3/db0/d69/d88/d8a/de5/lf1 0 2024-09-20T19:05:57.784 INFO:tasks.workunit.client.0.smithi027.stdout:8/426: symlink d2/d14/d13/d2e/d6c/d77/d88/l8c 0 2024-09-20T19:05:57.784 INFO:tasks.workunit.client.1.smithi098.stdout:4/529: fdatasync d3/d6/d11/d57/d7f/f8b 0 2024-09-20T19:05:57.785 INFO:tasks.workunit.client.0.smithi027.stdout:0/424: creat d2/d49/f97 x:0 0 0 2024-09-20T19:05:57.786 INFO:tasks.workunit.client.0.smithi027.stdout:7/403: creat d3/d8/d26/f88 x:0 0 0 2024-09-20T19:05:57.787 INFO:tasks.workunit.client.0.smithi027.stdout:7/404: readlink d3/d1a/l4f 0 2024-09-20T19:05:57.787 INFO:tasks.workunit.client.0.smithi027.stdout:3/397: creat d0/d1/d13/d15/d6f/d7f/f85 x:0 0 0 2024-09-20T19:05:57.788 INFO:tasks.workunit.client.1.smithi098.stdout:9/484: dread f3 [0,4194304] 0 2024-09-20T19:05:57.790 INFO:tasks.workunit.client.0.smithi027.stdout:8/427: rename d2/d14/d13/d2e/d6c/c7d to d2/d3/d6/d6d/d75/c8d 0 2024-09-20T19:05:57.791 INFO:tasks.workunit.client.1.smithi098.stdout:9/485: creat d4/d74/d8a/fa2 x:0 0 0 2024-09-20T19:05:57.792 INFO:tasks.workunit.client.0.smithi027.stdout:7/405: truncate d3/d24/f2c 2126023 0 2024-09-20T19:05:57.793 INFO:tasks.workunit.client.0.smithi027.stdout:3/398: creat d0/d1/d13/d15/d6f/d7f/f86 x:0 0 0 2024-09-20T19:05:57.793 INFO:tasks.workunit.client.1.smithi098.stdout:9/486: creat d4/de/d27/d6c/fa3 x:0 0 0 2024-09-20T19:05:57.794 INFO:tasks.workunit.client.1.smithi098.stdout:9/487: chown d4/de/d27/d4a/d21/f36 1 1 2024-09-20T19:05:57.795 INFO:tasks.workunit.client.0.smithi027.stdout:1/396: creat d2/d8/d41/f72 x:0 0 0 2024-09-20T19:05:57.796 INFO:tasks.workunit.client.0.smithi027.stdout:0/425: symlink d2/l98 0 2024-09-20T19:05:57.796 INFO:tasks.workunit.client.1.smithi098.stdout:9/488: creat d4/de/d27/d4a/d58/d5b/fa4 x:0 0 0 2024-09-20T19:05:57.797 INFO:tasks.workunit.client.0.smithi027.stdout:8/428: getdents d2/d14/d13/d43/d5d/d86 0 2024-09-20T19:05:57.799 INFO:tasks.workunit.client.0.smithi027.stdout:0/426: chown d2/d48/d6b/d79/d84/d1d/d2e/c96 63 1 2024-09-20T19:05:57.800 INFO:tasks.workunit.client.0.smithi027.stdout:7/406: creat d3/d8/d1c/d61/f89 x:0 0 0 2024-09-20T19:05:57.800 INFO:tasks.workunit.client.0.smithi027.stdout:3/399: dwrite d0/d1/d5e/f77 [0,4194304] 0 2024-09-20T19:05:57.801 INFO:tasks.workunit.client.1.smithi098.stdout:9/489: unlink d4/de/d27/d4a/d21/c4c 0 2024-09-20T19:05:57.801 INFO:tasks.workunit.client.1.smithi098.stdout:9/490: stat d4/de/d27/d4a/l3e 0 2024-09-20T19:05:57.802 INFO:tasks.workunit.client.0.smithi027.stdout:8/429: mknod d2/c8e 0 2024-09-20T19:05:57.802 INFO:tasks.workunit.client.1.smithi098.stdout:9/491: chown d4/de/d27/d4a/d58/d5b/f97 576829 1 2024-09-20T19:05:57.803 INFO:tasks.workunit.client.0.smithi027.stdout:1/397: mkdir d2/d8/d2b/d2d/d73 0 2024-09-20T19:05:57.803 INFO:tasks.workunit.client.0.smithi027.stdout:8/430: read - d2/d14/d13/d2e/d6c/d77/f8a zero size 2024-09-20T19:05:57.804 INFO:tasks.workunit.client.0.smithi027.stdout:0/427: mknod d2/d48/d6b/d79/d84/d1d/c99 0 2024-09-20T19:05:57.804 INFO:tasks.workunit.client.1.smithi098.stdout:9/492: symlink d4/de/d24/d35/d6d/d78/la5 0 2024-09-20T19:05:57.805 INFO:tasks.workunit.client.0.smithi027.stdout:0/428: write d2/d48/d6b/d79/d84/d1d/d2e/f54 [644438,55218] 0 2024-09-20T19:05:57.806 INFO:tasks.workunit.client.1.smithi098.stdout:9/493: truncate d4/f6a 769177 0 2024-09-20T19:05:57.807 INFO:tasks.workunit.client.0.smithi027.stdout:0/429: read - d2/d48/d6b/d79/d84/d1b/f8c zero size 2024-09-20T19:05:57.807 INFO:tasks.workunit.client.0.smithi027.stdout:0/430: write d2/d48/f76 [305612,36606] 0 2024-09-20T19:05:57.808 INFO:tasks.workunit.client.1.smithi098.stdout:9/494: mkdir d4/de/d24/d35/d2d/da6 0 2024-09-20T19:05:57.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/495: dwrite f3 [0,4194304] 0 2024-09-20T19:05:57.817 INFO:tasks.workunit.client.1.smithi098.stdout:9/496: creat d4/de/d27/d6c/fa7 x:0 0 0 2024-09-20T19:05:57.837 INFO:tasks.workunit.client.1.smithi098.stdout:9/497: dread d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:05:57.842 INFO:tasks.workunit.client.0.smithi027.stdout:8/431: dread d2/d3/d6/d21/f28 [0,4194304] 0 2024-09-20T19:05:57.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/400: rename d0/d1/f3f to d0/d1/d5e/d1d/d7d/f87 0 2024-09-20T19:05:57.843 INFO:tasks.workunit.client.1.smithi098.stdout:9/498: dwrite d4/f47 [0,4194304] 0 2024-09-20T19:05:57.845 INFO:tasks.workunit.client.1.smithi098.stdout:2/739: dread d3/d16/d1d/d4f/d8b/f3e [0,4194304] 0 2024-09-20T19:05:57.846 INFO:tasks.workunit.client.0.smithi027.stdout:7/407: rename d3/d8/da/dc/f21 to d3/d8/da/d2e/d39/f8a 0 2024-09-20T19:05:57.847 INFO:tasks.workunit.client.1.smithi098.stdout:2/740: write d3/db0/f4d [721184,98711] 0 2024-09-20T19:05:57.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/499: mknod d4/de/d27/d4a/d21/d25/d51/d7b/ca8 0 2024-09-20T19:05:57.852 INFO:tasks.workunit.client.1.smithi098.stdout:5/405: dwrite d1/fe [0,4194304] 0 2024-09-20T19:05:57.858 INFO:tasks.workunit.client.1.smithi098.stdout:9/500: mknod d4/de/d27/d4a/d21/d25/ca9 0 2024-09-20T19:05:57.859 INFO:tasks.workunit.client.0.smithi027.stdout:8/432: creat d2/d3/d6/d21/d33/f8f x:0 0 0 2024-09-20T19:05:57.860 INFO:tasks.workunit.client.0.smithi027.stdout:3/401: link d0/d1/d5e/l75 d0/d1/d13/d15/d76/l88 0 2024-09-20T19:05:57.862 INFO:tasks.workunit.client.0.smithi027.stdout:8/433: chown d2/d14/d13/d2e/d6c/d77/d88 122821 1 2024-09-20T19:05:57.862 INFO:tasks.workunit.client.1.smithi098.stdout:5/406: rename d1/d1b/l5b to d1/d71/l7b 0 2024-09-20T19:05:57.863 INFO:tasks.workunit.client.0.smithi027.stdout:9/540: dwrite d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:05:57.864 INFO:tasks.workunit.client.0.smithi027.stdout:1/398: rename d2/d1b/d3a to d2/d8/d74 0 2024-09-20T19:05:57.864 INFO:tasks.workunit.client.1.smithi098.stdout:4/530: write d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d [551594,95726] 0 2024-09-20T19:05:57.866 INFO:tasks.workunit.client.1.smithi098.stdout:9/501: mkdir d4/de/d27/d4a/d58/d81/d86/daa 0 2024-09-20T19:05:57.867 INFO:tasks.workunit.client.1.smithi098.stdout:4/531: stat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/db2/lb8 0 2024-09-20T19:05:57.871 INFO:tasks.workunit.client.0.smithi027.stdout:8/434: mkdir d2/d14/d13/d43/d5d/d90 0 2024-09-20T19:05:57.873 INFO:tasks.workunit.client.1.smithi098.stdout:5/407: rename d1/d17/f19 to d1/d17/d35/d54/d68/f7c 0 2024-09-20T19:05:57.877 INFO:tasks.workunit.client.0.smithi027.stdout:0/431: rename d2/l4f to d2/d20/l9a 0 2024-09-20T19:05:57.877 INFO:tasks.workunit.client.1.smithi098.stdout:1/392: sync 2024-09-20T19:05:57.879 INFO:tasks.workunit.client.1.smithi098.stdout:4/532: write d3/fc [688772,105409] 0 2024-09-20T19:05:57.879 INFO:tasks.workunit.client.0.smithi027.stdout:0/432: fsync d2/d20/d52/f58 0 2024-09-20T19:05:57.879 INFO:tasks.workunit.client.0.smithi027.stdout:8/435: dwrite d2/d65/f4f [0,4194304] 0 2024-09-20T19:05:57.882 INFO:tasks.workunit.client.1.smithi098.stdout:9/502: dwrite d4/f6a [0,4194304] 0 2024-09-20T19:05:57.882 INFO:tasks.workunit.client.1.smithi098.stdout:5/408: creat d1/d17/d5e/f7d x:0 0 0 2024-09-20T19:05:57.885 INFO:tasks.workunit.client.1.smithi098.stdout:9/503: dread - d4/de/d27/d4a/d58/d5b/f97 zero size 2024-09-20T19:05:57.889 INFO:tasks.workunit.client.1.smithi098.stdout:1/393: dwrite d1/d3/df/d34/d43/d65/f75 [0,4194304] 0 2024-09-20T19:05:57.891 INFO:tasks.workunit.client.0.smithi027.stdout:7/408: rename d3/d1a to d3/d8/da/d2e/d49/d8b 0 2024-09-20T19:05:57.896 INFO:tasks.workunit.client.1.smithi098.stdout:5/409: chown d1/d17/d35/c4d 0 1 2024-09-20T19:05:57.900 INFO:tasks.workunit.client.0.smithi027.stdout:3/402: creat d0/d1/d13/f89 x:0 0 0 2024-09-20T19:05:57.902 INFO:tasks.workunit.client.0.smithi027.stdout:0/433: mknod d2/d20/c9b 0 2024-09-20T19:05:57.904 INFO:tasks.workunit.client.1.smithi098.stdout:9/504: creat d4/de/d27/d4a/d58/fab x:0 0 0 2024-09-20T19:05:57.904 INFO:tasks.workunit.client.0.smithi027.stdout:8/436: mknod d2/d14/d13/d2e/d6c/d77/d88/c91 0 2024-09-20T19:05:57.906 INFO:tasks.workunit.client.0.smithi027.stdout:8/437: dread - d2/d3/d6/d21/d33/f8f zero size 2024-09-20T19:05:57.908 INFO:tasks.workunit.client.1.smithi098.stdout:4/533: symlink d3/d7d/da3/d3c/lbd 0 2024-09-20T19:05:57.909 INFO:tasks.workunit.client.1.smithi098.stdout:2/741: dwrite d3/d16/d1d/d2b/f5c [0,4194304] 0 2024-09-20T19:05:57.909 INFO:tasks.workunit.client.0.smithi027.stdout:0/434: dwrite d2/d48/d6b/d79/d84/d1b/d39/f57 [0,4194304] 0 2024-09-20T19:05:57.911 INFO:tasks.workunit.client.1.smithi098.stdout:5/410: stat d1/fb 0 2024-09-20T19:05:57.912 INFO:tasks.workunit.client.0.smithi027.stdout:7/409: read - d3/f29 zero size 2024-09-20T19:05:57.913 INFO:tasks.workunit.client.0.smithi027.stdout:7/410: chown d3/d8/d26/d45/d56 28200 1 2024-09-20T19:05:57.914 INFO:tasks.workunit.client.0.smithi027.stdout:8/438: dwrite d2/d3/d1b/d36/f61 [0,4194304] 0 2024-09-20T19:05:57.914 INFO:tasks.workunit.client.0.smithi027.stdout:7/411: chown d3/d8/d26/f7f 12 1 2024-09-20T19:05:57.916 INFO:tasks.workunit.client.0.smithi027.stdout:3/403: unlink d0/d1/d13/d15/d55/f72 0 2024-09-20T19:05:57.923 INFO:tasks.workunit.client.0.smithi027.stdout:0/435: rmdir d2/d48/d6b/d79/d84/d1d/d2e 39 2024-09-20T19:05:57.924 INFO:tasks.workunit.client.0.smithi027.stdout:3/404: dwrite d0/d1/d13/d15/f68 [0,4194304] 0 2024-09-20T19:05:57.925 INFO:tasks.workunit.client.1.smithi098.stdout:4/534: rename d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/f8a to d3/d6/d11/d57/d7f/d84/fbe 0 2024-09-20T19:05:57.925 INFO:tasks.workunit.client.1.smithi098.stdout:4/535: readlink d3/d6/d11/d1e/l55 0 2024-09-20T19:05:57.938 INFO:tasks.workunit.client.1.smithi098.stdout:1/394: write d1/d3/df/d34/d43/f56 [4965147,84324] 0 2024-09-20T19:05:57.939 INFO:tasks.workunit.client.1.smithi098.stdout:1/395: chown d1/d3/df/l26 21 1 2024-09-20T19:05:57.940 INFO:tasks.workunit.client.1.smithi098.stdout:1/396: fsync d1/d3/df/d34/f48 0 2024-09-20T19:05:57.941 INFO:tasks.workunit.client.1.smithi098.stdout:4/536: link d3/d2e/f67 d3/d6/d11/d1e/d2a/d45/d91/fbf 0 2024-09-20T19:05:57.941 INFO:tasks.workunit.client.1.smithi098.stdout:1/397: chown d1/d3/d2e/d68 18748 1 2024-09-20T19:05:57.942 INFO:tasks.workunit.client.1.smithi098.stdout:9/505: getdents d4/de/d24 0 2024-09-20T19:05:57.943 INFO:tasks.workunit.client.1.smithi098.stdout:9/506: chown d4/de/d27/d4a/d21/d25/l91 1 1 2024-09-20T19:05:57.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/537: dread d3/d6/f32 [0,4194304] 0 2024-09-20T19:05:57.944 INFO:tasks.workunit.client.1.smithi098.stdout:1/398: readlink d1/d3/l11 0 2024-09-20T19:05:57.945 INFO:tasks.workunit.client.1.smithi098.stdout:2/742: write d3/d16/d1a/f4b [2013255,63193] 0 2024-09-20T19:05:57.947 INFO:tasks.workunit.client.1.smithi098.stdout:1/399: creat d1/d3/df/f78 x:0 0 0 2024-09-20T19:05:57.949 INFO:tasks.workunit.client.1.smithi098.stdout:4/538: rename d3/d6/d11/d57/d7f/f87 to d3/d7d/fc0 0 2024-09-20T19:05:57.950 INFO:tasks.workunit.client.1.smithi098.stdout:2/743: mknod d3/d16/d1d/d2b/d46/dc0/cf2 0 2024-09-20T19:05:57.954 INFO:tasks.workunit.client.1.smithi098.stdout:2/744: fsync d3/d51/d9f/dbc/fbe 0 2024-09-20T19:05:57.955 INFO:tasks.workunit.client.1.smithi098.stdout:1/400: dread d1/d3/df/d34/d43/d65/f75 [0,4194304] 0 2024-09-20T19:05:57.956 INFO:tasks.workunit.client.1.smithi098.stdout:2/745: write d3/fe4 [633682,22927] 0 2024-09-20T19:05:57.957 INFO:tasks.workunit.client.1.smithi098.stdout:5/411: dwrite d1/d17/d35/f6a [0,4194304] 0 2024-09-20T19:05:57.958 INFO:tasks.workunit.client.1.smithi098.stdout:2/746: fsync d3/d16/d1a/fae 0 2024-09-20T19:05:57.962 INFO:tasks.workunit.client.1.smithi098.stdout:5/412: dread d1/f33 [0,4194304] 0 2024-09-20T19:05:57.964 INFO:tasks.workunit.client.1.smithi098.stdout:2/747: fsync d3/db0/f57 0 2024-09-20T19:05:57.965 INFO:tasks.workunit.client.1.smithi098.stdout:1/401: dwrite d1/d3/f57 [0,4194304] 0 2024-09-20T19:05:57.971 INFO:tasks.workunit.client.1.smithi098.stdout:2/748: symlink d3/d16/d1d/d2b/d46/d74/d82/lf3 0 2024-09-20T19:05:57.973 INFO:tasks.workunit.client.1.smithi098.stdout:5/413: link d1/fc d1/d1b/f7e 0 2024-09-20T19:05:57.974 INFO:tasks.workunit.client.1.smithi098.stdout:1/402: symlink d1/d3/d2e/d61/l79 0 2024-09-20T19:05:57.975 INFO:tasks.workunit.client.1.smithi098.stdout:4/539: dwrite d3/d7d/da3/d3c/d6b/d73/d98/db3/f4c [0,4194304] 0 2024-09-20T19:05:57.977 INFO:tasks.workunit.client.1.smithi098.stdout:2/749: stat d3/d16/d1d/d4f/d8b/d38/l81 0 2024-09-20T19:05:57.977 INFO:tasks.workunit.client.1.smithi098.stdout:1/403: chown d1/d3/df/d34/c6c 38168257 1 2024-09-20T19:05:57.977 INFO:tasks.workunit.client.1.smithi098.stdout:4/540: write d3/d7d/da3/f56 [3213474,130912] 0 2024-09-20T19:05:57.978 INFO:tasks.workunit.client.1.smithi098.stdout:5/414: mknod d1/d17/d25/d56/c7f 0 2024-09-20T19:05:57.980 INFO:tasks.workunit.client.1.smithi098.stdout:4/541: dread - d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/fb6 zero size 2024-09-20T19:05:57.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/750: mknod d3/db0/d69/d88/cf4 0 2024-09-20T19:05:57.983 INFO:tasks.workunit.client.1.smithi098.stdout:1/404: mkdir d1/d3/d2e/d68/d7a 0 2024-09-20T19:05:57.985 INFO:tasks.workunit.client.1.smithi098.stdout:1/405: dread d1/f37 [0,4194304] 0 2024-09-20T19:05:57.987 INFO:tasks.workunit.client.1.smithi098.stdout:1/406: write d1/d3/d2e/f47 [760248,73290] 0 2024-09-20T19:05:57.988 INFO:tasks.workunit.client.1.smithi098.stdout:1/407: fdatasync d1/d3/df/d34/d43/f59 0 2024-09-20T19:05:57.994 INFO:tasks.workunit.client.0.smithi027.stdout:9/541: truncate d0/d9/df/d1b/d9c/d4f/f9b 502554 0 2024-09-20T19:05:57.994 INFO:tasks.workunit.client.0.smithi027.stdout:7/412: symlink d3/d8/da/d51/l8c 0 2024-09-20T19:05:57.996 INFO:tasks.workunit.client.0.smithi027.stdout:1/399: dwrite d2/d8/f20 [0,4194304] 0 2024-09-20T19:05:57.998 INFO:tasks.workunit.client.1.smithi098.stdout:4/542: getdents d3/d7d/da3/d3c/d6b/d73/d98/db3/d50 0 2024-09-20T19:05:57.998 INFO:tasks.workunit.client.0.smithi027.stdout:3/405: mknod d0/d1/d13/d15/d55/c8a 0 2024-09-20T19:05:57.998 INFO:tasks.workunit.client.0.smithi027.stdout:9/542: chown d0/d9/df/d1b/d64/c87 166578 1 2024-09-20T19:05:57.999 INFO:tasks.workunit.client.0.smithi027.stdout:3/406: chown d0/d1/d13/d64 2295 1 2024-09-20T19:05:58.000 INFO:tasks.workunit.client.0.smithi027.stdout:1/400: fdatasync d2/d8/d2b/f4a 0 2024-09-20T19:05:58.001 INFO:tasks.workunit.client.1.smithi098.stdout:2/751: write d3/d16/f84 [585317,22011] 0 2024-09-20T19:05:58.001 INFO:tasks.workunit.client.0.smithi027.stdout:0/436: mknod d2/d48/d6b/d79/d84/d1d/d2e/c9c 0 2024-09-20T19:05:58.001 INFO:tasks.workunit.client.0.smithi027.stdout:7/413: truncate d3/d8/d26/d45/f52 4406598 0 2024-09-20T19:05:58.003 INFO:tasks.workunit.client.0.smithi027.stdout:9/543: write d0/d9/df/d1c/f69 [2821263,64748] 0 2024-09-20T19:05:58.005 INFO:tasks.workunit.client.1.smithi098.stdout:1/408: truncate d1/d3/df/d34/d43/d65/f73 1319055 0 2024-09-20T19:05:58.006 INFO:tasks.workunit.client.0.smithi027.stdout:1/401: rmdir d2/d8/d74 39 2024-09-20T19:05:58.007 INFO:tasks.workunit.client.0.smithi027.stdout:8/439: getdents d2/d3/d6/d21 0 2024-09-20T19:05:58.008 INFO:tasks.workunit.client.0.smithi027.stdout:0/437: symlink d2/d20/d52/d29/l9d 0 2024-09-20T19:05:58.012 INFO:tasks.workunit.client.0.smithi027.stdout:1/402: write d2/d1b/f2e [4218954,110046] 0 2024-09-20T19:05:58.012 INFO:tasks.workunit.client.1.smithi098.stdout:2/752: write d3/d16/d1d/fa7 [548173,100399] 0 2024-09-20T19:05:58.013 INFO:tasks.workunit.client.0.smithi027.stdout:3/407: dwrite d0/d1/d13/f49 [0,4194304] 0 2024-09-20T19:05:58.015 INFO:tasks.workunit.client.1.smithi098.stdout:2/753: write d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fdf [800888,108890] 0 2024-09-20T19:05:58.015 INFO:tasks.workunit.client.0.smithi027.stdout:7/414: dwrite d3/d8/d26/d45/f52 [0,4194304] 0 2024-09-20T19:05:58.016 INFO:tasks.workunit.client.0.smithi027.stdout:9/544: truncate d0/d9/df/d1c/d6a/d6d/dd/d66/f8e 356821 0 2024-09-20T19:05:58.016 INFO:tasks.workunit.client.0.smithi027.stdout:8/440: unlink d2/d3/d1b/d36/l58 0 2024-09-20T19:05:58.017 INFO:tasks.workunit.client.1.smithi098.stdout:2/754: fdatasync d3/d16/d1d/d2b/d46/fa1 0 2024-09-20T19:05:58.018 INFO:tasks.workunit.client.1.smithi098.stdout:4/543: dread d3/d6/d11/d57/f9b [0,4194304] 0 2024-09-20T19:05:58.020 INFO:tasks.workunit.client.0.smithi027.stdout:9/545: readlink d0/d9/df/d57/l7e 0 2024-09-20T19:05:58.022 INFO:tasks.workunit.client.0.smithi027.stdout:0/438: rename d2/d20/d52/f58 to d2/d20/d52/d29/f9e 0 2024-09-20T19:05:58.022 INFO:tasks.workunit.client.1.smithi098.stdout:4/544: creat d3/d7d/fc1 x:0 0 0 2024-09-20T19:05:58.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/755: link d3/f6d d3/d16/d1d/d2b/d99/ff5 0 2024-09-20T19:05:58.025 INFO:tasks.workunit.client.0.smithi027.stdout:7/415: mkdir d3/d8/d26/d45/d56/d8d 0 2024-09-20T19:05:58.026 INFO:tasks.workunit.client.1.smithi098.stdout:1/409: dread d1/d3/d2e/f3b [0,4194304] 0 2024-09-20T19:05:58.027 INFO:tasks.workunit.client.0.smithi027.stdout:8/441: symlink d2/d3/d6/d21/d33/l92 0 2024-09-20T19:05:58.028 INFO:tasks.workunit.client.0.smithi027.stdout:9/546: write d0/d9/df/d1b/d9c/d5a/f63 [959386,96868] 0 2024-09-20T19:05:58.028 INFO:tasks.workunit.client.0.smithi027.stdout:0/439: truncate d2/f19 295464 0 2024-09-20T19:05:58.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/756: unlink d3/d16/d1d/d4f/d8b/f67 0 2024-09-20T19:05:58.030 INFO:tasks.workunit.client.0.smithi027.stdout:1/403: dwrite d2/f13 [4194304,4194304] 0 2024-09-20T19:05:58.030 INFO:tasks.workunit.client.0.smithi027.stdout:3/408: dread d0/d1/d5e/d1d/f4e [0,4194304] 0 2024-09-20T19:05:58.031 INFO:tasks.workunit.client.0.smithi027.stdout:7/416: creat d3/d8/da/d2e/d50/f8e x:0 0 0 2024-09-20T19:05:58.033 INFO:tasks.workunit.client.1.smithi098.stdout:1/410: rename d1/d3/f46 to d1/d3/d62/f7b 0 2024-09-20T19:05:58.034 INFO:tasks.workunit.client.1.smithi098.stdout:1/411: chown d1/d3/l39 6 1 2024-09-20T19:05:58.034 INFO:tasks.workunit.client.0.smithi027.stdout:9/547: creat d0/d9/df/d1b/d9c/da4/fb0 x:0 0 0 2024-09-20T19:05:58.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/412: truncate d1/f3d 1322996 0 2024-09-20T19:05:58.035 INFO:tasks.workunit.client.1.smithi098.stdout:2/757: symlink d3/d16/d1d/d2b/d46/d74/lf6 0 2024-09-20T19:05:58.035 INFO:tasks.workunit.client.0.smithi027.stdout:8/442: dread d2/d3/d6/d21/f28 [0,4194304] 0 2024-09-20T19:05:58.036 INFO:tasks.workunit.client.0.smithi027.stdout:5/442: sync 2024-09-20T19:05:58.038 INFO:tasks.workunit.client.0.smithi027.stdout:5/443: write d4/da/fb [3098273,40460] 0 2024-09-20T19:05:58.038 INFO:tasks.workunit.client.1.smithi098.stdout:2/758: creat d3/ff7 x:0 0 0 2024-09-20T19:05:58.039 INFO:tasks.workunit.client.0.smithi027.stdout:5/444: stat d4/da/de/d3e/d69 0 2024-09-20T19:05:58.040 INFO:tasks.workunit.client.0.smithi027.stdout:8/443: symlink d2/d3/d6/d6d/l93 0 2024-09-20T19:05:58.042 INFO:tasks.workunit.client.1.smithi098.stdout:2/759: write d3/f6d [3045966,58126] 0 2024-09-20T19:05:58.044 INFO:tasks.workunit.client.1.smithi098.stdout:2/760: fsync d3/d16/d1d/d2b/d46/f8d 0 2024-09-20T19:05:58.046 INFO:tasks.workunit.client.0.smithi027.stdout:5/445: dwrite d4/d1f/d7f/f80 [0,4194304] 0 2024-09-20T19:05:58.046 INFO:tasks.workunit.client.0.smithi027.stdout:9/548: fdatasync d0/f12 0 2024-09-20T19:05:58.048 INFO:tasks.workunit.client.0.smithi027.stdout:9/549: chown d0/f42 150 1 2024-09-20T19:05:58.049 INFO:tasks.workunit.client.1.smithi098.stdout:2/761: symlink d3/lf8 0 2024-09-20T19:05:58.051 INFO:tasks.workunit.client.0.smithi027.stdout:1/404: mkdir d2/d8/d3b/d4b/d75 0 2024-09-20T19:05:58.054 INFO:tasks.workunit.client.1.smithi098.stdout:2/762: mknod d3/d16/d1d/d2b/d46/dc0/cf9 0 2024-09-20T19:05:58.057 INFO:tasks.workunit.client.0.smithi027.stdout:9/550: creat d0/d9/df/d1b/d9c/d4f/d8d/fb1 x:0 0 0 2024-09-20T19:05:58.066 INFO:tasks.workunit.client.0.smithi027.stdout:0/440: write d2/d48/d6b/d79/d84/f40 [271287,79529] 0 2024-09-20T19:05:58.066 INFO:tasks.workunit.client.0.smithi027.stdout:1/405: dwrite d2/d8/d3b/f6f [4194304,4194304] 0 2024-09-20T19:05:58.066 INFO:tasks.workunit.client.1.smithi098.stdout:2/763: link d3/df/d13/l77 d3/d16/d1d/d2b/d46/d74/d7b/lfa 0 2024-09-20T19:05:58.067 INFO:tasks.workunit.client.1.smithi098.stdout:2/764: chown d3/d16/d1d/d2b/d46/ce8 50169596 1 2024-09-20T19:05:58.067 INFO:tasks.workunit.client.0.smithi027.stdout:9/551: dread d0/d9/df/f24 [0,4194304] 0 2024-09-20T19:05:58.068 INFO:tasks.workunit.client.0.smithi027.stdout:3/409: truncate d0/d1/d5e/f2c 3536458 0 2024-09-20T19:05:58.069 INFO:tasks.workunit.client.0.smithi027.stdout:8/444: dread d2/d3/f11 [0,4194304] 0 2024-09-20T19:05:58.070 INFO:tasks.workunit.client.0.smithi027.stdout:0/441: mkdir d2/d48/d6b/d79/d9f 0 2024-09-20T19:05:58.074 INFO:tasks.workunit.client.0.smithi027.stdout:1/406: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:58.076 INFO:tasks.workunit.client.0.smithi027.stdout:0/442: creat d2/d20/d52/fa0 x:0 0 0 2024-09-20T19:05:58.076 INFO:tasks.workunit.client.0.smithi027.stdout:5/446: truncate d4/fd 4513202 0 2024-09-20T19:05:58.077 INFO:tasks.workunit.client.0.smithi027.stdout:5/447: chown d4/da/f2c 459378265 1 2024-09-20T19:05:58.077 INFO:tasks.workunit.client.0.smithi027.stdout:1/407: symlink d2/d8/d2b/l76 0 2024-09-20T19:05:58.083 INFO:tasks.workunit.client.0.smithi027.stdout:3/410: write d0/f2 [1543324,87646] 0 2024-09-20T19:05:58.086 INFO:tasks.workunit.client.0.smithi027.stdout:3/411: write d0/d1/f3b [2715843,38403] 0 2024-09-20T19:05:58.086 INFO:tasks.workunit.client.0.smithi027.stdout:1/408: dwrite d2/d8/d3b/f6f [4194304,4194304] 0 2024-09-20T19:05:58.090 INFO:tasks.workunit.client.0.smithi027.stdout:5/448: truncate d4/da/de/d3e/d61/f5e 2003089 0 2024-09-20T19:05:58.090 INFO:tasks.workunit.client.0.smithi027.stdout:1/409: truncate d2/d8/d41/f72 831875 0 2024-09-20T19:05:58.091 INFO:tasks.workunit.client.0.smithi027.stdout:5/449: write d4/d1f/f74 [241969,1777] 0 2024-09-20T19:05:58.096 INFO:tasks.workunit.client.0.smithi027.stdout:0/443: dread d2/fc [0,4194304] 0 2024-09-20T19:05:58.099 INFO:tasks.workunit.client.0.smithi027.stdout:3/412: truncate d0/d1/f35 2335563 0 2024-09-20T19:05:58.101 INFO:tasks.workunit.client.0.smithi027.stdout:5/450: dwrite d4/da/de/d3e/d69/f7c [0,4194304] 0 2024-09-20T19:05:58.102 INFO:tasks.workunit.client.0.smithi027.stdout:0/444: unlink d2/d20/d52/c3a 0 2024-09-20T19:05:58.102 INFO:tasks.workunit.client.0.smithi027.stdout:3/413: write d0/d1/d5e/f1e [7685439,53250] 0 2024-09-20T19:05:58.103 INFO:tasks.workunit.client.0.smithi027.stdout:5/451: read - d4/f45 zero size 2024-09-20T19:05:58.105 INFO:tasks.workunit.client.0.smithi027.stdout:3/414: creat d0/d1/d13/d15/d6f/d7f/f8b x:0 0 0 2024-09-20T19:05:58.106 INFO:tasks.workunit.client.0.smithi027.stdout:5/452: symlink d4/da/de/d3e/d69/l8d 0 2024-09-20T19:05:58.107 INFO:tasks.workunit.client.0.smithi027.stdout:5/453: chown d4/da/de/c49 90006067 1 2024-09-20T19:05:58.111 INFO:tasks.workunit.client.0.smithi027.stdout:1/410: truncate d2/d8/d74/f35 5241012 0 2024-09-20T19:05:58.117 INFO:tasks.workunit.client.0.smithi027.stdout:0/445: truncate d2/d48/d6b/d79/d84/d1b/f2b 3645579 0 2024-09-20T19:05:58.118 INFO:tasks.workunit.client.0.smithi027.stdout:0/446: chown d2/d20/d52/l50 61588 1 2024-09-20T19:05:58.119 INFO:tasks.workunit.client.0.smithi027.stdout:0/447: rmdir d2/d48/d6b/d79/d84/d1b 39 2024-09-20T19:05:58.120 INFO:tasks.workunit.client.0.smithi027.stdout:0/448: dread - d2/d48/d6b/d79/d84/d1d/f6c zero size 2024-09-20T19:05:58.121 INFO:tasks.workunit.client.0.smithi027.stdout:0/449: readlink d2/d20/d52/d29/l6d 0 2024-09-20T19:05:58.123 INFO:tasks.workunit.client.0.smithi027.stdout:0/450: mknod d2/d48/d6b/d79/d9f/ca1 0 2024-09-20T19:05:58.125 INFO:tasks.workunit.client.0.smithi027.stdout:0/451: unlink d2/d20/d52/f15 0 2024-09-20T19:05:58.125 INFO:tasks.workunit.client.1.smithi098.stdout:8/490: sync 2024-09-20T19:05:58.126 INFO:tasks.workunit.client.1.smithi098.stdout:0/273: sync 2024-09-20T19:05:58.126 INFO:tasks.workunit.client.0.smithi027.stdout:0/452: stat d2/d48 0 2024-09-20T19:05:58.126 INFO:tasks.workunit.client.1.smithi098.stdout:8/491: fsync d7/fd 0 2024-09-20T19:05:58.126 INFO:tasks.workunit.client.1.smithi098.stdout:0/274: readlink d0/d15/l30 0 2024-09-20T19:05:58.127 INFO:tasks.workunit.client.0.smithi027.stdout:1/411: truncate d2/d8/d2b/d2d/f34 4290007 0 2024-09-20T19:05:58.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/275: write d0/d6/f16 [4317327,25972] 0 2024-09-20T19:05:58.129 INFO:tasks.workunit.client.0.smithi027.stdout:1/412: write d2/d8/d3b/d4b/f2c [108302,66956] 0 2024-09-20T19:05:58.130 INFO:tasks.workunit.client.0.smithi027.stdout:1/413: truncate d2/f5c 1000636 0 2024-09-20T19:05:58.131 INFO:tasks.workunit.client.1.smithi098.stdout:8/492: rename d7/de/d11/d19/d30/d59/d80/c9f to d7/de/d35/cae 0 2024-09-20T19:05:58.132 INFO:tasks.workunit.client.0.smithi027.stdout:5/454: dread d4/da/de/d3e/f59 [0,4194304] 0 2024-09-20T19:05:58.132 INFO:tasks.workunit.client.1.smithi098.stdout:8/493: rmdir d7/de/d11/d19 39 2024-09-20T19:05:58.133 INFO:tasks.workunit.client.0.smithi027.stdout:5/455: chown d4/da/de/d3e/d69/l8d 63255 1 2024-09-20T19:05:58.135 INFO:tasks.workunit.client.0.smithi027.stdout:5/456: stat d4/da/de/d3e/d69/d75/d3d 0 2024-09-20T19:05:58.136 INFO:tasks.workunit.client.0.smithi027.stdout:5/457: fsync d4/da/de/f40 0 2024-09-20T19:05:58.137 INFO:tasks.workunit.client.1.smithi098.stdout:8/494: dread - d7/de/d11/d19/d30/d68/f6c zero size 2024-09-20T19:05:58.138 INFO:tasks.workunit.client.0.smithi027.stdout:1/414: dread d2/d8/d74/f4e [0,4194304] 0 2024-09-20T19:05:58.139 INFO:tasks.workunit.client.0.smithi027.stdout:6/350: sync 2024-09-20T19:05:58.139 INFO:tasks.workunit.client.0.smithi027.stdout:4/281: sync 2024-09-20T19:05:58.139 INFO:tasks.workunit.client.0.smithi027.stdout:2/343: sync 2024-09-20T19:05:58.141 INFO:tasks.workunit.client.0.smithi027.stdout:6/351: write d4/d6/f11 [705728,129934] 0 2024-09-20T19:05:58.142 INFO:tasks.workunit.client.0.smithi027.stdout:5/458: creat d4/da/de/d3e/d69/d75/d3d/f8e x:0 0 0 2024-09-20T19:05:58.144 INFO:tasks.workunit.client.0.smithi027.stdout:5/459: truncate d4/d1f/d28/f85 189866 0 2024-09-20T19:05:58.146 INFO:tasks.workunit.client.0.smithi027.stdout:0/453: write d2/d48/d6b/d79/d84/d1b/d39/f74 [1560600,125471] 0 2024-09-20T19:05:58.147 INFO:tasks.workunit.client.1.smithi098.stdout:8/495: dread d7/de/d11/d19/d30/d55/f69 [0,4194304] 0 2024-09-20T19:05:58.148 INFO:tasks.workunit.client.1.smithi098.stdout:8/496: chown d7/de/d11/d19/d30/d68/f6a 11164549 1 2024-09-20T19:05:58.150 INFO:tasks.workunit.client.0.smithi027.stdout:6/352: mknod d4/d1b/d2b/d46/d53/c63 0 2024-09-20T19:05:58.154 INFO:tasks.workunit.client.1.smithi098.stdout:0/276: dread d0/db/f14 [0,4194304] 0 2024-09-20T19:05:58.154 INFO:tasks.workunit.client.0.smithi027.stdout:2/344: symlink d3/d1c/d26/d2a/d63/l65 0 2024-09-20T19:05:58.160 INFO:tasks.workunit.client.0.smithi027.stdout:6/353: write d4/d6/fa [2828850,32712] 0 2024-09-20T19:05:58.163 INFO:tasks.workunit.client.0.smithi027.stdout:4/282: dwrite d5/d13/d36/d59/f5b [0,4194304] 0 2024-09-20T19:05:58.164 INFO:tasks.workunit.client.0.smithi027.stdout:2/345: rename d3/d1c/d26/c37 to d3/d24/c66 0 2024-09-20T19:05:58.169 INFO:tasks.workunit.client.0.smithi027.stdout:0/454: mkdir d2/da2 0 2024-09-20T19:05:58.175 INFO:tasks.workunit.client.0.smithi027.stdout:4/283: creat d5/d11/d17/d1b/f5f x:0 0 0 2024-09-20T19:05:58.176 INFO:tasks.workunit.client.0.smithi027.stdout:2/346: creat d3/d1c/d26/f67 x:0 0 0 2024-09-20T19:05:58.178 INFO:tasks.workunit.client.0.smithi027.stdout:0/455: creat d2/d49/d70/fa3 x:0 0 0 2024-09-20T19:05:58.179 INFO:tasks.workunit.client.0.smithi027.stdout:5/460: truncate d4/da/de/d3e/d44/f77 3686872 0 2024-09-20T19:05:58.179 INFO:tasks.workunit.client.0.smithi027.stdout:6/354: mkdir d4/d1b/d62/d64 0 2024-09-20T19:05:58.180 INFO:tasks.workunit.client.0.smithi027.stdout:4/284: mkdir d5/d13/d36/d60 0 2024-09-20T19:05:58.181 INFO:tasks.workunit.client.1.smithi098.stdout:8/497: stat d7/de/d11/d1f/f4d 0 2024-09-20T19:05:58.182 INFO:tasks.workunit.client.1.smithi098.stdout:8/498: chown d7/de/d11/d19/d47/f99 102032 1 2024-09-20T19:05:58.183 INFO:tasks.workunit.client.1.smithi098.stdout:0/277: chown d0/d15/l36 477 1 2024-09-20T19:05:58.184 INFO:tasks.workunit.client.0.smithi027.stdout:0/456: mkdir d2/d48/d6b/d79/d9f/da4 0 2024-09-20T19:05:58.185 INFO:tasks.workunit.client.0.smithi027.stdout:5/461: unlink d4/da/d1a/l84 0 2024-09-20T19:05:58.189 INFO:tasks.workunit.client.0.smithi027.stdout:4/285: creat d5/d11/d17/d53/f61 x:0 0 0 2024-09-20T19:05:58.190 INFO:tasks.workunit.client.1.smithi098.stdout:0/278: symlink d0/d6/d28/d31/d45/l4e 0 2024-09-20T19:05:58.191 INFO:tasks.workunit.client.0.smithi027.stdout:1/415: dwrite d2/d8/d2b/d2d/f34 [0,4194304] 0 2024-09-20T19:05:58.191 INFO:tasks.workunit.client.0.smithi027.stdout:0/457: stat d2/d48/l5d 0 2024-09-20T19:05:58.193 INFO:tasks.workunit.client.1.smithi098.stdout:0/279: mkdir d0/d6/d19/d4f 0 2024-09-20T19:05:58.196 INFO:tasks.workunit.client.1.smithi098.stdout:0/280: unlink d0/fa 0 2024-09-20T19:05:58.198 INFO:tasks.workunit.client.0.smithi027.stdout:2/347: dread d3/d1c/f2d [0,4194304] 0 2024-09-20T19:05:58.201 INFO:tasks.workunit.client.0.smithi027.stdout:4/286: dwrite d5/fa [4194304,4194304] 0 2024-09-20T19:05:58.202 INFO:tasks.workunit.client.0.smithi027.stdout:4/287: fsync d5/d13/d36/d48/f3b 0 2024-09-20T19:05:58.203 INFO:tasks.workunit.client.0.smithi027.stdout:0/458: symlink d2/d48/d6b/d79/d84/d1d/la5 0 2024-09-20T19:05:58.203 INFO:tasks.workunit.client.0.smithi027.stdout:5/462: creat d4/d1f/d28/f8f x:0 0 0 2024-09-20T19:05:58.208 INFO:tasks.workunit.client.0.smithi027.stdout:0/459: creat d2/d20/fa6 x:0 0 0 2024-09-20T19:05:58.208 INFO:tasks.workunit.client.0.smithi027.stdout:5/463: symlink d4/da/de/d3e/d69/l90 0 2024-09-20T19:05:58.209 INFO:tasks.workunit.client.0.smithi027.stdout:6/355: truncate d4/d1b/f29 1965308 0 2024-09-20T19:05:58.210 INFO:tasks.workunit.client.0.smithi027.stdout:2/348: dread d3/d2f/f32 [0,4194304] 0 2024-09-20T19:05:58.211 INFO:tasks.workunit.client.1.smithi098.stdout:0/281: write d0/d6/d19/f1c [2955362,84873] 0 2024-09-20T19:05:58.212 INFO:tasks.workunit.client.0.smithi027.stdout:2/349: read d3/de/f1a [10058,66815] 0 2024-09-20T19:05:58.212 INFO:tasks.workunit.client.0.smithi027.stdout:0/460: mknod d2/ca7 0 2024-09-20T19:05:58.213 INFO:tasks.workunit.client.0.smithi027.stdout:4/288: dwrite d5/fa [4194304,4194304] 0 2024-09-20T19:05:58.213 INFO:tasks.workunit.client.0.smithi027.stdout:2/350: readlink d3/l36 0 2024-09-20T19:05:58.213 INFO:tasks.workunit.client.0.smithi027.stdout:1/416: write d2/d8/d41/f43 [2996545,25458] 0 2024-09-20T19:05:58.214 INFO:tasks.workunit.client.0.smithi027.stdout:5/464: mkdir d4/d1f/d91 0 2024-09-20T19:05:58.215 INFO:tasks.workunit.client.0.smithi027.stdout:6/356: symlink d4/d1b/d2b/d33/l65 0 2024-09-20T19:05:58.215 INFO:tasks.workunit.client.0.smithi027.stdout:4/289: chown d5/d13/d16/l39 0 1 2024-09-20T19:05:58.216 INFO:tasks.workunit.client.0.smithi027.stdout:6/357: chown d4/d6 328544 1 2024-09-20T19:05:58.217 INFO:tasks.workunit.client.1.smithi098.stdout:0/282: creat d0/d6/d19/d4f/f50 x:0 0 0 2024-09-20T19:05:58.218 INFO:tasks.workunit.client.0.smithi027.stdout:2/351: rmdir d3/d13/d3c/d48 39 2024-09-20T19:05:58.220 INFO:tasks.workunit.client.0.smithi027.stdout:0/461: rename d2/d48/d6b/d79/d84/d1b/f43 to d2/da2/fa8 0 2024-09-20T19:05:58.221 INFO:tasks.workunit.client.0.smithi027.stdout:4/290: readlink d5/d11/l19 0 2024-09-20T19:05:58.222 INFO:tasks.workunit.client.0.smithi027.stdout:6/358: creat d4/d1b/d62/f66 x:0 0 0 2024-09-20T19:05:58.224 INFO:tasks.workunit.client.1.smithi098.stdout:0/283: dwrite d0/d15/d38/f44 [0,4194304] 0 2024-09-20T19:05:58.224 INFO:tasks.workunit.client.0.smithi027.stdout:5/465: mkdir d4/d6c/d6f/d92 0 2024-09-20T19:05:58.228 INFO:tasks.workunit.client.0.smithi027.stdout:6/359: truncate d4/d6/fa 5072258 0 2024-09-20T19:05:58.228 INFO:tasks.workunit.client.0.smithi027.stdout:2/352: dwrite d3/d2f/f42 [0,4194304] 0 2024-09-20T19:05:58.229 INFO:tasks.workunit.client.0.smithi027.stdout:5/466: truncate d4/da/de/f66 2699338 0 2024-09-20T19:05:58.229 INFO:tasks.workunit.client.1.smithi098.stdout:0/284: mkdir d0/d15/d38/d51 0 2024-09-20T19:05:58.230 INFO:tasks.workunit.client.0.smithi027.stdout:5/467: chown d4/d7a/d87 1175978321 1 2024-09-20T19:05:58.231 INFO:tasks.workunit.client.0.smithi027.stdout:6/360: chown d4/d15/d37/d39/f54 99 1 2024-09-20T19:05:58.234 INFO:tasks.workunit.client.0.smithi027.stdout:5/468: dread - d4/d1f/f64 zero size 2024-09-20T19:05:58.235 INFO:tasks.workunit.client.1.smithi098.stdout:0/285: fdatasync d0/d6/d19/f10 0 2024-09-20T19:05:58.235 INFO:tasks.workunit.client.0.smithi027.stdout:6/361: write d4/d15/d37/f45 [684269,46460] 0 2024-09-20T19:05:58.235 INFO:tasks.workunit.client.0.smithi027.stdout:4/291: link d5/d13/d36/d48/d3f/d4c/f55 d5/d13/d16/d21/d3a/f62 0 2024-09-20T19:05:58.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/286: readlink d0/d15/d38/l3e 0 2024-09-20T19:05:58.236 INFO:tasks.workunit.client.0.smithi027.stdout:0/462: dwrite d2/d48/d6b/d79/d84/f31 [0,4194304] 0 2024-09-20T19:05:58.237 INFO:tasks.workunit.client.0.smithi027.stdout:2/353: symlink d3/l68 0 2024-09-20T19:05:58.241 INFO:tasks.workunit.client.0.smithi027.stdout:6/362: unlink d4/d6/l5f 0 2024-09-20T19:05:58.242 INFO:tasks.workunit.client.0.smithi027.stdout:2/354: symlink d3/d24/l69 0 2024-09-20T19:05:58.242 INFO:tasks.workunit.client.0.smithi027.stdout:4/292: symlink d5/d11/d3d/l63 0 2024-09-20T19:05:58.244 INFO:tasks.workunit.client.0.smithi027.stdout:0/463: symlink d2/d48/d6b/d79/d9f/da4/la9 0 2024-09-20T19:05:58.244 INFO:tasks.workunit.client.0.smithi027.stdout:2/355: write d3/d24/f60 [756338,87609] 0 2024-09-20T19:05:58.245 INFO:tasks.workunit.client.0.smithi027.stdout:4/293: mkdir d5/d11/d17/d64 0 2024-09-20T19:05:58.246 INFO:tasks.workunit.client.0.smithi027.stdout:5/469: dread d4/da/de/d3e/d69/f7c [0,4194304] 0 2024-09-20T19:05:58.247 INFO:tasks.workunit.client.0.smithi027.stdout:2/356: chown d3/d1c/d26/d2a/l5b 22 1 2024-09-20T19:05:58.247 INFO:tasks.workunit.client.0.smithi027.stdout:0/464: rename d2/d48 to d2/d48/d6b/d79/d84/d1d/d2e/daa 22 2024-09-20T19:05:58.247 INFO:tasks.workunit.client.0.smithi027.stdout:6/363: link d4/d1b/d2b/d46/l61 d4/l67 0 2024-09-20T19:05:58.247 INFO:tasks.workunit.client.0.smithi027.stdout:2/357: stat d3/de/d34 0 2024-09-20T19:05:58.248 INFO:tasks.workunit.client.0.smithi027.stdout:6/364: chown d4/d6/d4b 236 1 2024-09-20T19:05:58.248 INFO:tasks.workunit.client.0.smithi027.stdout:4/294: creat d5/d11/d17/f65 x:0 0 0 2024-09-20T19:05:58.250 INFO:tasks.workunit.client.0.smithi027.stdout:2/358: chown d3/d24/f28 14254 1 2024-09-20T19:05:58.250 INFO:tasks.workunit.client.0.smithi027.stdout:4/295: fsync d5/d13/d16/d21/f2e 0 2024-09-20T19:05:58.251 INFO:tasks.workunit.client.0.smithi027.stdout:5/470: rename d4/da/de/d3e/d44/c6b to d4/da/de/d3e/d61/c93 0 2024-09-20T19:05:58.251 INFO:tasks.workunit.client.0.smithi027.stdout:4/296: truncate d5/d11/d17/f65 657611 0 2024-09-20T19:05:58.252 INFO:tasks.workunit.client.0.smithi027.stdout:6/365: write d4/d15/d37/f47 [1299351,90780] 0 2024-09-20T19:05:58.253 INFO:tasks.workunit.client.1.smithi098.stdout:0/287: fsync d0/d15/d38/f44 0 2024-09-20T19:05:58.254 INFO:tasks.workunit.client.0.smithi027.stdout:2/359: mkdir d3/d13/d3c/d48/d6a 0 2024-09-20T19:05:58.254 INFO:tasks.workunit.client.0.smithi027.stdout:5/471: write d4/da/f48 [1249935,50418] 0 2024-09-20T19:05:58.255 INFO:tasks.workunit.client.0.smithi027.stdout:6/366: creat d4/d1b/d62/d64/f68 x:0 0 0 2024-09-20T19:05:58.255 INFO:tasks.workunit.client.1.smithi098.stdout:0/288: chown d0/db/d1d/c3c 70 1 2024-09-20T19:05:58.256 INFO:tasks.workunit.client.0.smithi027.stdout:2/360: write d3/de/f18 [3304175,66520] 0 2024-09-20T19:05:58.256 INFO:tasks.workunit.client.1.smithi098.stdout:0/289: chown d0/d15/l30 547 1 2024-09-20T19:05:58.257 INFO:tasks.workunit.client.0.smithi027.stdout:4/297: getdents d5 0 2024-09-20T19:05:58.257 INFO:tasks.workunit.client.0.smithi027.stdout:5/472: rmdir d4/da/de/d3e/d69 39 2024-09-20T19:05:58.258 INFO:tasks.workunit.client.0.smithi027.stdout:2/361: stat d3/de/d34/l35 0 2024-09-20T19:05:58.260 INFO:tasks.workunit.client.1.smithi098.stdout:0/290: dread d0/db/d32/f3a [0,4194304] 0 2024-09-20T19:05:58.261 INFO:tasks.workunit.client.0.smithi027.stdout:6/367: creat d4/d15/f69 x:0 0 0 2024-09-20T19:05:58.263 INFO:tasks.workunit.client.0.smithi027.stdout:6/368: readlink d4/lc 0 2024-09-20T19:05:58.263 INFO:tasks.workunit.client.0.smithi027.stdout:5/473: fsync d4/da/d1a/f4f 0 2024-09-20T19:05:58.263 INFO:tasks.workunit.client.1.smithi098.stdout:0/291: mknod d0/d6/d28/d31/d45/c52 0 2024-09-20T19:05:58.266 INFO:tasks.workunit.client.0.smithi027.stdout:6/369: fdatasync d4/d1b/d62/d64/f68 0 2024-09-20T19:05:58.266 INFO:tasks.workunit.client.0.smithi027.stdout:4/298: dwrite d5/d11/d17/f65 [0,4194304] 0 2024-09-20T19:05:58.268 INFO:tasks.workunit.client.0.smithi027.stdout:5/474: write d4/da/d1a/f57 [1168433,23187] 0 2024-09-20T19:05:58.270 INFO:tasks.workunit.client.0.smithi027.stdout:2/362: dwrite d3/d13/f2b [0,4194304] 0 2024-09-20T19:05:58.271 INFO:tasks.workunit.client.0.smithi027.stdout:0/465: write d2/da2/fa8 [424077,123367] 0 2024-09-20T19:05:58.274 INFO:tasks.workunit.client.0.smithi027.stdout:2/363: fdatasync d3/de/f18 0 2024-09-20T19:05:58.275 INFO:tasks.workunit.client.0.smithi027.stdout:4/299: rename d5/f54 to d5/d13/f66 0 2024-09-20T19:05:58.280 INFO:tasks.workunit.client.0.smithi027.stdout:2/364: rmdir d3/d1c/d31 39 2024-09-20T19:05:58.280 INFO:tasks.workunit.client.0.smithi027.stdout:0/466: chown d2/d48/d6b/d79/d84/d1d/d2e/c7e 53664 1 2024-09-20T19:05:58.281 INFO:tasks.workunit.client.0.smithi027.stdout:6/370: dwrite d4/d15/d37/f4a [0,4194304] 0 2024-09-20T19:05:58.282 INFO:tasks.workunit.client.0.smithi027.stdout:5/475: rename d4/da/de/d3e/d69/f7c to d4/d1f/d91/f94 0 2024-09-20T19:05:58.283 INFO:tasks.workunit.client.0.smithi027.stdout:0/467: mknod d2/d49/cab 0 2024-09-20T19:05:58.284 INFO:tasks.workunit.client.0.smithi027.stdout:6/371: mkdir d4/d15/d37/d6a 0 2024-09-20T19:05:58.287 INFO:tasks.workunit.client.0.smithi027.stdout:5/476: rename d4/da/l46 to d4/da/de/d3e/d69/l95 0 2024-09-20T19:05:58.288 INFO:tasks.workunit.client.0.smithi027.stdout:6/372: creat d4/d6/d4b/f6b x:0 0 0 2024-09-20T19:05:58.291 INFO:tasks.workunit.client.0.smithi027.stdout:6/373: dread - d4/d15/f69 zero size 2024-09-20T19:05:58.291 INFO:tasks.workunit.client.1.smithi098.stdout:0/292: dread d0/d15/d38/f39 [0,4194304] 0 2024-09-20T19:05:58.292 INFO:tasks.workunit.client.0.smithi027.stdout:2/365: dwrite d3/d1c/d26/f67 [0,4194304] 0 2024-09-20T19:05:58.292 INFO:tasks.workunit.client.1.smithi098.stdout:0/293: dread d0/db/d32/f3a [0,4194304] 0 2024-09-20T19:05:58.293 INFO:tasks.workunit.client.0.smithi027.stdout:5/477: creat d4/da/de/d3e/d69/d75/d3d/f96 x:0 0 0 2024-09-20T19:05:58.296 INFO:tasks.workunit.client.0.smithi027.stdout:5/478: readlink d4/da/de/l14 0 2024-09-20T19:05:58.298 INFO:tasks.workunit.client.0.smithi027.stdout:4/300: chown d5/d11/d17/d53/l57 573978 1 2024-09-20T19:05:58.299 INFO:tasks.workunit.client.1.smithi098.stdout:0/294: dread d0/db/d1d/f26 [0,4194304] 0 2024-09-20T19:05:58.300 INFO:tasks.workunit.client.0.smithi027.stdout:6/374: dread d4/d6/f2a [0,4194304] 0 2024-09-20T19:05:58.300 INFO:tasks.workunit.client.0.smithi027.stdout:4/301: readlink d5/d11/l4b 0 2024-09-20T19:05:58.300 INFO:tasks.workunit.client.0.smithi027.stdout:2/366: truncate d3/d1c/f23 1669796 0 2024-09-20T19:05:58.301 INFO:tasks.workunit.client.0.smithi027.stdout:4/302: readlink d5/d13/d16/l18 0 2024-09-20T19:05:58.301 INFO:tasks.workunit.client.0.smithi027.stdout:4/303: stat d5/d13/d16/d21/d3a/f62 0 2024-09-20T19:05:58.304 INFO:tasks.workunit.client.1.smithi098.stdout:0/295: dwrite d0/d15/f1e [0,4194304] 0 2024-09-20T19:05:58.304 INFO:tasks.workunit.client.0.smithi027.stdout:4/304: unlink d5/d13/d16/d21/f2e 0 2024-09-20T19:05:58.308 INFO:tasks.workunit.client.0.smithi027.stdout:6/375: dwrite d4/d6/f56 [0,4194304] 0 2024-09-20T19:05:58.308 INFO:tasks.workunit.client.0.smithi027.stdout:4/305: mkdir d5/d13/d36/d67 0 2024-09-20T19:05:58.311 INFO:tasks.workunit.client.0.smithi027.stdout:6/376: creat d4/d1b/d62/f6c x:0 0 0 2024-09-20T19:05:58.312 INFO:tasks.workunit.client.0.smithi027.stdout:4/306: dread d5/d11/d17/d1b/f3c [0,4194304] 0 2024-09-20T19:05:58.313 INFO:tasks.workunit.client.0.smithi027.stdout:6/377: write d4/d15/f4f [264052,59255] 0 2024-09-20T19:05:58.313 INFO:tasks.workunit.client.0.smithi027.stdout:6/378: readlink d4/lc 0 2024-09-20T19:05:58.314 INFO:tasks.workunit.client.1.smithi098.stdout:0/296: dread d0/d6/fe [0,4194304] 0 2024-09-20T19:05:58.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/297: creat d0/d6/d28/d31/f53 x:0 0 0 2024-09-20T19:05:58.320 INFO:tasks.workunit.client.0.smithi027.stdout:6/379: dwrite d4/d6/f11 [0,4194304] 0 2024-09-20T19:05:58.320 INFO:tasks.workunit.client.1.smithi098.stdout:0/298: chown d0/db/d1d/f34 1824 1 2024-09-20T19:05:58.320 INFO:tasks.workunit.client.0.smithi027.stdout:4/307: truncate d5/d13/d16/d21/d3a/f5e 2248276 0 2024-09-20T19:05:58.321 INFO:tasks.workunit.client.0.smithi027.stdout:5/479: write d4/da/d1a/f4f [970222,119056] 0 2024-09-20T19:05:58.322 INFO:tasks.workunit.client.0.smithi027.stdout:6/380: chown d4/c13 251376496 1 2024-09-20T19:05:58.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/299: symlink d0/d6/d28/d31/d45/l54 0 2024-09-20T19:05:58.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/300: chown d0/db/d1d/f2a 0 1 2024-09-20T19:05:58.327 INFO:tasks.workunit.client.0.smithi027.stdout:5/480: rename d4/f89 to d4/d7a/f97 0 2024-09-20T19:05:58.328 INFO:tasks.workunit.client.0.smithi027.stdout:5/481: dread - d4/f86 zero size 2024-09-20T19:05:58.329 INFO:tasks.workunit.client.0.smithi027.stdout:2/367: dwrite d3/ff [0,4194304] 0 2024-09-20T19:05:58.330 INFO:tasks.workunit.client.0.smithi027.stdout:2/368: readlink d3/d2f/l3a 0 2024-09-20T19:05:58.330 INFO:tasks.workunit.client.1.smithi098.stdout:0/301: rename d0/d15 to d0/d55 0 2024-09-20T19:05:58.331 INFO:tasks.workunit.client.0.smithi027.stdout:5/482: mkdir d4/da/d98 0 2024-09-20T19:05:58.332 INFO:tasks.workunit.client.0.smithi027.stdout:2/369: readlink d3/d24/l3d 0 2024-09-20T19:05:58.332 INFO:tasks.workunit.client.1.smithi098.stdout:0/302: mknod d0/d6/d19/c56 0 2024-09-20T19:05:58.335 INFO:tasks.workunit.client.0.smithi027.stdout:5/483: symlink d4/d1f/d7f/l99 0 2024-09-20T19:05:58.336 INFO:tasks.workunit.client.1.smithi098.stdout:0/303: fdatasync d0/db/d1d/f2a 0 2024-09-20T19:05:58.337 INFO:tasks.workunit.client.0.smithi027.stdout:2/370: dread d3/ff [0,4194304] 0 2024-09-20T19:05:58.338 INFO:tasks.workunit.client.0.smithi027.stdout:5/484: read d4/da/de/d3e/f8b [157554,130765] 0 2024-09-20T19:05:58.340 INFO:tasks.workunit.client.0.smithi027.stdout:2/371: mknod d3/c6b 0 2024-09-20T19:05:58.341 INFO:tasks.workunit.client.0.smithi027.stdout:2/372: write d3/d1c/f47 [631818,12302] 0 2024-09-20T19:05:58.342 INFO:tasks.workunit.client.0.smithi027.stdout:5/485: link d4/da/de/d3e/d44/f4c d4/d7a/d87/f9a 0 2024-09-20T19:05:58.343 INFO:tasks.workunit.client.0.smithi027.stdout:5/486: fsync d4/da/f29 0 2024-09-20T19:05:58.348 INFO:tasks.workunit.client.0.smithi027.stdout:5/487: write d4/da/d1a/f1b [2098930,58870] 0 2024-09-20T19:05:58.349 INFO:tasks.workunit.client.0.smithi027.stdout:4/308: write d5/d13/d16/d21/d3a/f62 [324904,7945] 0 2024-09-20T19:05:58.349 INFO:tasks.workunit.client.0.smithi027.stdout:6/381: write d4/f9 [2617325,51984] 0 2024-09-20T19:05:58.352 INFO:tasks.workunit.client.0.smithi027.stdout:0/468: dread d2/d48/d6b/d79/d84/d1b/f5f [0,4194304] 0 2024-09-20T19:05:58.353 INFO:tasks.workunit.client.0.smithi027.stdout:5/488: readlink d4/da/de/d3e/d69/l95 0 2024-09-20T19:05:58.354 INFO:tasks.workunit.client.0.smithi027.stdout:6/382: mknod d4/d15/d2c/c6d 0 2024-09-20T19:05:58.356 INFO:tasks.workunit.client.0.smithi027.stdout:5/489: mkdir d4/d1f/d91/d9b 0 2024-09-20T19:05:58.358 INFO:tasks.workunit.client.0.smithi027.stdout:4/309: creat d5/d11/f68 x:0 0 0 2024-09-20T19:05:58.359 INFO:tasks.workunit.client.0.smithi027.stdout:5/490: chown d4/d1f/d28/c81 106990 1 2024-09-20T19:05:58.361 INFO:tasks.workunit.client.0.smithi027.stdout:5/491: readlink d4/da/de/l14 0 2024-09-20T19:05:58.361 INFO:tasks.workunit.client.0.smithi027.stdout:4/310: symlink d5/d13/d36/d48/d3f/d4c/l69 0 2024-09-20T19:05:58.363 INFO:tasks.workunit.client.0.smithi027.stdout:6/383: dwrite d4/d1b/d62/f66 [0,4194304] 0 2024-09-20T19:05:58.363 INFO:tasks.workunit.client.0.smithi027.stdout:5/492: rmdir d4/d1f 39 2024-09-20T19:05:58.365 INFO:tasks.workunit.client.0.smithi027.stdout:6/384: fsync d4/d15/f2f 0 2024-09-20T19:05:58.369 INFO:tasks.workunit.client.0.smithi027.stdout:0/469: dwrite d2/d48/d6b/f80 [4194304,4194304] 0 2024-09-20T19:05:58.374 INFO:tasks.workunit.client.0.smithi027.stdout:0/470: chown d2/d48/d6b/d79 173 1 2024-09-20T19:05:58.374 INFO:tasks.workunit.client.0.smithi027.stdout:6/385: rename d4/d1b/d2b/d33/l3e to d4/d1b/d2b/d46/d53/l6e 0 2024-09-20T19:05:58.378 INFO:tasks.workunit.client.0.smithi027.stdout:6/386: stat d4/d15/f69 0 2024-09-20T19:05:58.378 INFO:tasks.workunit.client.0.smithi027.stdout:4/311: dwrite d5/d13/d36/d48/f3b [0,4194304] 0 2024-09-20T19:05:58.380 INFO:tasks.workunit.client.0.smithi027.stdout:5/493: dwrite d4/d1f/d28/f8f [0,4194304] 0 2024-09-20T19:05:58.380 INFO:tasks.workunit.client.0.smithi027.stdout:0/471: creat d2/d48/d6b/d79/fac x:0 0 0 2024-09-20T19:05:58.381 INFO:tasks.workunit.client.0.smithi027.stdout:6/387: chown d4/l2e 787 1 2024-09-20T19:05:58.382 INFO:tasks.workunit.client.0.smithi027.stdout:6/388: stat d4/d6/f2a 0 2024-09-20T19:05:58.383 INFO:tasks.workunit.client.0.smithi027.stdout:4/312: rename d5/d13/d16/f46 to d5/d11/d3d/f6a 0 2024-09-20T19:05:58.384 INFO:tasks.workunit.client.0.smithi027.stdout:5/494: write d4/da/de/d3e/f8b [1632885,98153] 0 2024-09-20T19:05:58.385 INFO:tasks.workunit.client.0.smithi027.stdout:0/472: mknod d2/d48/d6b/d79/d9f/da4/cad 0 2024-09-20T19:05:58.386 INFO:tasks.workunit.client.0.smithi027.stdout:5/495: dread - d4/f45 zero size 2024-09-20T19:05:58.388 INFO:tasks.workunit.client.0.smithi027.stdout:6/389: rename d4/d1b/c55 to d4/d6/d4b/c6f 0 2024-09-20T19:05:58.390 INFO:tasks.workunit.client.0.smithi027.stdout:5/496: symlink d4/da/de/d3e/d69/d6a/l9c 0 2024-09-20T19:05:58.392 INFO:tasks.workunit.client.0.smithi027.stdout:6/390: mkdir d4/d1b/d2b/d70 0 2024-09-20T19:05:58.393 INFO:tasks.workunit.client.0.smithi027.stdout:6/391: readlink d4/d15/l21 0 2024-09-20T19:05:58.393 INFO:tasks.workunit.client.0.smithi027.stdout:5/497: creat d4/d1f/d91/f9d x:0 0 0 2024-09-20T19:05:58.395 INFO:tasks.workunit.client.0.smithi027.stdout:5/498: mkdir d4/da/de/d3e/d69/d6a/d9e 0 2024-09-20T19:05:58.397 INFO:tasks.workunit.client.0.smithi027.stdout:6/392: dread d4/d15/d37/f4a [0,4194304] 0 2024-09-20T19:05:58.400 INFO:tasks.workunit.client.0.smithi027.stdout:6/393: creat d4/d1b/d2b/d46/f71 x:0 0 0 2024-09-20T19:05:58.400 INFO:tasks.workunit.client.0.smithi027.stdout:5/499: dread d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:05:58.401 INFO:tasks.workunit.client.0.smithi027.stdout:0/473: write d2/d20/d52/fd [1213534,83457] 0 2024-09-20T19:05:58.402 INFO:tasks.workunit.client.0.smithi027.stdout:6/394: symlink d4/d1b/d2b/d46/d53/l72 0 2024-09-20T19:05:58.403 INFO:tasks.workunit.client.0.smithi027.stdout:5/500: creat d4/da/d1a/f9f x:0 0 0 2024-09-20T19:05:58.404 INFO:tasks.workunit.client.0.smithi027.stdout:6/395: dread - d4/d6/d4b/f6b zero size 2024-09-20T19:05:58.404 INFO:tasks.workunit.client.0.smithi027.stdout:0/474: creat d2/d49/fae x:0 0 0 2024-09-20T19:05:58.405 INFO:tasks.workunit.client.0.smithi027.stdout:6/396: write d4/d15/f2f [561238,127604] 0 2024-09-20T19:05:58.406 INFO:tasks.workunit.client.0.smithi027.stdout:0/475: mknod d2/caf 0 2024-09-20T19:05:58.407 INFO:tasks.workunit.client.0.smithi027.stdout:6/397: chown d4/d6/d4b/c6f 0 1 2024-09-20T19:05:58.408 INFO:tasks.workunit.client.0.smithi027.stdout:6/398: chown d4/d6/c12 494011614 1 2024-09-20T19:05:58.408 INFO:tasks.workunit.client.0.smithi027.stdout:0/476: symlink d2/d48/d6b/d79/d84/d1b/d39/lb0 0 2024-09-20T19:05:58.409 INFO:tasks.workunit.client.0.smithi027.stdout:6/399: stat d4/d1b/d2b 0 2024-09-20T19:05:58.409 INFO:tasks.workunit.client.0.smithi027.stdout:5/501: dread d4/da/d1a/f57 [0,4194304] 0 2024-09-20T19:05:58.410 INFO:tasks.workunit.client.0.smithi027.stdout:6/400: write d4/d6/fa [4289435,32704] 0 2024-09-20T19:05:58.411 INFO:tasks.workunit.client.0.smithi027.stdout:6/401: fsync d4/f42 0 2024-09-20T19:05:58.411 INFO:tasks.workunit.client.0.smithi027.stdout:0/477: link d2/d49/fae d2/d48/fb1 0 2024-09-20T19:05:58.412 INFO:tasks.workunit.client.0.smithi027.stdout:5/502: mknod d4/da/de/d3e/d44/ca0 0 2024-09-20T19:05:58.413 INFO:tasks.workunit.client.0.smithi027.stdout:0/478: chown d2/d48/d6b/d79/d84/d1d/d2e/c7e 0 1 2024-09-20T19:05:58.413 INFO:tasks.workunit.client.0.smithi027.stdout:6/402: creat d4/d15/d37/d6a/f73 x:0 0 0 2024-09-20T19:05:58.415 INFO:tasks.workunit.client.0.smithi027.stdout:0/479: creat d2/d48/fb2 x:0 0 0 2024-09-20T19:05:58.419 INFO:tasks.workunit.client.0.smithi027.stdout:0/480: creat d2/d20/d52/fb3 x:0 0 0 2024-09-20T19:05:58.422 INFO:tasks.workunit.client.0.smithi027.stdout:5/503: write d4/da/de/d3e/d69/d75/f20 [4795160,83178] 0 2024-09-20T19:05:58.423 INFO:tasks.workunit.client.0.smithi027.stdout:6/403: truncate d4/d15/d37/d39/f3f 3702097 0 2024-09-20T19:05:58.423 INFO:tasks.workunit.client.0.smithi027.stdout:0/481: dread d2/d48/d6b/d79/d84/f31 [0,4194304] 0 2024-09-20T19:05:58.424 INFO:tasks.workunit.client.0.smithi027.stdout:5/504: dread - d4/da/de/d3e/d69/d6a/f8c zero size 2024-09-20T19:05:58.425 INFO:tasks.workunit.client.0.smithi027.stdout:6/404: unlink d4/d6/c1c 0 2024-09-20T19:05:58.426 INFO:tasks.workunit.client.0.smithi027.stdout:0/482: unlink d2/d49/f97 0 2024-09-20T19:05:58.426 INFO:tasks.workunit.client.0.smithi027.stdout:5/505: symlink d4/d6c/la1 0 2024-09-20T19:05:58.427 INFO:tasks.workunit.client.0.smithi027.stdout:6/405: stat d4/d1b/d2b/d46/d53/l60 0 2024-09-20T19:05:58.427 INFO:tasks.workunit.client.0.smithi027.stdout:6/406: readlink d4/d6/l51 0 2024-09-20T19:05:58.428 INFO:tasks.workunit.client.0.smithi027.stdout:5/506: mknod d4/da/ca2 0 2024-09-20T19:05:58.429 INFO:tasks.workunit.client.0.smithi027.stdout:6/407: read d4/d1b/d2b/d33/f4d [2324157,112633] 0 2024-09-20T19:05:58.431 INFO:tasks.workunit.client.0.smithi027.stdout:0/483: dwrite d2/d49/f45 [0,4194304] 0 2024-09-20T19:05:58.432 INFO:tasks.workunit.client.0.smithi027.stdout:5/507: truncate d4/da/de/d3e/d69/d75/d3d/f96 279528 0 2024-09-20T19:05:58.434 INFO:tasks.workunit.client.0.smithi027.stdout:0/484: creat d2/d48/d6b/d79/fb4 x:0 0 0 2024-09-20T19:05:58.437 INFO:tasks.workunit.client.0.smithi027.stdout:6/408: dwrite d4/d15/d37/f40 [0,4194304] 0 2024-09-20T19:05:58.441 INFO:tasks.workunit.client.0.smithi027.stdout:0/485: truncate d2/d48/d6b/d79/d84/d1b/d39/f81 1778554 0 2024-09-20T19:05:58.443 INFO:tasks.workunit.client.0.smithi027.stdout:5/508: dread d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:58.444 INFO:tasks.workunit.client.0.smithi027.stdout:0/486: rmdir d2/d48/d6b/d79/d9f 39 2024-09-20T19:05:58.448 INFO:tasks.workunit.client.0.smithi027.stdout:5/509: creat d4/d1f/d28/fa3 x:0 0 0 2024-09-20T19:05:58.448 INFO:tasks.workunit.client.0.smithi027.stdout:0/487: symlink d2/d48/d6b/d79/d84/lb5 0 2024-09-20T19:05:58.450 INFO:tasks.workunit.client.0.smithi027.stdout:0/488: symlink d2/d48/d6b/d79/lb6 0 2024-09-20T19:05:58.452 INFO:tasks.workunit.client.0.smithi027.stdout:0/489: mkdir d2/db7 0 2024-09-20T19:05:58.454 INFO:tasks.workunit.client.0.smithi027.stdout:5/510: dwrite d4/da/de/f37 [0,4194304] 0 2024-09-20T19:05:58.456 INFO:tasks.workunit.client.0.smithi027.stdout:0/490: write d2/d20/f47 [3425370,16870] 0 2024-09-20T19:05:58.457 INFO:tasks.workunit.client.0.smithi027.stdout:5/511: rmdir d4/d1f/d7f 39 2024-09-20T19:05:58.459 INFO:tasks.workunit.client.0.smithi027.stdout:6/409: truncate d4/d1b/d2b/d33/f4d 2076455 0 2024-09-20T19:05:58.463 INFO:tasks.workunit.client.0.smithi027.stdout:6/410: truncate d4/d15/d2c/f5b 747 0 2024-09-20T19:05:58.463 INFO:tasks.workunit.client.0.smithi027.stdout:5/512: mkdir d4/d1f/d7f/da4 0 2024-09-20T19:05:58.463 INFO:tasks.workunit.client.0.smithi027.stdout:6/411: dread - d4/d1b/d62/d64/f68 zero size 2024-09-20T19:05:58.463 INFO:tasks.workunit.client.0.smithi027.stdout:0/491: dread d2/d20/d52/d51/f8e [0,4194304] 0 2024-09-20T19:05:58.464 INFO:tasks.workunit.client.0.smithi027.stdout:6/412: mknod d4/c74 0 2024-09-20T19:05:58.465 INFO:tasks.workunit.client.0.smithi027.stdout:0/492: mknod d2/db7/cb8 0 2024-09-20T19:05:58.466 INFO:tasks.workunit.client.0.smithi027.stdout:6/413: symlink d4/d1b/d2b/d46/d53/l75 0 2024-09-20T19:05:58.467 INFO:tasks.workunit.client.0.smithi027.stdout:0/493: rename d2/d20/fa6 to d2/d48/fb9 0 2024-09-20T19:05:58.468 INFO:tasks.workunit.client.0.smithi027.stdout:0/494: truncate d2/d20/d52/fa0 519143 0 2024-09-20T19:05:58.470 INFO:tasks.workunit.client.0.smithi027.stdout:9/552: sync 2024-09-20T19:05:58.470 INFO:tasks.workunit.client.0.smithi027.stdout:7/417: sync 2024-09-20T19:05:58.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:58 smithi098 ceph-mon[35737]: pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 189 MiB/s wr, 326 op/s 2024-09-20T19:05:58.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:58 smithi098 ceph-mon[35737]: mgrmap e25: smithi098.wrcvbg(active, since 8s), standbys: smithi027.tlgpqo 2024-09-20T19:05:58.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:05:58 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:05:58.486 INFO:tasks.workunit.client.0.smithi027.stdout:0/495: dread d2/d20/d52/d51/f8e [0,4194304] 0 2024-09-20T19:05:58.488 INFO:tasks.workunit.client.0.smithi027.stdout:7/418: truncate d3/d24/f2c 2962869 0 2024-09-20T19:05:58.488 INFO:tasks.workunit.client.0.smithi027.stdout:6/414: dwrite d4/d15/d37/f4a [0,4194304] 0 2024-09-20T19:05:58.489 INFO:tasks.workunit.client.0.smithi027.stdout:7/419: chown d3/d8 675 1 2024-09-20T19:05:58.490 INFO:tasks.workunit.client.0.smithi027.stdout:0/496: chown d2/d48/d6b/d79/d9f/da4/la9 6434887 1 2024-09-20T19:05:58.491 INFO:tasks.workunit.client.0.smithi027.stdout:6/415: chown d4/d15/d37/f45 4301891 1 2024-09-20T19:05:58.493 INFO:tasks.workunit.client.0.smithi027.stdout:7/420: chown d3/c62 1905 1 2024-09-20T19:05:58.494 INFO:tasks.workunit.client.0.smithi027.stdout:9/553: dwrite d0/d97/fa3 [0,4194304] 0 2024-09-20T19:05:58.496 INFO:tasks.workunit.client.0.smithi027.stdout:6/416: unlink d4/d1b/f35 0 2024-09-20T19:05:58.499 INFO:tasks.workunit.client.0.smithi027.stdout:6/417: fsync d4/d1b/d62/f6c 0 2024-09-20T19:05:58.500 INFO:tasks.workunit.client.0.smithi027.stdout:0/497: rename d2/d20/l91 to d2/d20/d52/d51/lba 0 2024-09-20T19:05:58.502 INFO:tasks.workunit.client.0.smithi027.stdout:0/498: read d2/d49/f45 [2428969,77760] 0 2024-09-20T19:05:58.502 INFO:tasks.workunit.client.0.smithi027.stdout:7/421: mknod d3/d8/d26/d45/d56/c8f 0 2024-09-20T19:05:58.503 INFO:tasks.workunit.client.0.smithi027.stdout:6/418: mknod d4/d15/d37/d39/c76 0 2024-09-20T19:05:58.505 INFO:tasks.workunit.client.0.smithi027.stdout:7/422: write d3/d8/da/dc/f63 [334903,38907] 0 2024-09-20T19:05:58.506 INFO:tasks.workunit.client.0.smithi027.stdout:9/554: unlink d0/c5c 0 2024-09-20T19:05:58.506 INFO:tasks.workunit.client.0.smithi027.stdout:4/313: dread d5/d13/f66 [0,4194304] 0 2024-09-20T19:05:58.507 INFO:tasks.workunit.client.0.smithi027.stdout:0/499: write d2/d20/d52/d51/f8e [666695,70803] 0 2024-09-20T19:05:58.507 INFO:tasks.workunit.client.0.smithi027.stdout:9/555: chown d0/d2e/l31 10222 1 2024-09-20T19:05:58.508 INFO:tasks.workunit.client.0.smithi027.stdout:7/423: read - d3/d24/f37 zero size 2024-09-20T19:05:58.509 INFO:tasks.workunit.client.0.smithi027.stdout:6/419: creat d4/d1b/d2b/f77 x:0 0 0 2024-09-20T19:05:58.509 INFO:tasks.workunit.client.0.smithi027.stdout:9/556: readlink d0/d9/df/l96 0 2024-09-20T19:05:58.509 INFO:tasks.workunit.client.0.smithi027.stdout:4/314: chown d5/d13/d16/d21/d26/l2c 17403 1 2024-09-20T19:05:58.511 INFO:tasks.workunit.client.0.smithi027.stdout:9/557: unlink d0/d9/df/f21 0 2024-09-20T19:05:58.513 INFO:tasks.workunit.client.0.smithi027.stdout:6/420: mkdir d4/d15/d37/d5a/d78 0 2024-09-20T19:05:58.514 INFO:tasks.workunit.client.0.smithi027.stdout:9/558: dread - d0/d9/df/d1b/d9c/d4f/d8d/fb1 zero size 2024-09-20T19:05:58.515 INFO:tasks.workunit.client.0.smithi027.stdout:4/315: unlink d5/d11/d17/d1b/f2b 0 2024-09-20T19:05:58.516 INFO:tasks.workunit.client.0.smithi027.stdout:7/424: getdents d3/d8/d26/d45/d56/d8d 0 2024-09-20T19:05:58.516 INFO:tasks.workunit.client.0.smithi027.stdout:0/500: dwrite d2/d48/d6b/d79/d84/f3f [0,4194304] 0 2024-09-20T19:05:58.517 INFO:tasks.workunit.client.0.smithi027.stdout:4/316: truncate f4 6083806 0 2024-09-20T19:05:58.517 INFO:tasks.workunit.client.0.smithi027.stdout:7/425: chown d3/f29 255898226 1 2024-09-20T19:05:58.519 INFO:tasks.workunit.client.0.smithi027.stdout:6/421: mknod d4/d15/d37/d6a/c79 0 2024-09-20T19:05:58.524 INFO:tasks.workunit.client.0.smithi027.stdout:4/317: creat d5/d11/d17/d64/f6b x:0 0 0 2024-09-20T19:05:58.527 INFO:tasks.workunit.client.0.smithi027.stdout:7/426: dwrite d3/d8/d26/f73 [0,4194304] 0 2024-09-20T19:05:58.529 INFO:tasks.workunit.client.0.smithi027.stdout:6/422: chown d4/d15/d37/d39/f3f 132888253 1 2024-09-20T19:05:58.532 INFO:tasks.workunit.client.0.smithi027.stdout:7/427: rmdir d3/d8/d26/d65 39 2024-09-20T19:05:58.534 INFO:tasks.workunit.client.0.smithi027.stdout:6/423: rename d4/d1b/d2b to d4/d15/d37/d7a 0 2024-09-20T19:05:58.536 INFO:tasks.workunit.client.0.smithi027.stdout:0/501: getdents d2/d48/d6b/d79/d84/d1d/d2e 0 2024-09-20T19:05:58.538 INFO:tasks.workunit.client.0.smithi027.stdout:7/428: rename d3/d8/da/d2e/d39/l6e to d3/d8/da/dc/l90 0 2024-09-20T19:05:58.540 INFO:tasks.workunit.client.1.smithi098.stdout:3/354: sync 2024-09-20T19:05:58.541 INFO:tasks.workunit.client.0.smithi027.stdout:0/502: symlink d2/lbb 0 2024-09-20T19:05:58.541 INFO:tasks.workunit.client.0.smithi027.stdout:4/318: dwrite d5/f10 [4194304,4194304] 0 2024-09-20T19:05:58.542 INFO:tasks.workunit.client.1.smithi098.stdout:3/355: write d4/d19/d1d/f47 [226507,14829] 0 2024-09-20T19:05:58.542 INFO:tasks.workunit.client.0.smithi027.stdout:6/424: getdents d4/d6 0 2024-09-20T19:05:58.543 INFO:tasks.workunit.client.1.smithi098.stdout:3/356: write d4/d19/d1d/f47 [59679,3575] 0 2024-09-20T19:05:58.544 INFO:tasks.workunit.client.0.smithi027.stdout:9/559: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/f86 [4194304,4194304] 0 2024-09-20T19:05:58.546 INFO:tasks.workunit.client.0.smithi027.stdout:4/319: dread - d5/d11/d17/d1b/f5f zero size 2024-09-20T19:05:58.549 INFO:tasks.workunit.client.0.smithi027.stdout:7/429: rename d3/d8/d26/f5c to d3/f91 0 2024-09-20T19:05:58.552 INFO:tasks.workunit.client.0.smithi027.stdout:6/425: unlink d4/d1b/d62/f66 0 2024-09-20T19:05:58.555 INFO:tasks.workunit.client.1.smithi098.stdout:3/357: dread d4/d19/d1d/f3b [0,4194304] 0 2024-09-20T19:05:58.556 INFO:tasks.workunit.client.0.smithi027.stdout:0/503: write d2/fc [824579,12665] 0 2024-09-20T19:05:58.557 INFO:tasks.workunit.client.0.smithi027.stdout:4/320: dwrite d5/d13/d16/d21/d3a/f62 [0,4194304] 0 2024-09-20T19:05:58.558 INFO:tasks.workunit.client.0.smithi027.stdout:7/430: rename d3/d8/da/f28 to d3/d24/d84/f92 0 2024-09-20T19:05:58.562 INFO:tasks.workunit.client.0.smithi027.stdout:6/426: creat d4/d15/d37/f7b x:0 0 0 2024-09-20T19:05:58.563 INFO:tasks.workunit.client.0.smithi027.stdout:3/415: sync 2024-09-20T19:05:58.563 INFO:tasks.workunit.client.0.smithi027.stdout:2/373: sync 2024-09-20T19:05:58.563 INFO:tasks.workunit.client.0.smithi027.stdout:1/417: sync 2024-09-20T19:05:58.563 INFO:tasks.workunit.client.0.smithi027.stdout:8/445: sync 2024-09-20T19:05:58.564 INFO:tasks.workunit.client.1.smithi098.stdout:3/358: mknod d4/d19/d1d/c73 0 2024-09-20T19:05:58.565 INFO:tasks.workunit.client.0.smithi027.stdout:0/504: symlink d2/d20/d52/d29/lbc 0 2024-09-20T19:05:58.568 INFO:tasks.workunit.client.0.smithi027.stdout:6/427: rename d4/d1b/d62 to d4/d6/d4b/d7c 0 2024-09-20T19:05:58.569 INFO:tasks.workunit.client.0.smithi027.stdout:8/446: rmdir d2/d3/d1b/d35 39 2024-09-20T19:05:58.569 INFO:tasks.workunit.client.0.smithi027.stdout:6/428: dread - d4/d15/d37/d7a/d46/f71 zero size 2024-09-20T19:05:58.570 INFO:tasks.workunit.client.0.smithi027.stdout:1/418: mknod d2/d8/d2b/d2d/d3e/c77 0 2024-09-20T19:05:58.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:58 smithi027 ceph-mon[28196]: pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 189 MiB/s wr, 326 op/s 2024-09-20T19:05:58.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:58 smithi027 ceph-mon[28196]: mgrmap e25: smithi098.wrcvbg(active, since 8s), standbys: smithi027.tlgpqo 2024-09-20T19:05:58.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:05:58 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:05:58.571 INFO:tasks.workunit.client.1.smithi098.stdout:3/359: dwrite d4/d25/f68 [0,4194304] 0 2024-09-20T19:05:58.572 INFO:tasks.workunit.client.0.smithi027.stdout:4/321: symlink d5/d13/d36/d59/l6c 0 2024-09-20T19:05:58.573 INFO:tasks.workunit.client.0.smithi027.stdout:0/505: creat d2/d48/d6b/d79/d84/d1b/fbd x:0 0 0 2024-09-20T19:05:58.575 INFO:tasks.workunit.client.1.smithi098.stdout:3/360: chown d4/f16 1050457949 1 2024-09-20T19:05:58.576 INFO:tasks.workunit.client.0.smithi027.stdout:9/560: link d0/d9/df/d1b/d9c/d4f/fa1 d0/d9/df/d1c/fb2 0 2024-09-20T19:05:58.577 INFO:tasks.workunit.client.0.smithi027.stdout:9/561: fdatasync d0/f47 0 2024-09-20T19:05:58.578 INFO:tasks.workunit.client.1.smithi098.stdout:3/361: creat d4/d38/d48/d60/f74 x:0 0 0 2024-09-20T19:05:58.581 INFO:tasks.workunit.client.1.smithi098.stdout:3/362: unlink d4/d19/d1d/d2f/l5f 0 2024-09-20T19:05:58.583 INFO:tasks.workunit.client.0.smithi027.stdout:6/429: fdatasync d4/d15/d2c/f49 0 2024-09-20T19:05:58.584 INFO:tasks.workunit.client.1.smithi098.stdout:3/363: rmdir d4/d19/d1d/d22 39 2024-09-20T19:05:58.586 INFO:tasks.workunit.client.0.smithi027.stdout:7/431: write d3/d24/f2c [1226515,1909] 0 2024-09-20T19:05:58.587 INFO:tasks.workunit.client.0.smithi027.stdout:7/432: readlink d3/d8/da/l77 0 2024-09-20T19:05:58.588 INFO:tasks.workunit.client.0.smithi027.stdout:0/506: unlink d2/d48/d6b/d79/d84/d1d/d2e/l8b 0 2024-09-20T19:05:58.588 INFO:tasks.workunit.client.0.smithi027.stdout:7/433: chown d3/d8/d26/d45/d56/f7d 159 1 2024-09-20T19:05:58.589 INFO:tasks.workunit.client.0.smithi027.stdout:3/416: creat d0/d1/d13/f8c x:0 0 0 2024-09-20T19:05:58.590 INFO:tasks.workunit.client.0.smithi027.stdout:9/562: creat d0/d9/df/d1c/d6a/d6d/dd/d66/fb3 x:0 0 0 2024-09-20T19:05:58.590 INFO:tasks.workunit.client.0.smithi027.stdout:2/374: link d3/d13/c21 d3/d13/d3c/d48/c6c 0 2024-09-20T19:05:58.591 INFO:tasks.workunit.client.0.smithi027.stdout:8/447: link d2/d14/d13/f3b d2/d3/d6/f94 0 2024-09-20T19:05:58.592 INFO:tasks.workunit.client.1.smithi098.stdout:3/364: dwrite d4/d19/d1d/f6d [0,4194304] 0 2024-09-20T19:05:58.592 INFO:tasks.workunit.client.0.smithi027.stdout:8/448: stat d2/d14/f27 0 2024-09-20T19:05:58.592 INFO:tasks.workunit.client.0.smithi027.stdout:6/430: mknod d4/d6/d4b/c7d 0 2024-09-20T19:05:58.593 INFO:tasks.workunit.client.0.smithi027.stdout:8/449: fsync d2/d14/d13/f7c 0 2024-09-20T19:05:58.593 INFO:tasks.workunit.client.0.smithi027.stdout:4/322: fdatasync d5/d13/d16/d21/d3a/f4e 0 2024-09-20T19:05:58.594 INFO:tasks.workunit.client.0.smithi027.stdout:0/507: mknod d2/d48/d6b/d79/d84/d1b/cbe 0 2024-09-20T19:05:58.596 INFO:tasks.workunit.client.0.smithi027.stdout:8/450: write d2/d3/f57 [827206,1135] 0 2024-09-20T19:05:58.596 INFO:tasks.workunit.client.0.smithi027.stdout:4/323: fdatasync d5/d13/f5c 0 2024-09-20T19:05:58.597 INFO:tasks.workunit.client.0.smithi027.stdout:6/431: chown d4/d6/d4b/f6b 14 1 2024-09-20T19:05:58.600 INFO:tasks.workunit.client.0.smithi027.stdout:7/434: creat d3/d8/d1c/d80/f93 x:0 0 0 2024-09-20T19:05:58.600 INFO:tasks.workunit.client.0.smithi027.stdout:0/508: truncate d2/d49/fae 897507 0 2024-09-20T19:05:58.601 INFO:tasks.workunit.client.0.smithi027.stdout:8/451: chown d2/d14/d13/d2e/d6c 2522865 1 2024-09-20T19:05:58.602 INFO:tasks.workunit.client.0.smithi027.stdout:6/432: write d4/d15/d37/d7a/f77 [329114,111531] 0 2024-09-20T19:05:58.603 INFO:tasks.workunit.client.0.smithi027.stdout:3/417: truncate d0/d1/d5e/d1d/f3a 1804699 0 2024-09-20T19:05:58.604 INFO:tasks.workunit.client.0.smithi027.stdout:1/419: link d2/d8/l4d d2/d8/d74/l78 0 2024-09-20T19:05:58.604 INFO:tasks.workunit.client.0.smithi027.stdout:8/452: dread d2/d14/d13/d2e/d6c/f6e [4194304,4194304] 0 2024-09-20T19:05:58.606 INFO:tasks.workunit.client.0.smithi027.stdout:9/563: creat d0/d9/df/d1b/d9c/fb4 x:0 0 0 2024-09-20T19:05:58.607 INFO:tasks.workunit.client.0.smithi027.stdout:9/564: chown d0/d9/f28 696996 1 2024-09-20T19:05:58.608 INFO:tasks.workunit.client.0.smithi027.stdout:7/435: unlink d3/d8/d26/c41 0 2024-09-20T19:05:58.608 INFO:tasks.workunit.client.0.smithi027.stdout:2/375: dread d3/de/f1f [0,4194304] 0 2024-09-20T19:05:58.609 INFO:tasks.workunit.client.0.smithi027.stdout:7/436: fsync d3/d8/d26/d45/d56/f7d 0 2024-09-20T19:05:58.610 INFO:tasks.workunit.client.0.smithi027.stdout:0/509: creat d2/d48/d6b/fbf x:0 0 0 2024-09-20T19:05:58.610 INFO:tasks.workunit.client.0.smithi027.stdout:7/437: fdatasync d3/d8/d26/f71 0 2024-09-20T19:05:58.612 INFO:tasks.workunit.client.0.smithi027.stdout:4/324: creat d5/f6d x:0 0 0 2024-09-20T19:05:58.613 INFO:tasks.workunit.client.0.smithi027.stdout:9/565: creat d0/d9/df/d1c/fb5 x:0 0 0 2024-09-20T19:05:58.614 INFO:tasks.workunit.client.0.smithi027.stdout:8/453: dread d2/d3/d6/f94 [0,4194304] 0 2024-09-20T19:05:58.615 INFO:tasks.workunit.client.0.smithi027.stdout:0/510: chown d2/d48/d6b/d79/d84/d1b/f75 1209714 1 2024-09-20T19:05:58.616 INFO:tasks.workunit.client.1.smithi098.stdout:3/365: dwrite d4/d25/f35 [0,4194304] 0 2024-09-20T19:05:58.616 INFO:tasks.workunit.client.0.smithi027.stdout:0/511: dread - d2/d48/d6b/d79/d84/d1b/f8c zero size 2024-09-20T19:05:58.617 INFO:tasks.workunit.client.0.smithi027.stdout:1/420: creat d2/d8/d74/f79 x:0 0 0 2024-09-20T19:05:58.618 INFO:tasks.workunit.client.0.smithi027.stdout:7/438: symlink d3/d8/d26/l94 0 2024-09-20T19:05:58.621 INFO:tasks.workunit.client.0.smithi027.stdout:3/418: link d0/d1/l2d d0/d1/d13/d15/d76/l8d 0 2024-09-20T19:05:58.621 INFO:tasks.workunit.client.0.smithi027.stdout:4/325: dwrite f4 [0,4194304] 0 2024-09-20T19:05:58.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/366: creat d4/d38/d48/f75 x:0 0 0 2024-09-20T19:05:58.625 INFO:tasks.workunit.client.0.smithi027.stdout:9/566: creat d0/d9/df/d1b/d9c/d5a/fb6 x:0 0 0 2024-09-20T19:05:58.626 INFO:tasks.workunit.client.0.smithi027.stdout:8/454: mknod d2/d14/d13/c95 0 2024-09-20T19:05:58.629 INFO:tasks.workunit.client.0.smithi027.stdout:7/439: creat d3/d8/d26/d45/f95 x:0 0 0 2024-09-20T19:05:58.633 INFO:tasks.workunit.client.0.smithi027.stdout:1/421: creat d2/d1b/d56/d71/f7a x:0 0 0 2024-09-20T19:05:58.635 INFO:tasks.workunit.client.0.smithi027.stdout:4/326: rename d5/d11/d17/d64 to d5/d11/d3d/d6e 0 2024-09-20T19:05:58.636 INFO:tasks.workunit.client.0.smithi027.stdout:8/455: mknod d2/d3/d6/d21/d33/d79/c96 0 2024-09-20T19:05:58.637 INFO:tasks.workunit.client.0.smithi027.stdout:7/440: creat d3/d8/f96 x:0 0 0 2024-09-20T19:05:58.637 INFO:tasks.workunit.client.0.smithi027.stdout:7/441: dread - d3/f29 zero size 2024-09-20T19:05:58.638 INFO:tasks.workunit.client.0.smithi027.stdout:8/456: mknod d2/d3/d6/d21/c97 0 2024-09-20T19:05:58.639 INFO:tasks.workunit.client.0.smithi027.stdout:1/422: creat d2/d1b/f7b x:0 0 0 2024-09-20T19:05:58.640 INFO:tasks.workunit.client.0.smithi027.stdout:7/442: creat d3/d8/d1c/d61/f97 x:0 0 0 2024-09-20T19:05:58.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/367: truncate d4/d19/d1d/f6d 128487 0 2024-09-20T19:05:58.642 INFO:tasks.workunit.client.0.smithi027.stdout:3/419: write d0/d1/d13/f1c [2371768,17056] 0 2024-09-20T19:05:58.643 INFO:tasks.workunit.client.0.smithi027.stdout:7/443: fdatasync d3/d8/da/d2e/d49/d8b/f6c 0 2024-09-20T19:05:58.643 INFO:tasks.workunit.client.0.smithi027.stdout:1/423: rename d2/c6a to d2/d8/c7c 0 2024-09-20T19:05:58.644 INFO:tasks.workunit.client.1.smithi098.stdout:3/368: readlink d4/d19/d1d/d2f/d4e/l6e 0 2024-09-20T19:05:58.645 INFO:tasks.workunit.client.0.smithi027.stdout:7/444: dread - d3/d8/f96 zero size 2024-09-20T19:05:58.647 INFO:tasks.workunit.client.0.smithi027.stdout:9/567: truncate d0/d9/df/d1c/d6a/d6d/f36 614819 0 2024-09-20T19:05:58.648 INFO:tasks.workunit.client.0.smithi027.stdout:8/457: dwrite d2/d14/d13/d2e/f62 [0,4194304] 0 2024-09-20T19:05:58.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/369: dwrite d4/f1b [0,4194304] 0 2024-09-20T19:05:58.649 INFO:tasks.workunit.client.0.smithi027.stdout:3/420: mkdir d0/d1/d65/d8e 0 2024-09-20T19:05:58.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/370: write d4/d25/f35 [5183943,28780] 0 2024-09-20T19:05:58.650 INFO:tasks.workunit.client.0.smithi027.stdout:3/421: dread - d0/d1/f26 zero size 2024-09-20T19:05:58.650 INFO:tasks.workunit.client.0.smithi027.stdout:9/568: write d0/d9/df/d1c/d6a/d6d/dd/f29 [987399,39744] 0 2024-09-20T19:05:58.651 INFO:tasks.workunit.client.1.smithi098.stdout:3/371: stat d4/d19/c57 0 2024-09-20T19:05:58.652 INFO:tasks.workunit.client.0.smithi027.stdout:1/424: rename d2/d8/d2b/d2d/l42 to d2/d8/d2b/d5e/l7d 0 2024-09-20T19:05:58.658 INFO:tasks.workunit.client.0.smithi027.stdout:8/458: creat d2/d14/d13/d51/f98 x:0 0 0 2024-09-20T19:05:58.660 INFO:tasks.workunit.client.1.smithi098.stdout:3/372: stat d4/d19/d1d/d22/f24 0 2024-09-20T19:05:58.663 INFO:tasks.workunit.client.0.smithi027.stdout:9/569: unlink d0/d9/df/d1c/f81 0 2024-09-20T19:05:58.670 INFO:tasks.workunit.client.0.smithi027.stdout:9/570: creat d0/d9/df/d1c/d6a/d9a/fb7 x:0 0 0 2024-09-20T19:05:58.671 INFO:tasks.workunit.client.0.smithi027.stdout:1/425: symlink d2/d8/d3b/d4b/l7e 0 2024-09-20T19:05:58.672 INFO:tasks.workunit.client.0.smithi027.stdout:7/445: getdents d3/d8 0 2024-09-20T19:05:58.677 INFO:tasks.workunit.client.0.smithi027.stdout:7/446: rename d3/d8/d26/d65/c76 to d3/d24/c98 0 2024-09-20T19:05:58.678 INFO:tasks.workunit.client.0.smithi027.stdout:9/571: dwrite d0/d9/df/d1b/d9c/f54 [4194304,4194304] 0 2024-09-20T19:05:58.678 INFO:tasks.workunit.client.0.smithi027.stdout:1/426: link d2/d8/d2b/d2d/d3e/c5f d2/d61/c7f 0 2024-09-20T19:05:58.682 INFO:tasks.workunit.client.0.smithi027.stdout:7/447: symlink d3/d8/da/l99 0 2024-09-20T19:05:58.685 INFO:tasks.workunit.client.0.smithi027.stdout:9/572: write d0/d2e/f76 [780295,65066] 0 2024-09-20T19:05:58.690 INFO:tasks.workunit.client.0.smithi027.stdout:8/459: dwrite d2/d14/d13/f3b [0,4194304] 0 2024-09-20T19:05:58.692 INFO:tasks.workunit.client.0.smithi027.stdout:5/513: sync 2024-09-20T19:05:58.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/373: dread d4/fd [0,4194304] 0 2024-09-20T19:05:58.693 INFO:tasks.workunit.client.0.smithi027.stdout:3/422: dwrite d0/d1/fb [0,4194304] 0 2024-09-20T19:05:58.693 INFO:tasks.workunit.client.0.smithi027.stdout:8/460: fdatasync d2/d14/d13/d2e/f60 0 2024-09-20T19:05:58.695 INFO:tasks.workunit.client.1.smithi098.stdout:3/374: mknod d4/d38/d48/c76 0 2024-09-20T19:05:58.695 INFO:tasks.workunit.client.0.smithi027.stdout:1/427: write d2/d8/d74/f35 [2766788,126482] 0 2024-09-20T19:05:58.696 INFO:tasks.workunit.client.0.smithi027.stdout:7/448: mknod d3/d8/d26/d45/d56/d8d/c9a 0 2024-09-20T19:05:58.696 INFO:tasks.workunit.client.1.smithi098.stdout:3/375: write d4/da/f6c [410605,43228] 0 2024-09-20T19:05:58.700 INFO:tasks.workunit.client.1.smithi098.stdout:3/376: symlink d4/d19/d1d/d2f/d3e/l77 0 2024-09-20T19:05:58.701 INFO:tasks.workunit.client.0.smithi027.stdout:3/423: read d0/d19/d54/f67 [2811278,22477] 0 2024-09-20T19:05:58.703 INFO:tasks.workunit.client.0.smithi027.stdout:9/573: dwrite d0/d9/df/d1c/d6a/d9a/fb7 [0,4194304] 0 2024-09-20T19:05:58.704 INFO:tasks.workunit.client.1.smithi098.stdout:3/377: creat d4/da/d50/f78 x:0 0 0 2024-09-20T19:05:58.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/378: getdents d4/d25/d40/d4b 0 2024-09-20T19:05:58.722 INFO:tasks.workunit.client.1.smithi098.stdout:3/379: dwrite d4/d25/f49 [0,4194304] 0 2024-09-20T19:05:58.724 INFO:tasks.workunit.client.1.smithi098.stdout:3/380: getdents d4/d25/d40/d4b 0 2024-09-20T19:05:58.730 INFO:tasks.workunit.client.1.smithi098.stdout:3/381: truncate d4/da/fb 969722 0 2024-09-20T19:05:58.730 INFO:tasks.workunit.client.1.smithi098.stdout:3/382: read d4/d19/d1d/f3b [122159,41767] 0 2024-09-20T19:05:58.733 INFO:tasks.workunit.client.1.smithi098.stdout:3/383: creat d4/d38/d48/f79 x:0 0 0 2024-09-20T19:05:58.735 INFO:tasks.workunit.client.1.smithi098.stdout:3/384: mkdir d4/da/d7a 0 2024-09-20T19:05:58.735 INFO:tasks.workunit.client.1.smithi098.stdout:3/385: fdatasync d4/d38/d48/f79 0 2024-09-20T19:05:58.740 INFO:tasks.workunit.client.1.smithi098.stdout:3/386: dwrite d4/d38/d48/f75 [0,4194304] 0 2024-09-20T19:05:58.743 INFO:tasks.workunit.client.1.smithi098.stdout:3/387: mkdir d4/d19/d7b 0 2024-09-20T19:05:58.764 INFO:tasks.workunit.client.1.smithi098.stdout:3/388: dread d4/f34 [0,4194304] 0 2024-09-20T19:05:58.765 INFO:tasks.workunit.client.1.smithi098.stdout:3/389: fsync d4/da/f32 0 2024-09-20T19:05:58.775 INFO:tasks.workunit.client.1.smithi098.stdout:3/390: dread d4/da/f14 [0,4194304] 0 2024-09-20T19:05:58.777 INFO:tasks.workunit.client.1.smithi098.stdout:3/391: getdents d4/d25 0 2024-09-20T19:05:58.777 INFO:tasks.workunit.client.1.smithi098.stdout:3/392: chown d4/d25/d40/d4b 10 1 2024-09-20T19:05:58.779 INFO:tasks.workunit.client.0.smithi027.stdout:3/424: write d0/d1/fb [4735139,124503] 0 2024-09-20T19:05:58.780 INFO:tasks.workunit.client.0.smithi027.stdout:7/449: creat d3/d8/da/d2e/d49/f9b x:0 0 0 2024-09-20T19:05:58.780 INFO:tasks.workunit.client.1.smithi098.stdout:7/526: sync 2024-09-20T19:05:58.780 INFO:tasks.workunit.client.1.smithi098.stdout:6/297: sync 2024-09-20T19:05:58.781 INFO:tasks.workunit.client.1.smithi098.stdout:3/393: getdents d4/d19/d1d/d2f/d4e 0 2024-09-20T19:05:58.781 INFO:tasks.workunit.client.0.smithi027.stdout:9/574: chown d0/d9/c2d 252 1 2024-09-20T19:05:58.783 INFO:tasks.workunit.client.1.smithi098.stdout:3/394: chown d4/d25/d40/d4b/l61 2782 1 2024-09-20T19:05:58.784 INFO:tasks.workunit.client.0.smithi027.stdout:7/450: write d3/d8/d26/f4a [1445662,49150] 0 2024-09-20T19:05:58.784 INFO:tasks.workunit.client.1.smithi098.stdout:7/527: read d3/d10/d16/d17/d33/d37/da0/f4d [782884,50012] 0 2024-09-20T19:05:58.787 INFO:tasks.workunit.client.0.smithi027.stdout:3/425: mknod d0/c8f 0 2024-09-20T19:05:58.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/395: dread d4/d25/f3c [0,4194304] 0 2024-09-20T19:05:58.788 INFO:tasks.workunit.client.0.smithi027.stdout:7/451: dread - d3/d8/d1c/d61/f89 zero size 2024-09-20T19:05:58.789 INFO:tasks.workunit.client.0.smithi027.stdout:5/514: dwrite d4/da/d1a/f57 [0,4194304] 0 2024-09-20T19:05:58.790 INFO:tasks.workunit.client.1.smithi098.stdout:3/396: fdatasync d4/da/f14 0 2024-09-20T19:05:58.790 INFO:tasks.workunit.client.0.smithi027.stdout:3/426: stat d0/d1/d5e/d1d/f4e 0 2024-09-20T19:05:58.792 INFO:tasks.workunit.client.1.smithi098.stdout:3/397: mkdir d4/d19/d1d/d2f/d4e/d59/d7c 0 2024-09-20T19:05:58.792 INFO:tasks.workunit.client.0.smithi027.stdout:1/428: dwrite d2/f66 [0,4194304] 0 2024-09-20T19:05:58.795 INFO:tasks.workunit.client.0.smithi027.stdout:7/452: chown d3/d8/d1c/d80 110144902 1 2024-09-20T19:05:58.795 INFO:tasks.workunit.client.0.smithi027.stdout:9/575: creat d0/d9/df/d1b/d9c/d4f/d8d/da0/fb8 x:0 0 0 2024-09-20T19:05:58.797 INFO:tasks.workunit.client.0.smithi027.stdout:5/515: dread d4/da/de/d3e/d69/d75/d3d/f96 [0,4194304] 0 2024-09-20T19:05:58.800 INFO:tasks.workunit.client.0.smithi027.stdout:7/453: fsync d3/d8/f96 0 2024-09-20T19:05:58.801 INFO:tasks.workunit.client.0.smithi027.stdout:9/576: rmdir d0/d9 39 2024-09-20T19:05:58.801 INFO:tasks.workunit.client.1.smithi098.stdout:3/398: dwrite d4/f1b [0,4194304] 0 2024-09-20T19:05:58.803 INFO:tasks.workunit.client.0.smithi027.stdout:5/516: chown d4/da/de/d3e/d69/l95 718150020 1 2024-09-20T19:05:58.803 INFO:tasks.workunit.client.0.smithi027.stdout:3/427: dwrite d0/d1/d13/f49 [0,4194304] 0 2024-09-20T19:05:58.804 INFO:tasks.workunit.client.1.smithi098.stdout:6/298: dread d0/de/d1b/d37/d44/dc/f1a [0,4194304] 0 2024-09-20T19:05:58.805 INFO:tasks.workunit.client.0.smithi027.stdout:3/428: chown d0/d38/c7b 36084 1 2024-09-20T19:05:58.805 INFO:tasks.workunit.client.0.smithi027.stdout:8/461: dread d2/f39 [0,4194304] 0 2024-09-20T19:05:58.807 INFO:tasks.workunit.client.0.smithi027.stdout:9/577: chown d0/d9/df/d1c/d6a/d6d/dd 42 1 2024-09-20T19:05:58.807 INFO:tasks.workunit.client.0.smithi027.stdout:8/462: write d2/d14/d13/f3b [3751211,46522] 0 2024-09-20T19:05:58.809 INFO:tasks.workunit.client.1.smithi098.stdout:6/299: truncate d0/de/d1b/d37/d44/dc/f41 5162079 0 2024-09-20T19:05:58.809 INFO:tasks.workunit.client.0.smithi027.stdout:6/433: sync 2024-09-20T19:05:58.814 INFO:tasks.workunit.client.1.smithi098.stdout:6/300: fsync d0/de/f18 0 2024-09-20T19:05:58.815 INFO:tasks.workunit.client.1.smithi098.stdout:7/528: dread d3/d10/d16/d17/d33/d1f/f3c [0,4194304] 0 2024-09-20T19:05:58.818 INFO:tasks.workunit.client.1.smithi098.stdout:7/529: symlink d3/d10/d16/d73/lac 0 2024-09-20T19:05:58.819 INFO:tasks.workunit.client.0.smithi027.stdout:3/429: dwrite d0/d19/d54/f73 [0,4194304] 0 2024-09-20T19:05:58.821 INFO:tasks.workunit.client.1.smithi098.stdout:7/530: symlink d3/d10/d16/d17/d7c/lad 0 2024-09-20T19:05:58.822 INFO:tasks.workunit.client.1.smithi098.stdout:6/301: getdents d0/de/d1b/d37/d44/d24/d29/d2b 0 2024-09-20T19:05:58.822 INFO:tasks.workunit.client.1.smithi098.stdout:3/399: dread d4/d19/d1d/d22/f24 [0,4194304] 0 2024-09-20T19:05:58.823 INFO:tasks.workunit.client.1.smithi098.stdout:6/302: mkdir d0/d55 0 2024-09-20T19:05:58.824 INFO:tasks.workunit.client.0.smithi027.stdout:8/463: dread d2/f47 [0,4194304] 0 2024-09-20T19:05:58.824 INFO:tasks.workunit.client.1.smithi098.stdout:7/531: truncate d3/d10/d16/d17/d33/d37/f98 946209 0 2024-09-20T19:05:58.825 INFO:tasks.workunit.client.0.smithi027.stdout:9/578: creat d0/d9/df/d1b/d9c/d4f/fb9 x:0 0 0 2024-09-20T19:05:58.830 INFO:tasks.workunit.client.1.smithi098.stdout:3/400: dwrite d4/da/f32 [0,4194304] 0 2024-09-20T19:05:58.831 INFO:tasks.workunit.client.1.smithi098.stdout:7/532: symlink d3/d10/d16/d17/d33/d37/da0/lae 0 2024-09-20T19:05:58.833 INFO:tasks.workunit.client.0.smithi027.stdout:6/434: dwrite d4/d6/d4b/d7c/f6c [0,4194304] 0 2024-09-20T19:05:58.834 INFO:tasks.workunit.client.1.smithi098.stdout:3/401: mknod d4/d19/d1d/d2f/c7d 0 2024-09-20T19:05:58.834 INFO:tasks.workunit.client.0.smithi027.stdout:5/517: dwrite d4/da/de/d3e/f59 [4194304,4194304] 0 2024-09-20T19:05:58.836 INFO:tasks.workunit.client.0.smithi027.stdout:9/579: rmdir d0/d9/df/d1c/d6a/d6d/dd 39 2024-09-20T19:05:58.840 INFO:tasks.workunit.client.0.smithi027.stdout:8/464: truncate d2/d14/f20 1144427 0 2024-09-20T19:05:58.842 INFO:tasks.workunit.client.1.smithi098.stdout:4/545: sync 2024-09-20T19:05:58.842 INFO:tasks.workunit.client.1.smithi098.stdout:9/507: sync 2024-09-20T19:05:58.842 INFO:tasks.workunit.client.1.smithi098.stdout:5/415: sync 2024-09-20T19:05:58.844 INFO:tasks.workunit.client.0.smithi027.stdout:1/429: truncate d2/d8/f52 224041 0 2024-09-20T19:05:58.848 INFO:tasks.workunit.client.0.smithi027.stdout:5/518: dread d4/da/de/d3e/d69/d75/d3d/f96 [0,4194304] 0 2024-09-20T19:05:58.850 INFO:tasks.workunit.client.0.smithi027.stdout:1/430: chown d2/d8/d2b/f58 962559 1 2024-09-20T19:05:58.851 INFO:tasks.workunit.client.0.smithi027.stdout:3/430: write d0/d1/d5e/d1d/f3a [38771,70424] 0 2024-09-20T19:05:58.851 INFO:tasks.workunit.client.0.smithi027.stdout:6/435: dwrite d4/d1b/f3d [0,4194304] 0 2024-09-20T19:05:58.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/508: rename d4/de/d24/fa1 to d4/de/d48/fac 0 2024-09-20T19:05:58.854 INFO:tasks.workunit.client.0.smithi027.stdout:7/454: dwrite d3/f5 [0,4194304] 0 2024-09-20T19:05:58.855 INFO:tasks.workunit.client.1.smithi098.stdout:9/509: write d4/de/d27/d4a/d58/d5b/fa4 [301087,1683] 0 2024-09-20T19:05:58.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/416: unlink d1/d1b/d40/l44 0 2024-09-20T19:05:58.859 INFO:tasks.workunit.client.1.smithi098.stdout:5/417: stat d1/d46/d69/c6c 0 2024-09-20T19:05:58.859 INFO:tasks.workunit.client.1.smithi098.stdout:3/402: dwrite d4/d19/d1d/d22/f24 [0,4194304] 0 2024-09-20T19:05:58.860 INFO:tasks.workunit.client.1.smithi098.stdout:9/510: chown d4/de/d27/d4a/d21/f46 21410 1 2024-09-20T19:05:58.861 INFO:tasks.workunit.client.1.smithi098.stdout:5/418: stat d1/d17/d25/c28 0 2024-09-20T19:05:58.861 INFO:tasks.workunit.client.0.smithi027.stdout:1/431: creat d2/d8/d2b/d2d/f80 x:0 0 0 2024-09-20T19:05:58.862 INFO:tasks.workunit.client.0.smithi027.stdout:3/431: rmdir d0/d1/d13 39 2024-09-20T19:05:58.863 INFO:tasks.workunit.client.1.smithi098.stdout:9/511: write d4/de/d27/d4a/d21/d25/f30 [5234624,29516] 0 2024-09-20T19:05:58.863 INFO:tasks.workunit.client.1.smithi098.stdout:3/403: write d4/d19/d1d/d2f/f53 [78946,96254] 0 2024-09-20T19:05:58.863 INFO:tasks.workunit.client.0.smithi027.stdout:5/519: chown d4/da/de/d3e/d61/c93 7 1 2024-09-20T19:05:58.866 INFO:tasks.workunit.client.0.smithi027.stdout:6/436: mknod d4/d6/d4b/d7c/c7e 0 2024-09-20T19:05:58.866 INFO:tasks.workunit.client.0.smithi027.stdout:8/465: dwrite d2/d14/d13/f71 [0,4194304] 0 2024-09-20T19:05:58.866 INFO:tasks.workunit.client.1.smithi098.stdout:9/512: readlink d4/de/d27/d4a/l87 0 2024-09-20T19:05:58.867 INFO:tasks.workunit.client.1.smithi098.stdout:5/419: creat d1/d17/d35/f80 x:0 0 0 2024-09-20T19:05:58.868 INFO:tasks.workunit.client.1.smithi098.stdout:3/404: rmdir d4/d19/d1d 39 2024-09-20T19:05:58.868 INFO:tasks.workunit.client.0.smithi027.stdout:6/437: write d4/d15/d37/f7b [523029,33844] 0 2024-09-20T19:05:58.869 INFO:tasks.workunit.client.0.smithi027.stdout:9/580: write d0/f12 [3347195,20258] 0 2024-09-20T19:05:58.870 INFO:tasks.workunit.client.1.smithi098.stdout:5/420: truncate d1/d17/d35/d54/f62 844118 0 2024-09-20T19:05:58.870 INFO:tasks.workunit.client.0.smithi027.stdout:7/455: creat d3/d8/da/d2e/f9c x:0 0 0 2024-09-20T19:05:58.873 INFO:tasks.workunit.client.1.smithi098.stdout:7/533: dread d3/f64 [0,4194304] 0 2024-09-20T19:05:58.876 INFO:tasks.workunit.client.0.smithi027.stdout:9/581: symlink d0/d97/lba 0 2024-09-20T19:05:58.876 INFO:tasks.workunit.client.1.smithi098.stdout:3/405: dread d4/f1c [0,4194304] 0 2024-09-20T19:05:58.876 INFO:tasks.workunit.client.0.smithi027.stdout:8/466: dread d2/d14/d13/d2e/d6c/f6e [0,4194304] 0 2024-09-20T19:05:58.879 INFO:tasks.workunit.client.1.smithi098.stdout:7/534: creat d3/d76/d86/faf x:0 0 0 2024-09-20T19:05:58.879 INFO:tasks.workunit.client.1.smithi098.stdout:9/513: dwrite d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:05:58.880 INFO:tasks.workunit.client.0.smithi027.stdout:6/438: mkdir d4/d15/d37/d6a/d7f 0 2024-09-20T19:05:58.880 INFO:tasks.workunit.client.1.smithi098.stdout:6/303: dread d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:05:58.880 INFO:tasks.workunit.client.0.smithi027.stdout:3/432: chown d0/d1/d13/d15/d76/l8d 39333486 1 2024-09-20T19:05:58.881 INFO:tasks.workunit.client.1.smithi098.stdout:5/421: dread d1/d17/d2e/f67 [0,4194304] 0 2024-09-20T19:05:58.882 INFO:tasks.workunit.client.0.smithi027.stdout:1/432: getdents d2/d8/d3b/d4b/d75 0 2024-09-20T19:05:58.887 INFO:tasks.workunit.client.0.smithi027.stdout:1/433: rmdir d2 39 2024-09-20T19:05:58.889 INFO:tasks.workunit.client.0.smithi027.stdout:3/433: dwrite d0/d1/d13/d15/d55/f6a [0,4194304] 0 2024-09-20T19:05:58.890 INFO:tasks.workunit.client.1.smithi098.stdout:5/422: unlink d1/d17/d25/f3d 0 2024-09-20T19:05:58.890 INFO:tasks.workunit.client.1.smithi098.stdout:5/423: dread - d1/d1b/f4a zero size 2024-09-20T19:05:58.891 INFO:tasks.workunit.client.0.smithi027.stdout:9/582: mknod d0/d9/df/d1c/d6a/d6d/dd/d58/cbb 0 2024-09-20T19:05:58.891 INFO:tasks.workunit.client.0.smithi027.stdout:9/583: stat d0/d9/la9 0 2024-09-20T19:05:58.893 INFO:tasks.workunit.client.0.smithi027.stdout:2/376: sync 2024-09-20T19:05:58.895 INFO:tasks.workunit.client.0.smithi027.stdout:8/467: rename d2/d3/d6/d21/c97 to d2/d14/d13/d43/d5d/d86/c99 0 2024-09-20T19:05:58.897 INFO:tasks.workunit.client.1.smithi098.stdout:5/424: dwrite d1/d1b/d40/f4c [0,4194304] 0 2024-09-20T19:05:58.897 INFO:tasks.workunit.client.0.smithi027.stdout:3/434: creat d0/d1/d13/d15/d6f/f90 x:0 0 0 2024-09-20T19:05:58.898 INFO:tasks.workunit.client.0.smithi027.stdout:0/512: sync 2024-09-20T19:05:58.898 INFO:tasks.workunit.client.0.smithi027.stdout:4/327: sync 2024-09-20T19:05:58.898 INFO:tasks.workunit.client.1.smithi098.stdout:3/406: creat d4/d19/d1d/d2f/f7e x:0 0 0 2024-09-20T19:05:58.898 INFO:tasks.workunit.client.1.smithi098.stdout:1/413: sync 2024-09-20T19:05:58.899 INFO:tasks.workunit.client.1.smithi098.stdout:8/499: sync 2024-09-20T19:05:58.899 INFO:tasks.workunit.client.1.smithi098.stdout:0/304: sync 2024-09-20T19:05:58.899 INFO:tasks.workunit.client.1.smithi098.stdout:2/765: sync 2024-09-20T19:05:58.900 INFO:tasks.workunit.client.0.smithi027.stdout:1/434: mknod d2/d8/d2b/d5e/c81 0 2024-09-20T19:05:58.903 INFO:tasks.workunit.client.0.smithi027.stdout:7/456: fsync d3/f5 0 2024-09-20T19:05:58.906 INFO:tasks.workunit.client.1.smithi098.stdout:5/425: creat d1/d17/d5e/f81 x:0 0 0 2024-09-20T19:05:58.906 INFO:tasks.workunit.client.0.smithi027.stdout:0/513: dwrite d2/d48/fb2 [0,4194304] 0 2024-09-20T19:05:58.907 INFO:tasks.workunit.client.0.smithi027.stdout:2/377: rename d3/d2f/f32 to d3/d13/f6d 0 2024-09-20T19:05:58.908 INFO:tasks.workunit.client.1.smithi098.stdout:5/426: chown d1/d46 1821 1 2024-09-20T19:05:58.910 INFO:tasks.workunit.client.1.smithi098.stdout:2/766: fsync d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fdf 0 2024-09-20T19:05:58.911 INFO:tasks.workunit.client.0.smithi027.stdout:8/468: write d2/f39 [9352064,7516] 0 2024-09-20T19:05:58.911 INFO:tasks.workunit.client.1.smithi098.stdout:1/414: mkdir d1/d3/df/d34/d43/d7c 0 2024-09-20T19:05:58.914 INFO:tasks.workunit.client.0.smithi027.stdout:5/520: dread d4/da/de/d3e/d44/f52 [0,4194304] 0 2024-09-20T19:05:58.917 INFO:tasks.workunit.client.0.smithi027.stdout:3/435: unlink d0/d1/d13/f49 0 2024-09-20T19:05:58.919 INFO:tasks.workunit.client.0.smithi027.stdout:2/378: dwrite d3/d1c/d26/d2a/f53 [0,4194304] 0 2024-09-20T19:05:58.919 INFO:tasks.workunit.client.1.smithi098.stdout:8/500: dwrite d7/f10 [8388608,4194304] 0 2024-09-20T19:05:58.919 INFO:tasks.workunit.client.0.smithi027.stdout:2/379: fsync d3/d2f/f42 0 2024-09-20T19:05:58.920 INFO:tasks.workunit.client.1.smithi098.stdout:2/767: stat d3/d16/d1d/d2b/d46 0 2024-09-20T19:05:58.921 INFO:tasks.workunit.client.1.smithi098.stdout:3/407: rename d4/d19/d1d/d2f/d3e/f67 to d4/d38/d48/d60/f7f 0 2024-09-20T19:05:58.923 INFO:tasks.workunit.client.1.smithi098.stdout:0/305: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:05:58.924 INFO:tasks.workunit.client.1.smithi098.stdout:4/546: dwrite d3/d4f/f72 [0,4194304] 0 2024-09-20T19:05:58.925 INFO:tasks.workunit.client.1.smithi098.stdout:1/415: read - d1/d3/df/d34/d43/d53/f60 zero size 2024-09-20T19:05:58.926 INFO:tasks.workunit.client.0.smithi027.stdout:9/584: link d0/d9/df/d1c/d6a/d6d/dd/d66/f86 d0/d9/df/d1c/fbc 0 2024-09-20T19:05:58.926 INFO:tasks.workunit.client.1.smithi098.stdout:8/501: chown d7/l9 60 1 2024-09-20T19:05:58.928 INFO:tasks.workunit.client.0.smithi027.stdout:4/328: dread d5/d13/d36/d48/d3f/d4c/f55 [0,4194304] 0 2024-09-20T19:05:58.929 INFO:tasks.workunit.client.0.smithi027.stdout:4/329: chown d5/d11/d17/d53/f61 12032 1 2024-09-20T19:05:58.930 INFO:tasks.workunit.client.0.smithi027.stdout:4/330: stat d5/d11/d1a/d2a 0 2024-09-20T19:05:58.931 INFO:tasks.workunit.client.1.smithi098.stdout:0/306: readlink d0/d55/l36 0 2024-09-20T19:05:58.931 INFO:tasks.workunit.client.1.smithi098.stdout:7/535: dread d3/d4c/f7f [0,4194304] 0 2024-09-20T19:05:58.932 INFO:tasks.workunit.client.0.smithi027.stdout:9/585: dread d0/d9/df/d1c/d6a/d6d/dd/d66/f86 [4194304,4194304] 0 2024-09-20T19:05:58.933 INFO:tasks.workunit.client.0.smithi027.stdout:1/435: mkdir d2/d8/d3b/d82 0 2024-09-20T19:05:58.938 INFO:tasks.workunit.client.0.smithi027.stdout:6/439: getdents d4/d15/d37/d6a 0 2024-09-20T19:05:58.938 INFO:tasks.workunit.client.0.smithi027.stdout:7/457: dread d3/f91 [0,4194304] 0 2024-09-20T19:05:58.940 INFO:tasks.workunit.client.0.smithi027.stdout:0/514: rename d2/d48/d6b/d79/d84/d1b/f75 to d2/da2/fc0 0 2024-09-20T19:05:58.942 INFO:tasks.workunit.client.1.smithi098.stdout:7/536: dwrite d3/d76/d86/fa3 [0,4194304] 0 2024-09-20T19:05:58.942 INFO:tasks.workunit.client.1.smithi098.stdout:3/408: dwrite d4/d19/d1d/d2f/f53 [0,4194304] 0 2024-09-20T19:05:58.948 INFO:tasks.workunit.client.0.smithi027.stdout:5/521: unlink d4/da/d1a/f9f 0 2024-09-20T19:05:58.948 INFO:tasks.workunit.client.1.smithi098.stdout:6/304: truncate d0/de/d1b/f39 510393 0 2024-09-20T19:05:58.955 INFO:tasks.workunit.client.1.smithi098.stdout:2/768: dread d3/d16/d1d/d2b/d99/f9d [0,4194304] 0 2024-09-20T19:05:58.959 INFO:tasks.workunit.client.1.smithi098.stdout:2/769: fsync d3/d16/d1d/d4f/d8b/d38/fc2 0 2024-09-20T19:05:58.961 INFO:tasks.workunit.client.0.smithi027.stdout:9/586: symlink d0/d9/df/d1c/d6a/d9a/lbd 0 2024-09-20T19:05:58.963 INFO:tasks.workunit.client.0.smithi027.stdout:1/436: readlink d2/d8/l4d 0 2024-09-20T19:05:58.964 INFO:tasks.workunit.client.1.smithi098.stdout:9/514: symlink d4/de/d24/d35/d2d/da6/lad 0 2024-09-20T19:05:58.966 INFO:tasks.workunit.client.0.smithi027.stdout:3/436: dread d0/f11 [0,4194304] 0 2024-09-20T19:05:58.966 INFO:tasks.workunit.client.1.smithi098.stdout:3/409: mkdir d4/d25/d40/d80 0 2024-09-20T19:05:58.967 INFO:tasks.workunit.client.0.smithi027.stdout:3/437: write d0/d1/d5e/d1d/f4e [1610674,674] 0 2024-09-20T19:05:58.971 INFO:tasks.workunit.client.0.smithi027.stdout:2/380: rename d3/de/d34/l35 to d3/d24/l6e 0 2024-09-20T19:05:58.972 INFO:tasks.workunit.client.1.smithi098.stdout:8/502: mkdir d7/de/d11/d19/daf 0 2024-09-20T19:05:58.972 INFO:tasks.workunit.client.1.smithi098.stdout:1/416: dread d1/d3/df/d34/d43/d65/f73 [0,4194304] 0 2024-09-20T19:05:58.975 INFO:tasks.workunit.client.1.smithi098.stdout:7/537: truncate d3/d10/d16/d17/d33/d1f/d28/f61 8402921 0 2024-09-20T19:05:58.976 INFO:tasks.workunit.client.1.smithi098.stdout:7/538: truncate d3/d10/d16/d73/fa4 57352 0 2024-09-20T19:05:58.976 INFO:tasks.workunit.client.0.smithi027.stdout:0/515: creat d2/d20/fc1 x:0 0 0 2024-09-20T19:05:58.978 INFO:tasks.workunit.client.1.smithi098.stdout:7/539: dread d3/d10/d16/d17/d33/d1f/d2d/f38 [0,4194304] 0 2024-09-20T19:05:58.981 INFO:tasks.workunit.client.0.smithi027.stdout:5/522: rmdir d4/da/de/d3e/d69 39 2024-09-20T19:05:58.982 INFO:tasks.workunit.client.0.smithi027.stdout:5/523: read - d4/d1f/d91/f9d zero size 2024-09-20T19:05:58.982 INFO:tasks.workunit.client.1.smithi098.stdout:4/547: truncate d3/d6/d11/d57/d7f/f8b 457656 0 2024-09-20T19:05:58.983 INFO:tasks.workunit.client.1.smithi098.stdout:4/548: write d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d [285337,23297] 0 2024-09-20T19:05:58.984 INFO:tasks.workunit.client.1.smithi098.stdout:0/307: write d0/db/d1d/f26 [827643,31383] 0 2024-09-20T19:05:58.986 INFO:tasks.workunit.client.0.smithi027.stdout:9/587: symlink d0/d97/lbe 0 2024-09-20T19:05:58.987 INFO:tasks.workunit.client.1.smithi098.stdout:2/770: rmdir d3/d16/d1d/d4f 39 2024-09-20T19:05:58.988 INFO:tasks.workunit.client.0.smithi027.stdout:1/437: symlink d2/d1b/d56/l83 0 2024-09-20T19:05:58.990 INFO:tasks.workunit.client.0.smithi027.stdout:7/458: symlink d3/d8/d26/l9d 0 2024-09-20T19:05:58.991 INFO:tasks.workunit.client.1.smithi098.stdout:3/410: readlink d4/d19/d1d/l26 0 2024-09-20T19:05:58.991 INFO:tasks.workunit.client.0.smithi027.stdout:5/524: dread d4/da/f2c [0,4194304] 0 2024-09-20T19:05:58.992 INFO:tasks.workunit.client.0.smithi027.stdout:5/525: chown d4/d1f/f74 256 1 2024-09-20T19:05:58.992 INFO:tasks.workunit.client.1.smithi098.stdout:1/417: mknod d1/d3/d2e/d68/c7d 0 2024-09-20T19:05:58.993 INFO:tasks.workunit.client.0.smithi027.stdout:5/526: write d4/da/de/f37 [2973294,58270] 0 2024-09-20T19:05:58.994 INFO:tasks.workunit.client.0.smithi027.stdout:5/527: chown d4/l58 171 1 2024-09-20T19:05:59.000 INFO:tasks.workunit.client.0.smithi027.stdout:4/331: rename d5/d13/d16/d21/d26/c4a to d5/d11/d17/d53/c6f 0 2024-09-20T19:05:59.000 INFO:tasks.workunit.client.1.smithi098.stdout:1/418: dwrite d1/d3/f1e [0,4194304] 0 2024-09-20T19:05:59.001 INFO:tasks.workunit.client.0.smithi027.stdout:4/332: fdatasync d5/d13/f30 0 2024-09-20T19:05:59.002 INFO:tasks.workunit.client.0.smithi027.stdout:2/381: mkdir d3/d1c/d26/d2a/d63/d6f 0 2024-09-20T19:05:59.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/540: creat d3/d10/d16/d17/d33/d4b/fb0 x:0 0 0 2024-09-20T19:05:59.010 INFO:tasks.workunit.client.0.smithi027.stdout:7/459: mknod d3/d8/d1c/c9e 0 2024-09-20T19:05:59.011 INFO:tasks.workunit.client.1.smithi098.stdout:4/549: rename d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/fb6 to d3/d6/d11/d57/d7f/fc2 0 2024-09-20T19:05:59.013 INFO:tasks.workunit.client.1.smithi098.stdout:2/771: stat d3/d16/d1d/d4f/c80 0 2024-09-20T19:05:59.013 INFO:tasks.workunit.client.0.smithi027.stdout:6/440: getdents d4/d15/d37/d6a 0 2024-09-20T19:05:59.014 INFO:tasks.workunit.client.0.smithi027.stdout:3/438: dread d0/f12 [0,4194304] 0 2024-09-20T19:05:59.016 INFO:tasks.workunit.client.0.smithi027.stdout:3/439: fsync d0/d1/d13/d15/d6f/d7f/f86 0 2024-09-20T19:05:59.016 INFO:tasks.workunit.client.0.smithi027.stdout:3/440: fdatasync d0/f2 0 2024-09-20T19:05:59.017 INFO:tasks.workunit.client.0.smithi027.stdout:0/516: rename d2/d48/d6b/d79/d84/d1d/f71 to d2/d48/d6b/d79/d84/d1b/d39/fc2 0 2024-09-20T19:05:59.020 INFO:tasks.workunit.client.0.smithi027.stdout:4/333: mkdir d5/d13/d70 0 2024-09-20T19:05:59.022 INFO:tasks.workunit.client.1.smithi098.stdout:6/305: creat d0/de/f56 x:0 0 0 2024-09-20T19:05:59.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/419: symlink d1/d3/df/d34/d52/l7e 0 2024-09-20T19:05:59.025 INFO:tasks.workunit.client.0.smithi027.stdout:1/438: mkdir d2/d8/d74/d84 0 2024-09-20T19:05:59.026 INFO:tasks.workunit.client.0.smithi027.stdout:4/334: dwrite d5/d13/f5c [0,4194304] 0 2024-09-20T19:05:59.026 INFO:tasks.workunit.client.0.smithi027.stdout:1/439: chown d2/d1b/f1e 133492 1 2024-09-20T19:05:59.027 INFO:tasks.workunit.client.0.smithi027.stdout:6/441: symlink d4/d15/d2c/l80 0 2024-09-20T19:05:59.028 INFO:tasks.workunit.client.0.smithi027.stdout:5/528: getdents d4/d1f/d7f/da4 0 2024-09-20T19:05:59.029 INFO:tasks.workunit.client.0.smithi027.stdout:4/335: read d5/d13/d36/d59/f5b [2297777,17419] 0 2024-09-20T19:05:59.030 INFO:tasks.workunit.client.1.smithi098.stdout:3/411: rename d4/d19/d1d/c73 to d4/d19/d1d/d2f/d4e/d59/c81 0 2024-09-20T19:05:59.030 INFO:tasks.workunit.client.0.smithi027.stdout:4/336: stat d5/d11/d17/d53/f61 0 2024-09-20T19:05:59.033 INFO:tasks.workunit.client.0.smithi027.stdout:0/517: mkdir d2/d48/d6b/d79/d9f/da4/dc3 0 2024-09-20T19:05:59.034 INFO:tasks.workunit.client.1.smithi098.stdout:2/772: creat d3/d16/d1a/ded/ffb x:0 0 0 2024-09-20T19:05:59.036 INFO:tasks.workunit.client.1.smithi098.stdout:4/550: dwrite d3/d6/d11/f15 [0,4194304] 0 2024-09-20T19:05:59.043 INFO:tasks.workunit.client.1.smithi098.stdout:6/306: unlink d0/l1d 0 2024-09-20T19:05:59.043 INFO:tasks.workunit.client.1.smithi098.stdout:6/307: chown d0 17 1 2024-09-20T19:05:59.043 INFO:tasks.workunit.client.0.smithi027.stdout:9/588: dwrite d0/d9/df/d1c/fb2 [0,4194304] 0 2024-09-20T19:05:59.044 INFO:tasks.workunit.client.1.smithi098.stdout:4/551: dwrite d3/d2e/f68 [0,4194304] 0 2024-09-20T19:05:59.046 INFO:tasks.workunit.client.0.smithi027.stdout:9/589: dread d0/f47 [0,4194304] 0 2024-09-20T19:05:59.046 INFO:tasks.workunit.client.1.smithi098.stdout:4/552: fdatasync d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d 0 2024-09-20T19:05:59.046 INFO:tasks.workunit.client.1.smithi098.stdout:1/420: creat d1/d3/df/d34/d43/d53/f7f x:0 0 0 2024-09-20T19:05:59.048 INFO:tasks.workunit.client.1.smithi098.stdout:9/515: truncate d4/de/d27/d4a/f4b 986440 0 2024-09-20T19:05:59.052 INFO:tasks.workunit.client.1.smithi098.stdout:0/308: creat d0/f57 x:0 0 0 2024-09-20T19:05:59.053 INFO:tasks.workunit.client.0.smithi027.stdout:6/442: dread d4/d6/f2a [0,4194304] 0 2024-09-20T19:05:59.054 INFO:tasks.workunit.client.1.smithi098.stdout:8/503: truncate d7/de/d11/d19/d47/f63 1306788 0 2024-09-20T19:05:59.055 INFO:tasks.workunit.client.1.smithi098.stdout:8/504: write d7/de/d11/d19/d30/d68/f6c [985643,85065] 0 2024-09-20T19:05:59.056 INFO:tasks.workunit.client.1.smithi098.stdout:3/412: unlink d4/d38/d48/d60/f7f 0 2024-09-20T19:05:59.056 INFO:tasks.workunit.client.1.smithi098.stdout:8/505: read - d7/de/d11/f6b zero size 2024-09-20T19:05:59.060 INFO:tasks.workunit.client.0.smithi027.stdout:0/518: rename d2/d20/d52 to d2/d48/d6b/d79/d84/d1d/d2e/dc4 0 2024-09-20T19:05:59.061 INFO:tasks.workunit.client.0.smithi027.stdout:0/519: stat d2/l30 0 2024-09-20T19:05:59.061 INFO:tasks.workunit.client.0.smithi027.stdout:0/520: chown d2/d48/f76 186 1 2024-09-20T19:05:59.064 INFO:tasks.workunit.client.0.smithi027.stdout:2/382: truncate d3/d1c/f54 3644835 0 2024-09-20T19:05:59.065 INFO:tasks.workunit.client.1.smithi098.stdout:1/421: readlink d1/l27 0 2024-09-20T19:05:59.066 INFO:tasks.workunit.client.1.smithi098.stdout:4/553: mknod d3/d2e/cc3 0 2024-09-20T19:05:59.070 INFO:tasks.workunit.client.1.smithi098.stdout:9/516: fdatasync d4/de/d24/f8b 0 2024-09-20T19:05:59.070 INFO:tasks.workunit.client.0.smithi027.stdout:8/469: sync 2024-09-20T19:05:59.071 INFO:tasks.workunit.client.0.smithi027.stdout:1/440: creat d2/d8/d2b/d2d/d73/f85 x:0 0 0 2024-09-20T19:05:59.072 INFO:tasks.workunit.client.1.smithi098.stdout:0/309: symlink d0/d6/d28/d31/d45/l58 0 2024-09-20T19:05:59.072 INFO:tasks.workunit.client.0.smithi027.stdout:1/441: read d2/f5c [392487,59066] 0 2024-09-20T19:05:59.073 INFO:tasks.workunit.client.1.smithi098.stdout:0/310: readlink d0/d55/l36 0 2024-09-20T19:05:59.074 INFO:tasks.workunit.client.1.smithi098.stdout:0/311: write d0/d6/f16 [266352,83698] 0 2024-09-20T19:05:59.075 INFO:tasks.workunit.client.1.smithi098.stdout:0/312: write d0/f5 [3146027,7745] 0 2024-09-20T19:05:59.075 INFO:tasks.workunit.client.1.smithi098.stdout:3/413: readlink d4/lf 0 2024-09-20T19:05:59.076 INFO:tasks.workunit.client.1.smithi098.stdout:3/414: write d4/da/f6c [1393033,56969] 0 2024-09-20T19:05:59.079 INFO:tasks.workunit.client.1.smithi098.stdout:8/506: mkdir d7/de/d11/d1f/d57/db0 0 2024-09-20T19:05:59.080 INFO:tasks.workunit.client.0.smithi027.stdout:2/383: dread d3/d24/f38 [0,4194304] 0 2024-09-20T19:05:59.080 INFO:tasks.workunit.client.0.smithi027.stdout:3/441: truncate d0/d1/d13/f22 3319824 0 2024-09-20T19:05:59.081 INFO:tasks.workunit.client.1.smithi098.stdout:3/415: dread d4/da/f45 [4194304,4194304] 0 2024-09-20T19:05:59.081 INFO:tasks.workunit.client.0.smithi027.stdout:2/384: readlink d3/d1c/d26/d2a/d63/l65 0 2024-09-20T19:05:59.081 INFO:tasks.workunit.client.1.smithi098.stdout:2/773: symlink d3/df/lfc 0 2024-09-20T19:05:59.084 INFO:tasks.workunit.client.1.smithi098.stdout:1/422: mknod d1/d3/d2e/c80 0 2024-09-20T19:05:59.086 INFO:tasks.workunit.client.0.smithi027.stdout:0/521: rename d2/d48/d6b/d79/d84/d1d to d2/d48/d6b/d79/d84/d1b/dc5 0 2024-09-20T19:05:59.087 INFO:tasks.workunit.client.0.smithi027.stdout:0/522: read - d2/d48/d6b/d79/d84/d1b/d39/fc2 zero size 2024-09-20T19:05:59.087 INFO:tasks.workunit.client.1.smithi098.stdout:3/416: dwrite d4/d19/d1d/f4c [0,4194304] 0 2024-09-20T19:05:59.088 INFO:tasks.workunit.client.1.smithi098.stdout:4/554: read d3/f5 [2119480,123795] 0 2024-09-20T19:05:59.089 INFO:tasks.workunit.client.1.smithi098.stdout:7/541: getdents d3/d10/d16/d17/d33/d1f/d28/d7d/d8c 0 2024-09-20T19:05:59.092 INFO:tasks.workunit.client.0.smithi027.stdout:9/590: symlink d0/d9/df/d1c/d6a/d6d/dd/lbf 0 2024-09-20T19:05:59.093 INFO:tasks.workunit.client.0.smithi027.stdout:9/591: chown d0/d9/df/d1b/f17 68 1 2024-09-20T19:05:59.095 INFO:tasks.workunit.client.1.smithi098.stdout:9/517: rename d4/de/d27/d4a/d58/d81 to d4/de/d24/d35/d2d/da6/dae 0 2024-09-20T19:05:59.097 INFO:tasks.workunit.client.1.smithi098.stdout:7/542: dwrite d3/f2e [0,4194304] 0 2024-09-20T19:05:59.098 INFO:tasks.workunit.client.0.smithi027.stdout:5/529: truncate d4/da/de/d3e/f59 1163788 0 2024-09-20T19:05:59.099 INFO:tasks.workunit.client.0.smithi027.stdout:6/443: creat d4/d15/d37/d6a/d7f/f81 x:0 0 0 2024-09-20T19:05:59.103 INFO:tasks.workunit.client.0.smithi027.stdout:1/442: mknod d2/d1b/d56/d71/c86 0 2024-09-20T19:05:59.105 INFO:tasks.workunit.client.1.smithi098.stdout:0/313: mknod d0/db/d1d/c59 0 2024-09-20T19:05:59.106 INFO:tasks.workunit.client.1.smithi098.stdout:0/314: chown d0/d6/d19/f10 6 1 2024-09-20T19:05:59.107 INFO:tasks.workunit.client.0.smithi027.stdout:3/442: unlink d0/d19/f6c 0 2024-09-20T19:05:59.108 INFO:tasks.workunit.client.0.smithi027.stdout:3/443: dread d0/d1/d13/d64/f7c [0,4194304] 0 2024-09-20T19:05:59.113 INFO:tasks.workunit.client.0.smithi027.stdout:8/470: rename d2/d14/d13/d2e/d6c/d77/d88 to d2/d3/d9a 0 2024-09-20T19:05:59.114 INFO:tasks.workunit.client.0.smithi027.stdout:8/471: stat d2/d14/d13/d43/d7a/c7b 0 2024-09-20T19:05:59.114 INFO:tasks.workunit.client.1.smithi098.stdout:4/555: dread d3/d6/d11/f62 [0,4194304] 0 2024-09-20T19:05:59.115 INFO:tasks.workunit.client.1.smithi098.stdout:4/556: fsync d3/d4f/f72 0 2024-09-20T19:05:59.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/557: read - d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/f9d zero size 2024-09-20T19:05:59.118 INFO:tasks.workunit.client.0.smithi027.stdout:7/460: getdents d3/d8 0 2024-09-20T19:05:59.119 INFO:tasks.workunit.client.0.smithi027.stdout:7/461: chown d3/d8/da/d2e/d49/d8b/f6c 884855 1 2024-09-20T19:05:59.121 INFO:tasks.workunit.client.0.smithi027.stdout:9/592: mknod d0/d9/df/d1b/d9c/d5a/cc0 0 2024-09-20T19:05:59.125 INFO:tasks.workunit.client.0.smithi027.stdout:6/444: symlink d4/d15/d37/d7a/d46/l82 0 2024-09-20T19:05:59.126 INFO:tasks.workunit.client.1.smithi098.stdout:9/518: truncate d4/f16 3844424 0 2024-09-20T19:05:59.126 INFO:tasks.workunit.client.0.smithi027.stdout:7/462: dwrite d3/d8/d1c/d61/f97 [0,4194304] 0 2024-09-20T19:05:59.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/315: fdatasync d0/db/d32/f3a 0 2024-09-20T19:05:59.133 INFO:tasks.workunit.client.0.smithi027.stdout:2/385: creat d3/d1c/d31/f70 x:0 0 0 2024-09-20T19:05:59.133 INFO:tasks.workunit.client.0.smithi027.stdout:2/386: fsync d3/d13/d3c/d48/f62 0 2024-09-20T19:05:59.135 INFO:tasks.workunit.client.1.smithi098.stdout:8/507: mknod d7/de/d11/d19/d30/d59/d80/da5/cb1 0 2024-09-20T19:05:59.139 INFO:tasks.workunit.client.0.smithi027.stdout:4/337: getdents d5/d13/d36 0 2024-09-20T19:05:59.145 INFO:tasks.workunit.client.1.smithi098.stdout:4/558: fdatasync d3/d6/d11/d57/f9b 0 2024-09-20T19:05:59.151 INFO:tasks.workunit.client.1.smithi098.stdout:4/559: dread d3/d6/d11/d57/f9b [0,4194304] 0 2024-09-20T19:05:59.151 INFO:tasks.workunit.client.0.smithi027.stdout:5/530: link d4/f16 d4/da/fa5 0 2024-09-20T19:05:59.151 INFO:tasks.workunit.client.1.smithi098.stdout:7/543: dwrite d3/d4c/f71 [0,4194304] 0 2024-09-20T19:05:59.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/519: mknod d4/de/d27/d4a/d58/d5b/d8f/caf 0 2024-09-20T19:05:59.153 INFO:tasks.workunit.client.0.smithi027.stdout:0/523: write d2/d48/d6b/d79/d84/d1b/d39/f6f [1909655,75220] 0 2024-09-20T19:05:59.154 INFO:tasks.workunit.client.0.smithi027.stdout:1/443: mkdir d2/d8/d3b/d82/d87 0 2024-09-20T19:05:59.155 INFO:tasks.workunit.client.0.smithi027.stdout:1/444: stat d2/d8/d3b/d4b/l27 0 2024-09-20T19:05:59.156 INFO:tasks.workunit.client.1.smithi098.stdout:7/544: chown d3/d10/d16/d17/d7c/lad 1015 1 2024-09-20T19:05:59.157 INFO:tasks.workunit.client.0.smithi027.stdout:6/445: creat d4/d15/d37/d39/f83 x:0 0 0 2024-09-20T19:05:59.158 INFO:tasks.workunit.client.1.smithi098.stdout:2/774: dwrite d3/d16/d1d/d4f/d8b/d38/f44 [0,4194304] 0 2024-09-20T19:05:59.159 INFO:tasks.workunit.client.1.smithi098.stdout:0/316: write d0/d6/d19/f33 [1718725,115163] 0 2024-09-20T19:05:59.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/545: chown d3/d10/d16/d17/d33/d1f/d28/d7d/f3f 4 1 2024-09-20T19:05:59.160 INFO:tasks.workunit.client.0.smithi027.stdout:7/463: mkdir d3/d8/da/d2e/d39/d9f 0 2024-09-20T19:05:59.161 INFO:tasks.workunit.client.1.smithi098.stdout:8/508: symlink d7/de/d11/d19/d30/d59/d80/lb2 0 2024-09-20T19:05:59.162 INFO:tasks.workunit.client.0.smithi027.stdout:7/464: chown d3/d8/d1c/f47 111063220 1 2024-09-20T19:05:59.162 INFO:tasks.workunit.client.0.smithi027.stdout:6/446: dread d4/d6/d4b/d7c/f6c [0,4194304] 0 2024-09-20T19:05:59.163 INFO:tasks.workunit.client.0.smithi027.stdout:7/465: chown d3/d8/da/f13 15318 1 2024-09-20T19:05:59.166 INFO:tasks.workunit.client.1.smithi098.stdout:1/423: creat d1/f81 x:0 0 0 2024-09-20T19:05:59.169 INFO:tasks.workunit.client.0.smithi027.stdout:2/387: read d3/d1c/f54 [2501911,70306] 0 2024-09-20T19:05:59.171 INFO:tasks.workunit.client.0.smithi027.stdout:5/531: creat d4/da/de/d3e/d44/fa6 x:0 0 0 2024-09-20T19:05:59.172 INFO:tasks.workunit.client.0.smithi027.stdout:0/524: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/lc6 0 2024-09-20T19:05:59.173 INFO:tasks.workunit.client.0.smithi027.stdout:0/525: read - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fb3 zero size 2024-09-20T19:05:59.175 INFO:tasks.workunit.client.0.smithi027.stdout:6/447: symlink d4/d15/d37/d6a/d7f/l84 0 2024-09-20T19:05:59.177 INFO:tasks.workunit.client.0.smithi027.stdout:4/338: mknod d5/d13/d36/d60/c71 0 2024-09-20T19:05:59.177 INFO:tasks.workunit.client.0.smithi027.stdout:0/526: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/f4d [0,4194304] 0 2024-09-20T19:05:59.182 INFO:tasks.workunit.client.0.smithi027.stdout:5/532: symlink d4/d7a/la7 0 2024-09-20T19:05:59.183 INFO:tasks.workunit.client.0.smithi027.stdout:5/533: fsync d4/d1f/d28/f85 0 2024-09-20T19:05:59.188 INFO:tasks.workunit.client.0.smithi027.stdout:3/444: getdents d0/d1/d13/d15/d6f 0 2024-09-20T19:05:59.189 INFO:tasks.workunit.client.1.smithi098.stdout:4/560: rmdir d3/d5e/d9f 39 2024-09-20T19:05:59.189 INFO:tasks.workunit.client.0.smithi027.stdout:3/445: readlink d0/d19/d54/l71 0 2024-09-20T19:05:59.190 INFO:tasks.workunit.client.1.smithi098.stdout:4/561: readlink d3/d6/d11/l2c 0 2024-09-20T19:05:59.190 INFO:tasks.workunit.client.0.smithi027.stdout:8/472: link d2/d3/d6/f3e d2/d3/d6/d21/d33/d79/f9b 0 2024-09-20T19:05:59.191 INFO:tasks.workunit.client.0.smithi027.stdout:4/339: symlink d5/d13/d16/d21/l72 0 2024-09-20T19:05:59.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/520: symlink d4/de/d48/lb0 0 2024-09-20T19:05:59.196 INFO:tasks.workunit.client.0.smithi027.stdout:9/593: getdents d0/d97 0 2024-09-20T19:05:59.200 INFO:tasks.workunit.client.0.smithi027.stdout:0/527: dwrite d2/d48/d6b/d79/d84/d1b/f5f [0,4194304] 0 2024-09-20T19:05:59.200 INFO:tasks.workunit.client.0.smithi027.stdout:1/445: rmdir d2/d8/d3b/d4b/d75 0 2024-09-20T19:05:59.201 INFO:tasks.workunit.client.1.smithi098.stdout:7/546: dwrite d3/d4c/f7f [0,4194304] 0 2024-09-20T19:05:59.202 INFO:tasks.workunit.client.0.smithi027.stdout:6/448: truncate d4/d6/d4b/d7c/f6c 1660089 0 2024-09-20T19:05:59.203 INFO:tasks.workunit.client.0.smithi027.stdout:0/528: chown d2/d48/d6b/d79/d9f/da4/cad 64637 1 2024-09-20T19:05:59.204 INFO:tasks.workunit.client.0.smithi027.stdout:7/466: truncate d3/d8/da/d2e/d49/d8b/f3a 2473139 0 2024-09-20T19:05:59.204 INFO:tasks.workunit.client.1.smithi098.stdout:3/417: getdents d4/d38/d48/d60 0 2024-09-20T19:05:59.205 INFO:tasks.workunit.client.0.smithi027.stdout:1/446: read d2/d8/d2b/d2d/f34 [3711340,62543] 0 2024-09-20T19:05:59.206 INFO:tasks.workunit.client.0.smithi027.stdout:5/534: dwrite d4/da/f2c [0,4194304] 0 2024-09-20T19:05:59.207 INFO:tasks.workunit.client.1.smithi098.stdout:4/562: mkdir d3/d7d/dc4 0 2024-09-20T19:05:59.209 INFO:tasks.workunit.client.0.smithi027.stdout:4/340: fdatasync d5/fa 0 2024-09-20T19:05:59.210 INFO:tasks.workunit.client.1.smithi098.stdout:9/521: rmdir d4/de/d27/d4a/d58/d5b 39 2024-09-20T19:05:59.214 INFO:tasks.workunit.client.0.smithi027.stdout:8/473: dwrite d2/d14/f27 [0,4194304] 0 2024-09-20T19:05:59.214 INFO:tasks.workunit.client.0.smithi027.stdout:2/388: write d3/d1c/f23 [1033877,62350] 0 2024-09-20T19:05:59.215 INFO:tasks.workunit.client.1.smithi098.stdout:1/424: creat d1/d3/df/d34/d52/d77/f82 x:0 0 0 2024-09-20T19:05:59.217 INFO:tasks.workunit.client.0.smithi027.stdout:2/389: chown d3/d1c 4237 1 2024-09-20T19:05:59.217 INFO:tasks.workunit.client.1.smithi098.stdout:7/547: stat d3/d10/d16/d17/d33/d1f/d28/d7d/c5e 0 2024-09-20T19:05:59.217 INFO:tasks.workunit.client.0.smithi027.stdout:9/594: rename d0/d9/df/d1b/d9c/l48 to d0/d9/df/d1b/d64/lc1 0 2024-09-20T19:05:59.220 INFO:tasks.workunit.client.1.smithi098.stdout:3/418: symlink d4/d38/d39/l82 0 2024-09-20T19:05:59.221 INFO:tasks.workunit.client.1.smithi098.stdout:8/509: dread d7/f6e [0,4194304] 0 2024-09-20T19:05:59.222 INFO:tasks.workunit.client.1.smithi098.stdout:9/522: mknod d4/d74/d8a/cb1 0 2024-09-20T19:05:59.224 INFO:tasks.workunit.client.1.smithi098.stdout:9/523: read - d4/de/d27/d6c/d73/f99 zero size 2024-09-20T19:05:59.225 INFO:tasks.workunit.client.1.smithi098.stdout:2/775: rename d3/d51/d9f/lb7 to d3/d16/d1d/d4f/d8b/lfd 0 2024-09-20T19:05:59.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/524: truncate d4/de/f34 8723061 0 2024-09-20T19:05:59.227 INFO:tasks.workunit.client.1.smithi098.stdout:2/776: readlink d3/d16/d1a/l30 0 2024-09-20T19:05:59.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/525: read - d4/de/d27/d4a/d21/f50 zero size 2024-09-20T19:05:59.229 INFO:tasks.workunit.client.0.smithi027.stdout:0/529: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f9e [3336113,130309] 0 2024-09-20T19:05:59.229 INFO:tasks.workunit.client.1.smithi098.stdout:1/425: mknod d1/d3/df/d4a/d6d/c83 0 2024-09-20T19:05:59.230 INFO:tasks.workunit.client.1.smithi098.stdout:2/777: read d3/d16/d1a/fb8 [4113683,9498] 0 2024-09-20T19:05:59.231 INFO:tasks.workunit.client.1.smithi098.stdout:4/563: creat d3/d5e/d9f/fc5 x:0 0 0 2024-09-20T19:05:59.232 INFO:tasks.workunit.client.0.smithi027.stdout:4/341: symlink d5/d11/d51/l73 0 2024-09-20T19:05:59.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/419: dread - d4/d25/d40/f58 zero size 2024-09-20T19:05:59.234 INFO:tasks.workunit.client.0.smithi027.stdout:5/535: dwrite d4/d1f/d28/f34 [0,4194304] 0 2024-09-20T19:05:59.235 INFO:tasks.workunit.client.1.smithi098.stdout:8/510: fdatasync d7/de/d11/d19/d47/f99 0 2024-09-20T19:05:59.238 INFO:tasks.workunit.client.0.smithi027.stdout:2/390: mknod d3/de/d34/c71 0 2024-09-20T19:05:59.239 INFO:tasks.workunit.client.0.smithi027.stdout:2/391: fdatasync d3/d1c/f47 0 2024-09-20T19:05:59.243 INFO:tasks.workunit.client.0.smithi027.stdout:3/446: creat d0/d1/f91 x:0 0 0 2024-09-20T19:05:59.244 INFO:tasks.workunit.client.0.smithi027.stdout:3/447: chown d0/d1/f91 520727791 1 2024-09-20T19:05:59.248 INFO:tasks.workunit.client.1.smithi098.stdout:2/778: rename d3/d16/d1d/d2b/d46/dc0/cf2 to d3/d51/d68/dd7/cfe 0 2024-09-20T19:05:59.251 INFO:tasks.workunit.client.0.smithi027.stdout:1/447: write d2/f5c [1243902,34893] 0 2024-09-20T19:05:59.252 INFO:tasks.workunit.client.0.smithi027.stdout:0/530: mkdir d2/d48/d6b/d79/d84/d1b/d39/dc7 0 2024-09-20T19:05:59.253 INFO:tasks.workunit.client.0.smithi027.stdout:1/448: chown d2/d8/d2b/f4a 14072821 1 2024-09-20T19:05:59.254 INFO:tasks.workunit.client.0.smithi027.stdout:1/449: write d2/d8/d2b/f58 [1015834,51787] 0 2024-09-20T19:05:59.255 INFO:tasks.workunit.client.0.smithi027.stdout:4/342: creat d5/d13/f74 x:0 0 0 2024-09-20T19:05:59.256 INFO:tasks.workunit.client.0.smithi027.stdout:4/343: stat d5/d13/d16/d21/d26 0 2024-09-20T19:05:59.256 INFO:tasks.workunit.client.0.smithi027.stdout:4/344: fdatasync d5/d13/f74 0 2024-09-20T19:05:59.257 INFO:tasks.workunit.client.1.smithi098.stdout:7/548: dread d3/d10/d16/f79 [0,4194304] 0 2024-09-20T19:05:59.257 INFO:tasks.workunit.client.0.smithi027.stdout:4/345: chown d5/d13/d16/d21/f33 0 1 2024-09-20T19:05:59.258 INFO:tasks.workunit.client.0.smithi027.stdout:7/467: rename d3/d8/c2d to d3/d24/ca0 0 2024-09-20T19:05:59.261 INFO:tasks.workunit.client.0.smithi027.stdout:9/595: getdents d0/d97 0 2024-09-20T19:05:59.262 INFO:tasks.workunit.client.0.smithi027.stdout:2/392: fdatasync d3/d13/f25 0 2024-09-20T19:05:59.264 INFO:tasks.workunit.client.0.smithi027.stdout:6/449: truncate d4/f9 778384 0 2024-09-20T19:05:59.266 INFO:tasks.workunit.client.1.smithi098.stdout:3/420: write d4/d38/d39/f5a [44371,52341] 0 2024-09-20T19:05:59.266 INFO:tasks.workunit.client.1.smithi098.stdout:7/549: stat d3/d10/d16/f84 0 2024-09-20T19:05:59.268 INFO:tasks.workunit.client.0.smithi027.stdout:1/450: creat d2/d8/d41/f88 x:0 0 0 2024-09-20T19:05:59.271 INFO:tasks.workunit.client.0.smithi027.stdout:5/536: creat d4/da/de/d3e/d69/d75/fa8 x:0 0 0 2024-09-20T19:05:59.271 INFO:tasks.workunit.client.0.smithi027.stdout:9/596: dwrite d0/d9/df/d1b/d9c/d4f/d8d/da0/fb8 [0,4194304] 0 2024-09-20T19:05:59.272 INFO:tasks.workunit.client.0.smithi027.stdout:7/468: rename d3/d8/da/d2e/f4c to d3/d8/d1c/d61/fa1 0 2024-09-20T19:05:59.275 INFO:tasks.workunit.client.0.smithi027.stdout:2/393: unlink d3/de/d34/c71 0 2024-09-20T19:05:59.280 INFO:tasks.workunit.client.0.smithi027.stdout:1/451: mknod d2/d8/d3b/d44/c89 0 2024-09-20T19:05:59.281 INFO:tasks.workunit.client.0.smithi027.stdout:5/537: symlink d4/d6c/d6f/la9 0 2024-09-20T19:05:59.284 INFO:tasks.workunit.client.0.smithi027.stdout:4/346: rmdir d5/d13/d36/d67 0 2024-09-20T19:05:59.287 INFO:tasks.workunit.client.0.smithi027.stdout:3/448: dwrite d0/d1/d13/d64/f7c [0,4194304] 0 2024-09-20T19:05:59.289 INFO:tasks.workunit.client.0.smithi027.stdout:2/394: creat d3/d13/d3c/d48/d6a/f72 x:0 0 0 2024-09-20T19:05:59.289 INFO:tasks.workunit.client.0.smithi027.stdout:1/452: rename d2/d8/d74/f35 to d2/d8/d2b/f8a 0 2024-09-20T19:05:59.290 INFO:tasks.workunit.client.0.smithi027.stdout:0/531: write d2/d48/d6b/d79/d84/d1b/f2b [3803693,35367] 0 2024-09-20T19:05:59.291 INFO:tasks.workunit.client.0.smithi027.stdout:2/395: readlink d3/d24/l69 0 2024-09-20T19:05:59.291 INFO:tasks.workunit.client.0.smithi027.stdout:3/449: fdatasync d0/d1/d13/d3c/f7e 0 2024-09-20T19:05:59.293 INFO:tasks.workunit.client.0.smithi027.stdout:1/453: chown d2/d8/d2b/f58 6603 1 2024-09-20T19:05:59.294 INFO:tasks.workunit.client.0.smithi027.stdout:1/454: chown d2/d8/d2b/f8a 1538508 1 2024-09-20T19:05:59.297 INFO:tasks.workunit.client.0.smithi027.stdout:5/538: dread d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:05:59.297 INFO:tasks.workunit.client.0.smithi027.stdout:2/396: symlink d3/d1c/d26/d2a/l73 0 2024-09-20T19:05:59.303 INFO:tasks.workunit.client.0.smithi027.stdout:7/469: truncate d3/d8/d26/f4a 1380470 0 2024-09-20T19:05:59.305 INFO:tasks.workunit.client.0.smithi027.stdout:2/397: write d3/d2f/f42 [2851125,17157] 0 2024-09-20T19:05:59.308 INFO:tasks.workunit.client.0.smithi027.stdout:3/450: write d0/d1/d5e/f2c [2039200,119388] 0 2024-09-20T19:05:59.310 INFO:tasks.workunit.client.0.smithi027.stdout:0/532: dread d2/d48/d6b/d79/d84/f31 [0,4194304] 0 2024-09-20T19:05:59.311 INFO:tasks.workunit.client.0.smithi027.stdout:1/455: dwrite d2/d8/f20 [4194304,4194304] 0 2024-09-20T19:05:59.311 INFO:tasks.workunit.client.0.smithi027.stdout:2/398: readlink d3/d24/l6e 0 2024-09-20T19:05:59.313 INFO:tasks.workunit.client.0.smithi027.stdout:7/470: rename d3/d8/da/d2e/f3f to d3/d24/d84/fa2 0 2024-09-20T19:05:59.315 INFO:tasks.workunit.client.0.smithi027.stdout:3/451: write d0/d1/d5e/f10 [1951769,114065] 0 2024-09-20T19:05:59.317 INFO:tasks.workunit.client.0.smithi027.stdout:2/399: creat d3/d13/d3c/d48/f74 x:0 0 0 2024-09-20T19:05:59.317 INFO:tasks.workunit.client.0.smithi027.stdout:2/400: stat d3/d1c 0 2024-09-20T19:05:59.320 INFO:tasks.workunit.client.0.smithi027.stdout:7/471: mknod d3/d8/ca3 0 2024-09-20T19:05:59.320 INFO:tasks.workunit.client.0.smithi027.stdout:0/533: creat d2/da2/fc8 x:0 0 0 2024-09-20T19:05:59.321 INFO:tasks.workunit.client.0.smithi027.stdout:1/456: write d2/d1b/f4f [3858436,100745] 0 2024-09-20T19:05:59.321 INFO:tasks.workunit.client.0.smithi027.stdout:2/401: unlink d3/d13/d3c/c50 0 2024-09-20T19:05:59.322 INFO:tasks.workunit.client.0.smithi027.stdout:1/457: chown d2/d8/d41/f72 209 1 2024-09-20T19:05:59.323 INFO:tasks.workunit.client.0.smithi027.stdout:3/452: mknod d0/d1/d13/d15/d55/d70/c92 0 2024-09-20T19:05:59.325 INFO:tasks.workunit.client.0.smithi027.stdout:5/539: truncate d4/da/d1a/f57 63064 0 2024-09-20T19:05:59.326 INFO:tasks.workunit.client.0.smithi027.stdout:0/534: mknod d2/d48/d6b/d79/d9f/cc9 0 2024-09-20T19:05:59.326 INFO:tasks.workunit.client.0.smithi027.stdout:2/402: dread d3/d24/f28 [0,4194304] 0 2024-09-20T19:05:59.330 INFO:tasks.workunit.client.0.smithi027.stdout:2/403: fsync d3/d1c/f47 0 2024-09-20T19:05:59.330 INFO:tasks.workunit.client.0.smithi027.stdout:3/453: fdatasync d0/d1/d13/d15/f29 0 2024-09-20T19:05:59.330 INFO:tasks.workunit.client.0.smithi027.stdout:1/458: unlink d2/d8/d2b/d2d/l45 0 2024-09-20T19:05:59.331 INFO:tasks.workunit.client.0.smithi027.stdout:5/540: rename d4/da/de/d3e/d69/d75/f62 to d4/da/d98/faa 0 2024-09-20T19:05:59.331 INFO:tasks.workunit.client.0.smithi027.stdout:4/347: dread d5/d11/d17/f65 [0,4194304] 0 2024-09-20T19:05:59.333 INFO:tasks.workunit.client.0.smithi027.stdout:7/472: creat d3/d8/d26/fa4 x:0 0 0 2024-09-20T19:05:59.334 INFO:tasks.workunit.client.0.smithi027.stdout:2/404: mkdir d3/d1c/d26/d75 0 2024-09-20T19:05:59.336 INFO:tasks.workunit.client.0.smithi027.stdout:3/454: mkdir d0/d1/d13/d3c/d93 0 2024-09-20T19:05:59.336 INFO:tasks.workunit.client.0.smithi027.stdout:5/541: mknod d4/da/d1a/cab 0 2024-09-20T19:05:59.338 INFO:tasks.workunit.client.0.smithi027.stdout:0/535: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f6e to d2/d20/fca 0 2024-09-20T19:05:59.340 INFO:tasks.workunit.client.0.smithi027.stdout:4/348: creat d5/d11/d3d/d6e/f75 x:0 0 0 2024-09-20T19:05:59.342 INFO:tasks.workunit.client.0.smithi027.stdout:2/405: creat d3/de/d34/f76 x:0 0 0 2024-09-20T19:05:59.343 INFO:tasks.workunit.client.0.smithi027.stdout:2/406: truncate d3/de/d34/f4e 330059 0 2024-09-20T19:05:59.347 INFO:tasks.workunit.client.0.smithi027.stdout:5/542: rename d4/da/de/d3e/f8b to d4/da/fac 0 2024-09-20T19:05:59.347 INFO:tasks.workunit.client.1.smithi098.stdout:1/426: creat d1/f84 x:0 0 0 2024-09-20T19:05:59.348 INFO:tasks.workunit.client.1.smithi098.stdout:2/779: symlink d3/d16/d1d/d2b/d99/def/lff 0 2024-09-20T19:05:59.348 INFO:tasks.workunit.client.1.smithi098.stdout:4/564: dwrite d3/d2e/f67 [8388608,4194304] 0 2024-09-20T19:05:59.348 INFO:tasks.workunit.client.0.smithi027.stdout:4/349: rmdir d5/d11/d17 39 2024-09-20T19:05:59.349 INFO:tasks.workunit.client.1.smithi098.stdout:8/511: write d7/f6e [4069453,35145] 0 2024-09-20T19:05:59.354 INFO:tasks.workunit.client.0.smithi027.stdout:2/407: rmdir d3/de 39 2024-09-20T19:05:59.354 INFO:tasks.workunit.client.0.smithi027.stdout:5/543: dread - d4/d7a/f97 zero size 2024-09-20T19:05:59.358 INFO:tasks.workunit.client.0.smithi027.stdout:1/459: dread d2/d8/d2b/d2d/f34 [0,4194304] 0 2024-09-20T19:05:59.359 INFO:tasks.workunit.client.1.smithi098.stdout:7/550: creat d3/d76/d86/fb1 x:0 0 0 2024-09-20T19:05:59.360 INFO:tasks.workunit.client.0.smithi027.stdout:3/455: dwrite d0/d1/d5e/d1d/f69 [0,4194304] 0 2024-09-20T19:05:59.361 INFO:tasks.workunit.client.1.smithi098.stdout:8/512: mkdir d7/de/d11/d1f/d77/db3 0 2024-09-20T19:05:59.362 INFO:tasks.workunit.client.1.smithi098.stdout:1/427: dwrite d1/f50 [0,4194304] 0 2024-09-20T19:05:59.365 INFO:tasks.workunit.client.1.smithi098.stdout:3/421: symlink d4/d19/d1d/l83 0 2024-09-20T19:05:59.365 INFO:tasks.workunit.client.0.smithi027.stdout:1/460: dread d2/d8/f70 [0,4194304] 0 2024-09-20T19:05:59.365 INFO:tasks.workunit.client.0.smithi027.stdout:8/474: sync 2024-09-20T19:05:59.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/565: mknod d3/d6/d11/cc6 0 2024-09-20T19:05:59.366 INFO:tasks.workunit.client.1.smithi098.stdout:4/566: chown d3/d7d/dc4 150533469 1 2024-09-20T19:05:59.367 INFO:tasks.workunit.client.1.smithi098.stdout:7/551: mknod d3/d10/d16/d17/d33/d4b/cb2 0 2024-09-20T19:05:59.369 INFO:tasks.workunit.client.1.smithi098.stdout:7/552: write d3/d10/d16/d73/fa9 [728367,76391] 0 2024-09-20T19:05:59.370 INFO:tasks.workunit.client.1.smithi098.stdout:1/428: symlink d1/d3/df/l85 0 2024-09-20T19:05:59.371 INFO:tasks.workunit.client.1.smithi098.stdout:7/553: dread - d3/d10/d16/f84 zero size 2024-09-20T19:05:59.372 INFO:tasks.workunit.client.0.smithi027.stdout:0/536: write d2/fe [8034406,39098] 0 2024-09-20T19:05:59.372 INFO:tasks.workunit.client.1.smithi098.stdout:3/422: symlink d4/d38/l84 0 2024-09-20T19:05:59.375 INFO:tasks.workunit.client.1.smithi098.stdout:2/780: link d3/d16/d1d/d2b/fd2 d3/d16/d1d/d4f/d8b/f100 0 2024-09-20T19:05:59.376 INFO:tasks.workunit.client.1.smithi098.stdout:1/429: fsync d1/f37 0 2024-09-20T19:05:59.377 INFO:tasks.workunit.client.1.smithi098.stdout:2/781: dread d3/d16/d1d/d2b/d99/f9d [0,4194304] 0 2024-09-20T19:05:59.377 INFO:tasks.workunit.client.1.smithi098.stdout:7/554: creat d3/d10/d16/d90/fb3 x:0 0 0 2024-09-20T19:05:59.379 INFO:tasks.workunit.client.1.smithi098.stdout:4/567: mkdir d3/d7d/dc4/dc7 0 2024-09-20T19:05:59.379 INFO:tasks.workunit.client.1.smithi098.stdout:2/782: chown d3/d16/d1d/d2b/d46/d74/d82/fac 4 1 2024-09-20T19:05:59.380 INFO:tasks.workunit.client.0.smithi027.stdout:4/350: dread - d5/d13/d16/d21/f33 zero size 2024-09-20T19:05:59.382 INFO:tasks.workunit.client.0.smithi027.stdout:2/408: symlink d3/d13/d3c/d48/l77 0 2024-09-20T19:05:59.382 INFO:tasks.workunit.client.0.smithi027.stdout:4/351: read d5/d11/f4d [3716284,14324] 0 2024-09-20T19:05:59.383 INFO:tasks.workunit.client.1.smithi098.stdout:3/423: symlink d4/d19/d1d/d2f/l85 0 2024-09-20T19:05:59.384 INFO:tasks.workunit.client.0.smithi027.stdout:5/544: creat d4/da/de/d3e/d69/d75/fad x:0 0 0 2024-09-20T19:05:59.385 INFO:tasks.workunit.client.1.smithi098.stdout:3/424: write d4/f1b [4408436,86692] 0 2024-09-20T19:05:59.387 INFO:tasks.workunit.client.0.smithi027.stdout:7/473: getdents d3/d8/d26 0 2024-09-20T19:05:59.388 INFO:tasks.workunit.client.0.smithi027.stdout:7/474: fdatasync d3/d8/f96 0 2024-09-20T19:05:59.388 INFO:tasks.workunit.client.1.smithi098.stdout:2/783: dwrite d3/d16/f84 [0,4194304] 0 2024-09-20T19:05:59.390 INFO:tasks.workunit.client.1.smithi098.stdout:4/568: truncate d3/d6/d11/d57/f9b 3309815 0 2024-09-20T19:05:59.391 INFO:tasks.workunit.client.0.smithi027.stdout:5/545: dwrite d4/da/f29 [0,4194304] 0 2024-09-20T19:05:59.391 INFO:tasks.workunit.client.1.smithi098.stdout:4/569: readlink d3/d2e/l41 0 2024-09-20T19:05:59.393 INFO:tasks.workunit.client.0.smithi027.stdout:3/456: write d0/d1/f30 [4239,117101] 0 2024-09-20T19:05:59.395 INFO:tasks.workunit.client.1.smithi098.stdout:8/513: dread d7/de/d11/d1d/f1e [0,4194304] 0 2024-09-20T19:05:59.398 INFO:tasks.workunit.client.0.smithi027.stdout:1/461: mknod d2/d8/d3b/c8b 0 2024-09-20T19:05:59.403 INFO:tasks.workunit.client.1.smithi098.stdout:3/425: rename d4/da/f65 to d4/d25/d40/d80/f86 0 2024-09-20T19:05:59.405 INFO:tasks.workunit.client.1.smithi098.stdout:4/570: rmdir d3/d6/d11/d1e/d2a 39 2024-09-20T19:05:59.407 INFO:tasks.workunit.client.0.smithi027.stdout:7/475: creat d3/d8/fa5 x:0 0 0 2024-09-20T19:05:59.408 INFO:tasks.workunit.client.0.smithi027.stdout:7/476: dread - d3/d8/da/d2e/d49/d8b/f6c zero size 2024-09-20T19:05:59.409 INFO:tasks.workunit.client.0.smithi027.stdout:7/477: chown d3/d8/ca3 14230 1 2024-09-20T19:05:59.410 INFO:tasks.workunit.client.0.smithi027.stdout:7/478: write d3/d8/d26/d45/d56/f7d [336568,93305] 0 2024-09-20T19:05:59.413 INFO:tasks.workunit.client.1.smithi098.stdout:4/571: rmdir d3/d7d/da3/d3c/d6b 39 2024-09-20T19:05:59.416 INFO:tasks.workunit.client.0.smithi027.stdout:1/462: chown d2/d8/c7c 670 1 2024-09-20T19:05:59.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/426: symlink d4/d19/d1d/l87 0 2024-09-20T19:05:59.419 INFO:tasks.workunit.client.0.smithi027.stdout:0/537: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/l59 to d2/d48/d6b/d79/d84/d1b/lcb 0 2024-09-20T19:05:59.422 INFO:tasks.workunit.client.1.smithi098.stdout:1/430: write d1/f4e [173420,126644] 0 2024-09-20T19:05:59.423 INFO:tasks.workunit.client.1.smithi098.stdout:3/427: dread d4/d19/d1d/f4c [0,4194304] 0 2024-09-20T19:05:59.424 INFO:tasks.workunit.client.1.smithi098.stdout:2/784: dread d3/d16/f89 [0,4194304] 0 2024-09-20T19:05:59.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/428: write d4/f1c [1016068,87259] 0 2024-09-20T19:05:59.424 INFO:tasks.workunit.client.1.smithi098.stdout:7/555: write d3/d10/d16/d17/d33/d1f/d28/f61 [1142721,97802] 0 2024-09-20T19:05:59.424 INFO:tasks.workunit.client.0.smithi027.stdout:4/352: link d5/d13/d36/d48/d3f/d4c/f55 d5/d13/d36/d49/f76 0 2024-09-20T19:05:59.425 INFO:tasks.workunit.client.1.smithi098.stdout:2/785: dread - d3/db0/fba zero size 2024-09-20T19:05:59.427 INFO:tasks.workunit.client.0.smithi027.stdout:4/353: readlink d5/d13/d16/l39 0 2024-09-20T19:05:59.427 INFO:tasks.workunit.client.0.smithi027.stdout:7/479: mknod d3/d8/ca6 0 2024-09-20T19:05:59.427 INFO:tasks.workunit.client.0.smithi027.stdout:1/463: dwrite d2/d8/d2b/d2d/d73/f85 [0,4194304] 0 2024-09-20T19:05:59.429 INFO:tasks.workunit.client.0.smithi027.stdout:7/480: read - d3/d8/da/d51/f72 zero size 2024-09-20T19:05:59.429 INFO:tasks.workunit.client.1.smithi098.stdout:8/514: getdents d7/de/d11/d19/d30/d55 0 2024-09-20T19:05:59.430 INFO:tasks.workunit.client.1.smithi098.stdout:1/431: symlink d1/d3/df/d34/d43/d53/l86 0 2024-09-20T19:05:59.431 INFO:tasks.workunit.client.0.smithi027.stdout:5/546: write d4/da/de/d3e/d44/f60 [19927,96632] 0 2024-09-20T19:05:59.431 INFO:tasks.workunit.client.0.smithi027.stdout:7/481: chown d3/d8/da/dc/l14 24 1 2024-09-20T19:05:59.432 INFO:tasks.workunit.client.0.smithi027.stdout:8/475: creat d2/d3/d1b/f9c x:0 0 0 2024-09-20T19:05:59.433 INFO:tasks.workunit.client.0.smithi027.stdout:8/476: fsync d2/d3/f37 0 2024-09-20T19:05:59.435 INFO:tasks.workunit.client.0.smithi027.stdout:2/409: creat d3/f78 x:0 0 0 2024-09-20T19:05:59.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/432: dwrite d1/d3/f2b [0,4194304] 0 2024-09-20T19:05:59.438 INFO:tasks.workunit.client.0.smithi027.stdout:2/410: dread d3/d1c/d26/f57 [0,4194304] 0 2024-09-20T19:05:59.439 INFO:tasks.workunit.client.0.smithi027.stdout:0/538: mknod d2/d48/d6b/d79/d9f/ccc 0 2024-09-20T19:05:59.440 INFO:tasks.workunit.client.0.smithi027.stdout:0/539: dread - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7d zero size 2024-09-20T19:05:59.441 INFO:tasks.workunit.client.0.smithi027.stdout:0/540: chown d2/fc 15 1 2024-09-20T19:05:59.442 INFO:tasks.workunit.client.0.smithi027.stdout:0/541: read - d2/d20/fc1 zero size 2024-09-20T19:05:59.443 INFO:tasks.workunit.client.1.smithi098.stdout:3/429: truncate d4/d25/f2b 2007594 0 2024-09-20T19:05:59.444 INFO:tasks.workunit.client.1.smithi098.stdout:4/572: write d3/d6/d11/d57/d7f/f8b [1386614,20523] 0 2024-09-20T19:05:59.444 INFO:tasks.workunit.client.0.smithi027.stdout:0/542: fsync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f3b 0 2024-09-20T19:05:59.445 INFO:tasks.workunit.client.1.smithi098.stdout:8/515: dread - d7/de/f3b zero size 2024-09-20T19:05:59.446 INFO:tasks.workunit.client.0.smithi027.stdout:0/543: read - d2/d49/d70/f89 zero size 2024-09-20T19:05:59.447 INFO:tasks.workunit.client.0.smithi027.stdout:5/547: creat d4/da/de/d3e/d44/fae x:0 0 0 2024-09-20T19:05:59.447 INFO:tasks.workunit.client.1.smithi098.stdout:2/786: dwrite d3/f15 [0,4194304] 0 2024-09-20T19:05:59.449 INFO:tasks.workunit.client.0.smithi027.stdout:7/482: mknod d3/d8/d1c/ca7 0 2024-09-20T19:05:59.454 INFO:tasks.workunit.client.0.smithi027.stdout:9/597: sync 2024-09-20T19:05:59.454 INFO:tasks.workunit.client.0.smithi027.stdout:6/450: sync 2024-09-20T19:05:59.454 INFO:tasks.workunit.client.1.smithi098.stdout:1/433: rename d1/d3/d2e/l5a to d1/d3/d2e/d61/l87 0 2024-09-20T19:05:59.455 INFO:tasks.workunit.client.0.smithi027.stdout:8/477: write d2/d3/d6/d21/f38 [2076209,43460] 0 2024-09-20T19:05:59.455 INFO:tasks.workunit.client.1.smithi098.stdout:2/787: dread d3/f15 [4194304,4194304] 0 2024-09-20T19:05:59.456 INFO:tasks.workunit.client.0.smithi027.stdout:8/478: chown d2/d14/d13/d72 10 1 2024-09-20T19:05:59.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/430: creat d4/d38/d39/f88 x:0 0 0 2024-09-20T19:05:59.458 INFO:tasks.workunit.client.1.smithi098.stdout:2/788: chown d3/d16/d1d/d4f/c80 6 1 2024-09-20T19:05:59.459 INFO:tasks.workunit.client.1.smithi098.stdout:7/556: dwrite d3/f6 [4194304,4194304] 0 2024-09-20T19:05:59.459 INFO:tasks.workunit.client.1.smithi098.stdout:4/573: creat d3/d6/d11/d57/d7f/d84/fc8 x:0 0 0 2024-09-20T19:05:59.462 INFO:tasks.workunit.client.0.smithi027.stdout:3/457: getdents d0/d19/d54 0 2024-09-20T19:05:59.464 INFO:tasks.workunit.client.1.smithi098.stdout:8/516: symlink d7/de/d11/d19/lb4 0 2024-09-20T19:05:59.465 INFO:tasks.workunit.client.0.smithi027.stdout:4/354: dwrite d5/d13/d36/d59/f5b [0,4194304] 0 2024-09-20T19:05:59.465 INFO:tasks.workunit.client.0.smithi027.stdout:0/544: fdatasync d2/d48/d6b/d79/d84/d1b/d39/fc2 0 2024-09-20T19:05:59.468 INFO:tasks.workunit.client.1.smithi098.stdout:1/434: dwrite d1/d3/df/f78 [0,4194304] 0 2024-09-20T19:05:59.468 INFO:tasks.workunit.client.0.smithi027.stdout:7/483: rmdir d3/d24 39 2024-09-20T19:05:59.470 INFO:tasks.workunit.client.1.smithi098.stdout:1/435: fdatasync d1/d3/d2e/f67 0 2024-09-20T19:05:59.470 INFO:tasks.workunit.client.1.smithi098.stdout:3/431: dwrite d4/f1b [0,4194304] 0 2024-09-20T19:05:59.472 INFO:tasks.workunit.client.1.smithi098.stdout:2/789: readlink d3/d16/d1d/d2b/d46/d74/d7b/lfa 0 2024-09-20T19:05:59.473 INFO:tasks.workunit.client.1.smithi098.stdout:7/557: mknod d3/d10/d16/d17/cb4 0 2024-09-20T19:05:59.473 INFO:tasks.workunit.client.0.smithi027.stdout:8/479: rmdir d2/d14/d13 39 2024-09-20T19:05:59.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/427: sync 2024-09-20T19:05:59.478 INFO:tasks.workunit.client.0.smithi027.stdout:1/464: creat d2/d8/f8c x:0 0 0 2024-09-20T19:05:59.480 INFO:tasks.workunit.client.0.smithi027.stdout:1/465: dread - d2/d8/d3b/d44/f6b zero size 2024-09-20T19:05:59.480 INFO:tasks.workunit.client.1.smithi098.stdout:4/574: dwrite d3/d7d/fad [0,4194304] 0 2024-09-20T19:05:59.482 INFO:tasks.workunit.client.0.smithi027.stdout:4/355: fdatasync d5/d13/d16/d21/d3a/f4e 0 2024-09-20T19:05:59.482 INFO:tasks.workunit.client.1.smithi098.stdout:5/428: read - d1/d17/f63 zero size 2024-09-20T19:05:59.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/432: mknod d4/d38/c89 0 2024-09-20T19:05:59.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/790: rmdir d3/d16/d1a 39 2024-09-20T19:05:59.484 INFO:tasks.workunit.client.0.smithi027.stdout:6/451: dread d4/d15/f2f [0,4194304] 0 2024-09-20T19:05:59.485 INFO:tasks.workunit.client.0.smithi027.stdout:7/484: write d3/d24/f2c [209412,114816] 0 2024-09-20T19:05:59.486 INFO:tasks.workunit.client.1.smithi098.stdout:8/517: dwrite d7/de/d11/d19/d30/d59/d80/f8a [0,4194304] 0 2024-09-20T19:05:59.488 INFO:tasks.workunit.client.1.smithi098.stdout:7/558: mknod d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/cb5 0 2024-09-20T19:05:59.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/575: truncate d3/d6/d11/d1e/f7b 862626 0 2024-09-20T19:05:59.489 INFO:tasks.workunit.client.0.smithi027.stdout:2/411: creat d3/d13/d3c/f79 x:0 0 0 2024-09-20T19:05:59.489 INFO:tasks.workunit.client.0.smithi027.stdout:4/356: dread d5/d13/d36/d59/f5b [0,4194304] 0 2024-09-20T19:05:59.491 INFO:tasks.workunit.client.0.smithi027.stdout:8/480: mknod d2/d3/d6/c9d 0 2024-09-20T19:05:59.491 INFO:tasks.workunit.client.0.smithi027.stdout:2/412: write d3/d1c/f23 [407539,37495] 0 2024-09-20T19:05:59.493 INFO:tasks.workunit.client.0.smithi027.stdout:5/548: link d4/d1f/d7f/l99 d4/d6c/d6f/d92/laf 0 2024-09-20T19:05:59.494 INFO:tasks.workunit.client.0.smithi027.stdout:8/481: readlink d2/d3/d9a/l8c 0 2024-09-20T19:05:59.495 INFO:tasks.workunit.client.1.smithi098.stdout:3/433: mknod d4/d19/c8a 0 2024-09-20T19:05:59.496 INFO:tasks.workunit.client.1.smithi098.stdout:3/434: write d4/d38/d39/f5a [277790,27591] 0 2024-09-20T19:05:59.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/436: link d1/d3/df/d34/d43/f6e d1/d3/df/d34/d43/d65/f88 0 2024-09-20T19:05:59.499 INFO:tasks.workunit.client.1.smithi098.stdout:1/437: dread - d1/d3/df/d4a/f5c zero size 2024-09-20T19:05:59.500 INFO:tasks.workunit.client.1.smithi098.stdout:1/438: chown d1/d3/l11 1531963 1 2024-09-20T19:05:59.500 INFO:tasks.workunit.client.0.smithi027.stdout:9/598: creat d0/d9/df/d1b/d9c/fc2 x:0 0 0 2024-09-20T19:05:59.501 INFO:tasks.workunit.client.0.smithi027.stdout:6/452: mkdir d4/d15/d37/d85 0 2024-09-20T19:05:59.501 INFO:tasks.workunit.client.1.smithi098.stdout:1/439: chown d1/d3/df/d34/c6c 50690 1 2024-09-20T19:05:59.502 INFO:tasks.workunit.client.1.smithi098.stdout:8/518: mkdir d7/de/d11/d19/d30/db5 0 2024-09-20T19:05:59.503 INFO:tasks.workunit.client.0.smithi027.stdout:7/485: symlink d3/d8/d26/d45/d56/la8 0 2024-09-20T19:05:59.504 INFO:tasks.workunit.client.1.smithi098.stdout:1/440: mkdir d1/d3/d2e/d68/d89 0 2024-09-20T19:05:59.505 INFO:tasks.workunit.client.0.smithi027.stdout:1/466: creat d2/d61/f8d x:0 0 0 2024-09-20T19:05:59.505 INFO:tasks.workunit.client.0.smithi027.stdout:7/486: chown d3/d5e/c6a 0 1 2024-09-20T19:05:59.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/519: mkdir d7/de/d11/d1f/d57/db6 0 2024-09-20T19:05:59.506 INFO:tasks.workunit.client.0.smithi027.stdout:2/413: dwrite d3/f9 [4194304,4194304] 0 2024-09-20T19:05:59.506 INFO:tasks.workunit.client.0.smithi027.stdout:5/549: dwrite d4/da/de/d3e/d69/d75/d3d/f68 [0,4194304] 0 2024-09-20T19:05:59.507 INFO:tasks.workunit.client.1.smithi098.stdout:8/520: write d7/de/d11/d1f/d57/f9a [678586,114860] 0 2024-09-20T19:05:59.508 INFO:tasks.workunit.client.1.smithi098.stdout:8/521: dread - d7/de/f3b zero size 2024-09-20T19:05:59.510 INFO:tasks.workunit.client.0.smithi027.stdout:8/482: mkdir d2/d3/d6/d9e 0 2024-09-20T19:05:59.510 INFO:tasks.workunit.client.1.smithi098.stdout:3/435: rename d4/d19/d1d/d22/f24 to d4/da/f8b 0 2024-09-20T19:05:59.511 INFO:tasks.workunit.client.1.smithi098.stdout:1/441: symlink d1/l8a 0 2024-09-20T19:05:59.517 INFO:tasks.workunit.client.1.smithi098.stdout:8/522: read d7/de/d11/d1d/f3e [770435,114923] 0 2024-09-20T19:05:59.517 INFO:tasks.workunit.client.0.smithi027.stdout:9/599: creat d0/d9/df/fc3 x:0 0 0 2024-09-20T19:05:59.518 INFO:tasks.workunit.client.0.smithi027.stdout:3/458: getdents d0/d1/d5e/d1d 0 2024-09-20T19:05:59.519 INFO:tasks.workunit.client.0.smithi027.stdout:9/600: dread - d0/d9/df/d1b/d9c/da4/fac zero size 2024-09-20T19:05:59.519 INFO:tasks.workunit.client.1.smithi098.stdout:3/436: fsync d4/d19/d1d/f4c 0 2024-09-20T19:05:59.521 INFO:tasks.workunit.client.0.smithi027.stdout:9/601: write d0/f75 [18983,112082] 0 2024-09-20T19:05:59.523 INFO:tasks.workunit.client.0.smithi027.stdout:9/602: chown d0/d9/df/d1c/d6a/d6d/dd/d66/f86 6 1 2024-09-20T19:05:59.525 INFO:tasks.workunit.client.1.smithi098.stdout:3/437: dread d4/d19/d1d/d22/f36 [0,4194304] 0 2024-09-20T19:05:59.527 INFO:tasks.workunit.client.0.smithi027.stdout:7/487: mkdir d3/d8/da/dc/da9 0 2024-09-20T19:05:59.528 INFO:tasks.workunit.client.0.smithi027.stdout:7/488: fdatasync d3/d8/d26/d45/d56/f64 0 2024-09-20T19:05:59.529 INFO:tasks.workunit.client.0.smithi027.stdout:1/467: creat d2/d1b/d56/d71/f8e x:0 0 0 2024-09-20T19:05:59.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/442: dwrite d1/d3/df/d34/d43/d53/f60 [0,4194304] 0 2024-09-20T19:05:59.529 INFO:tasks.workunit.client.0.smithi027.stdout:7/489: write d3/d8/da/f46 [831690,31447] 0 2024-09-20T19:05:59.531 INFO:tasks.workunit.client.1.smithi098.stdout:1/443: stat d1/d3/df/d34/d43/d65/f73 0 2024-09-20T19:05:59.534 INFO:tasks.workunit.client.0.smithi027.stdout:8/483: mkdir d2/d3/d6/d21/d33/d79/d9f 0 2024-09-20T19:05:59.534 INFO:tasks.workunit.client.1.smithi098.stdout:1/444: write d1/d3/fe [1704703,18694] 0 2024-09-20T19:05:59.534 INFO:tasks.workunit.client.1.smithi098.stdout:3/438: dwrite d4/d25/f68 [0,4194304] 0 2024-09-20T19:05:59.535 INFO:tasks.workunit.client.0.smithi027.stdout:6/453: symlink d4/d15/l86 0 2024-09-20T19:05:59.540 INFO:tasks.workunit.client.1.smithi098.stdout:4/576: rename d3/d6/d11/d1e/d2a/d45/c7a to d3/d5e/cc9 0 2024-09-20T19:05:59.541 INFO:tasks.workunit.client.1.smithi098.stdout:4/577: dread - d3/d6/d8c/f8e zero size 2024-09-20T19:05:59.542 INFO:tasks.workunit.client.1.smithi098.stdout:2/791: write d3/d16/d1d/d2b/d46/d74/d82/fac [602108,95855] 0 2024-09-20T19:05:59.543 INFO:tasks.workunit.client.1.smithi098.stdout:2/792: fdatasync d3/d51/fc3 0 2024-09-20T19:05:59.544 INFO:tasks.workunit.client.1.smithi098.stdout:2/793: fdatasync d3/d16/d1d/d2b/f5c 0 2024-09-20T19:05:59.545 INFO:tasks.workunit.client.1.smithi098.stdout:1/445: creat d1/d3/d2e/d71/f8b x:0 0 0 2024-09-20T19:05:59.552 INFO:tasks.workunit.client.1.smithi098.stdout:5/429: truncate d1/d17/d2e/f51 107877 0 2024-09-20T19:05:59.554 INFO:tasks.workunit.client.0.smithi027.stdout:0/545: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/f46 [648642,34300] 0 2024-09-20T19:05:59.554 INFO:tasks.workunit.client.0.smithi027.stdout:3/459: creat d0/d1/d13/d64/f94 x:0 0 0 2024-09-20T19:05:59.555 INFO:tasks.workunit.client.0.smithi027.stdout:6/454: fsync d4/d15/f69 0 2024-09-20T19:05:59.555 INFO:tasks.workunit.client.0.smithi027.stdout:2/414: creat d3/de/d34/f7a x:0 0 0 2024-09-20T19:05:59.557 INFO:tasks.workunit.client.0.smithi027.stdout:7/490: mkdir d3/d8/d26/d45/daa 0 2024-09-20T19:05:59.559 INFO:tasks.workunit.client.1.smithi098.stdout:2/794: mkdir d3/d16/d1d/d2b/d101 0 2024-09-20T19:05:59.560 INFO:tasks.workunit.client.0.smithi027.stdout:8/484: write d2/d14/d13/f22 [459659,73163] 0 2024-09-20T19:05:59.560 INFO:tasks.workunit.client.0.smithi027.stdout:1/468: dwrite d2/d8/d74/f79 [0,4194304] 0 2024-09-20T19:05:59.560 INFO:tasks.workunit.client.0.smithi027.stdout:4/357: write d5/d13/d16/d21/f33 [278900,64658] 0 2024-09-20T19:05:59.562 INFO:tasks.workunit.client.0.smithi027.stdout:5/550: creat d4/d1f/fb0 x:0 0 0 2024-09-20T19:05:59.563 INFO:tasks.workunit.client.0.smithi027.stdout:0/546: mknod d2/db7/ccd 0 2024-09-20T19:05:59.564 INFO:tasks.workunit.client.0.smithi027.stdout:8/485: chown d2/d14/d13/d2e/d6c/d77/f8a 36089 1 2024-09-20T19:05:59.564 INFO:tasks.workunit.client.0.smithi027.stdout:4/358: read - d5/d13/d16/d21/d26/f47 zero size 2024-09-20T19:05:59.565 INFO:tasks.workunit.client.1.smithi098.stdout:5/430: mkdir d1/d82 0 2024-09-20T19:05:59.566 INFO:tasks.workunit.client.0.smithi027.stdout:4/359: chown d5/d13/d16/l18 1064472 1 2024-09-20T19:05:59.567 INFO:tasks.workunit.client.1.smithi098.stdout:2/795: dread d3/db0/f57 [0,4194304] 0 2024-09-20T19:05:59.567 INFO:tasks.workunit.client.0.smithi027.stdout:4/360: readlink d5/d13/d16/d21/l72 0 2024-09-20T19:05:59.568 INFO:tasks.workunit.client.1.smithi098.stdout:1/446: creat d1/d3/f8c x:0 0 0 2024-09-20T19:05:59.569 INFO:tasks.workunit.client.0.smithi027.stdout:6/455: fsync d4/d15/d2c/f4c 0 2024-09-20T19:05:59.570 INFO:tasks.workunit.client.1.smithi098.stdout:4/578: link d3/d7d/da3/d3c/d6b/l6c d3/d4f/lca 0 2024-09-20T19:05:59.572 INFO:tasks.workunit.client.0.smithi027.stdout:2/415: mknod d3/de/c7b 0 2024-09-20T19:05:59.572 INFO:tasks.workunit.client.1.smithi098.stdout:8/523: write d7/de/d11/d1f/f2a [8640429,49059] 0 2024-09-20T19:05:59.572 INFO:tasks.workunit.client.0.smithi027.stdout:8/486: dwrite d2/d3/d6/d21/d33/f5a [0,4194304] 0 2024-09-20T19:05:59.576 INFO:tasks.workunit.client.1.smithi098.stdout:1/447: dwrite d1/d3/df/d4a/f5c [0,4194304] 0 2024-09-20T19:05:59.576 INFO:tasks.workunit.client.1.smithi098.stdout:2/796: write d3/d16/d1a/fae [370441,113818] 0 2024-09-20T19:05:59.577 INFO:tasks.workunit.client.1.smithi098.stdout:4/579: rmdir d3/d6/d11/d1e/d2a 39 2024-09-20T19:05:59.579 INFO:tasks.workunit.client.0.smithi027.stdout:5/551: readlink d4/da/de/d3e/d69/d75/d3d/l5b 0 2024-09-20T19:05:59.580 INFO:tasks.workunit.client.0.smithi027.stdout:8/487: dwrite d2/d3/d1b/d36/f4c [0,4194304] 0 2024-09-20T19:05:59.585 INFO:tasks.workunit.client.1.smithi098.stdout:5/431: creat d1/d46/f83 x:0 0 0 2024-09-20T19:05:59.590 INFO:tasks.workunit.client.1.smithi098.stdout:4/580: chown d3/d6/d11/d57/f9b 3782 1 2024-09-20T19:05:59.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/581: truncate d3/d2e/fb9 990142 0 2024-09-20T19:05:59.593 INFO:tasks.workunit.client.0.smithi027.stdout:6/456: symlink d4/d6/d4b/l87 0 2024-09-20T19:05:59.595 INFO:tasks.workunit.client.1.smithi098.stdout:3/439: dwrite d4/d19/d1d/d2f/d3e/f52 [0,4194304] 0 2024-09-20T19:05:59.600 INFO:tasks.workunit.client.0.smithi027.stdout:7/491: unlink d3/d24/ca0 0 2024-09-20T19:05:59.601 INFO:tasks.workunit.client.1.smithi098.stdout:1/448: getdents d1/d3/df/d34/d43/d7c 0 2024-09-20T19:05:59.601 INFO:tasks.workunit.client.0.smithi027.stdout:7/492: write d3/d8/da/d2e/d39/f3b [2049630,108435] 0 2024-09-20T19:05:59.605 INFO:tasks.workunit.client.0.smithi027.stdout:5/552: write d4/d1f/d91/f94 [3014739,51476] 0 2024-09-20T19:05:59.606 INFO:tasks.workunit.client.0.smithi027.stdout:8/488: creat d2/d3/d6/fa0 x:0 0 0 2024-09-20T19:05:59.607 INFO:tasks.workunit.client.0.smithi027.stdout:5/553: chown d4/da/de/d3e/d69 1 1 2024-09-20T19:05:59.608 INFO:tasks.workunit.client.1.smithi098.stdout:8/524: write d7/f8 [5004749,86696] 0 2024-09-20T19:05:59.609 INFO:tasks.workunit.client.1.smithi098.stdout:3/440: stat d4/d19/d1d/d2f/d4e/c63 0 2024-09-20T19:05:59.609 INFO:tasks.workunit.client.0.smithi027.stdout:8/489: fsync d2/d3/d6/d6d/d75/f84 0 2024-09-20T19:05:59.609 INFO:tasks.workunit.client.0.smithi027.stdout:3/460: dwrite d0/d1/f26 [0,4194304] 0 2024-09-20T19:05:59.612 INFO:tasks.workunit.client.0.smithi027.stdout:7/493: dread d3/d8/d26/f4a [0,4194304] 0 2024-09-20T19:05:59.612 INFO:tasks.workunit.client.1.smithi098.stdout:2/797: creat d3/db0/f102 x:0 0 0 2024-09-20T19:05:59.614 INFO:tasks.workunit.client.1.smithi098.stdout:5/432: dwrite d1/d17/d2e/f67 [0,4194304] 0 2024-09-20T19:05:59.614 INFO:tasks.workunit.client.1.smithi098.stdout:1/449: mknod d1/d3/d2e/c8d 0 2024-09-20T19:05:59.616 INFO:tasks.workunit.client.0.smithi027.stdout:2/416: link d3/d1c/f2d d3/d1c/d26/d2a/d63/f7c 0 2024-09-20T19:05:59.618 INFO:tasks.workunit.client.0.smithi027.stdout:7/494: dread d3/f91 [0,4194304] 0 2024-09-20T19:05:59.622 INFO:tasks.workunit.client.0.smithi027.stdout:1/469: creat d2/d8/d3b/d4b/f8f x:0 0 0 2024-09-20T19:05:59.622 INFO:tasks.workunit.client.1.smithi098.stdout:3/441: fdatasync d4/d25/d40/d80/f86 0 2024-09-20T19:05:59.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/442: stat d4/d38/d48/d60 0 2024-09-20T19:05:59.625 INFO:tasks.workunit.client.1.smithi098.stdout:3/443: write d4/d38/d48/d60/f6b [230620,6960] 0 2024-09-20T19:05:59.625 INFO:tasks.workunit.client.0.smithi027.stdout:0/547: link d2/d48/d6b/d79/d84/lb5 d2/d48/d6b/d79/d84/d1b/d39/dc7/lce 0 2024-09-20T19:05:59.626 INFO:tasks.workunit.client.1.smithi098.stdout:2/798: fsync d3/df/d13/f9b 0 2024-09-20T19:05:59.628 INFO:tasks.workunit.client.0.smithi027.stdout:3/461: fdatasync d0/d19/d54/f5c 0 2024-09-20T19:05:59.630 INFO:tasks.workunit.client.1.smithi098.stdout:4/582: rename d3/d6/l3a to d3/d6/d11/d1e/lcb 0 2024-09-20T19:05:59.630 INFO:tasks.workunit.client.0.smithi027.stdout:4/361: dwrite d5/d11/d17/d1b/f3c [0,4194304] 0 2024-09-20T19:05:59.631 INFO:tasks.workunit.client.1.smithi098.stdout:4/583: fdatasync d3/d2e/fb9 0 2024-09-20T19:05:59.632 INFO:tasks.workunit.client.0.smithi027.stdout:2/417: creat d3/d1c/d26/d2a/f7d x:0 0 0 2024-09-20T19:05:59.633 INFO:tasks.workunit.client.0.smithi027.stdout:6/457: dwrite d4/d15/d37/d7a/d33/f4d [0,4194304] 0 2024-09-20T19:05:59.635 INFO:tasks.workunit.client.0.smithi027.stdout:4/362: stat d5/d11/d17/d1b 0 2024-09-20T19:05:59.639 INFO:tasks.workunit.client.0.smithi027.stdout:1/470: mkdir d2/d8/d3b/d82/d90 0 2024-09-20T19:05:59.641 INFO:tasks.workunit.client.0.smithi027.stdout:4/363: dwrite d5/d11/d3d/d6e/f6b [0,4194304] 0 2024-09-20T19:05:59.642 INFO:tasks.workunit.client.1.smithi098.stdout:8/525: creat d7/fb7 x:0 0 0 2024-09-20T19:05:59.645 INFO:tasks.workunit.client.0.smithi027.stdout:3/462: dread - d0/f5d zero size 2024-09-20T19:05:59.646 INFO:tasks.workunit.client.0.smithi027.stdout:3/463: read - d0/f5d zero size 2024-09-20T19:05:59.647 INFO:tasks.workunit.client.1.smithi098.stdout:4/584: dread d3/d7d/da3/f56 [0,4194304] 0 2024-09-20T19:05:59.650 INFO:tasks.workunit.client.0.smithi027.stdout:0/548: unlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/l50 0 2024-09-20T19:05:59.652 INFO:tasks.workunit.client.1.smithi098.stdout:5/433: fdatasync d1/d17/d25/f2b 0 2024-09-20T19:05:59.653 INFO:tasks.workunit.client.0.smithi027.stdout:7/495: mknod d3/cab 0 2024-09-20T19:05:59.654 INFO:tasks.workunit.client.1.smithi098.stdout:1/450: rmdir d1/d3/df/d34/d43/d7c 0 2024-09-20T19:05:59.655 INFO:tasks.workunit.client.0.smithi027.stdout:0/549: dread d2/d48/f76 [0,4194304] 0 2024-09-20T19:05:59.655 INFO:tasks.workunit.client.1.smithi098.stdout:1/451: fsync d1/d3/df/d34/f48 0 2024-09-20T19:05:59.656 INFO:tasks.workunit.client.1.smithi098.stdout:1/452: readlink d1/l8a 0 2024-09-20T19:05:59.656 INFO:tasks.workunit.client.0.smithi027.stdout:0/550: truncate d2/da2/fc8 425253 0 2024-09-20T19:05:59.656 INFO:tasks.workunit.client.0.smithi027.stdout:6/458: rename d4/d15/d37/d39/f3f to d4/d6/f88 0 2024-09-20T19:05:59.657 INFO:tasks.workunit.client.0.smithi027.stdout:2/418: fdatasync d3/de/f1a 0 2024-09-20T19:05:59.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/444: link d4/d19/d1d/d2f/f66 d4/d19/d1d/d2f/f8c 0 2024-09-20T19:05:59.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/445: read d4/da/f5c [526395,71612] 0 2024-09-20T19:05:59.659 INFO:tasks.workunit.client.0.smithi027.stdout:1/471: write d2/d8/d74/f4e [6122,45931] 0 2024-09-20T19:05:59.662 INFO:tasks.workunit.client.0.smithi027.stdout:8/490: creat d2/d3/d6/d21/d33/fa1 x:0 0 0 2024-09-20T19:05:59.662 INFO:tasks.workunit.client.1.smithi098.stdout:5/434: mkdir d1/d46/d69/d84 0 2024-09-20T19:05:59.665 INFO:tasks.workunit.client.1.smithi098.stdout:2/799: rename d3/f15 to d3/d16/f103 0 2024-09-20T19:05:59.667 INFO:tasks.workunit.client.1.smithi098.stdout:3/446: mkdir d4/d25/d8d 0 2024-09-20T19:05:59.669 INFO:tasks.workunit.client.0.smithi027.stdout:0/551: write d2/d48/d6b/d79/d84/f31 [3391880,91274] 0 2024-09-20T19:05:59.670 INFO:tasks.workunit.client.1.smithi098.stdout:5/435: dwrite d1/d17/d5e/f81 [0,4194304] 0 2024-09-20T19:05:59.676 INFO:tasks.workunit.client.0.smithi027.stdout:1/472: fdatasync d2/f66 0 2024-09-20T19:05:59.677 INFO:tasks.workunit.client.1.smithi098.stdout:1/453: dread d1/d3/df/d34/f48 [0,4194304] 0 2024-09-20T19:05:59.680 INFO:tasks.workunit.client.0.smithi027.stdout:4/364: link d5/d11/d3d/f6a d5/d13/d36/d48/d3f/f77 0 2024-09-20T19:05:59.682 INFO:tasks.workunit.client.1.smithi098.stdout:5/436: fdatasync d1/d17/d2e/f2f 0 2024-09-20T19:05:59.683 INFO:tasks.workunit.client.0.smithi027.stdout:6/459: dread d4/d15/d37/d39/f54 [0,4194304] 0 2024-09-20T19:05:59.683 INFO:tasks.workunit.client.1.smithi098.stdout:4/585: write d3/d6/faf [636645,10733] 0 2024-09-20T19:05:59.685 INFO:tasks.workunit.client.0.smithi027.stdout:1/473: dwrite d2/d8/d3b/d4b/f8f [0,4194304] 0 2024-09-20T19:05:59.685 INFO:tasks.workunit.client.1.smithi098.stdout:1/454: creat d1/d3/d62/f8e x:0 0 0 2024-09-20T19:05:59.687 INFO:tasks.workunit.client.0.smithi027.stdout:7/496: symlink d3/lac 0 2024-09-20T19:05:59.688 INFO:tasks.workunit.client.1.smithi098.stdout:8/526: rename d7/de/d11/d1d/f3e to d7/de/d11/fb8 0 2024-09-20T19:05:59.691 INFO:tasks.workunit.client.0.smithi027.stdout:2/419: getdents d3/d1c/d26/d75 0 2024-09-20T19:05:59.692 INFO:tasks.workunit.client.0.smithi027.stdout:2/420: write d3/d1c/d26/d2a/f53 [1268995,26524] 0 2024-09-20T19:05:59.694 INFO:tasks.workunit.client.1.smithi098.stdout:4/586: mkdir d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/dcc 0 2024-09-20T19:05:59.696 INFO:tasks.workunit.client.1.smithi098.stdout:1/455: unlink d1/d3/df/d34/c6f 0 2024-09-20T19:05:59.696 INFO:tasks.workunit.client.1.smithi098.stdout:2/800: dwrite d3/df/d13/f3a [0,4194304] 0 2024-09-20T19:05:59.699 INFO:tasks.workunit.client.1.smithi098.stdout:8/527: unlink d7/de/d11/d19/d30/d59/d80/lb2 0 2024-09-20T19:05:59.700 INFO:tasks.workunit.client.1.smithi098.stdout:8/528: stat d7/de/f93 0 2024-09-20T19:05:59.701 INFO:tasks.workunit.client.1.smithi098.stdout:8/529: dread - d7/de/d11/d19/d30/d55/fa8 zero size 2024-09-20T19:05:59.704 INFO:tasks.workunit.client.1.smithi098.stdout:5/437: creat d1/d1b/d40/f85 x:0 0 0 2024-09-20T19:05:59.705 INFO:tasks.workunit.client.0.smithi027.stdout:6/460: write d4/d15/d2c/f5b [625550,112350] 0 2024-09-20T19:05:59.706 INFO:tasks.workunit.client.1.smithi098.stdout:4/587: mknod d3/d6/d11/d57/d7f/ccd 0 2024-09-20T19:05:59.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/456: rmdir d1/d3/d62 39 2024-09-20T19:05:59.708 INFO:tasks.workunit.client.1.smithi098.stdout:1/457: chown d1/d3/df/l28 11 1 2024-09-20T19:05:59.710 INFO:tasks.workunit.client.1.smithi098.stdout:2/801: truncate d3/d16/d1d/f4e 3117406 0 2024-09-20T19:05:59.712 INFO:tasks.workunit.client.0.smithi027.stdout:9/603: sync 2024-09-20T19:05:59.713 INFO:tasks.workunit.client.1.smithi098.stdout:3/447: creat d4/d25/d40/d4b/f8e x:0 0 0 2024-09-20T19:05:59.713 INFO:tasks.workunit.client.0.smithi027.stdout:1/474: dread d2/d1b/f2e [0,4194304] 0 2024-09-20T19:05:59.713 INFO:tasks.workunit.client.0.smithi027.stdout:4/365: write d5/d11/d1a/d2a/f41 [3407300,96097] 0 2024-09-20T19:05:59.715 INFO:tasks.workunit.client.0.smithi027.stdout:1/475: write d2/d8/d41/f72 [72402,75478] 0 2024-09-20T19:05:59.715 INFO:tasks.workunit.client.1.smithi098.stdout:8/530: unlink d7/f2f 0 2024-09-20T19:05:59.716 INFO:tasks.workunit.client.0.smithi027.stdout:2/421: mknod d3/d13/d3c/d48/d6a/c7e 0 2024-09-20T19:05:59.717 INFO:tasks.workunit.client.0.smithi027.stdout:1/476: write d2/d8/d3b/d4b/f8f [3585699,54517] 0 2024-09-20T19:05:59.718 INFO:tasks.workunit.client.0.smithi027.stdout:1/477: dread - d2/d8/d2b/d2d/f80 zero size 2024-09-20T19:05:59.719 INFO:tasks.workunit.client.0.smithi027.stdout:8/491: creat d2/d3/d1b/fa2 x:0 0 0 2024-09-20T19:05:59.720 INFO:tasks.workunit.client.0.smithi027.stdout:8/492: write d2/d3/d6/ff [5296125,77131] 0 2024-09-20T19:05:59.723 INFO:tasks.workunit.client.1.smithi098.stdout:1/458: rename d1/d3/d2e/d71/f76 to d1/d3/d2e/d71/f8f 0 2024-09-20T19:05:59.724 INFO:tasks.workunit.client.0.smithi027.stdout:3/464: getdents d0/d1/d13 0 2024-09-20T19:05:59.726 INFO:tasks.workunit.client.0.smithi027.stdout:3/465: truncate d0/d1/d13/d3c/f7e 564734 0 2024-09-20T19:05:59.727 INFO:tasks.workunit.client.1.smithi098.stdout:4/588: dread d3/d6/f13 [0,4194304] 0 2024-09-20T19:05:59.727 INFO:tasks.workunit.client.0.smithi027.stdout:6/461: rename d4/d15/d37/d7a/d46/d53/l75 to d4/d1b/l89 0 2024-09-20T19:05:59.729 INFO:tasks.workunit.client.0.smithi027.stdout:9/604: dread d0/d9/df/d1b/f3e [0,4194304] 0 2024-09-20T19:05:59.732 INFO:tasks.workunit.client.0.smithi027.stdout:0/552: creat d2/d48/d6b/d79/d84/fcf x:0 0 0 2024-09-20T19:05:59.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/438: dread d1/d1b/f26 [0,4194304] 0 2024-09-20T19:05:59.738 INFO:tasks.workunit.client.1.smithi098.stdout:4/589: mkdir d3/d6/d11/d64/dce 0 2024-09-20T19:05:59.738 INFO:tasks.workunit.client.0.smithi027.stdout:4/366: symlink d5/d13/d36/l78 0 2024-09-20T19:05:59.739 INFO:tasks.workunit.client.1.smithi098.stdout:5/439: dwrite d1/d1b/f5a [0,4194304] 0 2024-09-20T19:05:59.743 INFO:tasks.workunit.client.0.smithi027.stdout:8/493: symlink d2/d14/d13/d43/d5d/la3 0 2024-09-20T19:05:59.743 INFO:tasks.workunit.client.0.smithi027.stdout:8/494: stat d2/c46 0 2024-09-20T19:05:59.745 INFO:tasks.workunit.client.1.smithi098.stdout:4/590: read d3/d6/d11/d1e/f26 [5341663,107699] 0 2024-09-20T19:05:59.745 INFO:tasks.workunit.client.1.smithi098.stdout:2/802: rename d3/d16/d1d/d4f/d8b to d3/df/d104 0 2024-09-20T19:05:59.748 INFO:tasks.workunit.client.0.smithi027.stdout:6/462: creat d4/d15/d37/d7a/d33/f8a x:0 0 0 2024-09-20T19:05:59.749 INFO:tasks.workunit.client.1.smithi098.stdout:3/448: creat d4/d19/f8f x:0 0 0 2024-09-20T19:05:59.750 INFO:tasks.workunit.client.0.smithi027.stdout:9/605: mknod d0/d9/df/d1b/d9c/da4/cc4 0 2024-09-20T19:05:59.751 INFO:tasks.workunit.client.0.smithi027.stdout:7/497: unlink d3/d8/da/dc/c85 0 2024-09-20T19:05:59.752 INFO:tasks.workunit.client.1.smithi098.stdout:8/531: link d7/de/d11/d1f/c76 d7/de/d11/d19/d30/d82/cb9 0 2024-09-20T19:05:59.753 INFO:tasks.workunit.client.1.smithi098.stdout:8/532: chown d7/de/d11/d19/d30/d55/da9/fac 118484365 1 2024-09-20T19:05:59.754 INFO:tasks.workunit.client.0.smithi027.stdout:0/553: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 x:0 0 0 2024-09-20T19:05:59.756 INFO:tasks.workunit.client.1.smithi098.stdout:5/440: rename d1/d46/c53 to d1/d71/c86 0 2024-09-20T19:05:59.757 INFO:tasks.workunit.client.0.smithi027.stdout:2/422: symlink d3/d13/d3c/l7f 0 2024-09-20T19:05:59.758 INFO:tasks.workunit.client.1.smithi098.stdout:5/441: write d1/d1b/d40/f85 [320336,68315] 0 2024-09-20T19:05:59.758 INFO:tasks.workunit.client.0.smithi027.stdout:2/423: dread - d3/de/d34/f64 zero size 2024-09-20T19:05:59.761 INFO:tasks.workunit.client.1.smithi098.stdout:3/449: creat d4/d19/d1d/d2f/d4e/f90 x:0 0 0 2024-09-20T19:05:59.764 INFO:tasks.workunit.client.0.smithi027.stdout:3/466: mknod d0/d1/d13/d15/d76/c95 0 2024-09-20T19:05:59.764 INFO:tasks.workunit.client.1.smithi098.stdout:1/459: getdents d1/d3/df/d34/d43 0 2024-09-20T19:05:59.767 INFO:tasks.workunit.client.0.smithi027.stdout:6/463: creat d4/d6/d4b/d7c/f8b x:0 0 0 2024-09-20T19:05:59.768 INFO:tasks.workunit.client.1.smithi098.stdout:4/591: dread d3/d6/f34 [4194304,4194304] 0 2024-09-20T19:05:59.771 INFO:tasks.workunit.client.1.smithi098.stdout:2/803: write d3/d16/d1d/d2b/f56 [902360,41753] 0 2024-09-20T19:05:59.773 INFO:tasks.workunit.client.0.smithi027.stdout:6/464: dwrite d4/d15/d37/f45 [0,4194304] 0 2024-09-20T19:05:59.775 INFO:tasks.workunit.client.0.smithi027.stdout:2/424: creat d3/d24/f80 x:0 0 0 2024-09-20T19:05:59.775 INFO:tasks.workunit.client.0.smithi027.stdout:1/478: creat d2/d8/d74/f91 x:0 0 0 2024-09-20T19:05:59.776 INFO:tasks.workunit.client.1.smithi098.stdout:8/533: symlink d7/de/d11/d19/d30/d68/d78/lba 0 2024-09-20T19:05:59.778 INFO:tasks.workunit.client.0.smithi027.stdout:5/554: sync 2024-09-20T19:05:59.778 INFO:tasks.workunit.client.0.smithi027.stdout:8/495: symlink d2/d3/d1b/d35/la4 0 2024-09-20T19:05:59.780 INFO:tasks.workunit.client.1.smithi098.stdout:4/592: unlink d3/d7d/da3/d3c/f5a 0 2024-09-20T19:05:59.781 INFO:tasks.workunit.client.0.smithi027.stdout:3/467: creat d0/d1/d13/d15/d55/f96 x:0 0 0 2024-09-20T19:05:59.782 INFO:tasks.workunit.client.1.smithi098.stdout:5/442: mkdir d1/d46/d69/d84/d87 0 2024-09-20T19:05:59.783 INFO:tasks.workunit.client.0.smithi027.stdout:6/465: dread d4/d6/f2a [0,4194304] 0 2024-09-20T19:05:59.784 INFO:tasks.workunit.client.1.smithi098.stdout:2/804: creat d3/d16/d1d/d2b/d99/da2/f105 x:0 0 0 2024-09-20T19:05:59.784 INFO:tasks.workunit.client.0.smithi027.stdout:8/496: truncate d2/d3/d1b/f6f 135687 0 2024-09-20T19:05:59.788 INFO:tasks.workunit.client.0.smithi027.stdout:2/425: dwrite d3/d24/f80 [0,4194304] 0 2024-09-20T19:05:59.790 INFO:tasks.workunit.client.1.smithi098.stdout:3/450: dwrite d4/da/f51 [0,4194304] 0 2024-09-20T19:05:59.790 INFO:tasks.workunit.client.1.smithi098.stdout:4/593: mkdir d3/d5e/d9f/dcf 0 2024-09-20T19:05:59.791 INFO:tasks.workunit.client.1.smithi098.stdout:3/451: readlink d4/d19/d1d/l83 0 2024-09-20T19:05:59.792 INFO:tasks.workunit.client.1.smithi098.stdout:3/452: chown d4/d25/d40/c46 0 1 2024-09-20T19:05:59.793 INFO:tasks.workunit.client.0.smithi027.stdout:1/479: dwrite d2/d8/d2b/f58 [4194304,4194304] 0 2024-09-20T19:05:59.794 INFO:tasks.workunit.client.1.smithi098.stdout:3/453: fdatasync d4/d38/d48/d60/f6b 0 2024-09-20T19:05:59.795 INFO:tasks.workunit.client.1.smithi098.stdout:3/454: chown d4/d19/d1d/d2f/d4e/c63 6422 1 2024-09-20T19:05:59.796 INFO:tasks.workunit.client.1.smithi098.stdout:8/534: mkdir d7/de/dbb 0 2024-09-20T19:05:59.798 INFO:tasks.workunit.client.1.smithi098.stdout:8/535: write d7/de/f54 [691060,102882] 0 2024-09-20T19:05:59.799 INFO:tasks.workunit.client.0.smithi027.stdout:0/554: dwrite d2/d49/f45 [0,4194304] 0 2024-09-20T19:05:59.799 INFO:tasks.workunit.client.1.smithi098.stdout:8/536: readlink d7/de/d11/l17 0 2024-09-20T19:05:59.801 INFO:tasks.workunit.client.0.smithi027.stdout:4/367: dwrite d5/f34 [0,4194304] 0 2024-09-20T19:05:59.802 INFO:tasks.workunit.client.0.smithi027.stdout:3/468: dwrite d0/d1/d5e/f10 [0,4194304] 0 2024-09-20T19:05:59.805 INFO:tasks.workunit.client.1.smithi098.stdout:4/594: mkdir d3/d6/d5b/dd0 0 2024-09-20T19:05:59.808 INFO:tasks.workunit.client.1.smithi098.stdout:2/805: mknod d3/df/c106 0 2024-09-20T19:05:59.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/460: write d1/d3/f9 [25294,96045] 0 2024-09-20T19:05:59.812 INFO:tasks.workunit.client.0.smithi027.stdout:6/466: dread d4/d15/d37/d7a/f77 [0,4194304] 0 2024-09-20T19:05:59.812 INFO:tasks.workunit.client.0.smithi027.stdout:4/368: write d5/d11/d17/d1b/f3c [236031,52565] 0 2024-09-20T19:05:59.813 INFO:tasks.workunit.client.1.smithi098.stdout:3/455: creat d4/d38/f91 x:0 0 0 2024-09-20T19:05:59.814 INFO:tasks.workunit.client.0.smithi027.stdout:2/426: write d3/d1c/d26/f57 [238732,118574] 0 2024-09-20T19:05:59.816 INFO:tasks.workunit.client.0.smithi027.stdout:3/469: fsync d0/d1/d13/d64/f94 0 2024-09-20T19:05:59.816 INFO:tasks.workunit.client.1.smithi098.stdout:8/537: rmdir d7/de/d11/d19 39 2024-09-20T19:05:59.817 INFO:tasks.workunit.client.0.smithi027.stdout:1/480: rmdir d2/d8 39 2024-09-20T19:05:59.820 INFO:tasks.workunit.client.0.smithi027.stdout:9/606: link d0/d9/df/d1c/c77 d0/d9/df/d1c/d6a/d6d/cc5 0 2024-09-20T19:05:59.822 INFO:tasks.workunit.client.1.smithi098.stdout:3/456: rmdir d4/d38/d48/d60 39 2024-09-20T19:05:59.823 INFO:tasks.workunit.client.0.smithi027.stdout:6/467: creat d4/d15/d37/d7a/d46/d53/f8c x:0 0 0 2024-09-20T19:05:59.823 INFO:tasks.workunit.client.1.smithi098.stdout:5/443: dwrite d1/d46/f6e [0,4194304] 0 2024-09-20T19:05:59.827 INFO:tasks.workunit.client.1.smithi098.stdout:5/444: write d1/d1b/f6f [813458,93597] 0 2024-09-20T19:05:59.828 INFO:tasks.workunit.client.1.smithi098.stdout:8/538: creat d7/de/d11/d1f/d77/db3/fbc x:0 0 0 2024-09-20T19:05:59.828 INFO:tasks.workunit.client.1.smithi098.stdout:6/308: sync 2024-09-20T19:05:59.828 INFO:tasks.workunit.client.1.smithi098.stdout:9/526: sync 2024-09-20T19:05:59.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/317: sync 2024-09-20T19:05:59.828 INFO:tasks.workunit.client.0.smithi027.stdout:4/369: dread d5/d13/d36/d48/d3f/d4c/f55 [0,4194304] 0 2024-09-20T19:05:59.829 INFO:tasks.workunit.client.1.smithi098.stdout:4/595: dwrite d3/d7d/da3/d3c/d6b/f74 [0,4194304] 0 2024-09-20T19:05:59.829 INFO:tasks.workunit.client.0.smithi027.stdout:7/498: dwrite d3/d8/d1c/d61/fa1 [0,4194304] 0 2024-09-20T19:05:59.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/806: dread d3/d16/d1d/d2b/fb4 [0,4194304] 0 2024-09-20T19:05:59.832 INFO:tasks.workunit.client.1.smithi098.stdout:3/457: truncate d4/d19/d1d/f4c 504466 0 2024-09-20T19:05:59.833 INFO:tasks.workunit.client.1.smithi098.stdout:5/445: chown d1/d17/d5e/f7d 479 1 2024-09-20T19:05:59.836 INFO:tasks.workunit.client.1.smithi098.stdout:1/461: creat d1/f90 x:0 0 0 2024-09-20T19:05:59.836 INFO:tasks.workunit.client.1.smithi098.stdout:8/539: unlink d7/de/d11/d1d/f95 0 2024-09-20T19:05:59.836 INFO:tasks.workunit.client.1.smithi098.stdout:9/527: stat d4/de/d27/d6c/fa3 0 2024-09-20T19:05:59.836 INFO:tasks.workunit.client.1.smithi098.stdout:1/462: dread - d1/f84 zero size 2024-09-20T19:05:59.837 INFO:tasks.workunit.client.0.smithi027.stdout:2/427: dread d3/d1c/d26/d2a/f53 [0,4194304] 0 2024-09-20T19:05:59.838 INFO:tasks.workunit.client.1.smithi098.stdout:9/528: chown d4/de/d27 2 1 2024-09-20T19:05:59.838 INFO:tasks.workunit.client.1.smithi098.stdout:8/540: readlink d7/de/d11/l17 0 2024-09-20T19:05:59.838 INFO:tasks.workunit.client.1.smithi098.stdout:0/318: read d0/db/d32/f3a [132225,76992] 0 2024-09-20T19:05:59.839 INFO:tasks.workunit.client.1.smithi098.stdout:4/596: write d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d [1503728,29096] 0 2024-09-20T19:05:59.841 INFO:tasks.workunit.client.0.smithi027.stdout:6/468: dwrite d4/d6/f56 [0,4194304] 0 2024-09-20T19:05:59.841 INFO:tasks.workunit.client.0.smithi027.stdout:3/470: mknod d0/d1/d13/d3c/d93/c97 0 2024-09-20T19:05:59.841 INFO:tasks.workunit.client.0.smithi027.stdout:0/555: dread d2/d48/d6b/d79/d84/d1b/d39/f74 [0,4194304] 0 2024-09-20T19:05:59.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/319: fsync d0/d6/d19/f1c 0 2024-09-20T19:05:59.842 INFO:tasks.workunit.client.1.smithi098.stdout:9/529: write d4/d74/d8a/f98 [192341,28466] 0 2024-09-20T19:05:59.844 INFO:tasks.workunit.client.0.smithi027.stdout:0/556: write d2/d49/d70/fa3 [501260,62144] 0 2024-09-20T19:05:59.847 INFO:tasks.workunit.client.0.smithi027.stdout:8/497: dread d2/d3/d6/f3e [0,4194304] 0 2024-09-20T19:05:59.848 INFO:tasks.workunit.client.1.smithi098.stdout:0/320: chown d0/d6/d19/c23 15029 1 2024-09-20T19:05:59.850 INFO:tasks.workunit.client.0.smithi027.stdout:4/370: truncate d5/f37 1395628 0 2024-09-20T19:05:59.851 INFO:tasks.workunit.client.1.smithi098.stdout:9/530: write d4/de/d27/d4a/d21/d25/d51/f9d [87358,44469] 0 2024-09-20T19:05:59.851 INFO:tasks.workunit.client.1.smithi098.stdout:5/446: dread d1/d17/d5e/f81 [0,4194304] 0 2024-09-20T19:05:59.851 INFO:tasks.workunit.client.1.smithi098.stdout:0/321: chown d0/d55/c40 1339744 1 2024-09-20T19:05:59.852 INFO:tasks.workunit.client.0.smithi027.stdout:3/471: chown d0/d19/l6e 55 1 2024-09-20T19:05:59.852 INFO:tasks.workunit.client.0.smithi027.stdout:2/428: symlink d3/d1c/d26/d75/l81 0 2024-09-20T19:05:59.855 INFO:tasks.workunit.client.1.smithi098.stdout:8/541: rename d7/de/d11/d1f/d57/c98 to d7/de/d11/d1f/d57/d72/cbd 0 2024-09-20T19:05:59.856 INFO:tasks.workunit.client.0.smithi027.stdout:9/607: dread d0/d9/df/d1b/d9c/d5a/f63 [0,4194304] 0 2024-09-20T19:05:59.859 INFO:tasks.workunit.client.0.smithi027.stdout:0/557: dwrite d2/d48/d6b/d79/d84/f31 [0,4194304] 0 2024-09-20T19:05:59.862 INFO:tasks.workunit.client.1.smithi098.stdout:1/463: dwrite d1/d3/df/d34/d43/d53/f60 [0,4194304] 0 2024-09-20T19:05:59.863 INFO:tasks.workunit.client.1.smithi098.stdout:4/597: dwrite d3/d6/d11/d57/d7f/f8b [0,4194304] 0 2024-09-20T19:05:59.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/464: chown d1/d3/f2c 0 1 2024-09-20T19:05:59.868 INFO:tasks.workunit.client.0.smithi027.stdout:4/371: dwrite d5/d11/d17/d1b/f5f [0,4194304] 0 2024-09-20T19:05:59.868 INFO:tasks.workunit.client.0.smithi027.stdout:6/469: link d4/l67 d4/d15/d37/d5a/d78/l8d 0 2024-09-20T19:05:59.868 INFO:tasks.workunit.client.0.smithi027.stdout:9/608: write d0/d9/df/d1c/f72 [3348050,5995] 0 2024-09-20T19:05:59.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/447: dwrite d1/d1b/d40/f85 [0,4194304] 0 2024-09-20T19:05:59.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/559: sync 2024-09-20T19:05:59.871 INFO:tasks.workunit.client.0.smithi027.stdout:2/429: dread d3/d24/f80 [0,4194304] 0 2024-09-20T19:05:59.871 INFO:tasks.workunit.client.0.smithi027.stdout:8/498: getdents d2/d14/d13/d2e/d6c/d77 0 2024-09-20T19:05:59.872 INFO:tasks.workunit.client.0.smithi027.stdout:5/555: dread d4/fd [0,4194304] 0 2024-09-20T19:05:59.873 INFO:tasks.workunit.client.0.smithi027.stdout:6/470: chown d4/d6 93582 1 2024-09-20T19:05:59.876 INFO:tasks.workunit.client.1.smithi098.stdout:1/465: write d1/d3/f8c [684176,80929] 0 2024-09-20T19:05:59.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/309: dread d0/de/d1b/d37/f45 [0,4194304] 0 2024-09-20T19:05:59.880 INFO:tasks.workunit.client.0.smithi027.stdout:0/558: unlink d2/d48/d6b/d79/d9f/da4/cad 0 2024-09-20T19:05:59.880 INFO:tasks.workunit.client.0.smithi027.stdout:6/471: chown d4/d6/f11 755 1 2024-09-20T19:05:59.882 INFO:tasks.workunit.client.1.smithi098.stdout:8/542: mkdir d7/de/d11/d19/d30/d55/da9/dbe 0 2024-09-20T19:05:59.883 INFO:tasks.workunit.client.1.smithi098.stdout:0/322: dread d0/d6/fe [0,4194304] 0 2024-09-20T19:05:59.883 INFO:tasks.workunit.client.1.smithi098.stdout:9/531: dwrite d4/de/d27/d4a/d58/d5b/fa4 [0,4194304] 0 2024-09-20T19:05:59.884 INFO:tasks.workunit.client.1.smithi098.stdout:7/560: rmdir d3/d10/d16 39 2024-09-20T19:05:59.885 INFO:tasks.workunit.client.0.smithi027.stdout:4/372: creat d5/d13/d16/f79 x:0 0 0 2024-09-20T19:05:59.889 INFO:tasks.workunit.client.0.smithi027.stdout:8/499: creat d2/d14/d13/d2e/d6c/d77/fa5 x:0 0 0 2024-09-20T19:05:59.895 INFO:tasks.workunit.client.1.smithi098.stdout:5/448: rename d1/d17/d2e/f34 to d1/d17/d25/d79/f88 0 2024-09-20T19:05:59.895 INFO:tasks.workunit.client.1.smithi098.stdout:5/449: stat d1/d1b/l27 0 2024-09-20T19:05:59.896 INFO:tasks.workunit.client.0.smithi027.stdout:9/609: mknod d0/d9/df/d1b/cc6 0 2024-09-20T19:05:59.897 INFO:tasks.workunit.client.0.smithi027.stdout:9/610: dread - d0/d9/df/d1c/d6a/d9a/fab zero size 2024-09-20T19:05:59.899 INFO:tasks.workunit.client.1.smithi098.stdout:9/532: dwrite d4/de/f7f [0,4194304] 0 2024-09-20T19:05:59.902 INFO:tasks.workunit.client.1.smithi098.stdout:8/543: mknod d7/de/d11/d19/d30/d68/d78/cbf 0 2024-09-20T19:05:59.903 INFO:tasks.workunit.client.1.smithi098.stdout:8/544: write d7/f8 [4709471,55391] 0 2024-09-20T19:05:59.903 INFO:tasks.workunit.client.0.smithi027.stdout:2/430: creat d3/d1c/d26/d75/f82 x:0 0 0 2024-09-20T19:05:59.905 INFO:tasks.workunit.client.1.smithi098.stdout:4/598: creat d3/d7d/da3/d3c/fd1 x:0 0 0 2024-09-20T19:05:59.905 INFO:tasks.workunit.client.0.smithi027.stdout:3/472: dread d0/d1/f2e [4194304,4194304] 0 2024-09-20T19:05:59.907 INFO:tasks.workunit.client.1.smithi098.stdout:4/599: truncate d3/d6/d11/d57/d7f/d84/fc8 111803 0 2024-09-20T19:05:59.909 INFO:tasks.workunit.client.0.smithi027.stdout:4/373: creat d5/d13/d16/d21/f7a x:0 0 0 2024-09-20T19:05:59.912 INFO:tasks.workunit.client.1.smithi098.stdout:1/466: mknod d1/d3/df/d34/d43/c91 0 2024-09-20T19:05:59.913 INFO:tasks.workunit.client.0.smithi027.stdout:0/559: rename d2/d20/l9a to d2/da2/ld1 0 2024-09-20T19:05:59.916 INFO:tasks.workunit.client.1.smithi098.stdout:5/450: creat d1/d17/d35/f89 x:0 0 0 2024-09-20T19:05:59.916 INFO:tasks.workunit.client.0.smithi027.stdout:1/481: write d2/d8/f52 [186733,125254] 0 2024-09-20T19:05:59.917 INFO:tasks.workunit.client.1.smithi098.stdout:2/807: truncate d3/db0/f4d 2203308 0 2024-09-20T19:05:59.918 INFO:tasks.workunit.client.1.smithi098.stdout:7/561: fsync d3/d10/d16/d17/d33/d1f/f72 0 2024-09-20T19:05:59.920 INFO:tasks.workunit.client.0.smithi027.stdout:8/500: mknod d2/d3/d1b/ca6 0 2024-09-20T19:05:59.920 INFO:tasks.workunit.client.0.smithi027.stdout:4/374: read d5/d13/d16/f22 [9877,87885] 0 2024-09-20T19:05:59.921 INFO:tasks.workunit.client.1.smithi098.stdout:1/467: dwrite d1/f50 [0,4194304] 0 2024-09-20T19:05:59.922 INFO:tasks.workunit.client.0.smithi027.stdout:5/556: creat d4/da/de/d3e/fb1 x:0 0 0 2024-09-20T19:05:59.922 INFO:tasks.workunit.client.0.smithi027.stdout:0/560: dwrite d2/d20/fc1 [0,4194304] 0 2024-09-20T19:05:59.925 INFO:tasks.workunit.client.1.smithi098.stdout:3/458: dwrite d4/d19/d1d/d2f/f66 [0,4194304] 0 2024-09-20T19:05:59.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/323: creat d0/d55/d38/d51/f5a x:0 0 0 2024-09-20T19:05:59.928 INFO:tasks.workunit.client.0.smithi027.stdout:6/472: rename d4/d15/d37/d7a/d70 to d4/d15/d37/d7a/d8e 0 2024-09-20T19:05:59.931 INFO:tasks.workunit.client.0.smithi027.stdout:8/501: dwrite d2/d3/d6/d21/d33/f8f [0,4194304] 0 2024-09-20T19:05:59.931 INFO:tasks.workunit.client.0.smithi027.stdout:1/482: symlink d2/d8/d3b/d82/l92 0 2024-09-20T19:05:59.932 INFO:tasks.workunit.client.1.smithi098.stdout:4/600: creat d3/d7d/da3/d3c/d6b/d73/fd2 x:0 0 0 2024-09-20T19:05:59.932 INFO:tasks.workunit.client.1.smithi098.stdout:1/468: read d1/d3/df/d34/f5f [126818,119570] 0 2024-09-20T19:05:59.933 INFO:tasks.workunit.client.0.smithi027.stdout:6/473: truncate d4/d15/d37/d39/f83 362882 0 2024-09-20T19:05:59.933 INFO:tasks.workunit.client.0.smithi027.stdout:8/502: dread - d2/d14/d13/f7c zero size 2024-09-20T19:05:59.934 INFO:tasks.workunit.client.0.smithi027.stdout:6/474: chown d4/d6/fa 203 1 2024-09-20T19:05:59.935 INFO:tasks.workunit.client.1.smithi098.stdout:2/808: truncate d3/db0/f75 484545 0 2024-09-20T19:05:59.936 INFO:tasks.workunit.client.1.smithi098.stdout:2/809: fdatasync d3/dd9/fde 0 2024-09-20T19:05:59.937 INFO:tasks.workunit.client.1.smithi098.stdout:8/545: creat d7/de/dbb/fc0 x:0 0 0 2024-09-20T19:05:59.939 INFO:tasks.workunit.client.0.smithi027.stdout:1/483: mkdir d2/d8/d3b/d44/d93 0 2024-09-20T19:05:59.941 INFO:tasks.workunit.client.0.smithi027.stdout:2/431: rename d3/d13/d3c/c44 to d3/d1c/c83 0 2024-09-20T19:05:59.942 INFO:tasks.workunit.client.1.smithi098.stdout:0/324: creat d0/d55/f5b x:0 0 0 2024-09-20T19:05:59.946 INFO:tasks.workunit.client.1.smithi098.stdout:4/601: creat d3/d7d/fd3 x:0 0 0 2024-09-20T19:05:59.946 INFO:tasks.workunit.client.1.smithi098.stdout:6/310: link d0/de/l30 d0/de/d1b/d37/d43/d51/l57 0 2024-09-20T19:05:59.946 INFO:tasks.workunit.client.1.smithi098.stdout:1/469: creat d1/d3/df/d4a/d6d/f92 x:0 0 0 2024-09-20T19:05:59.949 INFO:tasks.workunit.client.0.smithi027.stdout:8/503: dwrite d2/f47 [0,4194304] 0 2024-09-20T19:05:59.949 INFO:tasks.workunit.client.0.smithi027.stdout:2/432: creat d3/d13/d3c/d48/f84 x:0 0 0 2024-09-20T19:05:59.950 INFO:tasks.workunit.client.0.smithi027.stdout:6/475: link d4/f42 d4/d15/d37/d6a/f8f 0 2024-09-20T19:05:59.952 INFO:tasks.workunit.client.1.smithi098.stdout:8/546: mknod d7/de/d11/d1f/d77/db3/cc1 0 2024-09-20T19:05:59.953 INFO:tasks.workunit.client.1.smithi098.stdout:9/533: dread d4/de/f1d [0,4194304] 0 2024-09-20T19:05:59.953 INFO:tasks.workunit.client.1.smithi098.stdout:3/459: mkdir d4/d92 0 2024-09-20T19:05:59.954 INFO:tasks.workunit.client.0.smithi027.stdout:0/561: link d2/d49/d70/c92 d2/d48/d6b/d79/d84/d1b/dc5/d2e/cd2 0 2024-09-20T19:05:59.954 INFO:tasks.workunit.client.0.smithi027.stdout:6/476: read d4/d15/d37/f40 [431336,33830] 0 2024-09-20T19:05:59.955 INFO:tasks.workunit.client.1.smithi098.stdout:0/325: creat d0/d6/d28/f5c x:0 0 0 2024-09-20T19:05:59.957 INFO:tasks.workunit.client.0.smithi027.stdout:6/477: chown d4/lc 5092 1 2024-09-20T19:05:59.958 INFO:tasks.workunit.client.0.smithi027.stdout:6/478: write d4/d15/d37/d39/f83 [409435,53011] 0 2024-09-20T19:05:59.959 INFO:tasks.workunit.client.0.smithi027.stdout:2/433: creat d3/d1c/d26/d2a/f85 x:0 0 0 2024-09-20T19:05:59.959 INFO:tasks.workunit.client.1.smithi098.stdout:4/602: rename d3/d7d/da3/d3c/d6b/d73/d98/db3/c93 to d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/cd4 0 2024-09-20T19:05:59.961 INFO:tasks.workunit.client.0.smithi027.stdout:1/484: link d2/d8/d2b/d2d/l68 d2/d8/d2b/d2d/l94 0 2024-09-20T19:05:59.962 INFO:tasks.workunit.client.0.smithi027.stdout:2/434: dread - d3/d13/d3c/d48/d6a/f72 zero size 2024-09-20T19:05:59.963 INFO:tasks.workunit.client.0.smithi027.stdout:1/485: dread - d2/d1b/d56/d71/f7a zero size 2024-09-20T19:05:59.964 INFO:tasks.workunit.client.1.smithi098.stdout:0/326: dwrite d0/d6/f16 [4194304,4194304] 0 2024-09-20T19:05:59.964 INFO:tasks.workunit.client.0.smithi027.stdout:2/435: dread d3/de/d34/f4e [0,4194304] 0 2024-09-20T19:05:59.965 INFO:tasks.workunit.client.1.smithi098.stdout:0/327: chown d0/d6/d28/l2d 2449 1 2024-09-20T19:05:59.965 INFO:tasks.workunit.client.0.smithi027.stdout:2/436: readlink d3/d24/l3d 0 2024-09-20T19:05:59.966 INFO:tasks.workunit.client.1.smithi098.stdout:7/562: creat d3/d10/d16/d17/fb6 x:0 0 0 2024-09-20T19:05:59.968 INFO:tasks.workunit.client.1.smithi098.stdout:7/563: write d3/d10/d16/d17/d7c/f92 [4256738,48049] 0 2024-09-20T19:05:59.969 INFO:tasks.workunit.client.0.smithi027.stdout:1/486: dread d2/d8/d3b/d4b/f8f [0,4194304] 0 2024-09-20T19:05:59.972 INFO:tasks.workunit.client.0.smithi027.stdout:6/479: creat d4/d15/d37/f90 x:0 0 0 2024-09-20T19:05:59.974 INFO:tasks.workunit.client.0.smithi027.stdout:6/480: dread - d4/d6/d4b/f6b zero size 2024-09-20T19:05:59.976 INFO:tasks.workunit.client.1.smithi098.stdout:0/328: dwrite d0/db/d1d/f4d [0,4194304] 0 2024-09-20T19:05:59.977 INFO:tasks.workunit.client.1.smithi098.stdout:0/329: chown d0/d6/f16 3321 1 2024-09-20T19:05:59.977 INFO:tasks.workunit.client.1.smithi098.stdout:0/330: stat d0/d6/d28/d31/d45/c52 0 2024-09-20T19:05:59.978 INFO:tasks.workunit.client.0.smithi027.stdout:2/437: rmdir d3 39 2024-09-20T19:05:59.981 INFO:tasks.workunit.client.0.smithi027.stdout:8/504: fsync d2/f47 0 2024-09-20T19:05:59.982 INFO:tasks.workunit.client.0.smithi027.stdout:8/505: write d2/d3/f57 [1109092,86823] 0 2024-09-20T19:05:59.984 INFO:tasks.workunit.client.1.smithi098.stdout:5/451: getdents d1/d71 0 2024-09-20T19:05:59.986 INFO:tasks.workunit.client.0.smithi027.stdout:1/487: creat d2/d1b/d56/d71/f95 x:0 0 0 2024-09-20T19:05:59.990 INFO:tasks.workunit.client.1.smithi098.stdout:7/564: rmdir d3/d10/d16/d17/d7c 39 2024-09-20T19:05:59.997 INFO:tasks.workunit.client.1.smithi098.stdout:8/547: link d7/de/d11/d1d/f7c d7/de/d11/d1f/d57/fc2 0 2024-09-20T19:05:59.999 INFO:tasks.workunit.client.0.smithi027.stdout:1/488: mkdir d2/d8/d3b/d44/d96 0 2024-09-20T19:06:00.000 INFO:tasks.workunit.client.1.smithi098.stdout:3/460: creat d4/d19/d1d/d2f/d4e/f93 x:0 0 0 2024-09-20T19:06:00.001 INFO:tasks.workunit.client.0.smithi027.stdout:3/473: dwrite d0/f5d [0,4194304] 0 2024-09-20T19:06:00.001 INFO:tasks.workunit.client.0.smithi027.stdout:8/506: dread d2/d3/d6/d21/f38 [0,4194304] 0 2024-09-20T19:06:00.003 INFO:tasks.workunit.client.1.smithi098.stdout:0/331: fdatasync d0/db/d1d/f2a 0 2024-09-20T19:06:00.003 INFO:tasks.workunit.client.0.smithi027.stdout:3/474: write d0/d1/d13/d64/f7c [3410796,106561] 0 2024-09-20T19:06:00.004 INFO:tasks.workunit.client.0.smithi027.stdout:2/438: creat d3/d1c/d26/d2a/f86 x:0 0 0 2024-09-20T19:06:00.006 INFO:tasks.workunit.client.1.smithi098.stdout:1/470: getdents d1/d3/df/d4a 0 2024-09-20T19:06:00.014 INFO:tasks.workunit.client.0.smithi027.stdout:8/507: mknod d2/d3/d6/ca7 0 2024-09-20T19:06:00.014 INFO:tasks.workunit.client.1.smithi098.stdout:1/471: read d1/d3/d2e/f3b [3288817,73286] 0 2024-09-20T19:06:00.014 INFO:tasks.workunit.client.1.smithi098.stdout:2/810: link d3/d16/d1d/f39 d3/d16/d1d/f107 0 2024-09-20T19:06:00.018 INFO:tasks.workunit.client.0.smithi027.stdout:1/489: dread d2/d8/d2b/f4a [0,4194304] 0 2024-09-20T19:06:00.018 INFO:tasks.workunit.client.0.smithi027.stdout:2/439: creat d3/d13/f87 x:0 0 0 2024-09-20T19:06:00.019 INFO:tasks.workunit.client.0.smithi027.stdout:4/375: write d5/d13/d16/d21/d26/f29 [3756567,105426] 0 2024-09-20T19:06:00.020 INFO:tasks.workunit.client.0.smithi027.stdout:1/490: chown d2/d8/d74/f91 436504019 1 2024-09-20T19:06:00.021 INFO:tasks.workunit.client.0.smithi027.stdout:8/508: creat d2/d14/d13/d2e/fa8 x:0 0 0 2024-09-20T19:06:00.022 INFO:tasks.workunit.client.0.smithi027.stdout:8/509: chown d2/d14/d13/f3b 5 1 2024-09-20T19:06:00.023 INFO:tasks.workunit.client.0.smithi027.stdout:8/510: fdatasync d2/d3/d6/d21/d33/f8f 0 2024-09-20T19:06:00.023 INFO:tasks.workunit.client.1.smithi098.stdout:3/461: dread - d4/d38/d39/f88 zero size 2024-09-20T19:06:00.024 INFO:tasks.workunit.client.0.smithi027.stdout:4/376: rmdir d5/d13/d36/d48/d3f/d4c 39 2024-09-20T19:06:00.024 INFO:tasks.workunit.client.1.smithi098.stdout:3/462: chown d4/d38/l84 10 1 2024-09-20T19:06:00.025 INFO:tasks.workunit.client.0.smithi027.stdout:4/377: fdatasync d5/d11/d3d/d6e/f6b 0 2024-09-20T19:06:00.028 INFO:tasks.workunit.client.0.smithi027.stdout:1/491: dwrite d2/d8/d3b/d4b/f2c [0,4194304] 0 2024-09-20T19:06:00.028 INFO:tasks.workunit.client.1.smithi098.stdout:8/548: dread d7/f61 [0,4194304] 0 2024-09-20T19:06:00.030 INFO:tasks.workunit.client.0.smithi027.stdout:1/492: write d2/d1b/d56/d71/f8e [855701,83560] 0 2024-09-20T19:06:00.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/603: link d3/f7 d3/d6/d11/fd5 0 2024-09-20T19:06:00.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/811: fdatasync d3/d16/d1a/f7c 0 2024-09-20T19:06:00.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/565: symlink d3/d10/d16/d17/d7c/lb7 0 2024-09-20T19:06:00.040 INFO:tasks.workunit.client.1.smithi098.stdout:7/566: fsync d3/d10/d16/d17/d33/d1f/d28/f4a 0 2024-09-20T19:06:00.040 INFO:tasks.workunit.client.1.smithi098.stdout:5/452: dread d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:06:00.042 INFO:tasks.workunit.client.1.smithi098.stdout:6/311: write d0/de/d1b/d37/d44/d24/d29/f35 [418503,121611] 0 2024-09-20T19:06:00.047 INFO:tasks.workunit.client.1.smithi098.stdout:9/534: write d4/f1a [73918,104373] 0 2024-09-20T19:06:00.048 INFO:tasks.workunit.client.0.smithi027.stdout:1/493: symlink d2/d8/d3b/d82/d87/l97 0 2024-09-20T19:06:00.051 INFO:tasks.workunit.client.1.smithi098.stdout:1/472: rename d1/d3/c20 to d1/d3/df/d4a/d6d/c93 0 2024-09-20T19:06:00.053 INFO:tasks.workunit.client.0.smithi027.stdout:0/562: truncate d2/d48/d6b/d79/d84/d1b/f5f 3431380 0 2024-09-20T19:06:00.053 INFO:tasks.workunit.client.0.smithi027.stdout:4/378: getdents d5/d11/d1a/d2a 0 2024-09-20T19:06:00.054 INFO:tasks.workunit.client.0.smithi027.stdout:0/563: stat d2/d48/d6b/d79/d84/d1b/d39/f74 0 2024-09-20T19:06:00.055 INFO:tasks.workunit.client.1.smithi098.stdout:3/463: mkdir d4/d25/d40/d80/d94 0 2024-09-20T19:06:00.058 INFO:tasks.workunit.client.0.smithi027.stdout:1/494: symlink d2/d8/d2b/d5e/l98 0 2024-09-20T19:06:00.059 INFO:tasks.workunit.client.0.smithi027.stdout:1/495: fsync d2/d8/d74/f79 0 2024-09-20T19:06:00.059 INFO:tasks.workunit.client.0.smithi027.stdout:4/379: dwrite d5/d11/d3d/d6e/f75 [0,4194304] 0 2024-09-20T19:06:00.059 INFO:tasks.workunit.client.0.smithi027.stdout:0/564: unlink d2/d48/d6b/d79/d84/d1b/d39/fc2 0 2024-09-20T19:06:00.060 INFO:tasks.workunit.client.1.smithi098.stdout:8/549: mknod d7/da2/cc3 0 2024-09-20T19:06:00.061 INFO:tasks.workunit.client.0.smithi027.stdout:4/380: write d5/d13/d16/d21/f33 [485701,115304] 0 2024-09-20T19:06:00.062 INFO:tasks.workunit.client.1.smithi098.stdout:4/604: symlink d3/ld6 0 2024-09-20T19:06:00.066 INFO:tasks.workunit.client.1.smithi098.stdout:1/473: symlink d1/d3/df/d34/d43/d65/l94 0 2024-09-20T19:06:00.068 INFO:tasks.workunit.client.0.smithi027.stdout:0/565: creat d2/d20/fd3 x:0 0 0 2024-09-20T19:06:00.068 INFO:tasks.workunit.client.1.smithi098.stdout:7/567: truncate d3/d10/d16/f34 1898762 0 2024-09-20T19:06:00.069 INFO:tasks.workunit.client.0.smithi027.stdout:4/381: dwrite d5/fa [4194304,4194304] 0 2024-09-20T19:06:00.069 INFO:tasks.workunit.client.0.smithi027.stdout:0/566: chown d2/d48/c8d 4082453 1 2024-09-20T19:06:00.072 INFO:tasks.workunit.client.1.smithi098.stdout:0/332: link d0/db/f14 d0/db/f5d 0 2024-09-20T19:06:00.073 INFO:tasks.workunit.client.1.smithi098.stdout:0/333: dread - d0/f4a zero size 2024-09-20T19:06:00.074 INFO:tasks.workunit.client.0.smithi027.stdout:4/382: dread d5/d11/d3d/d6e/f75 [0,4194304] 0 2024-09-20T19:06:00.075 INFO:tasks.workunit.client.1.smithi098.stdout:6/312: symlink d0/de/d1b/d37/d44/d24/d29/d50/l58 0 2024-09-20T19:06:00.077 INFO:tasks.workunit.client.1.smithi098.stdout:8/550: rename d7/de/d11/d19/d30/d59/c67 to d7/de/d11/d19/d30/d82/cc4 0 2024-09-20T19:06:00.080 INFO:tasks.workunit.client.1.smithi098.stdout:4/605: unlink d3/d6/d11/d57/d7f/ccd 0 2024-09-20T19:06:00.083 INFO:tasks.workunit.client.0.smithi027.stdout:0/567: creat d2/d48/d6b/d79/fd4 x:0 0 0 2024-09-20T19:06:00.085 INFO:tasks.workunit.client.1.smithi098.stdout:7/568: unlink d3/d76/f83 0 2024-09-20T19:06:00.085 INFO:tasks.workunit.client.1.smithi098.stdout:8/551: dwrite d7/de/d11/d19/d30/d55/da9/fac [0,4194304] 0 2024-09-20T19:06:00.086 INFO:tasks.workunit.client.0.smithi027.stdout:4/383: dwrite d5/d13/f66 [0,4194304] 0 2024-09-20T19:06:00.089 INFO:tasks.workunit.client.0.smithi027.stdout:0/568: dread d2/d49/f45 [0,4194304] 0 2024-09-20T19:06:00.090 INFO:tasks.workunit.client.0.smithi027.stdout:0/569: dread - d2/d49/d70/f89 zero size 2024-09-20T19:06:00.092 INFO:tasks.workunit.client.0.smithi027.stdout:4/384: unlink d5/d13/f66 0 2024-09-20T19:06:00.093 INFO:tasks.workunit.client.0.smithi027.stdout:3/475: dwrite d0/d1/d13/d15/f29 [0,4194304] 0 2024-09-20T19:06:00.095 INFO:tasks.workunit.client.1.smithi098.stdout:3/464: getdents d4/d19/d7b 0 2024-09-20T19:06:00.095 INFO:tasks.workunit.client.1.smithi098.stdout:3/465: fsync d4/d19/d1d/d2f/f66 0 2024-09-20T19:06:00.095 INFO:tasks.workunit.client.1.smithi098.stdout:0/334: creat d0/d6/d28/d31/d45/f5e x:0 0 0 2024-09-20T19:06:00.095 INFO:tasks.workunit.client.0.smithi027.stdout:3/476: write d0/d1/d13/d15/d6f/d7f/f86 [633950,39399] 0 2024-09-20T19:06:00.098 INFO:tasks.workunit.client.0.smithi027.stdout:0/570: mknod d2/da2/cd5 0 2024-09-20T19:06:00.102 INFO:tasks.workunit.client.0.smithi027.stdout:4/385: dwrite d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:00.107 INFO:tasks.workunit.client.0.smithi027.stdout:2/440: dwrite d3/d13/f25 [0,4194304] 0 2024-09-20T19:06:00.108 INFO:tasks.workunit.client.1.smithi098.stdout:1/474: link d1/d3/df/d34/d52/d77/f82 d1/d3/df/d34/d43/d53/f95 0 2024-09-20T19:06:00.109 INFO:tasks.workunit.client.0.smithi027.stdout:3/477: dwrite d0/d1/d13/f37 [4194304,4194304] 0 2024-09-20T19:06:00.109 INFO:tasks.workunit.client.0.smithi027.stdout:8/511: truncate d2/f39 7990172 0 2024-09-20T19:06:00.110 INFO:tasks.workunit.client.0.smithi027.stdout:0/571: fsync d2/d48/d6b/d79/d84/d1b/d39/f74 0 2024-09-20T19:06:00.111 INFO:tasks.workunit.client.1.smithi098.stdout:1/475: write d1/d3/df/d4a/d6d/f70 [88443,118148] 0 2024-09-20T19:06:00.112 INFO:tasks.workunit.client.1.smithi098.stdout:1/476: chown d1/d3/df/d34/d43/d53/l86 49359 1 2024-09-20T19:06:00.114 INFO:tasks.workunit.client.1.smithi098.stdout:2/812: write d3/df/d13/f29 [1550417,61798] 0 2024-09-20T19:06:00.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/569: truncate d3/d10/d16/d17/f7e 630282 0 2024-09-20T19:06:00.121 INFO:tasks.workunit.client.1.smithi098.stdout:4/606: dwrite d3/d6/f32 [0,4194304] 0 2024-09-20T19:06:00.121 INFO:tasks.workunit.client.0.smithi027.stdout:2/441: dread d3/de/f1f [0,4194304] 0 2024-09-20T19:06:00.121 INFO:tasks.workunit.client.0.smithi027.stdout:7/499: sync 2024-09-20T19:06:00.126 INFO:tasks.workunit.client.0.smithi027.stdout:4/386: unlink d5/d11/d17/d1b/f3c 0 2024-09-20T19:06:00.127 INFO:tasks.workunit.client.1.smithi098.stdout:1/477: dwrite d1/f14 [0,4194304] 0 2024-09-20T19:06:00.129 INFO:tasks.workunit.client.1.smithi098.stdout:1/478: dread - d1/d3/df/d34/d43/d65/f6b zero size 2024-09-20T19:06:00.131 INFO:tasks.workunit.client.1.smithi098.stdout:4/607: readlink d3/d7d/da3/d3c/d6b/l90 0 2024-09-20T19:06:00.132 INFO:tasks.workunit.client.0.smithi027.stdout:3/478: mkdir d0/d1/d13/d98 0 2024-09-20T19:06:00.136 INFO:tasks.workunit.client.0.smithi027.stdout:0/572: creat d2/d20/fd6 x:0 0 0 2024-09-20T19:06:00.138 INFO:tasks.workunit.client.1.smithi098.stdout:0/335: mknod d0/d55/c5f 0 2024-09-20T19:06:00.139 INFO:tasks.workunit.client.1.smithi098.stdout:4/608: chown d3/d6/d11/l31 7650 1 2024-09-20T19:06:00.141 INFO:tasks.workunit.client.1.smithi098.stdout:2/813: dwrite d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fd6 [0,4194304] 0 2024-09-20T19:06:00.145 INFO:tasks.workunit.client.1.smithi098.stdout:9/535: getdents d4/de/d27/d6c 0 2024-09-20T19:06:00.146 INFO:tasks.workunit.client.0.smithi027.stdout:7/500: truncate d3/f12 1046370 0 2024-09-20T19:06:00.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/552: mknod d7/de/d11/d19/d30/db5/cc5 0 2024-09-20T19:06:00.151 INFO:tasks.workunit.client.1.smithi098.stdout:9/536: write d4/f47 [3277374,44466] 0 2024-09-20T19:06:00.152 INFO:tasks.workunit.client.0.smithi027.stdout:4/387: fsync d5/d11/d3d/d6e/f75 0 2024-09-20T19:06:00.155 INFO:tasks.workunit.client.1.smithi098.stdout:1/479: read - d1/d3/f49 zero size 2024-09-20T19:06:00.156 INFO:tasks.workunit.client.1.smithi098.stdout:5/453: truncate d1/f2 1391141 0 2024-09-20T19:06:00.161 INFO:tasks.workunit.client.1.smithi098.stdout:3/466: unlink d4/da/f45 0 2024-09-20T19:06:00.162 INFO:tasks.workunit.client.0.smithi027.stdout:1/496: rename d2/d8/d2b/d5e/l31 to d2/d8/d3b/d44/d93/l99 0 2024-09-20T19:06:00.163 INFO:tasks.workunit.client.0.smithi027.stdout:1/497: fsync d2/d8/d2b/d2d/f80 0 2024-09-20T19:06:00.163 INFO:tasks.workunit.client.0.smithi027.stdout:0/573: dwrite d2/d20/fca [0,4194304] 0 2024-09-20T19:06:00.165 INFO:tasks.workunit.client.0.smithi027.stdout:0/574: dread - d2/d48/d6b/d79/fac zero size 2024-09-20T19:06:00.167 INFO:tasks.workunit.client.0.smithi027.stdout:2/442: link d3/de/f1f d3/d13/d3c/d48/f88 0 2024-09-20T19:06:00.168 INFO:tasks.workunit.client.0.smithi027.stdout:2/443: read - d3/d13/d3c/d48/d6a/f72 zero size 2024-09-20T19:06:00.169 INFO:tasks.workunit.client.1.smithi098.stdout:2/814: unlink d3/d16/fa6 0 2024-09-20T19:06:00.170 INFO:tasks.workunit.client.0.smithi027.stdout:2/444: write d3/d13/d3c/d48/f62 [618687,5308] 0 2024-09-20T19:06:00.172 INFO:tasks.workunit.client.0.smithi027.stdout:4/388: creat d5/d13/d36/f7b x:0 0 0 2024-09-20T19:06:00.173 INFO:tasks.workunit.client.0.smithi027.stdout:0/575: dwrite d2/d48/d6b/d79/d84/d1b/dc5/f88 [0,4194304] 0 2024-09-20T19:06:00.177 INFO:tasks.workunit.client.0.smithi027.stdout:8/512: creat d2/d14/fa9 x:0 0 0 2024-09-20T19:06:00.184 INFO:tasks.workunit.client.0.smithi027.stdout:8/513: dwrite d2/d3/d1b/d36/f4c [0,4194304] 0 2024-09-20T19:06:00.188 INFO:tasks.workunit.client.1.smithi098.stdout:6/313: truncate d0/de/d1b/f1c 649036 0 2024-09-20T19:06:00.189 INFO:tasks.workunit.client.0.smithi027.stdout:9/611: sync 2024-09-20T19:06:00.189 INFO:tasks.workunit.client.0.smithi027.stdout:5/557: sync 2024-09-20T19:06:00.189 INFO:tasks.workunit.client.0.smithi027.stdout:6/481: sync 2024-09-20T19:06:00.190 INFO:tasks.workunit.client.1.smithi098.stdout:1/480: dread d1/d3/f19 [0,4194304] 0 2024-09-20T19:06:00.190 INFO:tasks.workunit.client.0.smithi027.stdout:2/445: mkdir d3/d24/d89 0 2024-09-20T19:06:00.192 INFO:tasks.workunit.client.0.smithi027.stdout:6/482: dread - d4/d15/d37/d7a/d33/f8a zero size 2024-09-20T19:06:00.193 INFO:tasks.workunit.client.0.smithi027.stdout:6/483: readlink d4/d6/d4b/l87 0 2024-09-20T19:06:00.194 INFO:tasks.workunit.client.0.smithi027.stdout:6/484: readlink d4/d15/l21 0 2024-09-20T19:06:00.194 INFO:tasks.workunit.client.1.smithi098.stdout:1/481: dread d1/d3/df/d34/f48 [0,4194304] 0 2024-09-20T19:06:00.196 INFO:tasks.workunit.client.0.smithi027.stdout:2/446: dread d3/f9 [4194304,4194304] 0 2024-09-20T19:06:00.198 INFO:tasks.workunit.client.0.smithi027.stdout:6/485: read d4/d6/f11 [3835019,78787] 0 2024-09-20T19:06:00.203 INFO:tasks.workunit.client.0.smithi027.stdout:2/447: dwrite d3/d13/d3c/d48/d6a/f72 [0,4194304] 0 2024-09-20T19:06:00.205 INFO:tasks.workunit.client.1.smithi098.stdout:7/570: getdents d3/d10/d16/d73/da6 0 2024-09-20T19:06:00.207 INFO:tasks.workunit.client.0.smithi027.stdout:8/514: rename d2/d14/c52 to d2/d2a/caa 0 2024-09-20T19:06:00.210 INFO:tasks.workunit.client.0.smithi027.stdout:7/501: write d3/f9 [4002655,8826] 0 2024-09-20T19:06:00.211 INFO:tasks.workunit.client.1.smithi098.stdout:0/336: dwrite d0/db/d32/f3a [0,4194304] 0 2024-09-20T19:06:00.212 INFO:tasks.workunit.client.0.smithi027.stdout:5/558: mkdir d4/da/d98/db2 0 2024-09-20T19:06:00.212 INFO:tasks.workunit.client.1.smithi098.stdout:0/337: stat d0/db/f20 0 2024-09-20T19:06:00.214 INFO:tasks.workunit.client.1.smithi098.stdout:3/467: symlink d4/da/d50/l95 0 2024-09-20T19:06:00.216 INFO:tasks.workunit.client.0.smithi027.stdout:1/498: write d2/d8/d2b/d2d/f34 [571204,39516] 0 2024-09-20T19:06:00.221 INFO:tasks.workunit.client.0.smithi027.stdout:5/559: dwrite d4/da/de/d3e/d69/d75/fad [0,4194304] 0 2024-09-20T19:06:00.222 INFO:tasks.workunit.client.0.smithi027.stdout:6/486: mkdir d4/d15/d37/d6a/d91 0 2024-09-20T19:06:00.224 INFO:tasks.workunit.client.0.smithi027.stdout:5/560: truncate d4/f45 141534 0 2024-09-20T19:06:00.227 INFO:tasks.workunit.client.0.smithi027.stdout:2/448: rmdir d3/d1c/d26 39 2024-09-20T19:06:00.228 INFO:tasks.workunit.client.0.smithi027.stdout:2/449: write d3/d1c/d31/f70 [588140,55199] 0 2024-09-20T19:06:00.229 INFO:tasks.workunit.client.0.smithi027.stdout:8/515: stat d2/d3/d6/d21/d33/c44 0 2024-09-20T19:06:00.229 INFO:tasks.workunit.client.0.smithi027.stdout:2/450: readlink d3/l10 0 2024-09-20T19:06:00.230 INFO:tasks.workunit.client.0.smithi027.stdout:2/451: write d3/d13/f17 [1961662,50027] 0 2024-09-20T19:06:00.230 INFO:tasks.workunit.client.0.smithi027.stdout:9/612: rename d0/d9/lb to d0/d9/df/d1b/d64/lc7 0 2024-09-20T19:06:00.234 INFO:tasks.workunit.client.1.smithi098.stdout:7/571: rename d3/d10/d16/d73 to d3/d76/db8 0 2024-09-20T19:06:00.234 INFO:tasks.workunit.client.0.smithi027.stdout:9/613: dread d0/f75 [0,4194304] 0 2024-09-20T19:06:00.234 INFO:tasks.workunit.client.1.smithi098.stdout:8/553: dwrite d7/de/d11/d19/d30/d68/f6a [0,4194304] 0 2024-09-20T19:06:00.238 INFO:tasks.workunit.client.0.smithi027.stdout:2/452: dwrite d3/d13/f87 [0,4194304] 0 2024-09-20T19:06:00.244 INFO:tasks.workunit.client.1.smithi098.stdout:4/609: creat d3/d6/d11/d1e/fd7 x:0 0 0 2024-09-20T19:06:00.244 INFO:tasks.workunit.client.1.smithi098.stdout:9/537: truncate d4/de/d27/d4a/d21/d25/f75 2244290 0 2024-09-20T19:06:00.245 INFO:tasks.workunit.client.0.smithi027.stdout:0/576: dwrite d2/da2/fc0 [0,4194304] 0 2024-09-20T19:06:00.246 INFO:tasks.workunit.client.1.smithi098.stdout:2/815: dwrite d3/db0/d69/d88/f98 [4194304,4194304] 0 2024-09-20T19:06:00.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/816: chown d3/df/d104/f3e 28783 1 2024-09-20T19:06:00.249 INFO:tasks.workunit.client.1.smithi098.stdout:4/610: chown d3/d6/d11/d64/dce 1112 1 2024-09-20T19:06:00.252 INFO:tasks.workunit.client.0.smithi027.stdout:3/479: link d0/d1/d13/d3c/f62 d0/d38/f99 0 2024-09-20T19:06:00.255 INFO:tasks.workunit.client.0.smithi027.stdout:5/561: creat d4/d1f/d7f/fb3 x:0 0 0 2024-09-20T19:06:00.259 INFO:tasks.workunit.client.0.smithi027.stdout:3/480: dwrite d0/d1/d13/d3c/f42 [0,4194304] 0 2024-09-20T19:06:00.261 INFO:tasks.workunit.client.0.smithi027.stdout:7/502: rename d3/f91 to d3/d8/d26/d45/d56/d8d/fad 0 2024-09-20T19:06:00.262 INFO:tasks.workunit.client.1.smithi098.stdout:5/454: mknod d1/d17/d25/d56/c8a 0 2024-09-20T19:06:00.263 INFO:tasks.workunit.client.0.smithi027.stdout:7/503: write d3/d8/da/d2e/d49/f9b [837307,99545] 0 2024-09-20T19:06:00.264 INFO:tasks.workunit.client.0.smithi027.stdout:7/504: stat d3/d24/d84/fa2 0 2024-09-20T19:06:00.271 INFO:tasks.workunit.client.0.smithi027.stdout:4/389: getdents d5/d11/d3d 0 2024-09-20T19:06:00.271 INFO:tasks.workunit.client.1.smithi098.stdout:9/538: symlink d4/de/d27/d4a/d58/d5b/d8f/lb2 0 2024-09-20T19:06:00.272 INFO:tasks.workunit.client.0.smithi027.stdout:4/390: chown d5/d13/d16/l39 3226 1 2024-09-20T19:06:00.272 INFO:tasks.workunit.client.1.smithi098.stdout:2/817: write d3/df/d13/f33 [1417413,83664] 0 2024-09-20T19:06:00.272 INFO:tasks.workunit.client.0.smithi027.stdout:4/391: write d5/d11/f23 [9037369,11378] 0 2024-09-20T19:06:00.274 INFO:tasks.workunit.client.1.smithi098.stdout:2/818: fsync d3/d16/d1d/d2b/f56 0 2024-09-20T19:06:00.278 INFO:tasks.workunit.client.1.smithi098.stdout:3/468: dwrite d4/fd [4194304,4194304] 0 2024-09-20T19:06:00.279 INFO:tasks.workunit.client.1.smithi098.stdout:3/469: readlink d4/da/d50/l95 0 2024-09-20T19:06:00.279 INFO:tasks.workunit.client.1.smithi098.stdout:6/314: link d0/de/c32 d0/de/d1b/d37/d44/dc/c59 0 2024-09-20T19:06:00.280 INFO:tasks.workunit.client.1.smithi098.stdout:4/611: symlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/ld8 0 2024-09-20T19:06:00.285 INFO:tasks.workunit.client.1.smithi098.stdout:8/554: fsync d7/de/d11/d1f/d57/d72/f79 0 2024-09-20T19:06:00.286 INFO:tasks.workunit.client.1.smithi098.stdout:5/455: mkdir d1/d17/d2e/d8b 0 2024-09-20T19:06:00.290 INFO:tasks.workunit.client.0.smithi027.stdout:0/577: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/l34 to d2/d48/d6b/d79/d9f/da4/ld7 0 2024-09-20T19:06:00.293 INFO:tasks.workunit.client.1.smithi098.stdout:1/482: dwrite d1/d3/df/f58 [0,4194304] 0 2024-09-20T19:06:00.295 INFO:tasks.workunit.client.1.smithi098.stdout:0/338: write d0/db/f14 [4030194,51225] 0 2024-09-20T19:06:00.297 INFO:tasks.workunit.client.0.smithi027.stdout:0/578: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7d [0,4194304] 0 2024-09-20T19:06:00.299 INFO:tasks.workunit.client.0.smithi027.stdout:7/505: symlink d3/d8/da/d51/lae 0 2024-09-20T19:06:00.304 INFO:tasks.workunit.client.0.smithi027.stdout:4/392: mkdir d5/d13/d7c 0 2024-09-20T19:06:00.305 INFO:tasks.workunit.client.0.smithi027.stdout:6/487: truncate d4/d15/d37/d39/f54 3836565 0 2024-09-20T19:06:00.306 INFO:tasks.workunit.client.1.smithi098.stdout:1/483: dwrite d1/d3/df/f78 [0,4194304] 0 2024-09-20T19:06:00.307 INFO:tasks.workunit.client.0.smithi027.stdout:8/516: truncate d2/d3/f4a 4442436 0 2024-09-20T19:06:00.310 INFO:tasks.workunit.client.0.smithi027.stdout:0/579: dwrite d2/d48/d6b/d79/f94 [0,4194304] 0 2024-09-20T19:06:00.310 INFO:tasks.workunit.client.1.smithi098.stdout:7/572: creat d3/d10/d16/d17/fb9 x:0 0 0 2024-09-20T19:06:00.311 INFO:tasks.workunit.client.1.smithi098.stdout:6/315: dwrite d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:06:00.317 INFO:tasks.workunit.client.0.smithi027.stdout:2/453: rename d3/d1c/d26/d2a/c61 to d3/d13/c8a 0 2024-09-20T19:06:00.318 INFO:tasks.workunit.client.0.smithi027.stdout:9/614: rmdir d0/d9/df/d57 39 2024-09-20T19:06:00.318 INFO:tasks.workunit.client.1.smithi098.stdout:8/555: creat d7/de/d11/d1f/d9c/fc6 x:0 0 0 2024-09-20T19:06:00.321 INFO:tasks.workunit.client.0.smithi027.stdout:1/499: getdents d2/d8/d3b/d44/d93 0 2024-09-20T19:06:00.322 INFO:tasks.workunit.client.0.smithi027.stdout:3/481: dwrite d0/d1/f2e [0,4194304] 0 2024-09-20T19:06:00.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/456: dread d1/d17/d2e/f67 [0,4194304] 0 2024-09-20T19:06:00.323 INFO:tasks.workunit.client.1.smithi098.stdout:3/470: symlink d4/da/l96 0 2024-09-20T19:06:00.324 INFO:tasks.workunit.client.1.smithi098.stdout:9/539: dwrite d4/de/d48/f4d [4194304,4194304] 0 2024-09-20T19:06:00.326 INFO:tasks.workunit.client.0.smithi027.stdout:6/488: creat d4/d15/d37/d6a/d7f/f92 x:0 0 0 2024-09-20T19:06:00.327 INFO:tasks.workunit.client.0.smithi027.stdout:8/517: unlink d2/d3/d6/d6d/d75/f84 0 2024-09-20T19:06:00.333 INFO:tasks.workunit.client.0.smithi027.stdout:2/454: mkdir d3/d24/d8b 0 2024-09-20T19:06:00.334 INFO:tasks.workunit.client.0.smithi027.stdout:1/500: dread d2/d8/d3b/d4b/f2c [0,4194304] 0 2024-09-20T19:06:00.335 INFO:tasks.workunit.client.0.smithi027.stdout:5/562: getdents d4/da/de 0 2024-09-20T19:06:00.336 INFO:tasks.workunit.client.0.smithi027.stdout:9/615: fdatasync d0/d9/df/f24 0 2024-09-20T19:06:00.338 INFO:tasks.workunit.client.0.smithi027.stdout:0/580: dread d2/f19 [0,4194304] 0 2024-09-20T19:06:00.339 INFO:tasks.workunit.client.0.smithi027.stdout:5/563: chown d4/d1f/d28/f8f 236 1 2024-09-20T19:06:00.340 INFO:tasks.workunit.client.0.smithi027.stdout:3/482: dwrite d0/d1/f26 [0,4194304] 0 2024-09-20T19:06:00.343 INFO:tasks.workunit.client.0.smithi027.stdout:5/564: write d4/da/de/d3e/d44/fa6 [502607,100314] 0 2024-09-20T19:06:00.345 INFO:tasks.workunit.client.0.smithi027.stdout:0/581: write d2/d48/d6b/d79/d84/d1b/fbd [63277,47503] 0 2024-09-20T19:06:00.346 INFO:tasks.workunit.client.0.smithi027.stdout:5/565: dread - d4/d1f/d28/fa3 zero size 2024-09-20T19:06:00.347 INFO:tasks.workunit.client.0.smithi027.stdout:5/566: truncate d4/d1f/f64 907921 0 2024-09-20T19:06:00.348 INFO:tasks.workunit.client.1.smithi098.stdout:3/471: dread d4/da/fb [0,4194304] 0 2024-09-20T19:06:00.354 INFO:tasks.workunit.client.1.smithi098.stdout:7/573: dread d3/d10/d16/f34 [0,4194304] 0 2024-09-20T19:06:00.381 INFO:tasks.workunit.client.0.smithi027.stdout:7/506: rename d3/d8/d1c/d61/f6b to d3/d8/da/d2e/d39/faf 0 2024-09-20T19:06:00.385 INFO:tasks.workunit.client.1.smithi098.stdout:2/819: getdents d3/d16/d1d/d2b/d99/def 0 2024-09-20T19:06:00.388 INFO:tasks.workunit.client.1.smithi098.stdout:1/484: dwrite d1/d3/d62/f7b [0,4194304] 0 2024-09-20T19:06:00.390 INFO:tasks.workunit.client.1.smithi098.stdout:1/485: write d1/d3/fe [3596430,93187] 0 2024-09-20T19:06:00.390 INFO:tasks.workunit.client.1.smithi098.stdout:8/556: mknod d7/de/d11/d19/d30/d68/cc7 0 2024-09-20T19:06:00.393 INFO:tasks.workunit.client.1.smithi098.stdout:4/612: getdents d3/d6/d5b 0 2024-09-20T19:06:00.397 INFO:tasks.workunit.client.0.smithi027.stdout:6/489: mkdir d4/d15/d93 0 2024-09-20T19:06:00.399 INFO:tasks.workunit.client.0.smithi027.stdout:3/483: mknod d0/d1/d5e/d1d/d7d/c9a 0 2024-09-20T19:06:00.403 INFO:tasks.workunit.client.0.smithi027.stdout:0/582: mknod d2/da2/cd8 0 2024-09-20T19:06:00.403 INFO:tasks.workunit.client.0.smithi027.stdout:6/490: dwrite d4/d15/f69 [0,4194304] 0 2024-09-20T19:06:00.406 INFO:tasks.workunit.client.0.smithi027.stdout:5/567: mkdir d4/da/de/d3e/d69/d75/db4 0 2024-09-20T19:06:00.410 INFO:tasks.workunit.client.1.smithi098.stdout:2/820: creat d3/d16/d1d/d2b/d99/da2/f108 x:0 0 0 2024-09-20T19:06:00.414 INFO:tasks.workunit.client.1.smithi098.stdout:8/557: fsync d7/de/d11/d19/d30/f62 0 2024-09-20T19:06:00.416 INFO:tasks.workunit.client.1.smithi098.stdout:9/540: dread d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:06:00.418 INFO:tasks.workunit.client.1.smithi098.stdout:5/457: truncate d1/d17/f63 2221675 0 2024-09-20T19:06:00.420 INFO:tasks.workunit.client.1.smithi098.stdout:5/458: write d1/d46/d69/f6d [4097837,122629] 0 2024-09-20T19:06:00.422 INFO:tasks.workunit.client.1.smithi098.stdout:7/574: mkdir d3/d10/d16/d17/d33/d1f/dba 0 2024-09-20T19:06:00.424 INFO:tasks.workunit.client.1.smithi098.stdout:6/316: getdents d0/de/d1b/d37/d44 0 2024-09-20T19:06:00.433 INFO:tasks.workunit.client.1.smithi098.stdout:4/613: creat d3/d6/d11/d1e/d2a/fd9 x:0 0 0 2024-09-20T19:06:00.434 INFO:tasks.workunit.client.1.smithi098.stdout:4/614: write d3/d6/d11/fa1 [132313,75971] 0 2024-09-20T19:06:00.435 INFO:tasks.workunit.client.0.smithi027.stdout:1/501: mkdir d2/d8/d74/d9a 0 2024-09-20T19:06:00.438 INFO:tasks.workunit.client.1.smithi098.stdout:4/615: dread d3/d6/d5b/fb1 [0,4194304] 0 2024-09-20T19:06:00.440 INFO:tasks.workunit.client.1.smithi098.stdout:1/486: truncate d1/d3/df/f78 2317545 0 2024-09-20T19:06:00.441 INFO:tasks.workunit.client.0.smithi027.stdout:7/507: dread d3/d8/da/d2e/d39/f8a [0,4194304] 0 2024-09-20T19:06:00.442 INFO:tasks.workunit.client.1.smithi098.stdout:6/317: mknod d0/de/d1b/d37/c5a 0 2024-09-20T19:06:00.445 INFO:tasks.workunit.client.1.smithi098.stdout:8/558: symlink d7/de/d11/d19/d30/d68/lc8 0 2024-09-20T19:06:00.448 INFO:tasks.workunit.client.1.smithi098.stdout:3/472: getdents d4/d19/d1d/d2f 0 2024-09-20T19:06:00.448 INFO:tasks.workunit.client.0.smithi027.stdout:2/455: creat d3/d13/d3c/f8c x:0 0 0 2024-09-20T19:06:00.449 INFO:tasks.workunit.client.1.smithi098.stdout:4/616: creat d3/d6/d8c/fda x:0 0 0 2024-09-20T19:06:00.449 INFO:tasks.workunit.client.1.smithi098.stdout:5/459: dread d1/d17/d25/f3b [0,4194304] 0 2024-09-20T19:06:00.450 INFO:tasks.workunit.client.0.smithi027.stdout:9/616: creat d0/fc8 x:0 0 0 2024-09-20T19:06:00.451 INFO:tasks.workunit.client.0.smithi027.stdout:3/484: fdatasync d0/d1/d13/d15/d55/f5f 0 2024-09-20T19:06:00.452 INFO:tasks.workunit.client.0.smithi027.stdout:6/491: truncate d4/d6/f88 3564151 0 2024-09-20T19:06:00.454 INFO:tasks.workunit.client.1.smithi098.stdout:9/541: creat d4/de/d27/d4a/d21/fb3 x:0 0 0 2024-09-20T19:06:00.455 INFO:tasks.workunit.client.1.smithi098.stdout:9/542: read - d4/de/d27/d4a/d21/fb3 zero size 2024-09-20T19:06:00.455 INFO:tasks.workunit.client.0.smithi027.stdout:5/568: unlink d4/da/d1a/f57 0 2024-09-20T19:06:00.456 INFO:tasks.workunit.client.0.smithi027.stdout:8/518: getdents d2/d3/d6/d6d/d75 0 2024-09-20T19:06:00.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/473: mkdir d4/d38/d97 0 2024-09-20T19:06:00.458 INFO:tasks.workunit.client.1.smithi098.stdout:3/474: stat d4/d38/d48 0 2024-09-20T19:06:00.459 INFO:tasks.workunit.client.0.smithi027.stdout:1/502: mknod d2/d8/d3b/d44/d96/c9b 0 2024-09-20T19:06:00.461 INFO:tasks.workunit.client.0.smithi027.stdout:9/617: chown d0/d2e/f94 15724825 1 2024-09-20T19:06:00.462 INFO:tasks.workunit.client.0.smithi027.stdout:9/618: dread - d0/f7d zero size 2024-09-20T19:06:00.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/543: dwrite d4/de/d27/d4a/d58/d5b/d8f/d9e/f5a [4194304,4194304] 0 2024-09-20T19:06:00.463 INFO:tasks.workunit.client.1.smithi098.stdout:3/475: dread d4/d19/d1d/d22/f2c [0,4194304] 0 2024-09-20T19:06:00.464 INFO:tasks.workunit.client.1.smithi098.stdout:4/617: symlink d3/d6/d11/d57/d7f/ldb 0 2024-09-20T19:06:00.465 INFO:tasks.workunit.client.1.smithi098.stdout:4/618: write d3/d6/d11/fa1 [127744,95626] 0 2024-09-20T19:06:00.466 INFO:tasks.workunit.client.0.smithi027.stdout:0/583: creat d2/d48/d6b/d79/fd9 x:0 0 0 2024-09-20T19:06:00.467 INFO:tasks.workunit.client.1.smithi098.stdout:4/619: write d3/d6/d11/d57/d7f/d84/fc8 [700531,64823] 0 2024-09-20T19:06:00.469 INFO:tasks.workunit.client.1.smithi098.stdout:4/620: dread - d3/d6/d8c/f8e zero size 2024-09-20T19:06:00.469 INFO:tasks.workunit.client.0.smithi027.stdout:3/485: dwrite d0/d1/d13/d64/f94 [0,4194304] 0 2024-09-20T19:06:00.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/575: rename d3/d4c/f7f to d3/d10/d16/d17/fbb 0 2024-09-20T19:06:00.471 INFO:tasks.workunit.client.0.smithi027.stdout:7/508: creat d3/d8/d26/d45/daa/fb0 x:0 0 0 2024-09-20T19:06:00.474 INFO:tasks.workunit.client.0.smithi027.stdout:6/492: symlink d4/d15/d37/d39/l94 0 2024-09-20T19:06:00.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:00 smithi098 ceph-mon[35737]: pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 147 MiB/s wr, 253 op/s 2024-09-20T19:06:00.475 INFO:tasks.workunit.client.0.smithi027.stdout:3/486: dread d0/d1/d13/d3c/f42 [0,4194304] 0 2024-09-20T19:06:00.476 INFO:tasks.workunit.client.0.smithi027.stdout:3/487: fsync d0/d19/f4a 0 2024-09-20T19:06:00.476 INFO:tasks.workunit.client.0.smithi027.stdout:1/503: dread - d2/d8/d74/f5a zero size 2024-09-20T19:06:00.478 INFO:tasks.workunit.client.0.smithi027.stdout:9/619: symlink d0/d9/df/d1b/d9c/d5a/lc9 0 2024-09-20T19:06:00.478 INFO:tasks.workunit.client.1.smithi098.stdout:5/460: fsync d1/d17/d2e/f51 0 2024-09-20T19:06:00.480 INFO:tasks.workunit.client.1.smithi098.stdout:8/559: dwrite d7/de/d11/d19/d47/f99 [0,4194304] 0 2024-09-20T19:06:00.480 INFO:tasks.workunit.client.1.smithi098.stdout:1/487: creat d1/f96 x:0 0 0 2024-09-20T19:06:00.483 INFO:tasks.workunit.client.1.smithi098.stdout:3/476: write d4/f1c [684034,111534] 0 2024-09-20T19:06:00.486 INFO:tasks.workunit.client.1.smithi098.stdout:9/544: symlink d4/de/d24/d35/d2d/da6/lb4 0 2024-09-20T19:06:00.487 INFO:tasks.workunit.client.0.smithi027.stdout:6/493: fsync d4/d15/d37/f40 0 2024-09-20T19:06:00.488 INFO:tasks.workunit.client.1.smithi098.stdout:9/545: dread d4/de/d27/d4a/d21/d25/d51/f9d [0,4194304] 0 2024-09-20T19:06:00.489 INFO:tasks.workunit.client.1.smithi098.stdout:9/546: chown d4/de/d27/d6c/fa7 8862 1 2024-09-20T19:06:00.492 INFO:tasks.workunit.client.0.smithi027.stdout:3/488: rename d0/d1/c2a to d0/d1/d65/c9b 0 2024-09-20T19:06:00.493 INFO:tasks.workunit.client.0.smithi027.stdout:7/509: dread d3/d8/da/f44 [0,4194304] 0 2024-09-20T19:06:00.496 INFO:tasks.workunit.client.1.smithi098.stdout:4/621: symlink d3/d7d/ldc 0 2024-09-20T19:06:00.496 INFO:tasks.workunit.client.0.smithi027.stdout:1/504: dread d2/d8/d2b/d2d/f39 [0,4194304] 0 2024-09-20T19:06:00.497 INFO:tasks.workunit.client.0.smithi027.stdout:9/620: rmdir d0/d9/df/d1c 39 2024-09-20T19:06:00.502 INFO:tasks.workunit.client.0.smithi027.stdout:1/505: read d2/d8/d2b/d2d/f34 [2852320,79671] 0 2024-09-20T19:06:00.504 INFO:tasks.workunit.client.0.smithi027.stdout:1/506: truncate d2/d8/d2b/f8a 5810997 0 2024-09-20T19:06:00.507 INFO:tasks.workunit.client.0.smithi027.stdout:3/489: creat d0/d19/f9c x:0 0 0 2024-09-20T19:06:00.507 INFO:tasks.workunit.client.0.smithi027.stdout:3/490: chown d0/d1/lc 934627105 1 2024-09-20T19:06:00.509 INFO:tasks.workunit.client.1.smithi098.stdout:1/488: mkdir d1/d3/df/d34/d52/d77/d97 0 2024-09-20T19:06:00.510 INFO:tasks.workunit.client.1.smithi098.stdout:3/477: mknod d4/d19/d1d/d2f/c98 0 2024-09-20T19:06:00.512 INFO:tasks.workunit.client.0.smithi027.stdout:0/584: truncate d2/d48/d6b/d79/d84/d1b/d39/f81 106962 0 2024-09-20T19:06:00.514 INFO:tasks.workunit.client.1.smithi098.stdout:7/576: dwrite d3/d10/d16/d17/d33/d1f/f3c [4194304,4194304] 0 2024-09-20T19:06:00.515 INFO:tasks.workunit.client.0.smithi027.stdout:5/569: link d4/d7a/d87/c8a d4/cb5 0 2024-09-20T19:06:00.517 INFO:tasks.workunit.client.1.smithi098.stdout:8/560: write d7/de/d11/d19/d30/d68/f7b [747892,52081] 0 2024-09-20T19:06:00.517 INFO:tasks.workunit.client.1.smithi098.stdout:4/622: fdatasync d3/fc 0 2024-09-20T19:06:00.517 INFO:tasks.workunit.client.0.smithi027.stdout:1/507: mknod d2/d8/d41/c9c 0 2024-09-20T19:06:00.518 INFO:tasks.workunit.client.0.smithi027.stdout:6/494: mknod d4/d15/d37/d5a/d78/c95 0 2024-09-20T19:06:00.519 INFO:tasks.workunit.client.0.smithi027.stdout:7/510: dread d3/d8/da/d51/f53 [0,4194304] 0 2024-09-20T19:06:00.519 INFO:tasks.workunit.client.1.smithi098.stdout:6/318: getdents d0/de/d1b/d37/d44/d24/d29/d50 0 2024-09-20T19:06:00.520 INFO:tasks.workunit.client.0.smithi027.stdout:7/511: dread - d3/d8/fa5 zero size 2024-09-20T19:06:00.520 INFO:tasks.workunit.client.0.smithi027.stdout:1/508: dread d2/d8/d2b/d2d/f39 [4194304,4194304] 0 2024-09-20T19:06:00.521 INFO:tasks.workunit.client.0.smithi027.stdout:3/491: creat d0/d1/d13/d15/d55/f9d x:0 0 0 2024-09-20T19:06:00.521 INFO:tasks.workunit.client.1.smithi098.stdout:4/623: write d3/d6/d11/d64/f8f [214252,42826] 0 2024-09-20T19:06:00.524 INFO:tasks.workunit.client.1.smithi098.stdout:5/461: symlink d1/d17/l8c 0 2024-09-20T19:06:00.524 INFO:tasks.workunit.client.1.smithi098.stdout:7/577: dwrite d3/d10/d16/d17/d33/d1f/f6d [0,4194304] 0 2024-09-20T19:06:00.525 INFO:tasks.workunit.client.1.smithi098.stdout:5/462: stat d1/c3c 0 2024-09-20T19:06:00.526 INFO:tasks.workunit.client.0.smithi027.stdout:0/585: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/fda x:0 0 0 2024-09-20T19:06:00.526 INFO:tasks.workunit.client.0.smithi027.stdout:0/586: read - d2/d48/fb9 zero size 2024-09-20T19:06:00.527 INFO:tasks.workunit.client.0.smithi027.stdout:0/587: fdatasync d2/d20/fca 0 2024-09-20T19:06:00.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/489: symlink d1/d3/d62/l98 0 2024-09-20T19:06:00.530 INFO:tasks.workunit.client.1.smithi098.stdout:1/490: chown d1/d3/l11 5232 1 2024-09-20T19:06:00.533 INFO:tasks.workunit.client.1.smithi098.stdout:5/463: dwrite d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:06:00.535 INFO:tasks.workunit.client.0.smithi027.stdout:1/509: creat d2/d8/d2b/f9d x:0 0 0 2024-09-20T19:06:00.539 INFO:tasks.workunit.client.1.smithi098.stdout:9/547: mkdir d4/de/d27/d6c/d73/db5 0 2024-09-20T19:06:00.546 INFO:tasks.workunit.client.0.smithi027.stdout:9/621: creat d0/fca x:0 0 0 2024-09-20T19:06:00.546 INFO:tasks.workunit.client.0.smithi027.stdout:0/588: dwrite d2/d49/d70/f89 [0,4194304] 0 2024-09-20T19:06:00.546 INFO:tasks.workunit.client.0.smithi027.stdout:6/495: dwrite d4/d15/f2f [4194304,4194304] 0 2024-09-20T19:06:00.546 INFO:tasks.workunit.client.0.smithi027.stdout:0/589: rename d2/db7 to d2/db7/ddb 22 2024-09-20T19:06:00.549 INFO:tasks.workunit.client.0.smithi027.stdout:1/510: creat d2/d8/d2b/f9e x:0 0 0 2024-09-20T19:06:00.551 INFO:tasks.workunit.client.1.smithi098.stdout:4/624: creat d3/d7d/da3/d3c/d6b/d73/d98/db3/fdd x:0 0 0 2024-09-20T19:06:00.552 INFO:tasks.workunit.client.0.smithi027.stdout:3/492: dread d0/f11 [0,4194304] 0 2024-09-20T19:06:00.554 INFO:tasks.workunit.client.1.smithi098.stdout:6/319: dwrite d0/de/d1b/d37/d44/f13 [8388608,4194304] 0 2024-09-20T19:06:00.554 INFO:tasks.workunit.client.1.smithi098.stdout:7/578: rename d3/d10/d16/d17/d33/d1f/d28/d66/f6f to d3/d76/d7a/fbc 0 2024-09-20T19:06:00.554 INFO:tasks.workunit.client.1.smithi098.stdout:4/625: read - d3/d7d/da3/d3c/d6b/d73/d98/db3/fdd zero size 2024-09-20T19:06:00.558 INFO:tasks.workunit.client.0.smithi027.stdout:9/622: rmdir d0 39 2024-09-20T19:06:00.558 INFO:tasks.workunit.client.1.smithi098.stdout:3/478: fsync d4/f34 0 2024-09-20T19:06:00.559 INFO:tasks.workunit.client.1.smithi098.stdout:1/491: creat d1/d3/df/d4a/d6d/f99 x:0 0 0 2024-09-20T19:06:00.561 INFO:tasks.workunit.client.1.smithi098.stdout:5/464: unlink d1/d1b/d40/c4e 0 2024-09-20T19:06:00.562 INFO:tasks.workunit.client.1.smithi098.stdout:5/465: readlink d1/d17/d35/d54/d68/l74 0 2024-09-20T19:06:00.564 INFO:tasks.workunit.client.0.smithi027.stdout:0/590: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f61 [518069,1437] 0 2024-09-20T19:06:00.565 INFO:tasks.workunit.client.0.smithi027.stdout:0/591: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [4578367,38555] 0 2024-09-20T19:06:00.566 INFO:tasks.workunit.client.1.smithi098.stdout:9/548: rename d4/de/d48/lb0 to d4/de/d27/d4a/d58/d5b/lb6 0 2024-09-20T19:06:00.568 INFO:tasks.workunit.client.1.smithi098.stdout:4/626: creat d3/d6/d8c/fde x:0 0 0 2024-09-20T19:06:00.568 INFO:tasks.workunit.client.1.smithi098.stdout:8/561: dread d7/de/d11/f71 [0,4194304] 0 2024-09-20T19:06:00.568 INFO:tasks.workunit.client.1.smithi098.stdout:9/549: readlink d4/de/d27/d4a/d21/d25/d51/d7b/l9b 0 2024-09-20T19:06:00.569 INFO:tasks.workunit.client.1.smithi098.stdout:7/579: chown d3/d10/d16/d17/d33/d1f/d28/d66/c81 0 1 2024-09-20T19:06:00.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:00 smithi027 ceph-mon[28196]: pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 147 MiB/s wr, 253 op/s 2024-09-20T19:06:00.570 INFO:tasks.workunit.client.0.smithi027.stdout:3/493: rename d0/d1/d5e/d1d/f69 to d0/d19/d54/d7a/f9e 0 2024-09-20T19:06:00.571 INFO:tasks.workunit.client.1.smithi098.stdout:7/580: fdatasync d3/d76/db8/fa4 0 2024-09-20T19:06:00.573 INFO:tasks.workunit.client.0.smithi027.stdout:5/570: getdents d4/d1f/d28 0 2024-09-20T19:06:00.575 INFO:tasks.workunit.client.1.smithi098.stdout:6/320: symlink d0/de/d1b/l5b 0 2024-09-20T19:06:00.577 INFO:tasks.workunit.client.1.smithi098.stdout:4/627: creat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/fdf x:0 0 0 2024-09-20T19:06:00.578 INFO:tasks.workunit.client.0.smithi027.stdout:1/511: mkdir d2/d8/d3b/d82/d90/d9f 0 2024-09-20T19:06:00.580 INFO:tasks.workunit.client.1.smithi098.stdout:7/581: dwrite d3/d10/d16/d17/d33/d37/f98 [0,4194304] 0 2024-09-20T19:06:00.581 INFO:tasks.workunit.client.0.smithi027.stdout:7/512: getdents d3/d8/d1c/d61 0 2024-09-20T19:06:00.581 INFO:tasks.workunit.client.1.smithi098.stdout:7/582: dread - d3/d76/d86/faf zero size 2024-09-20T19:06:00.586 INFO:tasks.workunit.client.1.smithi098.stdout:9/550: mknod d4/de/d24/d35/d2d/da6/dae/d86/cb7 0 2024-09-20T19:06:00.587 INFO:tasks.workunit.client.1.smithi098.stdout:9/551: chown d4/de/d27/d4a/d21/d25/f75 3528 1 2024-09-20T19:06:00.587 INFO:tasks.workunit.client.1.smithi098.stdout:3/479: creat d4/d38/d48/d60/f99 x:0 0 0 2024-09-20T19:06:00.589 INFO:tasks.workunit.client.1.smithi098.stdout:3/480: write d4/d38/d48/f75 [3362680,13761] 0 2024-09-20T19:06:00.590 INFO:tasks.workunit.client.1.smithi098.stdout:1/492: truncate d1/d3/df/d34/d43/d65/f88 2042975 0 2024-09-20T19:06:00.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/562: dread d7/de/d11/d19/d30/d82/f8e [0,4194304] 0 2024-09-20T19:06:00.592 INFO:tasks.workunit.client.0.smithi027.stdout:9/623: creat d0/d9/df/d1b/fcb x:0 0 0 2024-09-20T19:06:00.596 INFO:tasks.workunit.client.1.smithi098.stdout:3/481: dwrite d4/d19/d1d/f47 [0,4194304] 0 2024-09-20T19:06:00.599 INFO:tasks.workunit.client.0.smithi027.stdout:7/513: write d3/f5 [2436125,17509] 0 2024-09-20T19:06:00.600 INFO:tasks.workunit.client.0.smithi027.stdout:7/514: fdatasync d3/d8/d26/d45/d56/f64 0 2024-09-20T19:06:00.602 INFO:tasks.workunit.client.1.smithi098.stdout:4/628: mkdir d3/d7d/da3/d3c/d6b/d73/d98/de0 0 2024-09-20T19:06:00.603 INFO:tasks.workunit.client.0.smithi027.stdout:7/515: read d3/d8/da/d2e/d49/f9b [473327,61701] 0 2024-09-20T19:06:00.605 INFO:tasks.workunit.client.0.smithi027.stdout:9/624: write d0/d9/df/d1c/d6a/d6d/dd/f29 [624190,128596] 0 2024-09-20T19:06:00.605 INFO:tasks.workunit.client.0.smithi027.stdout:6/496: link d4/d1b/f29 d4/d15/d37/d7a/d46/d53/f96 0 2024-09-20T19:06:00.608 INFO:tasks.workunit.client.0.smithi027.stdout:5/571: creat d4/da/de/d3e/d69/d75/db4/fb6 x:0 0 0 2024-09-20T19:06:00.609 INFO:tasks.workunit.client.0.smithi027.stdout:7/516: dread d3/d8/da/d2e/d49/f9b [0,4194304] 0 2024-09-20T19:06:00.611 INFO:tasks.workunit.client.0.smithi027.stdout:0/592: rename d2/d48/d6b/d79/d9f/da4/dc3 to d2/d48/d6b/d79/ddc 0 2024-09-20T19:06:00.615 INFO:tasks.workunit.client.1.smithi098.stdout:6/321: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:06:00.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/583: dwrite d3/d10/d16/d17/d33/d37/f98 [4194304,4194304] 0 2024-09-20T19:06:00.618 INFO:tasks.workunit.client.0.smithi027.stdout:9/625: dread - d0/d9/f44 zero size 2024-09-20T19:06:00.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/493: rmdir d1/d3/d2e 39 2024-09-20T19:06:00.619 INFO:tasks.workunit.client.0.smithi027.stdout:9/626: write d0/d9/df/d1b/d9c/d4f/d8d/da0/fa5 [99259,111652] 0 2024-09-20T19:06:00.619 INFO:tasks.workunit.client.1.smithi098.stdout:9/552: write d4/f8 [322599,79106] 0 2024-09-20T19:06:00.622 INFO:tasks.workunit.client.1.smithi098.stdout:8/563: mknod d7/de/d11/d19/d30/d55/d9d/cc9 0 2024-09-20T19:06:00.624 INFO:tasks.workunit.client.0.smithi027.stdout:7/517: mknod d3/d8/da/d2e/d49/d8b/cb1 0 2024-09-20T19:06:00.626 INFO:tasks.workunit.client.0.smithi027.stdout:0/593: mkdir d2/d49/d70/ddd 0 2024-09-20T19:06:00.626 INFO:tasks.workunit.client.1.smithi098.stdout:7/584: dwrite d3/d10/d16/d17/d33/d1f/d2d/f77 [0,4194304] 0 2024-09-20T19:06:00.627 INFO:tasks.workunit.client.0.smithi027.stdout:7/518: truncate d3/d8/d26/f88 389848 0 2024-09-20T19:06:00.627 INFO:tasks.workunit.client.0.smithi027.stdout:4/393: sync 2024-09-20T19:06:00.629 INFO:tasks.workunit.client.1.smithi098.stdout:7/585: truncate d3/d10/d16/d17/d33/d37/da0/f46 703190 0 2024-09-20T19:06:00.631 INFO:tasks.workunit.client.0.smithi027.stdout:9/627: creat d0/d97/fcc x:0 0 0 2024-09-20T19:06:00.632 INFO:tasks.workunit.client.0.smithi027.stdout:5/572: getdents d4/da/de/d3e/d69/d6a/d9e 0 2024-09-20T19:06:00.633 INFO:tasks.workunit.client.1.smithi098.stdout:6/322: chown d0/de/d1b/d37/c3b 45981 1 2024-09-20T19:06:00.648 INFO:tasks.workunit.client.0.smithi027.stdout:3/494: rename d0/d1/d65/c9b to d0/d1/d13/d15/d76/c9f 0 2024-09-20T19:06:00.649 INFO:tasks.workunit.client.1.smithi098.stdout:1/494: chown d1/d3/d2e 64315795 1 2024-09-20T19:06:00.653 INFO:tasks.workunit.client.0.smithi027.stdout:7/519: mkdir d3/d8/d1c/d80/db2 0 2024-09-20T19:06:00.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/553: mknod d4/de/d27/d4a/d8e/cb8 0 2024-09-20T19:06:00.655 INFO:tasks.workunit.client.1.smithi098.stdout:5/466: getdents d1/d1b 0 2024-09-20T19:06:00.658 INFO:tasks.workunit.client.1.smithi098.stdout:4/629: dwrite d3/d6/d11/fd5 [0,4194304] 0 2024-09-20T19:06:00.662 INFO:tasks.workunit.client.1.smithi098.stdout:1/495: symlink d1/d3/d2e/l9a 0 2024-09-20T19:06:00.663 INFO:tasks.workunit.client.1.smithi098.stdout:1/496: stat d1/d3/d2e/c33 0 2024-09-20T19:06:00.666 INFO:tasks.workunit.client.0.smithi027.stdout:0/594: link d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f9e d2/db7/fde 0 2024-09-20T19:06:00.667 INFO:tasks.workunit.client.1.smithi098.stdout:5/467: fdatasync d1/f6b 0 2024-09-20T19:06:00.667 INFO:tasks.workunit.client.0.smithi027.stdout:0/595: dread - d2/d48/d6b/d79/fd9 zero size 2024-09-20T19:06:00.668 INFO:tasks.workunit.client.0.smithi027.stdout:9/628: mknod d0/d9/df/da2/ccd 0 2024-09-20T19:06:00.668 INFO:tasks.workunit.client.0.smithi027.stdout:3/495: write d0/d19/d54/f5c [970109,105401] 0 2024-09-20T19:06:00.669 INFO:tasks.workunit.client.1.smithi098.stdout:8/564: mkdir d7/de/d11/dca 0 2024-09-20T19:06:00.670 INFO:tasks.workunit.client.0.smithi027.stdout:5/573: mkdir d4/da/de/d3e/db7 0 2024-09-20T19:06:00.672 INFO:tasks.workunit.client.1.smithi098.stdout:7/586: mknod d3/cbd 0 2024-09-20T19:06:00.673 INFO:tasks.workunit.client.1.smithi098.stdout:4/630: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/l6d 0 2024-09-20T19:06:00.674 INFO:tasks.workunit.client.0.smithi027.stdout:0/596: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [0,4194304] 0 2024-09-20T19:06:00.675 INFO:tasks.workunit.client.0.smithi027.stdout:4/394: rmdir d5/d13/d16/d4f 0 2024-09-20T19:06:00.676 INFO:tasks.workunit.client.0.smithi027.stdout:0/597: fsync d2/da2/fc8 0 2024-09-20T19:06:00.676 INFO:tasks.workunit.client.0.smithi027.stdout:4/395: stat d5/d11/d17/d1b/f5f 0 2024-09-20T19:06:00.677 INFO:tasks.workunit.client.1.smithi098.stdout:6/323: unlink d0/de/d1b/f39 0 2024-09-20T19:06:00.677 INFO:tasks.workunit.client.1.smithi098.stdout:1/497: mknod d1/d3/df/d34/d52/d77/c9b 0 2024-09-20T19:06:00.678 INFO:tasks.workunit.client.0.smithi027.stdout:4/396: write d5/d11/d17/d1b/f5f [2388096,110392] 0 2024-09-20T19:06:00.679 INFO:tasks.workunit.client.1.smithi098.stdout:9/554: mkdir d4/db9 0 2024-09-20T19:06:00.680 INFO:tasks.workunit.client.0.smithi027.stdout:3/496: chown d0/d1/d13/d15/c63 16455886 1 2024-09-20T19:06:00.680 INFO:tasks.workunit.client.1.smithi098.stdout:9/555: chown d4/de/d24/d35/d2d/da6 1085 1 2024-09-20T19:06:00.682 INFO:tasks.workunit.client.1.smithi098.stdout:5/468: mknod d1/d1b/d40/c8d 0 2024-09-20T19:06:00.682 INFO:tasks.workunit.client.1.smithi098.stdout:9/556: chown d4/de/d24/d35/l89 1352 1 2024-09-20T19:06:00.683 INFO:tasks.workunit.client.1.smithi098.stdout:6/324: dread d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:06:00.684 INFO:tasks.workunit.client.1.smithi098.stdout:8/565: fdatasync d7/de/d11/d19/f7e 0 2024-09-20T19:06:00.684 INFO:tasks.workunit.client.0.smithi027.stdout:5/574: creat d4/d6c/fb8 x:0 0 0 2024-09-20T19:06:00.684 INFO:tasks.workunit.client.1.smithi098.stdout:3/482: link d4/da/l1a d4/d25/l9a 0 2024-09-20T19:06:00.685 INFO:tasks.workunit.client.0.smithi027.stdout:1/512: rename d2/d8/d2b/d2d/f39 to d2/d8/fa0 0 2024-09-20T19:06:00.687 INFO:tasks.workunit.client.0.smithi027.stdout:1/513: dread d2/d8/d2b/f4a [0,4194304] 0 2024-09-20T19:06:00.688 INFO:tasks.workunit.client.1.smithi098.stdout:4/631: unlink d3/d6/d8c/fde 0 2024-09-20T19:06:00.688 INFO:tasks.workunit.client.1.smithi098.stdout:8/566: write d7/de/d11/d19/d30/d55/da9/fac [3933335,62580] 0 2024-09-20T19:06:00.689 INFO:tasks.workunit.client.0.smithi027.stdout:1/514: write d2/d8/d74/f91 [720750,106989] 0 2024-09-20T19:06:00.690 INFO:tasks.workunit.client.0.smithi027.stdout:7/520: rmdir d3/d8/da/d2e/d39/d9f 0 2024-09-20T19:06:00.691 INFO:tasks.workunit.client.1.smithi098.stdout:3/483: dread d4/d19/d1d/f3b [0,4194304] 0 2024-09-20T19:06:00.693 INFO:tasks.workunit.client.0.smithi027.stdout:2/456: sync 2024-09-20T19:06:00.693 INFO:tasks.workunit.client.0.smithi027.stdout:8/519: sync 2024-09-20T19:06:00.693 INFO:tasks.workunit.client.1.smithi098.stdout:6/325: dwrite d0/de/d1b/d37/d44/d24/d29/f35 [0,4194304] 0 2024-09-20T19:06:00.693 INFO:tasks.workunit.client.0.smithi027.stdout:3/497: creat d0/d1/d13/d15/d55/fa0 x:0 0 0 2024-09-20T19:06:00.694 INFO:tasks.workunit.client.0.smithi027.stdout:8/520: stat d2/d3/d1b/f26 0 2024-09-20T19:06:00.696 INFO:tasks.workunit.client.0.smithi027.stdout:9/629: symlink d0/d9/df/d1c/d6a/d6d/lce 0 2024-09-20T19:06:00.697 INFO:tasks.workunit.client.0.smithi027.stdout:6/497: rename d4/d15/d37/f40 to d4/d15/d37/d39/f97 0 2024-09-20T19:06:00.704 INFO:tasks.workunit.client.1.smithi098.stdout:9/557: creat d4/de/d27/d4a/d21/d25/d51/d7b/fba x:0 0 0 2024-09-20T19:06:00.705 INFO:tasks.workunit.client.1.smithi098.stdout:9/558: fdatasync d4/f8 0 2024-09-20T19:06:00.706 INFO:tasks.workunit.client.0.smithi027.stdout:4/397: symlink d5/d13/d70/l7d 0 2024-09-20T19:06:00.706 INFO:tasks.workunit.client.0.smithi027.stdout:7/521: dwrite d3/d8/d26/d45/d56/d8d/fad [0,4194304] 0 2024-09-20T19:06:00.708 INFO:tasks.workunit.client.0.smithi027.stdout:2/457: fdatasync d3/d24/f28 0 2024-09-20T19:06:00.710 INFO:tasks.workunit.client.0.smithi027.stdout:3/498: mkdir d0/d1/d13/d3c/da1 0 2024-09-20T19:06:00.715 INFO:tasks.workunit.client.1.smithi098.stdout:1/498: link d1/d3/df/d34/d43/d65/f6b d1/d3/df/d34/d43/f9c 0 2024-09-20T19:06:00.717 INFO:tasks.workunit.client.0.smithi027.stdout:8/521: dread d2/d3/f30 [0,4194304] 0 2024-09-20T19:06:00.718 INFO:tasks.workunit.client.0.smithi027.stdout:8/522: write d2/d14/d13/f7c [383392,95373] 0 2024-09-20T19:06:00.719 INFO:tasks.workunit.client.0.smithi027.stdout:0/598: rename d2/db7/ccd to d2/d48/d6b/d79/d84/d1b/d39/cdf 0 2024-09-20T19:06:00.722 INFO:tasks.workunit.client.1.smithi098.stdout:6/326: creat d0/de/d1b/d37/d44/dc/f5c x:0 0 0 2024-09-20T19:06:00.724 INFO:tasks.workunit.client.0.smithi027.stdout:7/522: mknod d3/d8/d26/d45/d56/d8d/cb3 0 2024-09-20T19:06:00.725 INFO:tasks.workunit.client.0.smithi027.stdout:2/458: mknod d3/de/d34/c8d 0 2024-09-20T19:06:00.726 INFO:tasks.workunit.client.1.smithi098.stdout:9/559: creat d4/de/d27/d4a/d8e/fbb x:0 0 0 2024-09-20T19:06:00.729 INFO:tasks.workunit.client.1.smithi098.stdout:7/587: truncate d3/d10/d16/d17/d33/d37/da0/f4d 359444 0 2024-09-20T19:06:00.730 INFO:tasks.workunit.client.1.smithi098.stdout:8/567: write d7/de/f54 [4385900,66333] 0 2024-09-20T19:06:00.733 INFO:tasks.workunit.client.1.smithi098.stdout:5/469: rmdir d1/d17/d2e/d8b 0 2024-09-20T19:06:00.737 INFO:tasks.workunit.client.1.smithi098.stdout:8/568: dwrite d7/de/d11/d19/f4a [0,4194304] 0 2024-09-20T19:06:00.739 INFO:tasks.workunit.client.1.smithi098.stdout:9/560: creat d4/de/d27/d6c/fbc x:0 0 0 2024-09-20T19:06:00.739 INFO:tasks.workunit.client.0.smithi027.stdout:4/398: write d5/d13/d16/d21/d3a/f4e [2314955,117126] 0 2024-09-20T19:06:00.740 INFO:tasks.workunit.client.0.smithi027.stdout:4/399: chown d5/d13/d36/f7b 6049383 1 2024-09-20T19:06:00.742 INFO:tasks.workunit.client.1.smithi098.stdout:7/588: symlink d3/d76/d7a/lbe 0 2024-09-20T19:06:00.743 INFO:tasks.workunit.client.0.smithi027.stdout:7/523: mknod d3/d8/d26/d45/d56/d8d/cb4 0 2024-09-20T19:06:00.743 INFO:tasks.workunit.client.0.smithi027.stdout:7/524: chown d3/l4 0 1 2024-09-20T19:06:00.744 INFO:tasks.workunit.client.1.smithi098.stdout:7/589: truncate d3/d10/d16/d17/fb9 1038886 0 2024-09-20T19:06:00.745 INFO:tasks.workunit.client.1.smithi098.stdout:1/499: rename d1/d3/d62/l64 to d1/d3/d2e/d71/l9d 0 2024-09-20T19:06:00.745 INFO:tasks.workunit.client.1.smithi098.stdout:1/500: readlink d1/d3/d2e/l9a 0 2024-09-20T19:06:00.746 INFO:tasks.workunit.client.1.smithi098.stdout:1/501: chown d1/d3/f2b 8915613 1 2024-09-20T19:06:00.746 INFO:tasks.workunit.client.0.smithi027.stdout:2/459: creat d3/d13/d3c/d48/d6a/f8e x:0 0 0 2024-09-20T19:06:00.750 INFO:tasks.workunit.client.0.smithi027.stdout:3/499: mkdir d0/d80/da2 0 2024-09-20T19:06:00.750 INFO:tasks.workunit.client.0.smithi027.stdout:8/523: write d2/d2a/f2f [511774,13302] 0 2024-09-20T19:06:00.752 INFO:tasks.workunit.client.1.smithi098.stdout:8/569: mkdir d7/de/d11/d1f/d77/db3/dcb 0 2024-09-20T19:06:00.753 INFO:tasks.workunit.client.0.smithi027.stdout:3/500: dread - d0/d1/d13/d3c/f66 zero size 2024-09-20T19:06:00.753 INFO:tasks.workunit.client.1.smithi098.stdout:9/561: mknod d4/de/d24/d35/d2d/cbd 0 2024-09-20T19:06:00.754 INFO:tasks.workunit.client.1.smithi098.stdout:9/562: chown d4/de/d24/d35/d6d/d78 460 1 2024-09-20T19:06:00.756 INFO:tasks.workunit.client.0.smithi027.stdout:0/599: dwrite d2/d48/d6b/d79/d84/d1b/d39/f66 [0,4194304] 0 2024-09-20T19:06:00.757 INFO:tasks.workunit.client.1.smithi098.stdout:7/590: stat d3/d10/d16/l48 0 2024-09-20T19:06:00.758 INFO:tasks.workunit.client.1.smithi098.stdout:7/591: dread - d3/d10/d16/d90/f9c zero size 2024-09-20T19:06:00.762 INFO:tasks.workunit.client.0.smithi027.stdout:8/524: dwrite d2/d3/d6/d21/d33/f74 [0,4194304] 0 2024-09-20T19:06:00.763 INFO:tasks.workunit.client.1.smithi098.stdout:6/327: creat d0/de/d1b/f5d x:0 0 0 2024-09-20T19:06:00.764 INFO:tasks.workunit.client.0.smithi027.stdout:2/460: creat d3/d13/d3c/d48/f8f x:0 0 0 2024-09-20T19:06:00.764 INFO:tasks.workunit.client.0.smithi027.stdout:3/501: dwrite d0/d1/d13/d15/d55/fa0 [0,4194304] 0 2024-09-20T19:06:00.765 INFO:tasks.workunit.client.0.smithi027.stdout:8/525: write d2/d3/f5e [2246628,5523] 0 2024-09-20T19:06:00.766 INFO:tasks.workunit.client.0.smithi027.stdout:3/502: dread - d0/d1/f91 zero size 2024-09-20T19:06:00.767 INFO:tasks.workunit.client.0.smithi027.stdout:9/630: getdents d0/d9/df/d1b/d9c/d4f/d8d/da0 0 2024-09-20T19:06:00.768 INFO:tasks.workunit.client.1.smithi098.stdout:1/502: dwrite d1/d3/f19 [4194304,4194304] 0 2024-09-20T19:06:00.768 INFO:tasks.workunit.client.1.smithi098.stdout:3/484: link d4/d25/d40/f58 d4/d19/d1d/d22/f9b 0 2024-09-20T19:06:00.772 INFO:tasks.workunit.client.1.smithi098.stdout:9/563: dread d4/fb [0,4194304] 0 2024-09-20T19:06:00.772 INFO:tasks.workunit.client.0.smithi027.stdout:2/461: read d3/d1c/d26/d2a/f53 [3421118,83998] 0 2024-09-20T19:06:00.774 INFO:tasks.workunit.client.1.smithi098.stdout:6/328: creat d0/de/d1b/d37/d43/f5e x:0 0 0 2024-09-20T19:06:00.774 INFO:tasks.workunit.client.0.smithi027.stdout:6/498: link d4/d15/d37/d5a/d78/l8d d4/d15/d37/d6a/l98 0 2024-09-20T19:06:00.776 INFO:tasks.workunit.client.1.smithi098.stdout:6/329: write d0/de/d1b/f5d [529873,19599] 0 2024-09-20T19:06:00.777 INFO:tasks.workunit.client.1.smithi098.stdout:9/564: read d4/de/d24/f8b [3282250,42228] 0 2024-09-20T19:06:00.777 INFO:tasks.workunit.client.0.smithi027.stdout:9/631: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/f89 [0,4194304] 0 2024-09-20T19:06:00.778 INFO:tasks.workunit.client.0.smithi027.stdout:6/499: write d4/d15/d37/f4a [2952341,5520] 0 2024-09-20T19:06:00.781 INFO:tasks.workunit.client.0.smithi027.stdout:4/400: mkdir d5/d13/d36/d48/d3f/d7e 0 2024-09-20T19:06:00.782 INFO:tasks.workunit.client.0.smithi027.stdout:8/526: dread - d2/d3/d6/d21/f63 zero size 2024-09-20T19:06:00.783 INFO:tasks.workunit.client.0.smithi027.stdout:4/401: dread - d5/d13/d16/d21/d26/f47 zero size 2024-09-20T19:06:00.783 INFO:tasks.workunit.client.0.smithi027.stdout:1/515: rename d2/d8/d2b/d5e/c46 to d2/d1b/ca1 0 2024-09-20T19:06:00.784 INFO:tasks.workunit.client.0.smithi027.stdout:1/516: write d2/d1b/f4f [2462961,12152] 0 2024-09-20T19:06:00.785 INFO:tasks.workunit.client.0.smithi027.stdout:3/503: write d0/d1/d13/f1c [1563427,73495] 0 2024-09-20T19:06:00.786 INFO:tasks.workunit.client.1.smithi098.stdout:3/485: write d4/d25/f49 [965238,9845] 0 2024-09-20T19:06:00.787 INFO:tasks.workunit.client.1.smithi098.stdout:1/503: getdents d1/d3/d2e/d68/d7a 0 2024-09-20T19:06:00.791 INFO:tasks.workunit.client.0.smithi027.stdout:9/632: unlink d0/d9/df/d1c/d6a/d9a/fab 0 2024-09-20T19:06:00.792 INFO:tasks.workunit.client.0.smithi027.stdout:6/500: symlink d4/d6/d4b/d7c/d64/l99 0 2024-09-20T19:06:00.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/504: rmdir d1/d3/df/d4a 39 2024-09-20T19:06:00.793 INFO:tasks.workunit.client.0.smithi027.stdout:6/501: read - d4/d15/d37/d6a/d7f/f92 zero size 2024-09-20T19:06:00.793 INFO:tasks.workunit.client.0.smithi027.stdout:8/527: symlink d2/d3/d6/d21/d33/d79/lab 0 2024-09-20T19:06:00.794 INFO:tasks.workunit.client.1.smithi098.stdout:6/330: creat d0/de/f5f x:0 0 0 2024-09-20T19:06:00.795 INFO:tasks.workunit.client.1.smithi098.stdout:9/565: link d4/de/f1f d4/de/d27/d6c/d73/db5/fbe 0 2024-09-20T19:06:00.796 INFO:tasks.workunit.client.0.smithi027.stdout:8/528: write d2/d14/d13/f22 [550768,99666] 0 2024-09-20T19:06:00.796 INFO:tasks.workunit.client.0.smithi027.stdout:4/402: symlink d5/d11/d3d/l7f 0 2024-09-20T19:06:00.796 INFO:tasks.workunit.client.1.smithi098.stdout:3/486: symlink d4/d38/d97/l9c 0 2024-09-20T19:06:00.798 INFO:tasks.workunit.client.1.smithi098.stdout:1/505: write d1/d3/df/f23 [4337595,39114] 0 2024-09-20T19:06:00.799 INFO:tasks.workunit.client.1.smithi098.stdout:6/331: creat d0/f60 x:0 0 0 2024-09-20T19:06:00.801 INFO:tasks.workunit.client.0.smithi027.stdout:2/462: truncate d3/d1c/f47 215111 0 2024-09-20T19:06:00.802 INFO:tasks.workunit.client.0.smithi027.stdout:4/403: dwrite d5/d11/d17/d1b/f5f [0,4194304] 0 2024-09-20T19:06:00.803 INFO:tasks.workunit.client.0.smithi027.stdout:2/463: truncate d3/d13/f6d 266582 0 2024-09-20T19:06:00.806 INFO:tasks.workunit.client.1.smithi098.stdout:1/506: truncate d1/d3/df/f78 2017699 0 2024-09-20T19:06:00.810 INFO:tasks.workunit.client.1.smithi098.stdout:3/487: unlink d4/d19/d1d/d2f/d4e/l6e 0 2024-09-20T19:06:00.810 INFO:tasks.workunit.client.0.smithi027.stdout:3/504: mknod d0/d1/ca3 0 2024-09-20T19:06:00.811 INFO:tasks.workunit.client.1.smithi098.stdout:1/507: mkdir d1/d3/d62/d9e 0 2024-09-20T19:06:00.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/508: readlink d1/d3/l3e 0 2024-09-20T19:06:00.813 INFO:tasks.workunit.client.0.smithi027.stdout:3/505: write d0/d1/d13/d15/d55/f96 [264058,97562] 0 2024-09-20T19:06:00.813 INFO:tasks.workunit.client.1.smithi098.stdout:1/509: chown d1/d3/df/f23 1 1 2024-09-20T19:06:00.814 INFO:tasks.workunit.client.1.smithi098.stdout:3/488: write d4/d19/d1d/f3b [494630,82422] 0 2024-09-20T19:06:00.815 INFO:tasks.workunit.client.0.smithi027.stdout:6/502: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:06:00.815 INFO:tasks.workunit.client.0.smithi027.stdout:3/506: chown d0/d1/d13/d15/d6f/d7f/f85 1349096 1 2024-09-20T19:06:00.819 INFO:tasks.workunit.client.1.smithi098.stdout:3/489: mknod d4/d38/d48/d60/c9d 0 2024-09-20T19:06:00.823 INFO:tasks.workunit.client.0.smithi027.stdout:8/529: truncate d2/d3/f4a 1708562 0 2024-09-20T19:06:00.824 INFO:tasks.workunit.client.1.smithi098.stdout:1/510: creat d1/f9f x:0 0 0 2024-09-20T19:06:00.825 INFO:tasks.workunit.client.1.smithi098.stdout:8/570: dwrite d7/de/d11/d19/d47/f8b [0,4194304] 0 2024-09-20T19:06:00.825 INFO:tasks.workunit.client.1.smithi098.stdout:1/511: readlink d1/d3/d62/l98 0 2024-09-20T19:06:00.826 INFO:tasks.workunit.client.1.smithi098.stdout:9/566: dread d4/f16 [0,4194304] 0 2024-09-20T19:06:00.827 INFO:tasks.workunit.client.1.smithi098.stdout:3/490: creat d4/d25/d8d/f9e x:0 0 0 2024-09-20T19:06:00.831 INFO:tasks.workunit.client.0.smithi027.stdout:4/404: mkdir d5/d80 0 2024-09-20T19:06:00.832 INFO:tasks.workunit.client.1.smithi098.stdout:7/592: write d3/d10/d16/d17/f7e [558964,129947] 0 2024-09-20T19:06:00.835 INFO:tasks.workunit.client.1.smithi098.stdout:8/571: symlink d7/de/d11/d1d/lcc 0 2024-09-20T19:06:00.836 INFO:tasks.workunit.client.0.smithi027.stdout:9/633: creat d0/d9/df/fcf x:0 0 0 2024-09-20T19:06:00.837 INFO:tasks.workunit.client.0.smithi027.stdout:0/600: truncate d2/fe 608013 0 2024-09-20T19:06:00.837 INFO:tasks.workunit.client.1.smithi098.stdout:9/567: mkdir d4/de/d27/dbf 0 2024-09-20T19:06:00.838 INFO:tasks.workunit.client.0.smithi027.stdout:8/530: rmdir d2/d65 39 2024-09-20T19:06:00.838 INFO:tasks.workunit.client.1.smithi098.stdout:9/568: dread - d4/de/d27/d88/f92 zero size 2024-09-20T19:06:00.841 INFO:tasks.workunit.client.0.smithi027.stdout:6/503: fsync d4/d1b/f29 0 2024-09-20T19:06:00.842 INFO:tasks.workunit.client.0.smithi027.stdout:6/504: chown d4/d6/c12 1 1 2024-09-20T19:06:00.844 INFO:tasks.workunit.client.0.smithi027.stdout:4/405: write d5/d11/f4d [2551865,101300] 0 2024-09-20T19:06:00.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/569: dread d4/de/d27/d4a/d21/d25/f30 [4194304,4194304] 0 2024-09-20T19:06:00.847 INFO:tasks.workunit.client.0.smithi027.stdout:2/464: rename d3/d1c/f2d to d3/d1c/f90 0 2024-09-20T19:06:00.847 INFO:tasks.workunit.client.1.smithi098.stdout:1/512: dread d1/d3/df/f23 [0,4194304] 0 2024-09-20T19:06:00.849 INFO:tasks.workunit.client.0.smithi027.stdout:0/601: read d2/f5e [248711,46921] 0 2024-09-20T19:06:00.850 INFO:tasks.workunit.client.0.smithi027.stdout:3/507: dread d0/d1/d5e/d1d/f84 [0,4194304] 0 2024-09-20T19:06:00.851 INFO:tasks.workunit.client.0.smithi027.stdout:0/602: write d2/d48/d6b/d79/d84/fcf [19440,109617] 0 2024-09-20T19:06:00.852 INFO:tasks.workunit.client.0.smithi027.stdout:9/634: unlink d0/d9/df/d1c/d6a/d6d/l1f 0 2024-09-20T19:06:00.855 INFO:tasks.workunit.client.1.smithi098.stdout:7/593: symlink d3/daa/lbf 0 2024-09-20T19:06:00.857 INFO:tasks.workunit.client.0.smithi027.stdout:3/508: dwrite d0/d1/d5e/d1d/f4e [0,4194304] 0 2024-09-20T19:06:00.859 INFO:tasks.workunit.client.1.smithi098.stdout:9/570: rename d4/de/d27/d4a/d21/f4e to d4/d74/d8a/d94/fc0 0 2024-09-20T19:06:00.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/332: dwrite d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:06:00.861 INFO:tasks.workunit.client.1.smithi098.stdout:9/571: write d4/de/d27/d6c/fa3 [742899,11830] 0 2024-09-20T19:06:00.861 INFO:tasks.workunit.client.1.smithi098.stdout:6/333: readlink d0/l6 0 2024-09-20T19:06:00.863 INFO:tasks.workunit.client.1.smithi098.stdout:9/572: chown d4/de/d27/d4a/d21/f46 26219567 1 2024-09-20T19:06:00.864 INFO:tasks.workunit.client.0.smithi027.stdout:4/406: creat d5/d11/d1a/f81 x:0 0 0 2024-09-20T19:06:00.866 INFO:tasks.workunit.client.0.smithi027.stdout:1/517: truncate d2/f5c 596235 0 2024-09-20T19:06:00.869 INFO:tasks.workunit.client.0.smithi027.stdout:1/518: read d2/d8/d41/f72 [67186,111740] 0 2024-09-20T19:06:00.873 INFO:tasks.workunit.client.0.smithi027.stdout:0/603: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f9e [0,4194304] 0 2024-09-20T19:06:00.878 INFO:tasks.workunit.client.0.smithi027.stdout:8/531: truncate d2/d14/f3f 89104 0 2024-09-20T19:06:00.880 INFO:tasks.workunit.client.1.smithi098.stdout:6/334: rename d0/de/d1b/d37/d44/d24/d29/d50/l58 to d0/de/d1b/d37/d44/d24/d29/d42/d4c/l61 0 2024-09-20T19:06:00.881 INFO:tasks.workunit.client.0.smithi027.stdout:9/635: dread - d0/d9/df/d1c/d6a/d6d/dd/f38 zero size 2024-09-20T19:06:00.882 INFO:tasks.workunit.client.0.smithi027.stdout:9/636: chown d0/d9/df/d1b/d9c/d4f/fb9 210 1 2024-09-20T19:06:00.883 INFO:tasks.workunit.client.1.smithi098.stdout:7/594: mknod d3/d76/db8/da6/cc0 0 2024-09-20T19:06:00.883 INFO:tasks.workunit.client.0.smithi027.stdout:5/575: sync 2024-09-20T19:06:00.883 INFO:tasks.workunit.client.0.smithi027.stdout:7/525: sync 2024-09-20T19:06:00.883 INFO:tasks.workunit.client.0.smithi027.stdout:9/637: chown d0/d9/df/f49 7528 1 2024-09-20T19:06:00.885 INFO:tasks.workunit.client.0.smithi027.stdout:3/509: write d0/f47 [234010,20117] 0 2024-09-20T19:06:00.886 INFO:tasks.workunit.client.0.smithi027.stdout:9/638: chown d0/d9/df/c3b 526704 1 2024-09-20T19:06:00.886 INFO:tasks.workunit.client.0.smithi027.stdout:7/526: write d3/d8/f96 [778064,102119] 0 2024-09-20T19:06:00.890 INFO:tasks.workunit.client.1.smithi098.stdout:6/335: creat d0/de/d1b/d37/d44/f62 x:0 0 0 2024-09-20T19:06:00.891 INFO:tasks.workunit.client.0.smithi027.stdout:4/407: symlink d5/d13/d36/l82 0 2024-09-20T19:06:00.892 INFO:tasks.workunit.client.1.smithi098.stdout:8/572: dwrite f1 [4194304,4194304] 0 2024-09-20T19:06:00.893 INFO:tasks.workunit.client.1.smithi098.stdout:3/491: dwrite d4/d25/f2b [0,4194304] 0 2024-09-20T19:06:00.894 INFO:tasks.workunit.client.1.smithi098.stdout:3/492: stat d4/d19/d1d/d22 0 2024-09-20T19:06:00.895 INFO:tasks.workunit.client.1.smithi098.stdout:3/493: read - d4/d38/d48/d60/f74 zero size 2024-09-20T19:06:00.896 INFO:tasks.workunit.client.0.smithi027.stdout:6/505: write d4/d6/f2a [3873839,122094] 0 2024-09-20T19:06:00.896 INFO:tasks.workunit.client.1.smithi098.stdout:3/494: write d4/d38/d48/d60/f99 [196687,10984] 0 2024-09-20T19:06:00.898 INFO:tasks.workunit.client.0.smithi027.stdout:6/506: write d4/d15/d37/f45 [1941509,15094] 0 2024-09-20T19:06:00.900 INFO:tasks.workunit.client.0.smithi027.stdout:1/519: creat d2/d8/d3b/d82/d87/fa2 x:0 0 0 2024-09-20T19:06:00.900 INFO:tasks.workunit.client.1.smithi098.stdout:8/573: rmdir d7/de/d11/d19/d30/d68 39 2024-09-20T19:06:00.902 INFO:tasks.workunit.client.1.smithi098.stdout:8/574: chown d7/de/d11/d1f/d77/fa4 271289291 1 2024-09-20T19:06:00.911 INFO:tasks.workunit.client.0.smithi027.stdout:5/576: dread d4/da/fb [0,4194304] 0 2024-09-20T19:06:00.912 INFO:tasks.workunit.client.0.smithi027.stdout:5/577: fsync d4/da/de/d3e/d44/fae 0 2024-09-20T19:06:00.913 INFO:tasks.workunit.client.0.smithi027.stdout:5/578: chown d4/da/de/d3e/d69/d75/d3d/c4b 1002 1 2024-09-20T19:06:00.915 INFO:tasks.workunit.client.0.smithi027.stdout:9/639: creat d0/d9/df/d1b/d9c/d4f/d8d/da0/fd0 x:0 0 0 2024-09-20T19:06:00.915 INFO:tasks.workunit.client.0.smithi027.stdout:2/465: truncate d3/ff 124810 0 2024-09-20T19:06:00.916 INFO:tasks.workunit.client.1.smithi098.stdout:6/336: getdents d0/de/d1b/d37/d43/d51 0 2024-09-20T19:06:00.917 INFO:tasks.workunit.client.1.smithi098.stdout:9/573: dwrite d4/de/d27/d4a/f4b [0,4194304] 0 2024-09-20T19:06:00.918 INFO:tasks.workunit.client.0.smithi027.stdout:4/408: unlink d5/d13/d36/d48/f3b 0 2024-09-20T19:06:00.929 INFO:tasks.workunit.client.0.smithi027.stdout:7/527: dread d3/d8/da/d2e/d49/d8b/f3a [0,4194304] 0 2024-09-20T19:06:00.930 INFO:tasks.workunit.client.0.smithi027.stdout:7/528: rename d3 to d3/d8/d26/d45/db5 22 2024-09-20T19:06:00.931 INFO:tasks.workunit.client.0.smithi027.stdout:7/529: write d3/d8/da/d2e/d49/d8b/f6c [621627,127513] 0 2024-09-20T19:06:00.933 INFO:tasks.workunit.client.1.smithi098.stdout:3/495: link d4/d19/d1d/d2f/f7e d4/d19/d1d/d22/f9f 0 2024-09-20T19:06:00.934 INFO:tasks.workunit.client.1.smithi098.stdout:3/496: dread d4/d25/f49 [0,4194304] 0 2024-09-20T19:06:00.938 INFO:tasks.workunit.client.1.smithi098.stdout:9/574: unlink d4/f6a 0 2024-09-20T19:06:00.941 INFO:tasks.workunit.client.0.smithi027.stdout:0/604: symlink d2/le0 0 2024-09-20T19:06:00.943 INFO:tasks.workunit.client.0.smithi027.stdout:8/532: mknod d2/d3/d6/d21/d33/cac 0 2024-09-20T19:06:00.943 INFO:tasks.workunit.client.1.smithi098.stdout:9/575: symlink d4/de/d24/d35/d6d/lc1 0 2024-09-20T19:06:00.944 INFO:tasks.workunit.client.1.smithi098.stdout:8/575: write d7/de/d11/f71 [1345762,35573] 0 2024-09-20T19:06:00.946 INFO:tasks.workunit.client.1.smithi098.stdout:3/497: mknod d4/d19/d1d/d2f/d4e/d59/d7c/ca0 0 2024-09-20T19:06:00.948 INFO:tasks.workunit.client.1.smithi098.stdout:6/337: mkdir d0/de/d1b/d37/d44/d24/d29/d63 0 2024-09-20T19:06:00.956 INFO:tasks.workunit.client.0.smithi027.stdout:2/466: mknod d3/d1c/d26/d2a/d63/c91 0 2024-09-20T19:06:00.957 INFO:tasks.workunit.client.1.smithi098.stdout:6/338: mknod d0/c64 0 2024-09-20T19:06:00.962 INFO:tasks.workunit.client.1.smithi098.stdout:6/339: mkdir d0/de/d1b/d37/d44/d24/d29/d2b/d65 0 2024-09-20T19:06:00.966 INFO:tasks.workunit.client.1.smithi098.stdout:8/576: dread d7/de/d11/d1f/d57/fc2 [0,4194304] 0 2024-09-20T19:06:00.966 INFO:tasks.workunit.client.0.smithi027.stdout:6/507: link d4/d15/d37/f90 d4/d6/d4b/f9a 0 2024-09-20T19:06:00.968 INFO:tasks.workunit.client.0.smithi027.stdout:1/520: mkdir d2/d8/d74/d9a/da3 0 2024-09-20T19:06:00.969 INFO:tasks.workunit.client.1.smithi098.stdout:8/577: rename d7/de/d11/d1f/d77 to d7/de/d11/d1f/dcd 0 2024-09-20T19:06:00.970 INFO:tasks.workunit.client.1.smithi098.stdout:8/578: fsync d7/de/d11/fa7 0 2024-09-20T19:06:00.970 INFO:tasks.workunit.client.0.smithi027.stdout:1/521: read d2/d8/d2b/f58 [4901214,81397] 0 2024-09-20T19:06:00.971 INFO:tasks.workunit.client.1.smithi098.stdout:8/579: readlink d7/de/d11/l7f 0 2024-09-20T19:06:00.971 INFO:tasks.workunit.client.0.smithi027.stdout:0/605: chown d2/d48/d6b/d79/d84/d1b/l56 1094590 1 2024-09-20T19:06:00.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/576: dread f0 [0,4194304] 0 2024-09-20T19:06:00.973 INFO:tasks.workunit.client.0.smithi027.stdout:5/579: write d4/fd [3610473,105344] 0 2024-09-20T19:06:00.974 INFO:tasks.workunit.client.1.smithi098.stdout:3/498: write d4/d19/d1d/d2f/f7e [393069,26620] 0 2024-09-20T19:06:00.975 INFO:tasks.workunit.client.0.smithi027.stdout:5/580: write d4/da/de/f66 [1747632,87228] 0 2024-09-20T19:06:00.979 INFO:tasks.workunit.client.1.smithi098.stdout:3/499: mknod d4/d25/d40/d80/ca1 0 2024-09-20T19:06:00.980 INFO:tasks.workunit.client.1.smithi098.stdout:3/500: write d4/fd [8175760,20212] 0 2024-09-20T19:06:00.981 INFO:tasks.workunit.client.1.smithi098.stdout:3/501: dread - d4/d25/d8d/f9e zero size 2024-09-20T19:06:00.981 INFO:tasks.workunit.client.1.smithi098.stdout:9/577: rename d4/de/d24/d35/c65 to d4/de/d27/d6c/cc2 0 2024-09-20T19:06:00.982 INFO:tasks.workunit.client.1.smithi098.stdout:3/502: stat d4/d19/d1d/d2f 0 2024-09-20T19:06:00.985 INFO:tasks.workunit.client.0.smithi027.stdout:7/530: dwrite d3/d24/f37 [0,4194304] 0 2024-09-20T19:06:00.991 INFO:tasks.workunit.client.0.smithi027.stdout:8/533: dread d2/d3/d6/d21/f28 [0,4194304] 0 2024-09-20T19:06:00.995 INFO:tasks.workunit.client.1.smithi098.stdout:8/580: link d7/de/d11/d19/d30/d82/cb9 d7/de/d35/cce 0 2024-09-20T19:06:00.996 INFO:tasks.workunit.client.0.smithi027.stdout:1/522: readlink d2/d8/d2b/d2d/l94 0 2024-09-20T19:06:00.997 INFO:tasks.workunit.client.1.smithi098.stdout:9/578: creat d4/de/d27/dbf/fc3 x:0 0 0 2024-09-20T19:06:00.998 INFO:tasks.workunit.client.0.smithi027.stdout:0/606: creat d2/d20/fe1 x:0 0 0 2024-09-20T19:06:00.999 INFO:tasks.workunit.client.0.smithi027.stdout:0/607: dread - d2/d20/fd6 zero size 2024-09-20T19:06:01.000 INFO:tasks.workunit.client.1.smithi098.stdout:8/581: mkdir d7/de/d11/d19/d30/d55/dcf 0 2024-09-20T19:06:01.001 INFO:tasks.workunit.client.0.smithi027.stdout:3/510: getdents d0/d1/d13/d15/d76 0 2024-09-20T19:06:01.002 INFO:tasks.workunit.client.1.smithi098.stdout:6/340: dwrite d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:06:01.002 INFO:tasks.workunit.client.0.smithi027.stdout:3/511: readlink d0/d1/l2d 0 2024-09-20T19:06:01.002 INFO:tasks.workunit.client.1.smithi098.stdout:3/503: dwrite d4/d25/f35 [4194304,4194304] 0 2024-09-20T19:06:01.003 INFO:tasks.workunit.client.0.smithi027.stdout:2/467: creat d3/d24/d8b/f92 x:0 0 0 2024-09-20T19:06:01.004 INFO:tasks.workunit.client.1.smithi098.stdout:9/579: mkdir d4/de/d24/d35/dc4 0 2024-09-20T19:06:01.009 INFO:tasks.workunit.client.0.smithi027.stdout:3/512: dwrite d0/d1/d13/d15/d6f/d7f/f8b [0,4194304] 0 2024-09-20T19:06:01.012 INFO:tasks.workunit.client.0.smithi027.stdout:9/640: rename d0/d9/df/d1b/d9c/f52 to d0/d9/df/d1c/d6a/d6d/dd/d58/fd1 0 2024-09-20T19:06:01.013 INFO:tasks.workunit.client.1.smithi098.stdout:6/341: chown d0/de/d1b/d37/d44/d24/d29/l33 0 1 2024-09-20T19:06:01.015 INFO:tasks.workunit.client.0.smithi027.stdout:7/531: unlink d3/d8/da/d51/lae 0 2024-09-20T19:06:01.016 INFO:tasks.workunit.client.0.smithi027.stdout:7/532: readlink d3/l7 0 2024-09-20T19:06:01.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/580: creat d4/de/d27/d4a/d21/d25/d51/d7b/fc5 x:0 0 0 2024-09-20T19:06:01.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/581: fdatasync d4/de/d27/d4a/f4b 0 2024-09-20T19:06:01.022 INFO:tasks.workunit.client.0.smithi027.stdout:9/641: dread d0/d9/df/d1b/f23 [4194304,4194304] 0 2024-09-20T19:06:01.023 INFO:tasks.workunit.client.0.smithi027.stdout:9/642: read - d0/f7d zero size 2024-09-20T19:06:01.024 INFO:tasks.workunit.client.0.smithi027.stdout:7/533: dwrite d3/d8/d1c/f47 [0,4194304] 0 2024-09-20T19:06:01.024 INFO:tasks.workunit.client.1.smithi098.stdout:6/342: mkdir d0/de/d1b/d37/d44/d24/d29/d2b/d66 0 2024-09-20T19:06:01.026 INFO:tasks.workunit.client.1.smithi098.stdout:9/582: dwrite d4/de/d27/d4a/d8e/f95 [0,4194304] 0 2024-09-20T19:06:01.028 INFO:tasks.workunit.client.0.smithi027.stdout:5/581: creat d4/da/de/d3e/db7/fb9 x:0 0 0 2024-09-20T19:06:01.028 INFO:tasks.workunit.client.0.smithi027.stdout:9/643: dread d0/d9/df/d1c/f7f [0,4194304] 0 2024-09-20T19:06:01.036 INFO:tasks.workunit.client.0.smithi027.stdout:9/644: dwrite d0/d9/df/d1b/f8 [0,4194304] 0 2024-09-20T19:06:01.037 INFO:tasks.workunit.client.1.smithi098.stdout:3/504: dread d4/d25/f68 [0,4194304] 0 2024-09-20T19:06:01.039 INFO:tasks.workunit.client.0.smithi027.stdout:6/508: creat d4/d15/d37/d7a/f9b x:0 0 0 2024-09-20T19:06:01.040 INFO:tasks.workunit.client.1.smithi098.stdout:3/505: stat d4/da/f14 0 2024-09-20T19:06:01.040 INFO:tasks.workunit.client.0.smithi027.stdout:8/534: getdents d2/d3/d6/d6d/d75 0 2024-09-20T19:06:01.040 INFO:tasks.workunit.client.1.smithi098.stdout:3/506: fsync d4/d38/d48/d60/f6b 0 2024-09-20T19:06:01.041 INFO:tasks.workunit.client.0.smithi027.stdout:8/535: read - d2/d14/d13/d51/f76 zero size 2024-09-20T19:06:01.042 INFO:tasks.workunit.client.1.smithi098.stdout:3/507: write d4/d19/d1d/f47 [2128829,30440] 0 2024-09-20T19:06:01.043 INFO:tasks.workunit.client.0.smithi027.stdout:1/523: link d2/d8/d2b/d2d/d3e/f6e d2/d8/d3b/d44/d96/fa4 0 2024-09-20T19:06:01.044 INFO:tasks.workunit.client.0.smithi027.stdout:5/582: creat d4/da/fba x:0 0 0 2024-09-20T19:06:01.046 INFO:tasks.workunit.client.1.smithi098.stdout:6/343: rename d0/de/d1b/d37/d44/l2e to d0/de/d1b/l67 0 2024-09-20T19:06:01.046 INFO:tasks.workunit.client.0.smithi027.stdout:5/583: truncate d4/d1f/d28/fa3 251105 0 2024-09-20T19:06:01.047 INFO:tasks.workunit.client.0.smithi027.stdout:4/409: getdents d5/d13/d36/d48/d3f/d4c 0 2024-09-20T19:06:01.048 INFO:tasks.workunit.client.0.smithi027.stdout:3/513: mknod d0/d1/d13/d98/ca4 0 2024-09-20T19:06:01.048 INFO:tasks.workunit.client.0.smithi027.stdout:4/410: stat d5/d13/d36/d60/c71 0 2024-09-20T19:06:01.049 INFO:tasks.workunit.client.0.smithi027.stdout:4/411: fdatasync d5/d11/d1a/f81 0 2024-09-20T19:06:01.051 INFO:tasks.workunit.client.0.smithi027.stdout:1/524: unlink d2/d8/d3b/d44/f6b 0 2024-09-20T19:06:01.053 INFO:tasks.workunit.client.0.smithi027.stdout:5/584: mknod d4/da/cbb 0 2024-09-20T19:06:01.054 INFO:tasks.workunit.client.1.smithi098.stdout:6/344: link d0/l6 d0/de/d1b/d37/d44/dc/l68 0 2024-09-20T19:06:01.054 INFO:tasks.workunit.client.0.smithi027.stdout:6/509: getdents d4/d15/d37/d6a/d91 0 2024-09-20T19:06:01.055 INFO:tasks.workunit.client.0.smithi027.stdout:6/510: fdatasync d4/d15/d37/d7a/d46/f71 0 2024-09-20T19:06:01.056 INFO:tasks.workunit.client.0.smithi027.stdout:1/525: creat d2/d8/d3b/d82/d87/fa5 x:0 0 0 2024-09-20T19:06:01.058 INFO:tasks.workunit.client.0.smithi027.stdout:8/536: link d2/d65/f4f d2/d3/d6/d6d/d75/fad 0 2024-09-20T19:06:01.059 INFO:tasks.workunit.client.1.smithi098.stdout:8/582: write d7/f61 [2029248,62236] 0 2024-09-20T19:06:01.060 INFO:tasks.workunit.client.0.smithi027.stdout:9/645: getdents d0/d9 0 2024-09-20T19:06:01.060 INFO:tasks.workunit.client.0.smithi027.stdout:3/514: dread d0/d1/d5e/d1d/d7d/f87 [0,4194304] 0 2024-09-20T19:06:01.061 INFO:tasks.workunit.client.0.smithi027.stdout:6/511: mkdir d4/d9c 0 2024-09-20T19:06:01.061 INFO:tasks.workunit.client.0.smithi027.stdout:5/585: dwrite d4/da/de/f66 [0,4194304] 0 2024-09-20T19:06:01.063 INFO:tasks.workunit.client.0.smithi027.stdout:5/586: write d4/da/de/d3e/fb1 [598590,46363] 0 2024-09-20T19:06:01.065 INFO:tasks.workunit.client.0.smithi027.stdout:1/526: symlink d2/d8/d3b/d82/d90/la6 0 2024-09-20T19:06:01.065 INFO:tasks.workunit.client.0.smithi027.stdout:5/587: dread - d4/da/de/d3e/d69/d75/fa8 zero size 2024-09-20T19:06:01.067 INFO:tasks.workunit.client.0.smithi027.stdout:8/537: unlink d2/d3/d6/d21/d33/c44 0 2024-09-20T19:06:01.068 INFO:tasks.workunit.client.0.smithi027.stdout:4/412: getdents d5/d13/d16/d21/d26 0 2024-09-20T19:06:01.069 INFO:tasks.workunit.client.0.smithi027.stdout:9/646: creat d0/d9/df/d1b/d9c/d5a/fd2 x:0 0 0 2024-09-20T19:06:01.071 INFO:tasks.workunit.client.0.smithi027.stdout:4/413: chown d5/d13/d16/d21/d26/l2c 20 1 2024-09-20T19:06:01.072 INFO:tasks.workunit.client.0.smithi027.stdout:6/512: rename d4/d15/d37/f45 to d4/d15/d37/d5a/d78/f9d 0 2024-09-20T19:06:01.073 INFO:tasks.workunit.client.0.smithi027.stdout:4/414: dread - d5/d11/f68 zero size 2024-09-20T19:06:01.073 INFO:tasks.workunit.client.1.smithi098.stdout:9/583: write d4/de/d24/d35/f32 [1730071,109504] 0 2024-09-20T19:06:01.073 INFO:tasks.workunit.client.0.smithi027.stdout:5/588: creat d4/d1f/d91/fbc x:0 0 0 2024-09-20T19:06:01.074 INFO:tasks.workunit.client.0.smithi027.stdout:8/538: symlink d2/d3/d6/d6d/lae 0 2024-09-20T19:06:01.078 INFO:tasks.workunit.client.1.smithi098.stdout:9/584: mknod d4/de/d27/d4a/d8e/cc6 0 2024-09-20T19:06:01.078 INFO:tasks.workunit.client.1.smithi098.stdout:8/583: dread d7/de/d11/d19/d30/f70 [0,4194304] 0 2024-09-20T19:06:01.079 INFO:tasks.workunit.client.0.smithi027.stdout:1/527: dwrite d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:01.079 INFO:tasks.workunit.client.0.smithi027.stdout:5/589: fdatasync d4/d1f/d28/f34 0 2024-09-20T19:06:01.082 INFO:tasks.workunit.client.0.smithi027.stdout:0/608: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/f54 159754 0 2024-09-20T19:06:01.084 INFO:tasks.workunit.client.0.smithi027.stdout:3/515: dwrite d0/d1/d13/f89 [0,4194304] 0 2024-09-20T19:06:01.084 INFO:tasks.workunit.client.1.smithi098.stdout:9/585: dread d4/de/d24/d35/f42 [0,4194304] 0 2024-09-20T19:06:01.088 INFO:tasks.workunit.client.0.smithi027.stdout:9/647: dwrite d0/d9/df/d1b/d9c/d4f/fa1 [4194304,4194304] 0 2024-09-20T19:06:01.089 INFO:tasks.workunit.client.0.smithi027.stdout:4/415: creat d5/d80/f83 x:0 0 0 2024-09-20T19:06:01.092 INFO:tasks.workunit.client.0.smithi027.stdout:5/590: mknod d4/da/de/d3e/d69/cbd 0 2024-09-20T19:06:01.093 INFO:tasks.workunit.client.0.smithi027.stdout:8/539: dwrite d2/d14/d13/d2e/f62 [0,4194304] 0 2024-09-20T19:06:01.094 INFO:tasks.workunit.client.0.smithi027.stdout:4/416: truncate d5/d80/f83 943824 0 2024-09-20T19:06:01.094 INFO:tasks.workunit.client.0.smithi027.stdout:0/609: symlink d2/da2/le2 0 2024-09-20T19:06:01.098 INFO:tasks.workunit.client.0.smithi027.stdout:3/516: dread d0/f12 [0,4194304] 0 2024-09-20T19:06:01.098 INFO:tasks.workunit.client.1.smithi098.stdout:8/584: link d7/de/d11/d19/d30/d68/f6c d7/de/d11/d19/d30/db5/fd0 0 2024-09-20T19:06:01.101 INFO:tasks.workunit.client.0.smithi027.stdout:6/513: creat d4/d15/f9e x:0 0 0 2024-09-20T19:06:01.106 INFO:tasks.workunit.client.1.smithi098.stdout:8/585: dwrite d7/f61 [0,4194304] 0 2024-09-20T19:06:01.107 INFO:tasks.workunit.client.0.smithi027.stdout:5/591: write d4/da/fac [2644401,34271] 0 2024-09-20T19:06:01.107 INFO:tasks.workunit.client.1.smithi098.stdout:8/586: chown d7/l9 95282 1 2024-09-20T19:06:01.110 INFO:tasks.workunit.client.0.smithi027.stdout:8/540: symlink d2/d3/d1b/d36/laf 0 2024-09-20T19:06:01.114 INFO:tasks.workunit.client.0.smithi027.stdout:4/417: rename f4 to d5/d13/d36/d59/f84 0 2024-09-20T19:06:01.116 INFO:tasks.workunit.client.0.smithi027.stdout:1/528: symlink d2/d8/d3b/d82/d90/d9f/la7 0 2024-09-20T19:06:01.117 INFO:tasks.workunit.client.0.smithi027.stdout:3/517: mknod d0/d1/d13/d15/d55/d70/ca5 0 2024-09-20T19:06:01.119 INFO:tasks.workunit.client.0.smithi027.stdout:9/648: fdatasync d0/d2e/f34 0 2024-09-20T19:06:01.119 INFO:tasks.workunit.client.0.smithi027.stdout:5/592: symlink d4/da/de/lbe 0 2024-09-20T19:06:01.120 INFO:tasks.workunit.client.0.smithi027.stdout:8/541: dwrite d2/d14/d13/d2e/d6c/d77/fa5 [0,4194304] 0 2024-09-20T19:06:01.123 INFO:tasks.workunit.client.0.smithi027.stdout:4/418: fsync d5/d11/d3d/f6a 0 2024-09-20T19:06:01.125 INFO:tasks.workunit.client.0.smithi027.stdout:9/649: mknod d0/d9/df/d1c/d6a/cd3 0 2024-09-20T19:06:01.126 INFO:tasks.workunit.client.0.smithi027.stdout:0/610: getdents d2/d49/d70 0 2024-09-20T19:06:01.127 INFO:tasks.workunit.client.0.smithi027.stdout:5/593: mknod d4/da/cbf 0 2024-09-20T19:06:01.133 INFO:tasks.workunit.client.0.smithi027.stdout:8/542: dwrite d2/d65/f4b [0,4194304] 0 2024-09-20T19:06:01.134 INFO:tasks.workunit.client.0.smithi027.stdout:5/594: rename d4/da/fb to d4/d6c/d6f/d92/fc0 0 2024-09-20T19:06:01.135 INFO:tasks.workunit.client.1.smithi098.stdout:9/586: truncate d4/de/d27/d4a/d58/d5b/d8f/d9e/f5a 7241859 0 2024-09-20T19:06:01.137 INFO:tasks.workunit.client.0.smithi027.stdout:4/419: dwrite d5/d13/d36/f7b [0,4194304] 0 2024-09-20T19:06:01.138 INFO:tasks.workunit.client.0.smithi027.stdout:1/529: getdents d2/d8/d3b/d44 0 2024-09-20T19:06:01.139 INFO:tasks.workunit.client.1.smithi098.stdout:8/587: dread f1 [0,4194304] 0 2024-09-20T19:06:01.139 INFO:tasks.workunit.client.0.smithi027.stdout:8/543: write d2/d3/d1b/fa2 [177422,7917] 0 2024-09-20T19:06:01.141 INFO:tasks.workunit.client.0.smithi027.stdout:8/544: fsync d2/d3/d6/ff 0 2024-09-20T19:06:01.142 INFO:tasks.workunit.client.0.smithi027.stdout:4/420: truncate d5/d11/d1a/f81 525813 0 2024-09-20T19:06:01.143 INFO:tasks.workunit.client.1.smithi098.stdout:9/587: dwrite d4/de/d27/d4a/d21/d25/f59 [0,4194304] 0 2024-09-20T19:06:01.144 INFO:tasks.workunit.client.1.smithi098.stdout:8/588: symlink d7/de/d11/d19/d30/d55/d9d/ld1 0 2024-09-20T19:06:01.147 INFO:tasks.workunit.client.0.smithi027.stdout:6/514: write d4/d6/d4b/f9a [332656,50962] 0 2024-09-20T19:06:01.153 INFO:tasks.workunit.client.0.smithi027.stdout:4/421: dwrite d5/d11/f68 [0,4194304] 0 2024-09-20T19:06:01.153 INFO:tasks.workunit.client.0.smithi027.stdout:3/518: dread d0/d19/d54/f67 [0,4194304] 0 2024-09-20T19:06:01.154 INFO:tasks.workunit.client.1.smithi098.stdout:8/589: truncate d7/de/d11/f58 1041667 0 2024-09-20T19:06:01.157 INFO:tasks.workunit.client.0.smithi027.stdout:6/515: mknod d4/d15/d37/d7a/d33/c9f 0 2024-09-20T19:06:01.160 INFO:tasks.workunit.client.0.smithi027.stdout:4/422: mknod d5/d11/d3d/d6e/c85 0 2024-09-20T19:06:01.163 INFO:tasks.workunit.client.0.smithi027.stdout:6/516: symlink d4/d6/d4b/la0 0 2024-09-20T19:06:01.164 INFO:tasks.workunit.client.0.smithi027.stdout:9/650: dread d0/d9/df/d57/f7b [0,4194304] 0 2024-09-20T19:06:01.165 INFO:tasks.workunit.client.0.smithi027.stdout:5/595: rename d4/da/l19 to d4/da/de/d3e/d44/lc1 0 2024-09-20T19:06:01.166 INFO:tasks.workunit.client.0.smithi027.stdout:9/651: write d0/d9/df/d1c/d6a/d6d/dd/d58/f8a [602992,49925] 0 2024-09-20T19:06:01.166 INFO:tasks.workunit.client.0.smithi027.stdout:5/596: readlink d4/l2f 0 2024-09-20T19:06:01.169 INFO:tasks.workunit.client.0.smithi027.stdout:3/519: creat d0/d80/da2/fa6 x:0 0 0 2024-09-20T19:06:01.171 INFO:tasks.workunit.client.0.smithi027.stdout:1/530: write d2/f66 [1934372,130411] 0 2024-09-20T19:06:01.172 INFO:tasks.workunit.client.0.smithi027.stdout:6/517: fsync d4/d15/d37/d5a/d78/f9d 0 2024-09-20T19:06:01.176 INFO:tasks.workunit.client.1.smithi098.stdout:9/588: dwrite d4/de/d24/d35/d2d/f49 [0,4194304] 0 2024-09-20T19:06:01.178 INFO:tasks.workunit.client.1.smithi098.stdout:9/589: chown d4/de/d27/d4a/d21/d25/f59 1 1 2024-09-20T19:06:01.178 INFO:tasks.workunit.client.1.smithi098.stdout:9/590: write d4/de/d24/d35/d2d/f49 [5241250,4260] 0 2024-09-20T19:06:01.179 INFO:tasks.workunit.client.0.smithi027.stdout:5/597: chown d4/da/de/c49 1494437 1 2024-09-20T19:06:01.183 INFO:tasks.workunit.client.0.smithi027.stdout:8/545: write d2/f39 [5327926,59777] 0 2024-09-20T19:06:01.184 INFO:tasks.workunit.client.0.smithi027.stdout:1/531: fdatasync d2/d1b/f2e 0 2024-09-20T19:06:01.185 INFO:tasks.workunit.client.0.smithi027.stdout:6/518: mknod d4/d15/d37/d6a/d7f/ca1 0 2024-09-20T19:06:01.186 INFO:tasks.workunit.client.0.smithi027.stdout:3/520: dread d0/d1/f30 [0,4194304] 0 2024-09-20T19:06:01.188 INFO:tasks.workunit.client.0.smithi027.stdout:4/423: creat d5/d13/d36/d48/d3f/f86 x:0 0 0 2024-09-20T19:06:01.188 INFO:tasks.workunit.client.0.smithi027.stdout:6/519: chown d4/d15/d37/d85 369 1 2024-09-20T19:06:01.190 INFO:tasks.workunit.client.0.smithi027.stdout:8/546: creat d2/d14/d13/d43/fb0 x:0 0 0 2024-09-20T19:06:01.191 INFO:tasks.workunit.client.0.smithi027.stdout:5/598: dwrite d4/da/de/d3e/d69/d75/d3d/f8e [0,4194304] 0 2024-09-20T19:06:01.191 INFO:tasks.workunit.client.0.smithi027.stdout:1/532: stat d2/d8/d3b/d44/l67 0 2024-09-20T19:06:01.191 INFO:tasks.workunit.client.0.smithi027.stdout:8/547: chown d2/d3/d6/d21 57732596 1 2024-09-20T19:06:01.193 INFO:tasks.workunit.client.0.smithi027.stdout:3/521: mkdir d0/d1/d5e/d1d/da7 0 2024-09-20T19:06:01.195 INFO:tasks.workunit.client.0.smithi027.stdout:6/520: unlink d4/d15/d37/d6a/d7f/ca1 0 2024-09-20T19:06:01.196 INFO:tasks.workunit.client.1.smithi098.stdout:9/591: creat d4/de/d24/d35/d2d/da6/dae/fc7 x:0 0 0 2024-09-20T19:06:01.197 INFO:tasks.workunit.client.0.smithi027.stdout:8/548: write d2/d3/d6/d6d/f8b [886526,74929] 0 2024-09-20T19:06:01.197 INFO:tasks.workunit.client.0.smithi027.stdout:4/424: unlink d5/d13/d36/d48/d3f/d4c/l69 0 2024-09-20T19:06:01.197 INFO:tasks.workunit.client.1.smithi098.stdout:9/592: write d4/de/d27/dbf/fc3 [451118,122964] 0 2024-09-20T19:06:01.199 INFO:tasks.workunit.client.0.smithi027.stdout:1/533: creat d2/d8/d2b/d2d/d73/fa8 x:0 0 0 2024-09-20T19:06:01.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/590: mkdir d7/dd2 0 2024-09-20T19:06:01.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/591: dread - d7/de/d11/f6b zero size 2024-09-20T19:06:01.202 INFO:tasks.workunit.client.0.smithi027.stdout:9/652: dwrite d0/d9/df/d1c/f7f [0,4194304] 0 2024-09-20T19:06:01.202 INFO:tasks.workunit.client.1.smithi098.stdout:9/593: mkdir d4/d74/dc8 0 2024-09-20T19:06:01.205 INFO:tasks.workunit.client.0.smithi027.stdout:5/599: rename d4/d7a to d4/da/de/d3e/db7/dc2 0 2024-09-20T19:06:01.205 INFO:tasks.workunit.client.1.smithi098.stdout:9/594: mkdir d4/de/d27/dc9 0 2024-09-20T19:06:01.209 INFO:tasks.workunit.client.1.smithi098.stdout:8/592: rename d7/de/d11/d19/d30/d55/f69 to d7/de/d11/d19/d30/d55/d9d/fd3 0 2024-09-20T19:06:01.210 INFO:tasks.workunit.client.0.smithi027.stdout:8/549: symlink d2/d14/d13/d2e/lb1 0 2024-09-20T19:06:01.213 INFO:tasks.workunit.client.1.smithi098.stdout:8/593: unlink f1 0 2024-09-20T19:06:01.214 INFO:tasks.workunit.client.0.smithi027.stdout:9/653: symlink d0/d9/df/da2/ld4 0 2024-09-20T19:06:01.215 INFO:tasks.workunit.client.0.smithi027.stdout:6/521: creat d4/d15/d37/d6a/d91/fa2 x:0 0 0 2024-09-20T19:06:01.217 INFO:tasks.workunit.client.0.smithi027.stdout:4/425: mkdir d5/d13/d36/d48/d3f/d4c/d52/d87 0 2024-09-20T19:06:01.217 INFO:tasks.workunit.client.0.smithi027.stdout:6/522: write d4/d15/d37/d6a/f73 [243828,60501] 0 2024-09-20T19:06:01.218 INFO:tasks.workunit.client.0.smithi027.stdout:5/600: mknod d4/d1f/cc3 0 2024-09-20T19:06:01.219 INFO:tasks.workunit.client.0.smithi027.stdout:8/550: creat d2/d14/d13/d43/d5d/d90/fb2 x:0 0 0 2024-09-20T19:06:01.220 INFO:tasks.workunit.client.0.smithi027.stdout:3/522: getdents d0/d80 0 2024-09-20T19:06:01.221 INFO:tasks.workunit.client.0.smithi027.stdout:6/523: fsync d4/d15/d37/d6a/f8f 0 2024-09-20T19:06:01.223 INFO:tasks.workunit.client.0.smithi027.stdout:5/601: rename d4/da/c70 to d4/d1f/d28/cc4 0 2024-09-20T19:06:01.229 INFO:tasks.workunit.client.0.smithi027.stdout:1/534: getdents d2/d8/d2b/d2d/d73 0 2024-09-20T19:06:01.230 INFO:tasks.workunit.client.0.smithi027.stdout:8/551: dwrite d2/d3/d1b/d36/f61 [0,4194304] 0 2024-09-20T19:06:01.231 INFO:tasks.workunit.client.0.smithi027.stdout:6/524: dwrite f0 [4194304,4194304] 0 2024-09-20T19:06:01.232 INFO:tasks.workunit.client.0.smithi027.stdout:1/535: fdatasync d2/d8/d2b/f9d 0 2024-09-20T19:06:01.233 INFO:tasks.workunit.client.1.smithi098.stdout:9/595: write d4/de/d27/d4a/d21/f50 [438515,15049] 0 2024-09-20T19:06:01.234 INFO:tasks.workunit.client.0.smithi027.stdout:8/552: dread - d2/d14/d13/d51/f98 zero size 2024-09-20T19:06:01.238 INFO:tasks.workunit.client.0.smithi027.stdout:3/523: getdents d0/d1/d13 0 2024-09-20T19:06:01.239 INFO:tasks.workunit.client.1.smithi098.stdout:9/596: dread d4/de/d48/f4d [4194304,4194304] 0 2024-09-20T19:06:01.240 INFO:tasks.workunit.client.0.smithi027.stdout:5/602: dwrite d4/d1f/d91/fbc [0,4194304] 0 2024-09-20T19:06:01.241 INFO:tasks.workunit.client.1.smithi098.stdout:9/597: fsync d4/de/d27/d4a/d21/f50 0 2024-09-20T19:06:01.242 INFO:tasks.workunit.client.1.smithi098.stdout:9/598: chown d4/de/d27/d6c/d73/db5 838308242 1 2024-09-20T19:06:01.243 INFO:tasks.workunit.client.0.smithi027.stdout:5/603: chown d4/da/de/d3e/db7/dc2/d87/c8a 1 1 2024-09-20T19:06:01.243 INFO:tasks.workunit.client.0.smithi027.stdout:6/525: fsync d4/d15/d2c/f4c 0 2024-09-20T19:06:01.243 INFO:tasks.workunit.client.0.smithi027.stdout:9/654: dread d0/d9/df/d1b/d9c/d4f/d8d/da0/fb8 [0,4194304] 0 2024-09-20T19:06:01.243 INFO:tasks.workunit.client.0.smithi027.stdout:1/536: creat d2/d8/d3b/d82/d90/d9f/fa9 x:0 0 0 2024-09-20T19:06:01.245 INFO:tasks.workunit.client.0.smithi027.stdout:5/604: write d4/da/f29 [2953238,40645] 0 2024-09-20T19:06:01.246 INFO:tasks.workunit.client.1.smithi098.stdout:8/594: dwrite d7/de/d11/d1d/f81 [0,4194304] 0 2024-09-20T19:06:01.252 INFO:tasks.workunit.client.1.smithi098.stdout:9/599: dread d4/de/d27/d6c/fa3 [0,4194304] 0 2024-09-20T19:06:01.253 INFO:tasks.workunit.client.0.smithi027.stdout:9/655: dwrite d0/d9/df/fcf [0,4194304] 0 2024-09-20T19:06:01.254 INFO:tasks.workunit.client.0.smithi027.stdout:9/656: stat d0/d9/df/d1b/cc6 0 2024-09-20T19:06:01.256 INFO:tasks.workunit.client.0.smithi027.stdout:9/657: dread - d0/d9/df/d1b/d9c/da4/fac zero size 2024-09-20T19:06:01.257 INFO:tasks.workunit.client.0.smithi027.stdout:4/426: truncate d5/d11/d17/f20 579471 0 2024-09-20T19:06:01.259 INFO:tasks.workunit.client.0.smithi027.stdout:6/526: creat d4/d15/d37/d6a/fa3 x:0 0 0 2024-09-20T19:06:01.260 INFO:tasks.workunit.client.1.smithi098.stdout:9/600: dread d4/de/d27/d4a/d21/d25/d51/f9d [0,4194304] 0 2024-09-20T19:06:01.260 INFO:tasks.workunit.client.0.smithi027.stdout:1/537: mknod d2/d8/d74/d9a/caa 0 2024-09-20T19:06:01.262 INFO:tasks.workunit.client.0.smithi027.stdout:9/658: dread d0/d9/df/fcf [0,4194304] 0 2024-09-20T19:06:01.262 INFO:tasks.workunit.client.0.smithi027.stdout:5/605: unlink d4/da/d1a/cab 0 2024-09-20T19:06:01.264 INFO:tasks.workunit.client.1.smithi098.stdout:9/601: symlink d4/de/d24/d35/d2d/da6/dae/lca 0 2024-09-20T19:06:01.264 INFO:tasks.workunit.client.1.smithi098.stdout:9/602: chown d4/d74/d8a/fa2 1 1 2024-09-20T19:06:01.267 INFO:tasks.workunit.client.0.smithi027.stdout:1/538: mknod d2/d8/d3b/d44/cab 0 2024-09-20T19:06:01.267 INFO:tasks.workunit.client.0.smithi027.stdout:6/527: creat d4/d15/d37/d7a/d8e/fa4 x:0 0 0 2024-09-20T19:06:01.270 INFO:tasks.workunit.client.0.smithi027.stdout:9/659: dread d0/d9/df/d1b/d9c/d4f/f9b [0,4194304] 0 2024-09-20T19:06:01.270 INFO:tasks.workunit.client.0.smithi027.stdout:6/528: mkdir d4/d15/d37/d6a/da5 0 2024-09-20T19:06:01.271 INFO:tasks.workunit.client.0.smithi027.stdout:5/606: creat d4/da/de/d3e/fc5 x:0 0 0 2024-09-20T19:06:01.271 INFO:tasks.workunit.client.0.smithi027.stdout:3/524: getdents d0/d1/d13 0 2024-09-20T19:06:01.273 INFO:tasks.workunit.client.0.smithi027.stdout:8/553: dread d2/d3/f5e [0,4194304] 0 2024-09-20T19:06:01.274 INFO:tasks.workunit.client.0.smithi027.stdout:1/539: rename d2/d8/c1a to d2/d1b/cac 0 2024-09-20T19:06:01.275 INFO:tasks.workunit.client.0.smithi027.stdout:5/607: unlink d4/f43 0 2024-09-20T19:06:01.278 INFO:tasks.workunit.client.0.smithi027.stdout:5/608: creat d4/da/de/d3e/db7/fc6 x:0 0 0 2024-09-20T19:06:01.279 INFO:tasks.workunit.client.0.smithi027.stdout:8/554: read d2/d14/f27 [4112768,47182] 0 2024-09-20T19:06:01.281 INFO:tasks.workunit.client.0.smithi027.stdout:3/525: rename d0/d38/c81 to d0/d1/d13/d3c/d93/ca8 0 2024-09-20T19:06:01.281 INFO:tasks.workunit.client.0.smithi027.stdout:4/427: dread d5/d13/d36/d59/f84 [0,4194304] 0 2024-09-20T19:06:01.281 INFO:tasks.workunit.client.0.smithi027.stdout:5/609: mkdir d4/d6c/dc7 0 2024-09-20T19:06:01.282 INFO:tasks.workunit.client.0.smithi027.stdout:4/428: chown d5/d11/l19 16254805 1 2024-09-20T19:06:01.283 INFO:tasks.workunit.client.0.smithi027.stdout:1/540: dwrite d2/d8/d74/f79 [0,4194304] 0 2024-09-20T19:06:01.283 INFO:tasks.workunit.client.0.smithi027.stdout:4/429: chown d5 4921019 1 2024-09-20T19:06:01.284 INFO:tasks.workunit.client.0.smithi027.stdout:5/610: dread - d4/da/de/d3e/d44/fae zero size 2024-09-20T19:06:01.286 INFO:tasks.workunit.client.1.smithi098.stdout:8/595: dread d7/f10 [8388608,4194304] 0 2024-09-20T19:06:01.287 INFO:tasks.workunit.client.0.smithi027.stdout:3/526: symlink d0/d19/d54/d7a/la9 0 2024-09-20T19:06:01.288 INFO:tasks.workunit.client.0.smithi027.stdout:8/555: rename d2/d3/d6/d21/d33/d79/f9b to d2/d3/d6/d6d/fb3 0 2024-09-20T19:06:01.288 INFO:tasks.workunit.client.1.smithi098.stdout:8/596: write d7/de/d11/d19/d30/d68/f7b [575480,2924] 0 2024-09-20T19:06:01.291 INFO:tasks.workunit.client.0.smithi027.stdout:1/541: write d2/d1b/d56/d71/f7a [608612,45360] 0 2024-09-20T19:06:01.292 INFO:tasks.workunit.client.1.smithi098.stdout:8/597: mknod d7/de/d11/d19/d30/db5/cd4 0 2024-09-20T19:06:01.295 INFO:tasks.workunit.client.0.smithi027.stdout:3/527: creat d0/d1/d13/d15/d55/d70/faa x:0 0 0 2024-09-20T19:06:01.295 INFO:tasks.workunit.client.0.smithi027.stdout:5/611: dwrite d4/da/f2c [0,4194304] 0 2024-09-20T19:06:01.300 INFO:tasks.workunit.client.0.smithi027.stdout:6/529: write d4/f42 [500957,12891] 0 2024-09-20T19:06:01.301 INFO:tasks.workunit.client.0.smithi027.stdout:1/542: mkdir d2/d8/d74/d9a/da3/dad 0 2024-09-20T19:06:01.301 INFO:tasks.workunit.client.0.smithi027.stdout:5/612: write d4/da/d98/faa [2216976,57247] 0 2024-09-20T19:06:01.301 INFO:tasks.workunit.client.0.smithi027.stdout:3/528: dread d0/d19/d54/f67 [0,4194304] 0 2024-09-20T19:06:01.302 INFO:tasks.workunit.client.0.smithi027.stdout:6/530: read - d4/d15/f9e zero size 2024-09-20T19:06:01.302 INFO:tasks.workunit.client.0.smithi027.stdout:5/613: chown d4/da 1245 1 2024-09-20T19:06:01.304 INFO:tasks.workunit.client.0.smithi027.stdout:8/556: creat d2/d3/d6/d21/d80/fb4 x:0 0 0 2024-09-20T19:06:01.305 INFO:tasks.workunit.client.0.smithi027.stdout:8/557: stat d2/d14/d13/f1d 0 2024-09-20T19:06:01.305 INFO:tasks.workunit.client.0.smithi027.stdout:1/543: creat d2/d61/fae x:0 0 0 2024-09-20T19:06:01.307 INFO:tasks.workunit.client.0.smithi027.stdout:3/529: mkdir d0/d1/d13/d98/dab 0 2024-09-20T19:06:01.308 INFO:tasks.workunit.client.0.smithi027.stdout:5/614: mkdir d4/d6c/d6f/d92/dc8 0 2024-09-20T19:06:01.310 INFO:tasks.workunit.client.0.smithi027.stdout:8/558: mkdir d2/d14/d13/db5 0 2024-09-20T19:06:01.311 INFO:tasks.workunit.client.0.smithi027.stdout:4/430: dread d5/d13/d16/d21/d3a/f4e [0,4194304] 0 2024-09-20T19:06:01.313 INFO:tasks.workunit.client.0.smithi027.stdout:9/660: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/f86 [0,4194304] 0 2024-09-20T19:06:01.316 INFO:tasks.workunit.client.0.smithi027.stdout:6/531: getdents d4/d15/d2c 0 2024-09-20T19:06:01.316 INFO:tasks.workunit.client.0.smithi027.stdout:5/615: rmdir d4/da/de/d3e/d69/d75/d3d 39 2024-09-20T19:06:01.317 INFO:tasks.workunit.client.0.smithi027.stdout:6/532: fsync d4/d15/d37/d7a/d33/f8a 0 2024-09-20T19:06:01.318 INFO:tasks.workunit.client.0.smithi027.stdout:3/530: rename d0/d1/d13/d15/c4c to d0/d1/d13/d15/d6f/cac 0 2024-09-20T19:06:01.320 INFO:tasks.workunit.client.0.smithi027.stdout:4/431: dwrite d5/d11/d17/d1b/f5f [0,4194304] 0 2024-09-20T19:06:01.321 INFO:tasks.workunit.client.1.smithi098.stdout:8/598: write d7/de/f93 [1005712,70128] 0 2024-09-20T19:06:01.325 INFO:tasks.workunit.client.0.smithi027.stdout:8/559: rename d2/d14/d13/d2e/f62 to d2/d14/d13/d51/fb6 0 2024-09-20T19:06:01.326 INFO:tasks.workunit.client.0.smithi027.stdout:3/531: mknod d0/d1/d13/d3c/cad 0 2024-09-20T19:06:01.327 INFO:tasks.workunit.client.0.smithi027.stdout:3/532: readlink d0/d1/l2d 0 2024-09-20T19:06:01.327 INFO:tasks.workunit.client.0.smithi027.stdout:3/533: readlink d0/d1/d5e/l34 0 2024-09-20T19:06:01.329 INFO:tasks.workunit.client.0.smithi027.stdout:9/661: mkdir d0/d9/df/d1b/d9c/d4f/dd5 0 2024-09-20T19:06:01.330 INFO:tasks.workunit.client.0.smithi027.stdout:9/662: chown d0/d9/df/d1c/f7f 416556325 1 2024-09-20T19:06:01.330 INFO:tasks.workunit.client.0.smithi027.stdout:4/432: symlink d5/d11/d1a/d2a/l88 0 2024-09-20T19:06:01.331 INFO:tasks.workunit.client.0.smithi027.stdout:4/433: chown d5/d11/d1a/d2a/f41 2162903 1 2024-09-20T19:06:01.332 INFO:tasks.workunit.client.0.smithi027.stdout:1/544: write d2/d8/d3b/d44/d96/fa4 [1026333,98390] 0 2024-09-20T19:06:01.332 INFO:tasks.workunit.client.0.smithi027.stdout:6/533: symlink d4/d9c/la6 0 2024-09-20T19:06:01.335 INFO:tasks.workunit.client.0.smithi027.stdout:3/534: creat d0/d1/d13/d3c/fae x:0 0 0 2024-09-20T19:06:01.335 INFO:tasks.workunit.client.0.smithi027.stdout:4/434: rmdir d5/d13/d70 39 2024-09-20T19:06:01.336 INFO:tasks.workunit.client.0.smithi027.stdout:3/535: fdatasync d0/d1/d13/d15/d6f/d7f/f85 0 2024-09-20T19:06:01.336 INFO:tasks.workunit.client.0.smithi027.stdout:6/534: symlink d4/d6/d4b/la7 0 2024-09-20T19:06:01.338 INFO:tasks.workunit.client.0.smithi027.stdout:9/663: link d0/d9/df/d1b/d9c/d4f/fa1 d0/d9/fd6 0 2024-09-20T19:06:01.339 INFO:tasks.workunit.client.0.smithi027.stdout:1/545: mknod d2/caf 0 2024-09-20T19:06:01.339 INFO:tasks.workunit.client.0.smithi027.stdout:6/535: dread - d4/d15/d37/d7a/d33/f8a zero size 2024-09-20T19:06:01.340 INFO:tasks.workunit.client.0.smithi027.stdout:8/560: getdents d2/d65 0 2024-09-20T19:06:01.341 INFO:tasks.workunit.client.0.smithi027.stdout:3/536: truncate d0/d1/d13/d15/d6f/f83 1018701 0 2024-09-20T19:06:01.341 INFO:tasks.workunit.client.0.smithi027.stdout:5/616: write d4/d1f/d7f/f67 [987397,61540] 0 2024-09-20T19:06:01.343 INFO:tasks.workunit.client.0.smithi027.stdout:0/611: sync 2024-09-20T19:06:01.343 INFO:tasks.workunit.client.0.smithi027.stdout:2/468: sync 2024-09-20T19:06:01.343 INFO:tasks.workunit.client.0.smithi027.stdout:7/534: sync 2024-09-20T19:06:01.344 INFO:tasks.workunit.client.0.smithi027.stdout:6/536: mknod d4/d15/d37/d7a/d33/ca8 0 2024-09-20T19:06:01.345 INFO:tasks.workunit.client.0.smithi027.stdout:8/561: chown d2/d3/d6/d21/d33/l92 4 1 2024-09-20T19:06:01.345 INFO:tasks.workunit.client.0.smithi027.stdout:1/546: dread - d2/d8/d3b/d82/d87/fa2 zero size 2024-09-20T19:06:01.345 INFO:tasks.workunit.client.1.smithi098.stdout:8/599: truncate d7/de/d11/d19/f4c 2222325 0 2024-09-20T19:06:01.346 INFO:tasks.workunit.client.0.smithi027.stdout:4/435: dwrite d5/f6d [0,4194304] 0 2024-09-20T19:06:01.350 INFO:tasks.workunit.client.1.smithi098.stdout:8/600: link d7/de/d11/d19/d30/d59/fa6 d7/de/d11/d19/d30/d55/da9/dbe/fd5 0 2024-09-20T19:06:01.356 INFO:tasks.workunit.client.1.smithi098.stdout:8/601: dwrite d7/de/d11/d1f/d57/d72/f75 [4194304,4194304] 0 2024-09-20T19:06:01.356 INFO:tasks.workunit.client.0.smithi027.stdout:2/469: symlink d3/d2f/l93 0 2024-09-20T19:06:01.363 INFO:tasks.workunit.client.0.smithi027.stdout:8/562: write d2/d14/d13/f3b [3514724,65163] 0 2024-09-20T19:06:01.363 INFO:tasks.workunit.client.0.smithi027.stdout:1/547: mknod d2/d8/d3b/cb0 0 2024-09-20T19:06:01.364 INFO:tasks.workunit.client.0.smithi027.stdout:6/537: dread - d4/d15/d37/d7a/d33/f8a zero size 2024-09-20T19:06:01.367 INFO:tasks.workunit.client.0.smithi027.stdout:9/664: stat d0/d9/df/d1b/d9c/d4f/fb9 0 2024-09-20T19:06:01.367 INFO:tasks.workunit.client.0.smithi027.stdout:1/548: chown d2/d1b/c62 16 1 2024-09-20T19:06:01.367 INFO:tasks.workunit.client.0.smithi027.stdout:5/617: write d4/da/de/d3e/d69/d75/d3d/f68 [1738680,52411] 0 2024-09-20T19:06:01.367 INFO:tasks.workunit.client.0.smithi027.stdout:7/535: write d3/d8/d26/f88 [3653,42529] 0 2024-09-20T19:06:01.368 INFO:tasks.workunit.client.0.smithi027.stdout:0/612: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [2287131,29846] 0 2024-09-20T19:06:01.369 INFO:tasks.workunit.client.0.smithi027.stdout:8/563: readlink d2/d3/d1b/l6b 0 2024-09-20T19:06:01.371 INFO:tasks.workunit.client.0.smithi027.stdout:2/470: read d3/d2f/f33 [1301514,99918] 0 2024-09-20T19:06:01.372 INFO:tasks.workunit.client.0.smithi027.stdout:3/537: dread d0/d1/d13/d15/d55/fa0 [0,4194304] 0 2024-09-20T19:06:01.372 INFO:tasks.workunit.client.0.smithi027.stdout:2/471: fsync d3/de/f46 0 2024-09-20T19:06:01.373 INFO:tasks.workunit.client.0.smithi027.stdout:0/613: chown d2/d48/d6b/d79/d84/d1b/d39/lb0 1 1 2024-09-20T19:06:01.374 INFO:tasks.workunit.client.1.smithi098.stdout:8/602: dwrite d7/de/d11/d19/d30/d59/fa6 [0,4194304] 0 2024-09-20T19:06:01.378 INFO:tasks.workunit.client.0.smithi027.stdout:4/436: mknod d5/d13/d36/d59/c89 0 2024-09-20T19:06:01.379 INFO:tasks.workunit.client.1.smithi098.stdout:8/603: dread d7/f61 [0,4194304] 0 2024-09-20T19:06:01.380 INFO:tasks.workunit.client.1.smithi098.stdout:8/604: chown d7/de/d11/d19/d30/f62 59 1 2024-09-20T19:06:01.382 INFO:tasks.workunit.client.0.smithi027.stdout:6/538: rename d4/d1b/l59 to d4/la9 0 2024-09-20T19:06:01.383 INFO:tasks.workunit.client.0.smithi027.stdout:0/614: dwrite d2/d49/d70/fa3 [0,4194304] 0 2024-09-20T19:06:01.385 INFO:tasks.workunit.client.0.smithi027.stdout:0/615: write d2/d48/d6b/d79/d84/d1b/d39/f57 [2695,14242] 0 2024-09-20T19:06:01.386 INFO:tasks.workunit.client.0.smithi027.stdout:5/618: creat d4/da/de/d3e/db7/fc9 x:0 0 0 2024-09-20T19:06:01.391 INFO:tasks.workunit.client.0.smithi027.stdout:3/538: creat d0/d1/d13/d15/faf x:0 0 0 2024-09-20T19:06:01.391 INFO:tasks.workunit.client.0.smithi027.stdout:3/539: chown d0/d1/fb 3 1 2024-09-20T19:06:01.394 INFO:tasks.workunit.client.0.smithi027.stdout:2/472: rename d3/c14 to d3/d24/c94 0 2024-09-20T19:06:01.396 INFO:tasks.workunit.client.0.smithi027.stdout:2/473: fdatasync d3/d13/f49 0 2024-09-20T19:06:01.399 INFO:tasks.workunit.client.0.smithi027.stdout:1/549: dread d2/d8/d2b/f8a [4194304,4194304] 0 2024-09-20T19:06:01.400 INFO:tasks.workunit.client.0.smithi027.stdout:1/550: chown d2/d8/d41 213333977 1 2024-09-20T19:06:01.401 INFO:tasks.workunit.client.0.smithi027.stdout:6/539: creat d4/d15/d93/faa x:0 0 0 2024-09-20T19:06:01.402 INFO:tasks.workunit.client.1.smithi098.stdout:8/605: truncate d7/de/d11/d1f/d57/d72/f75 238401 0 2024-09-20T19:06:01.404 INFO:tasks.workunit.client.1.smithi098.stdout:8/606: symlink d7/de/d11/d19/d30/d55/d9d/ld6 0 2024-09-20T19:06:01.404 INFO:tasks.workunit.client.0.smithi027.stdout:2/474: creat d3/d24/f95 x:0 0 0 2024-09-20T19:06:01.405 INFO:tasks.workunit.client.1.smithi098.stdout:8/607: write d7/f61 [11375,34931] 0 2024-09-20T19:06:01.406 INFO:tasks.workunit.client.0.smithi027.stdout:3/540: dwrite d0/d1/d13/d15/d6f/d7f/f85 [0,4194304] 0 2024-09-20T19:06:01.408 INFO:tasks.workunit.client.1.smithi098.stdout:8/608: symlink d7/de/d11/d1f/d9c/ld7 0 2024-09-20T19:06:01.408 INFO:tasks.workunit.client.0.smithi027.stdout:4/437: rename d5/d11/d1a/d2a/f41 to d5/d13/f8a 0 2024-09-20T19:06:01.408 INFO:tasks.workunit.client.0.smithi027.stdout:9/665: dread d0/d9/f28 [0,4194304] 0 2024-09-20T19:06:01.408 INFO:tasks.workunit.client.0.smithi027.stdout:6/540: write d4/d15/f9e [935316,89028] 0 2024-09-20T19:06:01.411 INFO:tasks.workunit.client.1.smithi098.stdout:8/609: stat d7/de/d11/d19/d30/d82/cc4 0 2024-09-20T19:06:01.413 INFO:tasks.workunit.client.0.smithi027.stdout:8/564: write d2/d3/d6/d6d/d75/fad [1709176,49565] 0 2024-09-20T19:06:01.413 INFO:tasks.workunit.client.0.smithi027.stdout:0/616: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7a [0,4194304] 0 2024-09-20T19:06:01.415 INFO:tasks.workunit.client.0.smithi027.stdout:1/551: mkdir d2/d8/d74/d9a/da3/dad/db1 0 2024-09-20T19:06:01.416 INFO:tasks.workunit.client.0.smithi027.stdout:7/536: dwrite d3/f29 [0,4194304] 0 2024-09-20T19:06:01.417 INFO:tasks.workunit.client.1.smithi098.stdout:8/610: mknod d7/de/d11/cd8 0 2024-09-20T19:06:01.418 INFO:tasks.workunit.client.0.smithi027.stdout:4/438: chown d5/d13/d16/d21/d26/f47 4 1 2024-09-20T19:06:01.421 INFO:tasks.workunit.client.0.smithi027.stdout:6/541: symlink d4/d6/d4b/lab 0 2024-09-20T19:06:01.422 INFO:tasks.workunit.client.0.smithi027.stdout:0/617: chown d2/d48/d6b/d79/d84/d1b/dc5/c5c 17 1 2024-09-20T19:06:01.422 INFO:tasks.workunit.client.0.smithi027.stdout:4/439: stat d5/d13/d36/d48/d3f/d4c 0 2024-09-20T19:06:01.423 INFO:tasks.workunit.client.0.smithi027.stdout:8/565: dread - d2/d65/f6a zero size 2024-09-20T19:06:01.423 INFO:tasks.workunit.client.0.smithi027.stdout:2/475: dread d3/d13/f15 [0,4194304] 0 2024-09-20T19:06:01.424 INFO:tasks.workunit.client.1.smithi098.stdout:8/611: creat d7/de/d11/d19/d30/d55/fd9 x:0 0 0 2024-09-20T19:06:01.426 INFO:tasks.workunit.client.0.smithi027.stdout:3/541: mkdir d0/d1/d5e/d1d/da7/db0 0 2024-09-20T19:06:01.427 INFO:tasks.workunit.client.0.smithi027.stdout:9/666: mknod d0/d9/df/d1b/d9c/d5a/cd7 0 2024-09-20T19:06:01.428 INFO:tasks.workunit.client.0.smithi027.stdout:5/619: dwrite d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:06:01.431 INFO:tasks.workunit.client.0.smithi027.stdout:7/537: dread d3/d8/d26/d45/d56/f7d [0,4194304] 0 2024-09-20T19:06:01.435 INFO:tasks.workunit.client.0.smithi027.stdout:4/440: dread d5/d80/f83 [0,4194304] 0 2024-09-20T19:06:01.435 INFO:tasks.workunit.client.0.smithi027.stdout:2/476: unlink d3/d13/d3c/d48/f84 0 2024-09-20T19:06:01.436 INFO:tasks.workunit.client.0.smithi027.stdout:6/542: creat d4/d15/d37/d6a/d7f/fac x:0 0 0 2024-09-20T19:06:01.437 INFO:tasks.workunit.client.0.smithi027.stdout:3/542: read - d0/d1/d13/d3c/f66 zero size 2024-09-20T19:06:01.438 INFO:tasks.workunit.client.1.smithi098.stdout:8/612: write d7/de/d11/d1f/d57/d72/f75 [913016,2] 0 2024-09-20T19:06:01.439 INFO:tasks.workunit.client.0.smithi027.stdout:3/543: chown d0/d19 978 1 2024-09-20T19:06:01.440 INFO:tasks.workunit.client.0.smithi027.stdout:9/667: chown d0/d9/df/d1c/d6a/d6d/dd/d66/c9f 15862 1 2024-09-20T19:06:01.441 INFO:tasks.workunit.client.1.smithi098.stdout:8/613: mknod d7/de/d11/d19/d47/cda 0 2024-09-20T19:06:01.441 INFO:tasks.workunit.client.0.smithi027.stdout:1/552: dwrite d2/d8/f8c [0,4194304] 0 2024-09-20T19:06:01.443 INFO:tasks.workunit.client.0.smithi027.stdout:9/668: chown d0/d9/df/d1c/d6a/d6d 73733222 1 2024-09-20T19:06:01.443 INFO:tasks.workunit.client.0.smithi027.stdout:0/618: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 x:0 0 0 2024-09-20T19:06:01.444 INFO:tasks.workunit.client.0.smithi027.stdout:6/543: creat d4/d15/d37/fad x:0 0 0 2024-09-20T19:06:01.444 INFO:tasks.workunit.client.0.smithi027.stdout:4/441: creat d5/d13/d16/f8b x:0 0 0 2024-09-20T19:06:01.444 INFO:tasks.workunit.client.0.smithi027.stdout:9/669: dread - d0/d9/df/d1b/d9c/fb4 zero size 2024-09-20T19:06:01.445 INFO:tasks.workunit.client.0.smithi027.stdout:0/619: chown d2/d48/l7b 235 1 2024-09-20T19:06:01.445 INFO:tasks.workunit.client.0.smithi027.stdout:4/442: stat d5/d13/d16 0 2024-09-20T19:06:01.446 INFO:tasks.workunit.client.0.smithi027.stdout:3/544: rmdir d0/d1/d13/d15/d55 39 2024-09-20T19:06:01.446 INFO:tasks.workunit.client.0.smithi027.stdout:0/620: chown d2/d49/d70/f89 45071 1 2024-09-20T19:06:01.447 INFO:tasks.workunit.client.1.smithi098.stdout:8/614: dwrite d7/f8 [4194304,4194304] 0 2024-09-20T19:06:01.448 INFO:tasks.workunit.client.0.smithi027.stdout:0/621: write f1 [3155094,113275] 0 2024-09-20T19:06:01.451 INFO:tasks.workunit.client.0.smithi027.stdout:7/538: mkdir d3/d8/da/dc/da9/db6 0 2024-09-20T19:06:01.451 INFO:tasks.workunit.client.0.smithi027.stdout:6/544: mkdir d4/d15/d37/d5a/d78/dae 0 2024-09-20T19:06:01.452 INFO:tasks.workunit.client.0.smithi027.stdout:4/443: dwrite d5/d13/f74 [0,4194304] 0 2024-09-20T19:06:01.456 INFO:tasks.workunit.client.1.smithi098.stdout:8/615: truncate d7/de/d11/f58 1903790 0 2024-09-20T19:06:01.459 INFO:tasks.workunit.client.0.smithi027.stdout:7/539: creat d3/d8/da/dc/da9/fb7 x:0 0 0 2024-09-20T19:06:01.461 INFO:tasks.workunit.client.0.smithi027.stdout:3/545: dwrite d0/d19/d54/f67 [0,4194304] 0 2024-09-20T19:06:01.463 INFO:tasks.workunit.client.0.smithi027.stdout:9/670: rename d0/c60 to d0/d9/df/cd8 0 2024-09-20T19:06:01.464 INFO:tasks.workunit.client.0.smithi027.stdout:9/671: write d0/d9/df/d1b/d9c/f54 [7195308,24539] 0 2024-09-20T19:06:01.464 INFO:tasks.workunit.client.0.smithi027.stdout:0/622: mknod d2/d48/d6b/d79/ce4 0 2024-09-20T19:06:01.466 INFO:tasks.workunit.client.0.smithi027.stdout:0/623: write d2/d20/fca [3697129,222] 0 2024-09-20T19:06:01.466 INFO:tasks.workunit.client.0.smithi027.stdout:6/545: symlink d4/d15/d37/d7a/laf 0 2024-09-20T19:06:01.467 INFO:tasks.workunit.client.0.smithi027.stdout:2/477: write d3/d1c/d31/f4c [452732,96] 0 2024-09-20T19:06:01.471 INFO:tasks.workunit.client.0.smithi027.stdout:7/540: mkdir d3/d8/da/d2e/d50/db8 0 2024-09-20T19:06:01.471 INFO:tasks.workunit.client.0.smithi027.stdout:8/566: dwrite d2/d14/f20 [0,4194304] 0 2024-09-20T19:06:01.471 INFO:tasks.workunit.client.0.smithi027.stdout:3/546: dread - d0/d1/f56 zero size 2024-09-20T19:06:01.473 INFO:tasks.workunit.client.0.smithi027.stdout:8/567: chown d2/d14/d13/f3b 0 1 2024-09-20T19:06:01.474 INFO:tasks.workunit.client.0.smithi027.stdout:6/546: dread d4/d15/d37/d6a/f73 [0,4194304] 0 2024-09-20T19:06:01.474 INFO:tasks.workunit.client.0.smithi027.stdout:5/620: truncate d4/d1f/d7f/f67 827711 0 2024-09-20T19:06:01.475 INFO:tasks.workunit.client.0.smithi027.stdout:7/541: chown d3/d8/da/d2e/d49/f9b 2503 1 2024-09-20T19:06:01.475 INFO:tasks.workunit.client.0.smithi027.stdout:9/672: mknod d0/d97/cd9 0 2024-09-20T19:06:01.477 INFO:tasks.workunit.client.0.smithi027.stdout:3/547: truncate d0/d1/d13/d15/d6f/f90 685664 0 2024-09-20T19:06:01.477 INFO:tasks.workunit.client.0.smithi027.stdout:6/547: write d4/d15/d37/d6a/d7f/fac [75743,96076] 0 2024-09-20T19:06:01.480 INFO:tasks.workunit.client.0.smithi027.stdout:9/673: dread - d0/d9/df/d1b/d9c/d4f/d8d/fb1 zero size 2024-09-20T19:06:01.480 INFO:tasks.workunit.client.0.smithi027.stdout:3/548: chown d0/d1/f56 0 1 2024-09-20T19:06:01.480 INFO:tasks.workunit.client.0.smithi027.stdout:4/444: rename d5/d11/d17/f20 to d5/d13/d36/d49/f8c 0 2024-09-20T19:06:01.481 INFO:tasks.workunit.client.0.smithi027.stdout:7/542: symlink d3/d8/da/d2e/d49/lb9 0 2024-09-20T19:06:01.482 INFO:tasks.workunit.client.0.smithi027.stdout:7/543: chown d3/d24/l6f 1 1 2024-09-20T19:06:01.483 INFO:tasks.workunit.client.0.smithi027.stdout:6/548: symlink d4/lb0 0 2024-09-20T19:06:01.485 INFO:tasks.workunit.client.0.smithi027.stdout:4/445: write d5/f10 [2196105,83919] 0 2024-09-20T19:06:01.489 INFO:tasks.workunit.client.0.smithi027.stdout:9/674: rename d0/d9/df/d1c/d6a/d6d/dd/l4c to d0/d9/lda 0 2024-09-20T19:06:01.491 INFO:tasks.workunit.client.0.smithi027.stdout:9/675: truncate d0/fca 629055 0 2024-09-20T19:06:01.491 INFO:tasks.workunit.client.0.smithi027.stdout:6/549: mkdir d4/d15/d37/d7a/db1 0 2024-09-20T19:06:01.491 INFO:tasks.workunit.client.0.smithi027.stdout:7/544: link d3/d8/da/d2e/d49/d8b/l43 d3/d8/da/d2e/d39/lba 0 2024-09-20T19:06:01.492 INFO:tasks.workunit.client.0.smithi027.stdout:7/545: fdatasync d3/d8/da/d2e/d49/d8b/f42 0 2024-09-20T19:06:01.493 INFO:tasks.workunit.client.0.smithi027.stdout:3/549: rename d0/d1/d13/d15/c25 to d0/d1/d13/d3c/d93/cb1 0 2024-09-20T19:06:01.494 INFO:tasks.workunit.client.0.smithi027.stdout:1/553: write d2/d8/d3b/d4b/f8f [2588352,99272] 0 2024-09-20T19:06:01.498 INFO:tasks.workunit.client.0.smithi027.stdout:4/446: write d5/d13/d16/d21/f7a [2069,94913] 0 2024-09-20T19:06:01.499 INFO:tasks.workunit.client.0.smithi027.stdout:1/554: creat d2/d8/d3b/d44/fb2 x:0 0 0 2024-09-20T19:06:01.499 INFO:tasks.workunit.client.1.smithi098.stdout:8/616: write d7/de/d11/d19/d47/f63 [1974871,102998] 0 2024-09-20T19:06:01.501 INFO:tasks.workunit.client.0.smithi027.stdout:3/550: dread d0/d1/f30 [0,4194304] 0 2024-09-20T19:06:01.502 INFO:tasks.workunit.client.0.smithi027.stdout:9/676: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb 0 2024-09-20T19:06:01.503 INFO:tasks.workunit.client.0.smithi027.stdout:9/677: fdatasync d0/d9/df/d1c/d6a/d6d/f62 0 2024-09-20T19:06:01.504 INFO:tasks.workunit.client.1.smithi098.stdout:8/617: creat d7/de/dbb/fdb x:0 0 0 2024-09-20T19:06:01.504 INFO:tasks.workunit.client.1.smithi098.stdout:8/618: dread - d7/de/f3b zero size 2024-09-20T19:06:01.505 INFO:tasks.workunit.client.0.smithi027.stdout:6/550: dread d4/d15/d37/f4a [0,4194304] 0 2024-09-20T19:06:01.506 INFO:tasks.workunit.client.0.smithi027.stdout:1/555: unlink d2/d8/d2b/f58 0 2024-09-20T19:06:01.508 INFO:tasks.workunit.client.0.smithi027.stdout:6/551: chown d4/d6/d4b/d7c/d64 1225 1 2024-09-20T19:06:01.508 INFO:tasks.workunit.client.0.smithi027.stdout:7/546: link d3/d8/da/f44 d3/d8/da/dc/da9/db6/fbb 0 2024-09-20T19:06:01.510 INFO:tasks.workunit.client.0.smithi027.stdout:4/447: rename d5/d13/d16/d21 to d5/d11/d17/d1b/d8d 0 2024-09-20T19:06:01.511 INFO:tasks.workunit.client.0.smithi027.stdout:2/478: dread d3/d1c/d26/d2a/d63/f7c [0,4194304] 0 2024-09-20T19:06:01.511 INFO:tasks.workunit.client.1.smithi098.stdout:8/619: rename d7/de/d11/d19/d30/d55/da9/fac to d7/de/dbb/fdc 0 2024-09-20T19:06:01.512 INFO:tasks.workunit.client.0.smithi027.stdout:2/479: dread - d3/d13/f4d zero size 2024-09-20T19:06:01.512 INFO:tasks.workunit.client.1.smithi098.stdout:8/620: read - d7/de/d11/d19/d30/d59/d80/fa1 zero size 2024-09-20T19:06:01.513 INFO:tasks.workunit.client.0.smithi027.stdout:0/624: write d2/d49/fae [801071,57313] 0 2024-09-20T19:06:01.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/621: rmdir d7/de/d11/d1f/dcd/db3 39 2024-09-20T19:06:01.517 INFO:tasks.workunit.client.0.smithi027.stdout:6/552: rmdir d4/d6/d4b 39 2024-09-20T19:06:01.519 INFO:tasks.workunit.client.1.smithi098.stdout:8/622: creat d7/de/d11/d1f/d57/db6/fdd x:0 0 0 2024-09-20T19:06:01.520 INFO:tasks.workunit.client.1.smithi098.stdout:8/623: dread - d7/de/d11/d19/f7e zero size 2024-09-20T19:06:01.521 INFO:tasks.workunit.client.0.smithi027.stdout:6/553: write d4/d15/d2c/f49 [501556,65195] 0 2024-09-20T19:06:01.521 INFO:tasks.workunit.client.0.smithi027.stdout:7/547: dwrite d3/d8/da/f46 [0,4194304] 0 2024-09-20T19:06:01.522 INFO:tasks.workunit.client.1.smithi098.stdout:8/624: write d7/de/d11/d19/d47/f99 [542032,74420] 0 2024-09-20T19:06:01.522 INFO:tasks.workunit.client.0.smithi027.stdout:4/448: creat d5/d13/d16/f8e x:0 0 0 2024-09-20T19:06:01.526 INFO:tasks.workunit.client.0.smithi027.stdout:9/678: dread d0/fa [0,4194304] 0 2024-09-20T19:06:01.526 INFO:tasks.workunit.client.0.smithi027.stdout:4/449: chown d5/d11/d51 212 1 2024-09-20T19:06:01.528 INFO:tasks.workunit.client.0.smithi027.stdout:0/625: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/fe5 x:0 0 0 2024-09-20T19:06:01.529 INFO:tasks.workunit.client.0.smithi027.stdout:3/551: dwrite d0/d1/d13/d15/d55/f6a [0,4194304] 0 2024-09-20T19:06:01.530 INFO:tasks.workunit.client.0.smithi027.stdout:2/480: mkdir d3/d96 0 2024-09-20T19:06:01.530 INFO:tasks.workunit.client.0.smithi027.stdout:9/679: stat d0/d9/df/d1c/f69 0 2024-09-20T19:06:01.531 INFO:tasks.workunit.client.0.smithi027.stdout:7/548: truncate d3/d8/d26/fa4 373246 0 2024-09-20T19:06:01.532 INFO:tasks.workunit.client.0.smithi027.stdout:6/554: mknod d4/d15/d2c/cb2 0 2024-09-20T19:06:01.533 INFO:tasks.workunit.client.1.smithi098.stdout:8/625: creat d7/de/d11/d19/d30/d68/fde x:0 0 0 2024-09-20T19:06:01.535 INFO:tasks.workunit.client.0.smithi027.stdout:1/556: dread d2/d8/fa0 [0,4194304] 0 2024-09-20T19:06:01.535 INFO:tasks.workunit.client.0.smithi027.stdout:6/555: fdatasync d4/f42 0 2024-09-20T19:06:01.536 INFO:tasks.workunit.client.0.smithi027.stdout:2/481: dread - d3/de/d34/f64 zero size 2024-09-20T19:06:01.536 INFO:tasks.workunit.client.0.smithi027.stdout:4/450: mkdir d5/d13/d36/d49/d8f 0 2024-09-20T19:06:01.536 INFO:tasks.workunit.client.1.smithi098.stdout:8/626: creat d7/de/d11/d1f/d57/fdf x:0 0 0 2024-09-20T19:06:01.538 INFO:tasks.workunit.client.0.smithi027.stdout:3/552: creat d0/d1/d5e/d1d/d7d/fb2 x:0 0 0 2024-09-20T19:06:01.539 INFO:tasks.workunit.client.0.smithi027.stdout:2/482: fdatasync d3/d13/d3c/d48/d6a/f8e 0 2024-09-20T19:06:01.540 INFO:tasks.workunit.client.0.smithi027.stdout:4/451: write d5/d11/d17/d1b/d8d/d26/f29 [450052,117924] 0 2024-09-20T19:06:01.543 INFO:tasks.workunit.client.0.smithi027.stdout:0/626: mkdir d2/d48/d6b/d79/d9f/da4/de6 0 2024-09-20T19:06:01.544 INFO:tasks.workunit.client.0.smithi027.stdout:9/680: dwrite d0/d9/df/d1b/d9c/d5a/fd2 [0,4194304] 0 2024-09-20T19:06:01.544 INFO:tasks.workunit.client.0.smithi027.stdout:7/549: mkdir d3/d8/da/dc/da9/dbc 0 2024-09-20T19:06:01.545 INFO:tasks.workunit.client.0.smithi027.stdout:9/681: read d0/d9/df/d1b/f23 [7877719,88646] 0 2024-09-20T19:06:01.546 INFO:tasks.workunit.client.1.smithi098.stdout:8/627: creat d7/de/d11/d1f/dcd/db3/fe0 x:0 0 0 2024-09-20T19:06:01.547 INFO:tasks.workunit.client.0.smithi027.stdout:9/682: fdatasync d0/d9/df/d1c/d6a/d6d/f13 0 2024-09-20T19:06:01.547 INFO:tasks.workunit.client.0.smithi027.stdout:6/556: creat d4/fb3 x:0 0 0 2024-09-20T19:06:01.551 INFO:tasks.workunit.client.0.smithi027.stdout:1/557: rename d2/f66 to d2/d8/d74/d9a/fb3 0 2024-09-20T19:06:01.552 INFO:tasks.workunit.client.1.smithi098.stdout:8/628: mknod d7/de/d11/d1f/d57/ce1 0 2024-09-20T19:06:01.556 INFO:tasks.workunit.client.1.smithi098.stdout:8/629: symlink d7/de/d11/d1f/d57/le2 0 2024-09-20T19:06:01.560 INFO:tasks.workunit.client.1.smithi098.stdout:8/630: unlink d7/de/d11/d1f/d57/le2 0 2024-09-20T19:06:01.561 INFO:tasks.workunit.client.1.smithi098.stdout:8/631: chown d7/de/d11/d19/daf 22338259 1 2024-09-20T19:06:01.566 INFO:tasks.workunit.client.0.smithi027.stdout:1/558: creat d2/d8/d3b/d82/d90/d9f/fb4 x:0 0 0 2024-09-20T19:06:01.567 INFO:tasks.workunit.client.0.smithi027.stdout:2/483: mknod d3/d13/d3c/c97 0 2024-09-20T19:06:01.568 INFO:tasks.workunit.client.0.smithi027.stdout:2/484: chown d3/d13/c41 9171556 1 2024-09-20T19:06:01.569 INFO:tasks.workunit.client.1.smithi098.stdout:8/632: dwrite d7/de/d11/d1f/d9c/f9e [0,4194304] 0 2024-09-20T19:06:01.569 INFO:tasks.workunit.client.0.smithi027.stdout:3/553: mkdir d0/d1/d13/d15/db3 0 2024-09-20T19:06:01.570 INFO:tasks.workunit.client.1.smithi098.stdout:8/633: write d7/de/d11/d19/f4e [3653516,101469] 0 2024-09-20T19:06:01.570 INFO:tasks.workunit.client.0.smithi027.stdout:2/485: write d3/d1c/d31/f4c [835968,5248] 0 2024-09-20T19:06:01.572 INFO:tasks.workunit.client.1.smithi098.stdout:8/634: read d7/de/d11/d19/d47/f8b [3407509,47821] 0 2024-09-20T19:06:01.572 INFO:tasks.workunit.client.0.smithi027.stdout:3/554: write d0/d1/d5e/f10 [2296186,92182] 0 2024-09-20T19:06:01.573 INFO:tasks.workunit.client.0.smithi027.stdout:9/683: symlink d0/d2e/ldc 0 2024-09-20T19:06:01.574 INFO:tasks.workunit.client.0.smithi027.stdout:2/486: chown d3/d13/f4d 14404790 1 2024-09-20T19:06:01.575 INFO:tasks.workunit.client.0.smithi027.stdout:1/559: dwrite d2/d8/d2b/f4a [0,4194304] 0 2024-09-20T19:06:01.575 INFO:tasks.workunit.client.0.smithi027.stdout:6/557: creat d4/d6/d4b/fb4 x:0 0 0 2024-09-20T19:06:01.578 INFO:tasks.workunit.client.0.smithi027.stdout:6/558: stat d4/d15/l5e 0 2024-09-20T19:06:01.578 INFO:tasks.workunit.client.0.smithi027.stdout:1/560: fdatasync d2/d61/fae 0 2024-09-20T19:06:01.582 INFO:tasks.workunit.client.0.smithi027.stdout:6/559: chown d4/d15/l21 5713715 1 2024-09-20T19:06:01.582 INFO:tasks.workunit.client.0.smithi027.stdout:4/452: creat d5/d13/f90 x:0 0 0 2024-09-20T19:06:01.582 INFO:tasks.workunit.client.0.smithi027.stdout:4/453: readlink d5/d11/d17/d1b/d8d/l72 0 2024-09-20T19:06:01.586 INFO:tasks.workunit.client.0.smithi027.stdout:4/454: dread d5/d11/d17/d1b/d8d/d3a/f4e [0,4194304] 0 2024-09-20T19:06:01.587 INFO:tasks.workunit.client.0.smithi027.stdout:4/455: write d5/d13/f74 [1098123,80344] 0 2024-09-20T19:06:01.588 INFO:tasks.workunit.client.0.smithi027.stdout:4/456: chown d5/d11/d17/d53 16 1 2024-09-20T19:06:01.588 INFO:tasks.workunit.client.0.smithi027.stdout:1/561: mknod d2/d8/d3b/d82/cb5 0 2024-09-20T19:06:01.589 INFO:tasks.workunit.client.0.smithi027.stdout:6/560: fdatasync d4/d15/d37/d7a/f77 0 2024-09-20T19:06:01.589 INFO:tasks.workunit.client.0.smithi027.stdout:1/562: chown d2/d8/d41/c9c 0 1 2024-09-20T19:06:01.590 INFO:tasks.workunit.client.0.smithi027.stdout:7/550: getdents d3/d8/da/d2e 0 2024-09-20T19:06:01.591 INFO:tasks.workunit.client.0.smithi027.stdout:3/555: fsync d0/f5 0 2024-09-20T19:06:01.593 INFO:tasks.workunit.client.0.smithi027.stdout:9/684: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/fdd x:0 0 0 2024-09-20T19:06:01.594 INFO:tasks.workunit.client.0.smithi027.stdout:2/487: rename d3/d1c/f47 to d3/d1c/d26/d2a/d63/f98 0 2024-09-20T19:06:01.595 INFO:tasks.workunit.client.0.smithi027.stdout:9/685: write d0/fc8 [408093,42437] 0 2024-09-20T19:06:01.596 INFO:tasks.workunit.client.0.smithi027.stdout:6/561: mknod d4/d1b/cb5 0 2024-09-20T19:06:01.597 INFO:tasks.workunit.client.0.smithi027.stdout:3/556: write d0/d1/d13/d15/d55/d70/faa [106884,41726] 0 2024-09-20T19:06:01.598 INFO:tasks.workunit.client.0.smithi027.stdout:2/488: read d3/d1c/d31/f4c [716755,36267] 0 2024-09-20T19:06:01.599 INFO:tasks.workunit.client.0.smithi027.stdout:4/457: dwrite d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:01.600 INFO:tasks.workunit.client.0.smithi027.stdout:9/686: chown d0/d9/df/d1b/d9c/d5a 1 1 2024-09-20T19:06:01.600 INFO:tasks.workunit.client.0.smithi027.stdout:7/551: getdents d3/d8/da/d2e/d50/db8 0 2024-09-20T19:06:01.601 INFO:tasks.workunit.client.0.smithi027.stdout:4/458: dread - d5/d13/f90 zero size 2024-09-20T19:06:01.602 INFO:tasks.workunit.client.0.smithi027.stdout:6/562: creat d4/d15/d37/d6a/fb6 x:0 0 0 2024-09-20T19:06:01.603 INFO:tasks.workunit.client.0.smithi027.stdout:1/563: creat d2/d8/d74/fb6 x:0 0 0 2024-09-20T19:06:01.604 INFO:tasks.workunit.client.0.smithi027.stdout:3/557: fsync d0/d38/f99 0 2024-09-20T19:06:01.604 INFO:tasks.workunit.client.0.smithi027.stdout:9/687: chown d0/d9/df/d1c/d6a/d6d/dd/d66/d79/l85 2334769 1 2024-09-20T19:06:01.605 INFO:tasks.workunit.client.0.smithi027.stdout:2/489: rename d3/de/f1f to d3/d24/d8b/f99 0 2024-09-20T19:06:01.606 INFO:tasks.workunit.client.1.smithi098.stdout:8/635: truncate d7/de/d11/d1f/d57/fc2 820166 0 2024-09-20T19:06:01.606 INFO:tasks.workunit.client.0.smithi027.stdout:1/564: write d2/d8/d3b/d82/d87/fa5 [808142,12538] 0 2024-09-20T19:06:01.608 INFO:tasks.workunit.client.0.smithi027.stdout:7/552: mknod d3/d8/d26/cbd 0 2024-09-20T19:06:01.611 INFO:tasks.workunit.client.0.smithi027.stdout:4/459: rename d5/d80/f83 to d5/d11/d17/d1b/f91 0 2024-09-20T19:06:01.613 INFO:tasks.workunit.client.0.smithi027.stdout:4/460: write d5/d11/d1a/f81 [960773,60493] 0 2024-09-20T19:06:01.613 INFO:tasks.workunit.client.0.smithi027.stdout:1/565: mknod d2/d8/d3b/d82/cb7 0 2024-09-20T19:06:01.616 INFO:tasks.workunit.client.0.smithi027.stdout:7/553: rmdir d3/d8/da/d2e/d49/d8b 39 2024-09-20T19:06:01.617 INFO:tasks.workunit.client.0.smithi027.stdout:3/558: rename d0/d1/d13/d15/d76 to d0/d1/d5e/d1d/d7d/db4 0 2024-09-20T19:06:01.619 INFO:tasks.workunit.client.0.smithi027.stdout:2/490: dread d3/d24/d8b/f99 [0,4194304] 0 2024-09-20T19:06:01.620 INFO:tasks.workunit.client.0.smithi027.stdout:1/566: symlink d2/d8/d2b/d2d/d73/lb8 0 2024-09-20T19:06:01.620 INFO:tasks.workunit.client.0.smithi027.stdout:2/491: readlink d3/d13/d3c/d48/l56 0 2024-09-20T19:06:01.621 INFO:tasks.workunit.client.0.smithi027.stdout:7/554: stat d3/d8/da/d2e/d49/d8b/f7a 0 2024-09-20T19:06:01.622 INFO:tasks.workunit.client.0.smithi027.stdout:7/555: fsync d3/d8/d1c/d61/f89 0 2024-09-20T19:06:01.623 INFO:tasks.workunit.client.0.smithi027.stdout:3/559: unlink d0/d1/d5e/d1d/d7d/fb2 0 2024-09-20T19:06:01.623 INFO:tasks.workunit.client.0.smithi027.stdout:7/556: write d3/d8/da/d2e/d50/f8e [87513,56071] 0 2024-09-20T19:06:01.625 INFO:tasks.workunit.client.0.smithi027.stdout:4/461: symlink d5/d13/d70/l92 0 2024-09-20T19:06:01.627 INFO:tasks.workunit.client.0.smithi027.stdout:4/462: chown d5/d11/d1a/d2a/c5a 1528 1 2024-09-20T19:06:01.628 INFO:tasks.workunit.client.0.smithi027.stdout:1/567: rmdir d2/d8/d3b/d44/d96 39 2024-09-20T19:06:01.631 INFO:tasks.workunit.client.0.smithi027.stdout:9/688: dread d0/d9/df/d1c/d6a/d6d/f62 [0,4194304] 0 2024-09-20T19:06:01.631 INFO:tasks.workunit.client.0.smithi027.stdout:6/563: truncate d4/d6/f56 724153 0 2024-09-20T19:06:01.633 INFO:tasks.workunit.client.0.smithi027.stdout:1/568: creat d2/d8/d3b/fb9 x:0 0 0 2024-09-20T19:06:01.635 INFO:tasks.workunit.client.0.smithi027.stdout:4/463: dwrite d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:01.636 INFO:tasks.workunit.client.0.smithi027.stdout:1/569: chown d2/d8/d3b/c8b 44531509 1 2024-09-20T19:06:01.638 INFO:tasks.workunit.client.0.smithi027.stdout:3/560: link d0/d1/d13/d15/f29 d0/d1/d5e/d1d/fb5 0 2024-09-20T19:06:01.640 INFO:tasks.workunit.client.0.smithi027.stdout:9/689: readlink d0/d2e/l31 0 2024-09-20T19:06:01.640 INFO:tasks.workunit.client.0.smithi027.stdout:6/564: dwrite d4/f7 [12582912,4194304] 0 2024-09-20T19:06:01.642 INFO:tasks.workunit.client.0.smithi027.stdout:6/565: chown d4/d15/d37/d7a/d46/d53/l60 692669 1 2024-09-20T19:06:01.648 INFO:tasks.workunit.client.0.smithi027.stdout:2/492: truncate d3/d13/f25 3136199 0 2024-09-20T19:06:01.649 INFO:tasks.workunit.client.0.smithi027.stdout:4/464: mknod d5/d13/d36/d49/d8f/c93 0 2024-09-20T19:06:01.649 INFO:tasks.workunit.client.0.smithi027.stdout:2/493: chown d3/de/c7b 0 1 2024-09-20T19:06:01.649 INFO:tasks.workunit.client.0.smithi027.stdout:6/566: mkdir d4/d15/d37/d6a/db7 0 2024-09-20T19:06:01.650 INFO:tasks.workunit.client.0.smithi027.stdout:6/567: chown d4/d15/d37/d6a/fb6 9383 1 2024-09-20T19:06:01.652 INFO:tasks.workunit.client.0.smithi027.stdout:6/568: write d4/d6/d4b/d7c/d64/f68 [58735,16600] 0 2024-09-20T19:06:01.653 INFO:tasks.workunit.client.0.smithi027.stdout:7/557: link d3/d8/da/dc/l90 d3/d8/da/d2e/d49/lbe 0 2024-09-20T19:06:01.653 INFO:tasks.workunit.client.0.smithi027.stdout:3/561: link d0/d38/f99 d0/d1/d13/d64/fb6 0 2024-09-20T19:06:01.654 INFO:tasks.workunit.client.0.smithi027.stdout:3/562: fdatasync d0/d1/d5e/d1d/f84 0 2024-09-20T19:06:01.654 INFO:tasks.workunit.client.0.smithi027.stdout:9/690: creat d0/d9/df/d1b/d9c/fde x:0 0 0 2024-09-20T19:06:01.655 INFO:tasks.workunit.client.0.smithi027.stdout:2/494: creat d3/d96/f9a x:0 0 0 2024-09-20T19:06:01.656 INFO:tasks.workunit.client.0.smithi027.stdout:6/569: write d4/d6/f11 [3979560,16299] 0 2024-09-20T19:06:01.659 INFO:tasks.workunit.client.0.smithi027.stdout:3/563: rename d0/d1/d5e/f10 to d0/d1/d5e/d1d/da7/db0/fb7 0 2024-09-20T19:06:01.659 INFO:tasks.workunit.client.0.smithi027.stdout:6/570: write d4/d15/d37/d7a/f77 [82027,17365] 0 2024-09-20T19:06:01.659 INFO:tasks.workunit.client.0.smithi027.stdout:6/571: fdatasync d4/d15/d37/d7a/f58 0 2024-09-20T19:06:01.674 INFO:tasks.workunit.client.0.smithi027.stdout:9/691: mknod d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/cdf 0 2024-09-20T19:06:01.675 INFO:tasks.workunit.client.0.smithi027.stdout:2/495: symlink d3/d24/d89/l9b 0 2024-09-20T19:06:01.675 INFO:tasks.workunit.client.0.smithi027.stdout:1/570: truncate d2/d8/f20 1859087 0 2024-09-20T19:06:01.676 INFO:tasks.workunit.client.0.smithi027.stdout:6/572: symlink d4/d15/d37/d6a/da5/lb8 0 2024-09-20T19:06:01.677 INFO:tasks.workunit.client.0.smithi027.stdout:1/571: creat d2/d8/d3b/fba x:0 0 0 2024-09-20T19:06:01.678 INFO:tasks.workunit.client.0.smithi027.stdout:2/496: creat d3/f9c x:0 0 0 2024-09-20T19:06:01.679 INFO:tasks.workunit.client.0.smithi027.stdout:9/692: link d0/d9/df/d1b/d9c/da4/fb0 d0/d9/df/d1b/d64/fe0 0 2024-09-20T19:06:01.680 INFO:tasks.workunit.client.0.smithi027.stdout:2/497: rmdir d3/d13/d3c/d48 39 2024-09-20T19:06:01.681 INFO:tasks.workunit.client.0.smithi027.stdout:4/465: dread d5/fa [4194304,4194304] 0 2024-09-20T19:06:01.681 INFO:tasks.workunit.client.0.smithi027.stdout:1/572: symlink d2/d8/d74/d84/lbb 0 2024-09-20T19:06:01.681 INFO:tasks.workunit.client.0.smithi027.stdout:9/693: dread d0/fca [0,4194304] 0 2024-09-20T19:06:01.682 INFO:tasks.workunit.client.0.smithi027.stdout:4/466: chown d5/d13/d70/l92 29768933 1 2024-09-20T19:06:01.682 INFO:tasks.workunit.client.0.smithi027.stdout:6/573: link d4/d15/d37/d7a/d46/d53/l72 d4/d15/d37/d7a/d33/lb9 0 2024-09-20T19:06:01.685 INFO:tasks.workunit.client.0.smithi027.stdout:1/573: rename d2/d8/d3b/d44/d93/l99 to d2/d8/d2b/lbc 0 2024-09-20T19:06:01.685 INFO:tasks.workunit.client.0.smithi027.stdout:4/467: creat d5/d11/d1a/d2a/f94 x:0 0 0 2024-09-20T19:06:01.686 INFO:tasks.workunit.client.0.smithi027.stdout:1/574: truncate d2/d1b/f7b 813094 0 2024-09-20T19:06:01.688 INFO:tasks.workunit.client.0.smithi027.stdout:1/575: chown d2/d8/f52 364853526 1 2024-09-20T19:06:01.690 INFO:tasks.workunit.client.0.smithi027.stdout:6/574: link d4/d15/d37/d7a/d46/f71 d4/d15/d37/d7a/fba 0 2024-09-20T19:06:01.691 INFO:tasks.workunit.client.0.smithi027.stdout:1/576: mknod d2/d8/d2b/d2d/d73/cbd 0 2024-09-20T19:06:01.691 INFO:tasks.workunit.client.0.smithi027.stdout:6/575: write d4/d15/d37/d6a/d7f/f92 [237168,97200] 0 2024-09-20T19:06:01.694 INFO:tasks.workunit.client.0.smithi027.stdout:4/468: link d5/fa d5/d13/d36/d48/d3f/f95 0 2024-09-20T19:06:01.694 INFO:tasks.workunit.client.0.smithi027.stdout:2/498: dread d3/d24/f38 [0,4194304] 0 2024-09-20T19:06:01.695 INFO:tasks.workunit.client.0.smithi027.stdout:6/576: dread d4/d15/d37/d6a/d7f/fac [0,4194304] 0 2024-09-20T19:06:01.695 INFO:tasks.workunit.client.0.smithi027.stdout:4/469: readlink d5/d13/d36/l82 0 2024-09-20T19:06:01.697 INFO:tasks.workunit.client.0.smithi027.stdout:2/499: mknod d3/d24/d89/c9d 0 2024-09-20T19:06:01.698 INFO:tasks.workunit.client.0.smithi027.stdout:1/577: getdents d2/d8/d41 0 2024-09-20T19:06:01.698 INFO:tasks.workunit.client.0.smithi027.stdout:2/500: chown d3/d1c/c1d 41461 1 2024-09-20T19:06:01.700 INFO:tasks.workunit.client.0.smithi027.stdout:2/501: write d3/d13/f87 [1705202,110819] 0 2024-09-20T19:06:01.702 INFO:tasks.workunit.client.0.smithi027.stdout:4/470: dread d5/d13/d36/d48/d3f/f95 [4194304,4194304] 0 2024-09-20T19:06:01.704 INFO:tasks.workunit.client.0.smithi027.stdout:1/578: rename d2/d1b/d56/d71/f8e to d2/d8/d3b/d82/d90/fbe 0 2024-09-20T19:06:01.705 INFO:tasks.workunit.client.0.smithi027.stdout:6/577: getdents d4/d15/d37/d5a/d78 0 2024-09-20T19:06:01.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/579: fdatasync d2/d8/d2b/f9d 0 2024-09-20T19:06:01.706 INFO:tasks.workunit.client.0.smithi027.stdout:2/502: mkdir d3/d1c/d31/d9e 0 2024-09-20T19:06:01.707 INFO:tasks.workunit.client.0.smithi027.stdout:6/578: dread - d4/d15/d37/d7a/f58 zero size 2024-09-20T19:06:01.707 INFO:tasks.workunit.client.0.smithi027.stdout:9/694: dwrite d0/d9/df/d1c/d6a/d6d/f36 [0,4194304] 0 2024-09-20T19:06:01.710 INFO:tasks.workunit.client.0.smithi027.stdout:2/503: readlink d3/d13/d3c/d48/l5c 0 2024-09-20T19:06:01.710 INFO:tasks.workunit.client.0.smithi027.stdout:4/471: fsync d5/d13/d36/d49/f8c 0 2024-09-20T19:06:01.711 INFO:tasks.workunit.client.0.smithi027.stdout:6/579: rmdir d4/d15/d37/d6a/d91 39 2024-09-20T19:06:01.712 INFO:tasks.workunit.client.0.smithi027.stdout:9/695: creat d0/d9/df/da2/fe1 x:0 0 0 2024-09-20T19:06:01.713 INFO:tasks.workunit.client.0.smithi027.stdout:2/504: unlink d3/f9c 0 2024-09-20T19:06:01.714 INFO:tasks.workunit.client.0.smithi027.stdout:2/505: stat d3/d1c/d26/d75/f82 0 2024-09-20T19:06:01.714 INFO:tasks.workunit.client.0.smithi027.stdout:4/472: mkdir d5/d13/d36/d48/d3f/d4c/d52/d96 0 2024-09-20T19:06:01.715 INFO:tasks.workunit.client.0.smithi027.stdout:9/696: read d0/d9/df/d1b/d9c/d4f/d8d/da0/fb8 [2599479,73479] 0 2024-09-20T19:06:01.716 INFO:tasks.workunit.client.0.smithi027.stdout:4/473: readlink d5/d11/d17/d53/l57 0 2024-09-20T19:06:01.717 INFO:tasks.workunit.client.0.smithi027.stdout:6/580: symlink d4/d15/d37/d7a/d33/lbb 0 2024-09-20T19:06:01.719 INFO:tasks.workunit.client.0.smithi027.stdout:9/697: creat d0/d9/df/d1b/d9c/d5a/fe2 x:0 0 0 2024-09-20T19:06:01.720 INFO:tasks.workunit.client.0.smithi027.stdout:2/506: truncate d3/d1c/d26/d2a/d63/f98 1230099 0 2024-09-20T19:06:01.726 INFO:tasks.workunit.client.0.smithi027.stdout:6/581: write d4/d15/d2c/f4c [1229089,129527] 0 2024-09-20T19:06:01.727 INFO:tasks.workunit.client.0.smithi027.stdout:9/698: write d0/d9/f44 [349757,130954] 0 2024-09-20T19:06:01.729 INFO:tasks.workunit.client.0.smithi027.stdout:6/582: readlink d4/d15/d37/d7a/laf 0 2024-09-20T19:06:01.731 INFO:tasks.workunit.client.0.smithi027.stdout:6/583: fsync d4/f7 0 2024-09-20T19:06:01.732 INFO:tasks.workunit.client.0.smithi027.stdout:9/699: rename d0/c6b to d0/d9/ce3 0 2024-09-20T19:06:01.736 INFO:tasks.workunit.client.0.smithi027.stdout:2/507: dwrite d3/d1c/d26/d2a/d63/f98 [0,4194304] 0 2024-09-20T19:06:01.737 INFO:tasks.workunit.client.0.smithi027.stdout:9/700: truncate d0/d9/df/f74 1111147 0 2024-09-20T19:06:01.742 INFO:tasks.workunit.client.0.smithi027.stdout:4/474: dread d5/d11/d3d/d6e/f6b [0,4194304] 0 2024-09-20T19:06:01.742 INFO:tasks.workunit.client.0.smithi027.stdout:9/701: chown d0/d9/df/d1c/d6a/d6d/dd/lbf 3382 1 2024-09-20T19:06:01.743 INFO:tasks.workunit.client.0.smithi027.stdout:9/702: stat d0/f7d 0 2024-09-20T19:06:01.745 INFO:tasks.workunit.client.0.smithi027.stdout:4/475: write d5/d11/f23 [8905601,120218] 0 2024-09-20T19:06:01.747 INFO:tasks.workunit.client.0.smithi027.stdout:2/508: dwrite d3/d1c/f23 [0,4194304] 0 2024-09-20T19:06:01.748 INFO:tasks.workunit.client.0.smithi027.stdout:6/584: dwrite d4/d6/f88 [0,4194304] 0 2024-09-20T19:06:01.748 INFO:tasks.workunit.client.0.smithi027.stdout:9/703: creat d0/d9/df/d1b/fe4 x:0 0 0 2024-09-20T19:06:01.752 INFO:tasks.workunit.client.0.smithi027.stdout:4/476: creat d5/d13/d36/d48/f97 x:0 0 0 2024-09-20T19:06:01.753 INFO:tasks.workunit.client.0.smithi027.stdout:4/477: readlink d5/d11/d51/l73 0 2024-09-20T19:06:01.753 INFO:tasks.workunit.client.0.smithi027.stdout:9/704: rmdir d0/d9/df/d1c/d6a/d9a 39 2024-09-20T19:06:01.755 INFO:tasks.workunit.client.0.smithi027.stdout:6/585: fsync d4/d15/d37/d7a/d46/d53/f96 0 2024-09-20T19:06:01.757 INFO:tasks.workunit.client.0.smithi027.stdout:6/586: readlink d4/d15/d37/d39/l94 0 2024-09-20T19:06:01.760 INFO:tasks.workunit.client.0.smithi027.stdout:2/509: dwrite d3/d24/f80 [0,4194304] 0 2024-09-20T19:06:01.760 INFO:tasks.workunit.client.0.smithi027.stdout:9/705: mkdir d0/d9/df/d1c/d6a/d6d/de5 0 2024-09-20T19:06:01.760 INFO:tasks.workunit.client.0.smithi027.stdout:4/478: dread d5/d11/d17/d1b/d8d/d3a/f4e [0,4194304] 0 2024-09-20T19:06:01.763 INFO:tasks.workunit.client.0.smithi027.stdout:9/706: readlink d0/d9/df/l96 0 2024-09-20T19:06:01.764 INFO:tasks.workunit.client.0.smithi027.stdout:4/479: fsync d5/d11/f23 0 2024-09-20T19:06:01.769 INFO:tasks.workunit.client.0.smithi027.stdout:4/480: truncate d5/d13/f30 4551008 0 2024-09-20T19:06:01.771 INFO:tasks.workunit.client.0.smithi027.stdout:6/587: dwrite d4/d15/f69 [4194304,4194304] 0 2024-09-20T19:06:01.773 INFO:tasks.workunit.client.0.smithi027.stdout:2/510: dread d3/d1c/d26/d2a/d63/f98 [0,4194304] 0 2024-09-20T19:06:01.774 INFO:tasks.workunit.client.0.smithi027.stdout:2/511: chown d3/d13/d3c/d48/f74 10520459 1 2024-09-20T19:06:01.775 INFO:tasks.workunit.client.0.smithi027.stdout:9/707: write d0/d9/df/d1c/fb2 [4785148,56462] 0 2024-09-20T19:06:01.776 INFO:tasks.workunit.client.0.smithi027.stdout:9/708: fdatasync d0/d9/df/f24 0 2024-09-20T19:06:01.777 INFO:tasks.workunit.client.0.smithi027.stdout:2/512: creat d3/d1c/d26/f9f x:0 0 0 2024-09-20T19:06:01.780 INFO:tasks.workunit.client.0.smithi027.stdout:2/513: write d3/d1c/d26/d75/f82 [467686,57494] 0 2024-09-20T19:06:01.781 INFO:tasks.workunit.client.0.smithi027.stdout:9/709: mknod d0/d9/df/d1b/d9c/d5a/ce6 0 2024-09-20T19:06:01.782 INFO:tasks.workunit.client.0.smithi027.stdout:9/710: chown d0/d9/df/d1b/d9c/d5a/cc0 248364 1 2024-09-20T19:06:01.783 INFO:tasks.workunit.client.0.smithi027.stdout:2/514: creat d3/d1c/d26/d2a/d63/d6f/fa0 x:0 0 0 2024-09-20T19:06:01.785 INFO:tasks.workunit.client.0.smithi027.stdout:6/588: dread d4/d6/f11 [0,4194304] 0 2024-09-20T19:06:01.785 INFO:tasks.workunit.client.0.smithi027.stdout:6/589: stat d4/d15/f4f 0 2024-09-20T19:06:01.796 INFO:tasks.workunit.client.0.smithi027.stdout:4/481: truncate d5/d13/d36/d59/f5b 782584 0 2024-09-20T19:06:01.798 INFO:tasks.workunit.client.0.smithi027.stdout:9/711: truncate d0/d9/df/d1b/d9c/d4f/d8d/da0/fb8 1963832 0 2024-09-20T19:06:01.799 INFO:tasks.workunit.client.0.smithi027.stdout:4/482: getdents d5/d11/d17 0 2024-09-20T19:06:01.801 INFO:tasks.workunit.client.0.smithi027.stdout:9/712: rename d0/d9/df/d1b/d9c/d5a/cd7 to d0/d9/df/d1c/d6a/d6d/dd/d58/ce7 0 2024-09-20T19:06:01.803 INFO:tasks.workunit.client.0.smithi027.stdout:4/483: dread d5/d11/d3d/d6e/f6b [0,4194304] 0 2024-09-20T19:06:01.804 INFO:tasks.workunit.client.0.smithi027.stdout:9/713: rename d0/d9/df/f9e to d0/d9/df/d57/fe8 0 2024-09-20T19:06:01.810 INFO:tasks.workunit.client.0.smithi027.stdout:4/484: write d5/d13/d36/d48/d3f/f95 [2579444,40584] 0 2024-09-20T19:06:01.812 INFO:tasks.workunit.client.0.smithi027.stdout:4/485: creat d5/d13/f98 x:0 0 0 2024-09-20T19:06:01.826 INFO:tasks.workunit.client.0.smithi027.stdout:8/568: sync 2024-09-20T19:06:01.829 INFO:tasks.workunit.client.0.smithi027.stdout:8/569: creat d2/d3/d6/d6d/fb7 x:0 0 0 2024-09-20T19:06:01.841 INFO:tasks.workunit.client.0.smithi027.stdout:4/486: dread d5/f34 [0,4194304] 0 2024-09-20T19:06:01.842 INFO:tasks.workunit.client.0.smithi027.stdout:4/487: rmdir d5/d13/d36/d60 39 2024-09-20T19:06:01.843 INFO:tasks.workunit.client.0.smithi027.stdout:4/488: chown d5/d11/d17/d1b/d8d/d3a/f5e 0 1 2024-09-20T19:06:01.846 INFO:tasks.workunit.client.0.smithi027.stdout:4/489: rename d5/d11/d17/d53 to d5/d13/d36/d48/d3f/d4c/d52/d87/d99 0 2024-09-20T19:06:01.848 INFO:tasks.workunit.client.0.smithi027.stdout:4/490: symlink d5/d13/d36/d48/d3f/d7e/l9a 0 2024-09-20T19:06:01.861 INFO:tasks.workunit.client.0.smithi027.stdout:4/491: dread d5/d13/d36/d48/d3f/d4c/f55 [0,4194304] 0 2024-09-20T19:06:01.864 INFO:tasks.workunit.client.0.smithi027.stdout:4/492: rename d5/d11/d17/d1b/d8d/d3a to d5/d9b 0 2024-09-20T19:06:01.870 INFO:tasks.workunit.client.0.smithi027.stdout:4/493: dwrite d5/d11/d17/d1b/f5f [0,4194304] 0 2024-09-20T19:06:01.871 INFO:tasks.workunit.client.0.smithi027.stdout:4/494: write d5/fa [2672353,43429] 0 2024-09-20T19:06:01.874 INFO:tasks.workunit.client.0.smithi027.stdout:4/495: creat d5/d13/d7c/f9c x:0 0 0 2024-09-20T19:06:01.875 INFO:tasks.workunit.client.0.smithi027.stdout:4/496: mknod d5/d11/d1a/d2a/c9d 0 2024-09-20T19:06:01.876 INFO:tasks.workunit.client.0.smithi027.stdout:4/497: stat d5/d13/d36/d48/d3f/d7e/l9a 0 2024-09-20T19:06:01.877 INFO:tasks.workunit.client.0.smithi027.stdout:4/498: fdatasync d5/d11/d3d/d6e/f75 0 2024-09-20T19:06:01.878 INFO:tasks.workunit.client.1.smithi098.stdout:0/339: sync 2024-09-20T19:06:01.891 INFO:tasks.workunit.client.0.smithi027.stdout:4/499: truncate d5/d11/d17/d1b/d8d/d26/f29 3348896 0 2024-09-20T19:06:01.893 INFO:tasks.workunit.client.0.smithi027.stdout:4/500: symlink d5/d11/d1a/l9e 0 2024-09-20T19:06:01.893 INFO:tasks.workunit.client.0.smithi027.stdout:5/621: sync 2024-09-20T19:06:01.894 INFO:tasks.workunit.client.0.smithi027.stdout:0/627: sync 2024-09-20T19:06:01.894 INFO:tasks.workunit.client.1.smithi098.stdout:0/340: dwrite d0/d6/fe [4194304,4194304] 0 2024-09-20T19:06:01.894 INFO:tasks.workunit.client.0.smithi027.stdout:0/628: chown d2/d49/f45 30351 1 2024-09-20T19:06:01.897 INFO:tasks.workunit.client.0.smithi027.stdout:5/622: unlink d4/da/de/d3e/d69/d75/d3d/f8e 0 2024-09-20T19:06:01.898 INFO:tasks.workunit.client.1.smithi098.stdout:0/341: mkdir d0/d6/d28/d31/d45/d60 0 2024-09-20T19:06:01.900 INFO:tasks.workunit.client.0.smithi027.stdout:4/501: dwrite d5/d11/d17/d1b/d8d/f33 [0,4194304] 0 2024-09-20T19:06:01.902 INFO:tasks.workunit.client.1.smithi098.stdout:0/342: rmdir d0/d55/d38 39 2024-09-20T19:06:01.903 INFO:tasks.workunit.client.0.smithi027.stdout:5/623: symlink d4/d1f/d7f/lca 0 2024-09-20T19:06:01.904 INFO:tasks.workunit.client.0.smithi027.stdout:0/629: mknod d2/d48/d6b/d79/d84/d1b/d39/dc7/ce7 0 2024-09-20T19:06:01.907 INFO:tasks.workunit.client.0.smithi027.stdout:0/630: dread - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 zero size 2024-09-20T19:06:01.909 INFO:tasks.workunit.client.0.smithi027.stdout:4/502: mkdir d5/d13/d36/d48/d9f 0 2024-09-20T19:06:01.911 INFO:tasks.workunit.client.0.smithi027.stdout:5/624: write d4/d6c/d6f/d92/fc0 [4454605,103115] 0 2024-09-20T19:06:01.914 INFO:tasks.workunit.client.0.smithi027.stdout:4/503: rename d5/d11/d1a/d2a/f94 to d5/d11/d17/d1b/fa0 0 2024-09-20T19:06:01.916 INFO:tasks.workunit.client.0.smithi027.stdout:5/625: getdents d4/d1f/d91 0 2024-09-20T19:06:01.916 INFO:tasks.workunit.client.0.smithi027.stdout:0/631: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/f46 [0,4194304] 0 2024-09-20T19:06:01.918 INFO:tasks.workunit.client.0.smithi027.stdout:4/504: creat d5/d13/d36/d48/d3f/d4c/d52/fa1 x:0 0 0 2024-09-20T19:06:01.923 INFO:tasks.workunit.client.1.smithi098.stdout:0/343: write d0/db/f20 [430153,46125] 0 2024-09-20T19:06:01.924 INFO:tasks.workunit.client.1.smithi098.stdout:0/344: dread - d0/f4a zero size 2024-09-20T19:06:01.925 INFO:tasks.workunit.client.0.smithi027.stdout:4/505: creat d5/d13/d36/d48/d3f/d4c/d52/fa2 x:0 0 0 2024-09-20T19:06:01.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/345: dread d0/db/f17 [0,4194304] 0 2024-09-20T19:06:01.927 INFO:tasks.workunit.client.0.smithi027.stdout:4/506: write d5/d11/d17/d1b/d8d/f33 [63372,75670] 0 2024-09-20T19:06:01.930 INFO:tasks.workunit.client.0.smithi027.stdout:5/626: write d4/da/de/d3e/f59 [728345,98441] 0 2024-09-20T19:06:01.931 INFO:tasks.workunit.client.0.smithi027.stdout:0/632: truncate d2/d20/fc1 344364 0 2024-09-20T19:06:01.932 INFO:tasks.workunit.client.0.smithi027.stdout:5/627: fsync d4/da/de/d3e/db7/fb9 0 2024-09-20T19:06:01.935 INFO:tasks.workunit.client.0.smithi027.stdout:4/507: dwrite d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:01.936 INFO:tasks.workunit.client.0.smithi027.stdout:0/633: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [2711397,26973] 0 2024-09-20T19:06:01.937 INFO:tasks.workunit.client.0.smithi027.stdout:0/634: dread - d2/d48/d6b/d79/d84/d1b/dc5/d2e/fe5 zero size 2024-09-20T19:06:01.938 INFO:tasks.workunit.client.0.smithi027.stdout:5/628: creat d4/da/de/d3e/d69/d6a/fcb x:0 0 0 2024-09-20T19:06:01.940 INFO:tasks.workunit.client.0.smithi027.stdout:0/635: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/l9d 0 2024-09-20T19:06:01.944 INFO:tasks.workunit.client.0.smithi027.stdout:4/508: dwrite d5/d13/d36/d48/d3f/d4c/d52/d87/d99/f61 [0,4194304] 0 2024-09-20T19:06:01.944 INFO:tasks.workunit.client.0.smithi027.stdout:5/629: rename d4/da/de/d3e/l83 to d4/da/d1a/lcc 0 2024-09-20T19:06:01.946 INFO:tasks.workunit.client.0.smithi027.stdout:0/636: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/le8 0 2024-09-20T19:06:01.949 INFO:tasks.workunit.client.1.smithi098.stdout:0/346: dread d0/db/fd [0,4194304] 0 2024-09-20T19:06:01.951 INFO:tasks.workunit.client.0.smithi027.stdout:0/637: mknod d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/ce9 0 2024-09-20T19:06:01.952 INFO:tasks.workunit.client.1.smithi098.stdout:0/347: creat d0/d6/f61 x:0 0 0 2024-09-20T19:06:01.953 INFO:tasks.workunit.client.0.smithi027.stdout:0/638: chown d2/d48/d6b/d79/d84/d1b/d39/dc7 27873 1 2024-09-20T19:06:01.954 INFO:tasks.workunit.client.0.smithi027.stdout:5/630: dwrite d4/da/d1a/f4f [0,4194304] 0 2024-09-20T19:06:01.955 INFO:tasks.workunit.client.0.smithi027.stdout:5/631: chown d4/da/d98 237469101 1 2024-09-20T19:06:01.956 INFO:tasks.workunit.client.0.smithi027.stdout:5/632: stat d4/da/de/d3e/d44/fa6 0 2024-09-20T19:06:01.957 INFO:tasks.workunit.client.1.smithi098.stdout:0/348: rename d0/d55/l1b to d0/d55/d38/l62 0 2024-09-20T19:06:01.957 INFO:tasks.workunit.client.0.smithi027.stdout:0/639: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/f54 0 2024-09-20T19:06:01.958 INFO:tasks.workunit.client.0.smithi027.stdout:5/633: symlink d4/d6c/lcd 0 2024-09-20T19:06:01.966 INFO:tasks.workunit.client.1.smithi098.stdout:0/349: rename d0/d55/c40 to d0/d55/c63 0 2024-09-20T19:06:01.968 INFO:tasks.workunit.client.0.smithi027.stdout:5/634: unlink d4/da/de/d3e/d61/f5e 0 2024-09-20T19:06:01.969 INFO:tasks.workunit.client.0.smithi027.stdout:5/635: stat d4/da/cbf 0 2024-09-20T19:06:01.969 INFO:tasks.workunit.client.0.smithi027.stdout:5/636: readlink d4/da/de/d3e/db7/dc2/la7 0 2024-09-20T19:06:01.971 INFO:tasks.workunit.client.1.smithi098.stdout:0/350: unlink d0/db/d32/f3a 0 2024-09-20T19:06:01.972 INFO:tasks.workunit.client.0.smithi027.stdout:4/509: dread d5/d11/d3d/d6e/f75 [0,4194304] 0 2024-09-20T19:06:01.973 INFO:tasks.workunit.client.1.smithi098.stdout:0/351: rmdir d0/db/d1d 39 2024-09-20T19:06:01.974 INFO:tasks.workunit.client.0.smithi027.stdout:5/637: creat d4/da/de/d3e/db7/fce x:0 0 0 2024-09-20T19:06:01.974 INFO:tasks.workunit.client.1.smithi098.stdout:0/352: readlink d0/d55/l49 0 2024-09-20T19:06:01.974 INFO:tasks.workunit.client.0.smithi027.stdout:0/640: link d2/d48/d6b/d79/d84/d1b/dc5/l95 d2/d48/d6b/d79/d84/lea 0 2024-09-20T19:06:01.975 INFO:tasks.workunit.client.0.smithi027.stdout:5/638: stat d4/da/c25 0 2024-09-20T19:06:01.975 INFO:tasks.workunit.client.0.smithi027.stdout:3/564: sync 2024-09-20T19:06:01.978 INFO:tasks.workunit.client.0.smithi027.stdout:5/639: fsync d4/da/de/f40 0 2024-09-20T19:06:01.984 INFO:tasks.workunit.client.0.smithi027.stdout:3/565: rename d0/d1/d13/d3c/fae to d0/d19/d54/d7a/fb8 0 2024-09-20T19:06:01.984 INFO:tasks.workunit.client.0.smithi027.stdout:4/510: dwrite d5/d13/d36/f7b [0,4194304] 0 2024-09-20T19:06:01.985 INFO:tasks.workunit.client.0.smithi027.stdout:3/566: chown d0/d19/d54/d7a/la9 12 1 2024-09-20T19:06:01.985 INFO:tasks.workunit.client.0.smithi027.stdout:0/641: mknod d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/ceb 0 2024-09-20T19:06:01.990 INFO:tasks.workunit.client.0.smithi027.stdout:5/640: mkdir d4/d1f/d7f/da4/dcf 0 2024-09-20T19:06:01.991 INFO:tasks.workunit.client.0.smithi027.stdout:5/641: truncate d4/da/de/d3e/d69/d6a/fcb 464226 0 2024-09-20T19:06:01.994 INFO:tasks.workunit.client.0.smithi027.stdout:5/642: write d4/d1f/d28/f85 [1096076,116361] 0 2024-09-20T19:06:01.995 INFO:tasks.workunit.client.0.smithi027.stdout:5/643: read d4/f45 [126747,44765] 0 2024-09-20T19:06:02.001 INFO:tasks.workunit.client.0.smithi027.stdout:3/567: write d0/d1/d5e/d1d/f4e [4839434,37537] 0 2024-09-20T19:06:02.002 INFO:tasks.workunit.client.0.smithi027.stdout:5/644: dwrite d4/d1f/d7f/fb3 [0,4194304] 0 2024-09-20T19:06:02.006 INFO:tasks.workunit.client.0.smithi027.stdout:5/645: rmdir d4/d1f/d7f/da4 39 2024-09-20T19:06:02.011 INFO:tasks.workunit.client.0.smithi027.stdout:0/642: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f3b [0,4194304] 0 2024-09-20T19:06:02.012 INFO:tasks.workunit.client.0.smithi027.stdout:4/511: dwrite d5/f37 [0,4194304] 0 2024-09-20T19:06:02.014 INFO:tasks.workunit.client.0.smithi027.stdout:5/646: link d4/da/c25 d4/da/d98/cd0 0 2024-09-20T19:06:02.018 INFO:tasks.workunit.client.0.smithi027.stdout:0/643: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/lba to d2/d48/d6b/d79/d84/d1b/lec 0 2024-09-20T19:06:02.020 INFO:tasks.workunit.client.0.smithi027.stdout:5/647: mkdir d4/dd1 0 2024-09-20T19:06:02.022 INFO:tasks.workunit.client.0.smithi027.stdout:4/512: getdents d5/d13/d36/d48/d3f/d4c 0 2024-09-20T19:06:02.026 INFO:tasks.workunit.client.0.smithi027.stdout:4/513: read d5/d11/d3d/f6a [161162,107318] 0 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:3/568: dwrite d0/d1/d13/d3c/f62 [0,4194304] 0 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:1/580: sync 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:8/570: sync 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:2/515: sync 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:6/590: sync 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:9/714: sync 2024-09-20T19:06:02.027 INFO:tasks.workunit.client.0.smithi027.stdout:7/558: sync 2024-09-20T19:06:02.028 INFO:tasks.workunit.client.1.smithi098.stdout:2/821: sync 2024-09-20T19:06:02.028 INFO:tasks.workunit.client.0.smithi027.stdout:4/514: read - d5/d13/d16/f79 zero size 2024-09-20T19:06:02.028 INFO:tasks.workunit.client.0.smithi027.stdout:1/581: stat d2/d8/d2b/d5e 0 2024-09-20T19:06:02.029 INFO:tasks.workunit.client.0.smithi027.stdout:0/644: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 540870 0 2024-09-20T19:06:02.031 INFO:tasks.workunit.client.0.smithi027.stdout:6/591: stat d4/la9 0 2024-09-20T19:06:02.031 INFO:tasks.workunit.client.0.smithi027.stdout:8/571: chown d2/d3/d1b/d36/f61 51506 1 2024-09-20T19:06:02.033 INFO:tasks.workunit.client.0.smithi027.stdout:2/516: unlink d3/d1c/d26/d2a/d63/f7c 0 2024-09-20T19:06:02.034 INFO:tasks.workunit.client.0.smithi027.stdout:4/515: dread - d5/d13/d36/d48/f97 zero size 2024-09-20T19:06:02.034 INFO:tasks.workunit.client.0.smithi027.stdout:0/645: chown d2/d48/l7b 4 1 2024-09-20T19:06:02.035 INFO:tasks.workunit.client.1.smithi098.stdout:2/822: dwrite d3/db0/d69/d88/f98 [4194304,4194304] 0 2024-09-20T19:06:02.036 INFO:tasks.workunit.client.0.smithi027.stdout:1/582: symlink d2/d8/d41/lbf 0 2024-09-20T19:06:02.038 INFO:tasks.workunit.client.0.smithi027.stdout:6/592: chown d4/d15/d37/d7a/d33/l65 300312 1 2024-09-20T19:06:02.039 INFO:tasks.workunit.client.1.smithi098.stdout:2/823: mkdir d3/d16/d1a/d109 0 2024-09-20T19:06:02.042 INFO:tasks.workunit.client.0.smithi027.stdout:7/559: rename d3/d8/da/l59 to d3/d8/da/d51/lbf 0 2024-09-20T19:06:02.044 INFO:tasks.workunit.client.0.smithi027.stdout:3/569: dwrite d0/f47 [0,4194304] 0 2024-09-20T19:06:02.045 INFO:tasks.workunit.client.0.smithi027.stdout:8/572: symlink d2/d14/d13/d43/d5d/d86/lb8 0 2024-09-20T19:06:02.048 INFO:tasks.workunit.client.0.smithi027.stdout:0/646: mkdir d2/d49/ded 0 2024-09-20T19:06:02.049 INFO:tasks.workunit.client.0.smithi027.stdout:4/516: dwrite d5/fa [0,4194304] 0 2024-09-20T19:06:02.056 INFO:tasks.workunit.client.0.smithi027.stdout:0/647: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29 1083 1 2024-09-20T19:06:02.057 INFO:tasks.workunit.client.0.smithi027.stdout:2/517: link d3/f78 d3/d1c/d26/d2a/fa1 0 2024-09-20T19:06:02.062 INFO:tasks.workunit.client.0.smithi027.stdout:2/518: readlink d3/d24/d89/l9b 0 2024-09-20T19:06:02.064 INFO:tasks.workunit.client.0.smithi027.stdout:3/570: dwrite d0/d1/d13/d15/d55/d70/faa [0,4194304] 0 2024-09-20T19:06:02.065 INFO:tasks.workunit.client.0.smithi027.stdout:9/715: dwrite d0/fca [0,4194304] 0 2024-09-20T19:06:02.066 INFO:tasks.workunit.client.0.smithi027.stdout:0/648: unlink d2/d48/d6b/d79/d84/d1b/d39/lb0 0 2024-09-20T19:06:02.070 INFO:tasks.workunit.client.0.smithi027.stdout:2/519: creat d3/d1c/d26/fa2 x:0 0 0 2024-09-20T19:06:02.070 INFO:tasks.workunit.client.1.smithi098.stdout:2/824: dread d3/df/d13/f33 [0,4194304] 0 2024-09-20T19:06:02.072 INFO:tasks.workunit.client.0.smithi027.stdout:9/716: mkdir d0/d9/df/da2/de9 0 2024-09-20T19:06:02.072 INFO:tasks.workunit.client.0.smithi027.stdout:4/517: dread d5/d13/d36/d48/d3f/f95 [4194304,4194304] 0 2024-09-20T19:06:02.073 INFO:tasks.workunit.client.0.smithi027.stdout:3/571: read d0/f12 [1798773,117477] 0 2024-09-20T19:06:02.075 INFO:tasks.workunit.client.0.smithi027.stdout:0/649: rename d2/d49/d70/ddd to d2/d48/d6b/d79/d9f/da4/dee 0 2024-09-20T19:06:02.075 INFO:tasks.workunit.client.1.smithi098.stdout:2/825: mkdir d3/d16/d1d/d10a 0 2024-09-20T19:06:02.076 INFO:tasks.workunit.client.0.smithi027.stdout:5/648: dread d4/d1f/d7f/f80 [0,4194304] 0 2024-09-20T19:06:02.077 INFO:tasks.workunit.client.0.smithi027.stdout:2/520: symlink d3/d1c/d26/d2a/la3 0 2024-09-20T19:06:02.077 INFO:tasks.workunit.client.0.smithi027.stdout:0/650: write d2/d20/fd3 [990229,45243] 0 2024-09-20T19:06:02.078 INFO:tasks.workunit.client.0.smithi027.stdout:2/521: readlink d3/d24/l3d 0 2024-09-20T19:06:02.079 INFO:tasks.workunit.client.1.smithi098.stdout:2/826: rmdir d3/d51 39 2024-09-20T19:06:02.081 INFO:tasks.workunit.client.1.smithi098.stdout:2/827: write d3/d16/d1a/ded/ffb [845490,110128] 0 2024-09-20T19:06:02.082 INFO:tasks.workunit.client.0.smithi027.stdout:2/522: chown d3/d13/d3c/d48/f88 906057271 1 2024-09-20T19:06:02.083 INFO:tasks.workunit.client.0.smithi027.stdout:4/518: dread d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:02.083 INFO:tasks.workunit.client.0.smithi027.stdout:2/523: readlink d3/d13/d3c/l7f 0 2024-09-20T19:06:02.085 INFO:tasks.workunit.client.0.smithi027.stdout:3/572: mkdir d0/d1/d13/d64/db9 0 2024-09-20T19:06:02.086 INFO:tasks.workunit.client.0.smithi027.stdout:2/524: write d3/d1c/d26/f67 [80779,127597] 0 2024-09-20T19:06:02.087 INFO:tasks.workunit.client.0.smithi027.stdout:2/525: chown d3/d13/d3c/l7f 945319600 1 2024-09-20T19:06:02.088 INFO:tasks.workunit.client.1.smithi098.stdout:2/828: symlink d3/d16/d1d/d2b/d99/da2/l10b 0 2024-09-20T19:06:02.088 INFO:tasks.workunit.client.0.smithi027.stdout:1/583: truncate d2/d8/d41/f43 724780 0 2024-09-20T19:06:02.092 INFO:tasks.workunit.client.0.smithi027.stdout:4/519: mkdir d5/d11/d1a/d2a/da3 0 2024-09-20T19:06:02.094 INFO:tasks.workunit.client.0.smithi027.stdout:5/649: mknod d4/d1f/cd2 0 2024-09-20T19:06:02.095 INFO:tasks.workunit.client.1.smithi098.stdout:2/829: dwrite d3/d16/f103 [4194304,4194304] 0 2024-09-20T19:06:02.098 INFO:tasks.workunit.client.0.smithi027.stdout:9/717: creat d0/fea x:0 0 0 2024-09-20T19:06:02.099 INFO:tasks.workunit.client.0.smithi027.stdout:0/651: symlink d2/d48/d6b/d79/d84/d1b/dc5/lef 0 2024-09-20T19:06:02.099 INFO:tasks.workunit.client.0.smithi027.stdout:3/573: mkdir d0/d1/d13/d98/dab/dba 0 2024-09-20T19:06:02.100 INFO:tasks.workunit.client.0.smithi027.stdout:2/526: dwrite d3/d13/f17 [0,4194304] 0 2024-09-20T19:06:02.100 INFO:tasks.workunit.client.0.smithi027.stdout:7/560: dread d3/d8/d26/d45/d56/d8d/fad [0,4194304] 0 2024-09-20T19:06:02.101 INFO:tasks.workunit.client.0.smithi027.stdout:8/573: dwrite d2/d3/d6/f3e [0,4194304] 0 2024-09-20T19:06:02.104 INFO:tasks.workunit.client.1.smithi098.stdout:2/830: link d3/d16/d1d/d4f/cc1 d3/d16/d1d/d2b/d46/dc0/c10c 0 2024-09-20T19:06:02.104 INFO:tasks.workunit.client.1.smithi098.stdout:2/831: read - d3/df/d13/f9b zero size 2024-09-20T19:06:02.106 INFO:tasks.workunit.client.0.smithi027.stdout:4/520: write d5/d13/d36/d48/f97 [52098,94410] 0 2024-09-20T19:06:02.109 INFO:tasks.workunit.client.0.smithi027.stdout:2/527: dread - d3/d13/d3c/d48/f8f zero size 2024-09-20T19:06:02.115 INFO:tasks.workunit.client.0.smithi027.stdout:8/574: symlink d2/d14/d13/d43/d5d/d86/lb9 0 2024-09-20T19:06:02.115 INFO:tasks.workunit.client.0.smithi027.stdout:4/521: write d5/d13/f30 [658398,31906] 0 2024-09-20T19:06:02.115 INFO:tasks.workunit.client.0.smithi027.stdout:7/561: chown d3/d8/da/d2e/d49/d8b/cb1 334984 1 2024-09-20T19:06:02.116 INFO:tasks.workunit.client.0.smithi027.stdout:0/652: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f42 828918 1 2024-09-20T19:06:02.117 INFO:tasks.workunit.client.0.smithi027.stdout:2/528: write d3/d1c/d26/f67 [2077571,33048] 0 2024-09-20T19:06:02.122 INFO:tasks.workunit.client.0.smithi027.stdout:9/718: dwrite d0/d9/df/f74 [0,4194304] 0 2024-09-20T19:06:02.122 INFO:tasks.workunit.client.0.smithi027.stdout:4/522: creat d5/d13/fa4 x:0 0 0 2024-09-20T19:06:02.123 INFO:tasks.workunit.client.0.smithi027.stdout:7/562: mkdir d3/d8/da/d51/dc0 0 2024-09-20T19:06:02.124 INFO:tasks.workunit.client.0.smithi027.stdout:5/650: write d4/da/de/f35 [2511207,110816] 0 2024-09-20T19:06:02.127 INFO:tasks.workunit.client.0.smithi027.stdout:9/719: chown d0/d9/df/d1b/d9c/d5a/f82 9 1 2024-09-20T19:06:02.130 INFO:tasks.workunit.client.0.smithi027.stdout:3/574: dwrite d0/d1/d13/d15/d55/d70/faa [0,4194304] 0 2024-09-20T19:06:02.131 INFO:tasks.workunit.client.0.smithi027.stdout:9/720: write d0/f47 [766583,95343] 0 2024-09-20T19:06:02.131 INFO:tasks.workunit.client.0.smithi027.stdout:0/653: rename d2/d20/c64 to d2/d48/d6b/d79/d84/cf0 0 2024-09-20T19:06:02.135 INFO:tasks.workunit.client.0.smithi027.stdout:7/563: creat d3/d8/da/dc/da9/dbc/fc1 x:0 0 0 2024-09-20T19:06:02.135 INFO:tasks.workunit.client.0.smithi027.stdout:5/651: symlink d4/d1f/ld3 0 2024-09-20T19:06:02.136 INFO:tasks.workunit.client.0.smithi027.stdout:4/523: getdents d5/d11/d1a 0 2024-09-20T19:06:02.137 INFO:tasks.workunit.client.0.smithi027.stdout:3/575: mkdir d0/d1/d65/dbb 0 2024-09-20T19:06:02.139 INFO:tasks.workunit.client.0.smithi027.stdout:9/721: symlink d0/d97/leb 0 2024-09-20T19:06:02.139 INFO:tasks.workunit.client.0.smithi027.stdout:4/524: write d5/d11/f68 [2882052,8974] 0 2024-09-20T19:06:02.140 INFO:tasks.workunit.client.1.smithi098.stdout:2/832: dread d3/d16/d1d/d2b/f5c [0,4194304] 0 2024-09-20T19:06:02.140 INFO:tasks.workunit.client.0.smithi027.stdout:3/576: write d0/d1/d5e/d1d/f4e [3045186,61921] 0 2024-09-20T19:06:02.141 INFO:tasks.workunit.client.0.smithi027.stdout:9/722: fsync d0/d9/df/d1b/fcb 0 2024-09-20T19:06:02.141 INFO:tasks.workunit.client.0.smithi027.stdout:2/529: write d3/d1c/d26/d2a/fa1 [829931,66453] 0 2024-09-20T19:06:02.142 INFO:tasks.workunit.client.1.smithi098.stdout:2/833: dread - d3/d16/d1d/d2b/d99/da2/f105 zero size 2024-09-20T19:06:02.144 INFO:tasks.workunit.client.0.smithi027.stdout:5/652: stat d4/d1f/d7f/f67 0 2024-09-20T19:06:02.145 INFO:tasks.workunit.client.0.smithi027.stdout:5/653: write d4/f86 [682545,75569] 0 2024-09-20T19:06:02.147 INFO:tasks.workunit.client.0.smithi027.stdout:3/577: mknod d0/d1/d13/d3c/cbc 0 2024-09-20T19:06:02.149 INFO:tasks.workunit.client.1.smithi098.stdout:2/834: getdents d3/df/d104/d38 0 2024-09-20T19:06:02.149 INFO:tasks.workunit.client.0.smithi027.stdout:2/530: chown d3/d13/c21 3414802 1 2024-09-20T19:06:02.149 INFO:tasks.workunit.client.0.smithi027.stdout:7/564: rmdir d3/d8/d26/d65 39 2024-09-20T19:06:02.150 INFO:tasks.workunit.client.0.smithi027.stdout:0/654: rmdir d2/d48/d6b/d79/d9f/da4/dee 0 2024-09-20T19:06:02.151 INFO:tasks.workunit.client.1.smithi098.stdout:2/835: symlink d3/d16/d1d/db5/l10d 0 2024-09-20T19:06:02.152 INFO:tasks.workunit.client.1.smithi098.stdout:2/836: mkdir d3/d16/d96/d10e 0 2024-09-20T19:06:02.153 INFO:tasks.workunit.client.0.smithi027.stdout:3/578: read d0/d19/f57 [321395,40453] 0 2024-09-20T19:06:02.154 INFO:tasks.workunit.client.0.smithi027.stdout:2/531: fsync d3/d1c/d26/d2a/f53 0 2024-09-20T19:06:02.157 INFO:tasks.workunit.client.0.smithi027.stdout:5/654: dwrite d4/da/de/d3e/d69/d75/fa8 [0,4194304] 0 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:4/632: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:8/636: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:5/470: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:1/513: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:3/508: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:7/595: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:6/345: sync 2024-09-20T19:06:02.158 INFO:tasks.workunit.client.1.smithi098.stdout:9/603: sync 2024-09-20T19:06:02.160 INFO:tasks.workunit.client.1.smithi098.stdout:6/346: stat d0/c46 0 2024-09-20T19:06:02.160 INFO:tasks.workunit.client.1.smithi098.stdout:3/509: fsync d4/d19/d1d/d22/f9f 0 2024-09-20T19:06:02.161 INFO:tasks.workunit.client.1.smithi098.stdout:4/633: write d3/d4f/f72 [681148,22543] 0 2024-09-20T19:06:02.161 INFO:tasks.workunit.client.1.smithi098.stdout:8/637: dread - d7/de/d11/d19/d30/d55/fa8 zero size 2024-09-20T19:06:02.164 INFO:tasks.workunit.client.1.smithi098.stdout:1/514: chown d1/d3/df/d34/d43/d53/l86 32198 1 2024-09-20T19:06:02.164 INFO:tasks.workunit.client.1.smithi098.stdout:3/510: dread - d4/da/d50/f78 zero size 2024-09-20T19:06:02.164 INFO:tasks.workunit.client.0.smithi027.stdout:9/723: dread d0/d9/df/d1b/f3e [0,4194304] 0 2024-09-20T19:06:02.164 INFO:tasks.workunit.client.1.smithi098.stdout:8/638: readlink d7/de/d11/d19/l52 0 2024-09-20T19:06:02.165 INFO:tasks.workunit.client.0.smithi027.stdout:9/724: chown d0/d9/df/d1b/f8 42 1 2024-09-20T19:06:02.166 INFO:tasks.workunit.client.1.smithi098.stdout:1/515: stat d1/d3/df/d34/d52/c5e 0 2024-09-20T19:06:02.170 INFO:tasks.workunit.client.1.smithi098.stdout:6/347: dwrite d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:06:02.172 INFO:tasks.workunit.client.1.smithi098.stdout:6/348: write d0/f60 [493266,9633] 0 2024-09-20T19:06:02.180 INFO:tasks.workunit.client.0.smithi027.stdout:7/565: link d3/d8/d26/f7f d3/d8/d26/d45/d56/fc2 0 2024-09-20T19:06:02.183 INFO:tasks.workunit.client.0.smithi027.stdout:0/655: dwrite d2/d20/fc1 [0,4194304] 0 2024-09-20T19:06:02.183 INFO:tasks.workunit.client.0.smithi027.stdout:3/579: rename d0/d38/f99 to d0/fbd 0 2024-09-20T19:06:02.191 INFO:tasks.workunit.client.1.smithi098.stdout:0/353: sync 2024-09-20T19:06:02.200 INFO:tasks.workunit.client.1.smithi098.stdout:7/596: dread - d3/d10/d16/d17/d33/d37/f74 zero size 2024-09-20T19:06:02.202 INFO:tasks.workunit.client.1.smithi098.stdout:5/471: unlink d1/d1b/d40/c8d 0 2024-09-20T19:06:02.204 INFO:tasks.workunit.client.1.smithi098.stdout:9/604: creat d4/de/d24/d35/d2d/da6/dae/d86/fcb x:0 0 0 2024-09-20T19:06:02.206 INFO:tasks.workunit.client.1.smithi098.stdout:3/511: symlink d4/d19/d1d/d22/la2 0 2024-09-20T19:06:02.208 INFO:tasks.workunit.client.1.smithi098.stdout:1/516: creat d1/d3/df/d34/d52/d77/fa0 x:0 0 0 2024-09-20T19:06:02.209 INFO:tasks.workunit.client.1.smithi098.stdout:0/354: mknod d0/d6/d28/d31/d45/c64 0 2024-09-20T19:06:02.210 INFO:tasks.workunit.client.1.smithi098.stdout:0/355: dread - d0/f4a zero size 2024-09-20T19:06:02.211 INFO:tasks.workunit.client.0.smithi027.stdout:7/566: creat d3/d8/da/d2e/d49/d8b/fc3 x:0 0 0 2024-09-20T19:06:02.211 INFO:tasks.workunit.client.0.smithi027.stdout:0/656: rmdir d2 39 2024-09-20T19:06:02.211 INFO:tasks.workunit.client.0.smithi027.stdout:2/532: write d3/d13/f25 [441931,96470] 0 2024-09-20T19:06:02.211 INFO:tasks.workunit.client.0.smithi027.stdout:3/580: write d0/d1/d13/f37 [1425793,77873] 0 2024-09-20T19:06:02.212 INFO:tasks.workunit.client.1.smithi098.stdout:2/837: rename d3/c5b to d3/d16/d1d/d2b/c10f 0 2024-09-20T19:06:02.215 INFO:tasks.workunit.client.0.smithi027.stdout:2/533: write d3/d13/d3c/d48/f74 [609057,51455] 0 2024-09-20T19:06:02.217 INFO:tasks.workunit.client.1.smithi098.stdout:9/605: readlink d4/de/d24/l56 0 2024-09-20T19:06:02.218 INFO:tasks.workunit.client.0.smithi027.stdout:5/655: dwrite d4/da/de/d3e/db7/dc2/d87/f9a [4194304,4194304] 0 2024-09-20T19:06:02.218 INFO:tasks.workunit.client.0.smithi027.stdout:2/534: fsync d3/d24/d8b/f92 0 2024-09-20T19:06:02.220 INFO:tasks.workunit.client.1.smithi098.stdout:8/639: creat d7/dd2/fe3 x:0 0 0 2024-09-20T19:06:02.220 INFO:tasks.workunit.client.0.smithi027.stdout:7/567: chown d3/d8/da/d2e/d39/lba 0 1 2024-09-20T19:06:02.220 INFO:tasks.workunit.client.1.smithi098.stdout:8/640: chown d7 1227 1 2024-09-20T19:06:02.221 INFO:tasks.workunit.client.0.smithi027.stdout:2/535: read d3/de/f18 [2630355,106948] 0 2024-09-20T19:06:02.221 INFO:tasks.workunit.client.1.smithi098.stdout:4/634: dwrite d3/fc [0,4194304] 0 2024-09-20T19:06:02.222 INFO:tasks.workunit.client.0.smithi027.stdout:9/725: rename d0/d9/df/d1c/f7f to d0/d9/fec 0 2024-09-20T19:06:02.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/512: mkdir d4/d19/d1d/d2f/d4e/da3 0 2024-09-20T19:06:02.227 INFO:tasks.workunit.client.0.smithi027.stdout:0/657: creat d2/d49/d70/ff1 x:0 0 0 2024-09-20T19:06:02.228 INFO:tasks.workunit.client.1.smithi098.stdout:9/606: dwrite d4/de/d27/d4a/d58/fab [0,4194304] 0 2024-09-20T19:06:02.231 INFO:tasks.workunit.client.1.smithi098.stdout:0/356: mkdir d0/db/d32/d65 0 2024-09-20T19:06:02.232 INFO:tasks.workunit.client.1.smithi098.stdout:9/607: write d4/de/d27/d4a/d8e/fbb [479834,81395] 0 2024-09-20T19:06:02.233 INFO:tasks.workunit.client.1.smithi098.stdout:9/608: dread - d4/d74/d8a/fa2 zero size 2024-09-20T19:06:02.235 INFO:tasks.workunit.client.1.smithi098.stdout:2/838: readlink d3/df/d104/lfd 0 2024-09-20T19:06:02.238 INFO:tasks.workunit.client.0.smithi027.stdout:7/568: chown d3/d8/d26/f4a 18661091 1 2024-09-20T19:06:02.239 INFO:tasks.workunit.client.1.smithi098.stdout:9/609: dread d4/de/d27/d4a/d21/d25/f26 [0,4194304] 0 2024-09-20T19:06:02.240 INFO:tasks.workunit.client.0.smithi027.stdout:0/658: dwrite d2/d48/d6b/d79/d84/d1b/d39/f74 [0,4194304] 0 2024-09-20T19:06:02.240 INFO:tasks.workunit.client.0.smithi027.stdout:9/726: chown d0/d9/df/d1b/d9c/d4f/l67 12 1 2024-09-20T19:06:02.243 INFO:tasks.workunit.client.1.smithi098.stdout:4/635: symlink d3/d5e/d97/le1 0 2024-09-20T19:06:02.244 INFO:tasks.workunit.client.1.smithi098.stdout:9/610: dread d4/de/d27/d4a/f4b [0,4194304] 0 2024-09-20T19:06:02.245 INFO:tasks.workunit.client.1.smithi098.stdout:4/636: chown d3/d6/d11/f62 16373 1 2024-09-20T19:06:02.245 INFO:tasks.workunit.client.1.smithi098.stdout:8/641: creat d7/de/d11/d19/d30/d55/fe4 x:0 0 0 2024-09-20T19:06:02.245 INFO:tasks.workunit.client.1.smithi098.stdout:9/611: chown d4/de/d24/d35 526523 1 2024-09-20T19:06:02.249 INFO:tasks.workunit.client.0.smithi027.stdout:9/727: dwrite d0/d9/df/d1c/d6a/d6d/f13 [0,4194304] 0 2024-09-20T19:06:02.250 INFO:tasks.workunit.client.0.smithi027.stdout:5/656: dread d4/da/de/d3e/d69/d75/fad [0,4194304] 0 2024-09-20T19:06:02.250 INFO:tasks.workunit.client.1.smithi098.stdout:3/513: dread d4/da/fb [0,4194304] 0 2024-09-20T19:06:02.251 INFO:tasks.workunit.client.0.smithi027.stdout:0/659: rename d2/d49/d70 to d2/d49/ded/df2 0 2024-09-20T19:06:02.252 INFO:tasks.workunit.client.1.smithi098.stdout:3/514: readlink d4/d19/d1d/l83 0 2024-09-20T19:06:02.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/517: mkdir d1/d3/d2e/d68/d7a/da1 0 2024-09-20T19:06:02.253 INFO:tasks.workunit.client.0.smithi027.stdout:0/660: write d2/d48/fb1 [175525,58814] 0 2024-09-20T19:06:02.256 INFO:tasks.workunit.client.0.smithi027.stdout:0/661: read d2/d20/fc1 [3301700,31711] 0 2024-09-20T19:06:02.259 INFO:tasks.workunit.client.1.smithi098.stdout:4/637: dwrite d3/d5e/d9f/fc5 [0,4194304] 0 2024-09-20T19:06:02.260 INFO:tasks.workunit.client.0.smithi027.stdout:5/657: dwrite d4/d1f/d28/f85 [0,4194304] 0 2024-09-20T19:06:02.260 INFO:tasks.workunit.client.0.smithi027.stdout:5/658: stat d4/da/de/d3e 0 2024-09-20T19:06:02.262 INFO:tasks.workunit.client.1.smithi098.stdout:4/638: stat d3/d5e/d9f/fc5 0 2024-09-20T19:06:02.318 INFO:tasks.workunit.client.1.smithi098.stdout:7/597: truncate d3/d10/d16/d17/d33/d1f/f44 3959531 0 2024-09-20T19:06:02.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:02 smithi027 ceph-mon[28196]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 75 MiB/s rd, 254 MiB/s wr, 474 op/s 2024-09-20T19:06:02.320 INFO:tasks.workunit.client.1.smithi098.stdout:0/357: rmdir d0/d55 39 2024-09-20T19:06:02.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/472: truncate d1/d17/d35/f6a 1780738 0 2024-09-20T19:06:02.325 INFO:tasks.workunit.client.0.smithi027.stdout:3/581: truncate d0/d1/d13/f1c 3283741 0 2024-09-20T19:06:02.333 INFO:tasks.workunit.client.1.smithi098.stdout:6/349: getdents d0/de/d1b/d37/d43 0 2024-09-20T19:06:02.334 INFO:tasks.workunit.client.0.smithi027.stdout:6/593: sync 2024-09-20T19:06:02.337 INFO:tasks.workunit.client.1.smithi098.stdout:5/473: dread d1/d1b/f26 [4194304,4194304] 0 2024-09-20T19:06:02.337 INFO:tasks.workunit.client.0.smithi027.stdout:2/536: write d3/ff [777151,71062] 0 2024-09-20T19:06:02.342 INFO:tasks.workunit.client.1.smithi098.stdout:1/518: creat d1/d3/d62/fa2 x:0 0 0 2024-09-20T19:06:02.346 INFO:tasks.workunit.client.1.smithi098.stdout:3/515: rename d4/d19/d1d/l87 to d4/d25/d40/d80/d94/la4 0 2024-09-20T19:06:02.358 INFO:tasks.workunit.client.0.smithi027.stdout:9/728: link d0/d9/df/da2/fe1 d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/fed 0 2024-09-20T19:06:02.359 INFO:tasks.workunit.client.0.smithi027.stdout:2/537: mknod d3/d1c/d31/ca4 0 2024-09-20T19:06:02.360 INFO:tasks.workunit.client.0.smithi027.stdout:2/538: dread - d3/d1c/d26/d2a/f86 zero size 2024-09-20T19:06:02.361 INFO:tasks.workunit.client.0.smithi027.stdout:2/539: fsync d3/d1c/d26/d2a/f5d 0 2024-09-20T19:06:02.366 INFO:tasks.workunit.client.0.smithi027.stdout:2/540: dread - d3/d1c/d26/fa2 zero size 2024-09-20T19:06:02.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/639: symlink d3/d7d/da3/d3c/d6b/d73/d98/de0/le2 0 2024-09-20T19:06:02.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/640: readlink d3/d6/l49 0 2024-09-20T19:06:02.372 INFO:tasks.workunit.client.0.smithi027.stdout:9/729: write d0/fa [2955000,20838] 0 2024-09-20T19:06:02.372 INFO:tasks.workunit.client.0.smithi027.stdout:2/541: dwrite d3/d13/d3c/d48/f74 [0,4194304] 0 2024-09-20T19:06:02.381 INFO:tasks.workunit.client.1.smithi098.stdout:6/350: getdents d0/de/d1b/d37/d43/d51 0 2024-09-20T19:06:02.385 INFO:tasks.workunit.client.1.smithi098.stdout:1/519: mknod d1/d3/ca3 0 2024-09-20T19:06:02.394 INFO:tasks.workunit.client.1.smithi098.stdout:0/358: mknod d0/d55/c66 0 2024-09-20T19:06:02.395 INFO:tasks.workunit.client.0.smithi027.stdout:1/584: sync 2024-09-20T19:06:02.403 INFO:tasks.workunit.client.1.smithi098.stdout:6/351: rename d0/de/d1b/d37/d44/d24/d29/l38 to d0/de/d1b/d37/d44/d24/d29/d2b/l69 0 2024-09-20T19:06:02.407 INFO:tasks.workunit.client.1.smithi098.stdout:6/352: dread d0/de/d1b/f5d [0,4194304] 0 2024-09-20T19:06:02.408 INFO:tasks.workunit.client.1.smithi098.stdout:4/641: mkdir d3/d6/de3 0 2024-09-20T19:06:02.410 INFO:tasks.workunit.client.1.smithi098.stdout:7/598: getdents d3/d10/d16/d17/d33/d37 0 2024-09-20T19:06:02.414 INFO:tasks.workunit.client.1.smithi098.stdout:0/359: rmdir d0/d55/d38 39 2024-09-20T19:06:02.417 INFO:tasks.workunit.client.1.smithi098.stdout:5/474: getdents d1/d17/d25/d79 0 2024-09-20T19:06:02.421 INFO:tasks.workunit.client.0.smithi027.stdout:5/659: creat d4/d1f/d7f/da4/dcf/fd4 x:0 0 0 2024-09-20T19:06:02.430 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:02 smithi098 ceph-mon[35737]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 75 MiB/s rd, 254 MiB/s wr, 474 op/s 2024-09-20T19:06:02.435 INFO:tasks.workunit.client.0.smithi027.stdout:5/660: write d4/da/de/f37 [2459224,114383] 0 2024-09-20T19:06:02.437 INFO:tasks.workunit.client.0.smithi027.stdout:9/730: dwrite d0/d9/df/d1b/d9c/d5a/f63 [0,4194304] 0 2024-09-20T19:06:02.437 INFO:tasks.workunit.client.0.smithi027.stdout:0/662: rename d2/d48/d6b/d79/d84/d1b/dc5/l95 to d2/d48/d6b/d79/d84/d1b/dc5/lf3 0 2024-09-20T19:06:02.438 INFO:tasks.workunit.client.1.smithi098.stdout:6/353: creat d0/de/d1b/d37/d44/d24/d29/d2b/d65/f6a x:0 0 0 2024-09-20T19:06:02.438 INFO:tasks.workunit.client.0.smithi027.stdout:9/731: write d0/d9/df/d1c/d6a/d6d/f13 [5052091,5880] 0 2024-09-20T19:06:02.439 INFO:tasks.workunit.client.0.smithi027.stdout:9/732: fsync d0/fc8 0 2024-09-20T19:06:02.440 INFO:tasks.workunit.client.0.smithi027.stdout:6/594: rename d4/d15/d37/d7a/db1 to d4/d15/d37/d5a/d78/dbc 0 2024-09-20T19:06:02.443 INFO:tasks.workunit.client.0.smithi027.stdout:2/542: mknod d3/d1c/d31/d9e/ca5 0 2024-09-20T19:06:02.445 INFO:tasks.workunit.client.1.smithi098.stdout:0/360: mkdir d0/d55/d67 0 2024-09-20T19:06:02.448 INFO:tasks.workunit.client.0.smithi027.stdout:2/543: dread d3/d13/f2b [4194304,4194304] 0 2024-09-20T19:06:02.448 INFO:tasks.workunit.client.1.smithi098.stdout:6/354: fdatasync d0/f22 0 2024-09-20T19:06:02.449 INFO:tasks.workunit.client.0.smithi027.stdout:2/544: fsync d3/de/f18 0 2024-09-20T19:06:02.453 INFO:tasks.workunit.client.1.smithi098.stdout:0/361: chown d0/db/d1d/f4d 153374220 1 2024-09-20T19:06:02.456 INFO:tasks.workunit.client.1.smithi098.stdout:6/355: unlink d0/de/c3a 0 2024-09-20T19:06:02.458 INFO:tasks.workunit.client.1.smithi098.stdout:0/362: chown d0/d6/f12 0 1 2024-09-20T19:06:02.458 INFO:tasks.workunit.client.0.smithi027.stdout:1/585: link d2/d8/d2b/d2d/c5d d2/d8/d74/d9a/cc0 0 2024-09-20T19:06:02.459 INFO:tasks.workunit.client.0.smithi027.stdout:1/586: read - d2/d61/f8d zero size 2024-09-20T19:06:02.460 INFO:tasks.workunit.client.0.smithi027.stdout:1/587: write d2/d8/d2b/f4a [4862350,1002] 0 2024-09-20T19:06:02.460 INFO:tasks.workunit.client.0.smithi027.stdout:2/545: symlink d3/d1c/d31/d9e/la6 0 2024-09-20T19:06:02.461 INFO:tasks.workunit.client.0.smithi027.stdout:1/588: fsync d2/d8/d3b/fb9 0 2024-09-20T19:06:02.461 INFO:tasks.workunit.client.0.smithi027.stdout:2/546: chown d3/de/d34/l4a 90 1 2024-09-20T19:06:02.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/363: creat d0/d55/d67/f68 x:0 0 0 2024-09-20T19:06:02.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/364: dread - d0/d55/f5b zero size 2024-09-20T19:06:02.466 INFO:tasks.workunit.client.0.smithi027.stdout:1/589: dwrite d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:02.469 INFO:tasks.workunit.client.1.smithi098.stdout:6/356: creat d0/de/f6b x:0 0 0 2024-09-20T19:06:02.479 INFO:tasks.workunit.client.0.smithi027.stdout:1/590: creat d2/d8/d74/d9a/da3/fc1 x:0 0 0 2024-09-20T19:06:02.482 INFO:tasks.workunit.client.0.smithi027.stdout:1/591: read - d2/d1b/d56/d71/f95 zero size 2024-09-20T19:06:02.482 INFO:tasks.workunit.client.0.smithi027.stdout:2/547: dwrite d3/d13/f6d [0,4194304] 0 2024-09-20T19:06:02.486 INFO:tasks.workunit.client.1.smithi098.stdout:6/357: creat d0/de/f6c x:0 0 0 2024-09-20T19:06:02.488 INFO:tasks.workunit.client.0.smithi027.stdout:1/592: dread d2/d8/f52 [0,4194304] 0 2024-09-20T19:06:02.489 INFO:tasks.workunit.client.0.smithi027.stdout:2/548: creat d3/d1c/d26/fa7 x:0 0 0 2024-09-20T19:06:02.493 INFO:tasks.workunit.client.0.smithi027.stdout:2/549: fsync d3/d24/d8b/f99 0 2024-09-20T19:06:02.495 INFO:tasks.workunit.client.1.smithi098.stdout:9/612: dwrite d4/de/d27/d4a/d21/d25/f30 [0,4194304] 0 2024-09-20T19:06:02.499 INFO:tasks.workunit.client.0.smithi027.stdout:2/550: creat d3/d1c/d26/d2a/d63/fa8 x:0 0 0 2024-09-20T19:06:02.503 INFO:tasks.workunit.client.1.smithi098.stdout:6/358: rmdir d0/de/d1b/d37/d44/d24/d29/d63 0 2024-09-20T19:06:02.504 INFO:tasks.workunit.client.1.smithi098.stdout:6/359: write d0/de/f6b [929590,90061] 0 2024-09-20T19:06:02.506 INFO:tasks.workunit.client.0.smithi027.stdout:2/551: unlink d3/d13/d3c/d48/c6c 0 2024-09-20T19:06:02.508 INFO:tasks.workunit.client.1.smithi098.stdout:6/360: mkdir d0/de/d1b/d37/d43/d6d 0 2024-09-20T19:06:02.509 INFO:tasks.workunit.client.0.smithi027.stdout:2/552: rmdir d3/de/d34 39 2024-09-20T19:06:02.510 INFO:tasks.workunit.client.0.smithi027.stdout:7/569: truncate d3/d8/da/d2e/d39/f3b 2733634 0 2024-09-20T19:06:02.512 INFO:tasks.workunit.client.1.smithi098.stdout:6/361: creat d0/de/d1b/d37/d44/d24/d29/d42/d4c/f6e x:0 0 0 2024-09-20T19:06:02.513 INFO:tasks.workunit.client.0.smithi027.stdout:2/553: symlink d3/d96/la9 0 2024-09-20T19:06:02.513 INFO:tasks.workunit.client.0.smithi027.stdout:2/554: stat d3/de/c7b 0 2024-09-20T19:06:02.515 INFO:tasks.workunit.client.0.smithi027.stdout:7/570: mkdir d3/d8/d26/d65/dc4 0 2024-09-20T19:06:02.517 INFO:tasks.workunit.client.0.smithi027.stdout:2/555: creat d3/d13/d3c/d48/faa x:0 0 0 2024-09-20T19:06:02.517 INFO:tasks.workunit.client.0.smithi027.stdout:3/582: write d0/d1/d13/f22 [2073002,71350] 0 2024-09-20T19:06:02.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/362: dwrite d0/de/d1b/d37/d44/f62 [0,4194304] 0 2024-09-20T19:06:02.518 INFO:tasks.workunit.client.0.smithi027.stdout:7/571: stat d3/d8/d26/f71 0 2024-09-20T19:06:02.519 INFO:tasks.workunit.client.0.smithi027.stdout:3/583: write d0/d1/f35 [1471467,62239] 0 2024-09-20T19:06:02.520 INFO:tasks.workunit.client.1.smithi098.stdout:6/363: write d0/de/d1b/d37/d44/d24/d29/f35 [1812409,121073] 0 2024-09-20T19:06:02.524 INFO:tasks.workunit.client.1.smithi098.stdout:6/364: chown d0/de/d1b/d37/d44/d24/d29/d2b/d66 56 1 2024-09-20T19:06:02.524 INFO:tasks.workunit.client.0.smithi027.stdout:7/572: creat d3/d24/fc5 x:0 0 0 2024-09-20T19:06:02.527 INFO:tasks.workunit.client.1.smithi098.stdout:2/839: dwrite d3/d51/d68/fb1 [4194304,4194304] 0 2024-09-20T19:06:02.527 INFO:tasks.workunit.client.0.smithi027.stdout:8/575: sync 2024-09-20T19:06:02.527 INFO:tasks.workunit.client.0.smithi027.stdout:4/525: sync 2024-09-20T19:06:02.528 INFO:tasks.workunit.client.0.smithi027.stdout:8/576: chown d2/d14/d13/d43/d5d/d86 110291251 1 2024-09-20T19:06:02.531 INFO:tasks.workunit.client.1.smithi098.stdout:6/365: getdents d0/de/d1b/d37/d43/d51 0 2024-09-20T19:06:02.536 INFO:tasks.workunit.client.0.smithi027.stdout:8/577: symlink d2/d14/d13/d2e/d6c/d77/lba 0 2024-09-20T19:06:02.537 INFO:tasks.workunit.client.1.smithi098.stdout:6/366: symlink d0/de/d1b/d37/d44/d24/l6f 0 2024-09-20T19:06:02.540 INFO:tasks.workunit.client.1.smithi098.stdout:6/367: write d0/de/d1b/d37/d44/d24/d29/d42/d4c/f6e [260269,50204] 0 2024-09-20T19:06:02.542 INFO:tasks.workunit.client.1.smithi098.stdout:1/520: mknod d1/ca4 0 2024-09-20T19:06:02.545 INFO:tasks.workunit.client.0.smithi027.stdout:8/578: creat d2/d3/d1b/fbb x:0 0 0 2024-09-20T19:06:02.545 INFO:tasks.workunit.client.1.smithi098.stdout:2/840: dread d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fd6 [0,4194304] 0 2024-09-20T19:06:02.550 INFO:tasks.workunit.client.0.smithi027.stdout:8/579: getdents d2/d65 0 2024-09-20T19:06:02.550 INFO:tasks.workunit.client.0.smithi027.stdout:4/526: dread d5/f6d [0,4194304] 0 2024-09-20T19:06:02.552 INFO:tasks.workunit.client.1.smithi098.stdout:2/841: creat d3/d16/d1d/d2b/d46/d74/d82/f110 x:0 0 0 2024-09-20T19:06:02.553 INFO:tasks.workunit.client.0.smithi027.stdout:4/527: creat d5/d13/d36/d49/fa5 x:0 0 0 2024-09-20T19:06:02.554 INFO:tasks.workunit.client.0.smithi027.stdout:4/528: write d5/d11/f68 [139373,28005] 0 2024-09-20T19:06:02.555 INFO:tasks.workunit.client.0.smithi027.stdout:8/580: mknod d2/d14/d13/d2e/d6c/cbc 0 2024-09-20T19:06:02.561 INFO:tasks.workunit.client.0.smithi027.stdout:8/581: fsync d2/d3/d1b/f2c 0 2024-09-20T19:06:02.562 INFO:tasks.workunit.client.1.smithi098.stdout:3/516: dwrite d4/d25/d40/f58 [0,4194304] 0 2024-09-20T19:06:02.563 INFO:tasks.workunit.client.0.smithi027.stdout:0/663: sync 2024-09-20T19:06:02.564 INFO:tasks.workunit.client.1.smithi098.stdout:3/517: read d4/d25/f2b [3464203,32543] 0 2024-09-20T19:06:02.566 INFO:tasks.workunit.client.1.smithi098.stdout:3/518: write d4/f34 [3585203,50472] 0 2024-09-20T19:06:02.567 INFO:tasks.workunit.client.1.smithi098.stdout:3/519: write d4/f1c [2149470,109577] 0 2024-09-20T19:06:02.569 INFO:tasks.workunit.client.1.smithi098.stdout:1/521: dread d1/d3/df/d4a/f5c [0,4194304] 0 2024-09-20T19:06:02.569 INFO:tasks.workunit.client.0.smithi027.stdout:4/529: link d5/d13/d70/l92 d5/d11/d3d/la6 0 2024-09-20T19:06:02.570 INFO:tasks.workunit.client.0.smithi027.stdout:8/582: dwrite d2/d3/d6/d21/d80/fb4 [0,4194304] 0 2024-09-20T19:06:02.571 INFO:tasks.workunit.client.0.smithi027.stdout:8/583: chown d2 100 1 2024-09-20T19:06:02.571 INFO:tasks.workunit.client.0.smithi027.stdout:0/664: chown d2/d48/d6b/d79/d84/d1b/f5f 41935 1 2024-09-20T19:06:02.575 INFO:tasks.workunit.client.1.smithi098.stdout:3/520: unlink d4/f34 0 2024-09-20T19:06:02.578 INFO:tasks.workunit.client.0.smithi027.stdout:4/530: creat d5/d11/d17/d1b/d8d/fa7 x:0 0 0 2024-09-20T19:06:02.579 INFO:tasks.workunit.client.1.smithi098.stdout:3/521: dread d4/d25/f68 [0,4194304] 0 2024-09-20T19:06:02.581 INFO:tasks.workunit.client.0.smithi027.stdout:8/584: getdents d2/d3/d6/d21/d33/d79/d9f 0 2024-09-20T19:06:02.581 INFO:tasks.workunit.client.0.smithi027.stdout:8/585: stat d2/d14/d13/d2e/f53 0 2024-09-20T19:06:02.586 INFO:tasks.workunit.client.0.smithi027.stdout:8/586: dread d2/d3/d6/d21/d80/fb4 [0,4194304] 0 2024-09-20T19:06:02.587 INFO:tasks.workunit.client.0.smithi027.stdout:4/531: getdents d5/d13/d36 0 2024-09-20T19:06:02.588 INFO:tasks.workunit.client.0.smithi027.stdout:8/587: symlink d2/d3/d9a/lbd 0 2024-09-20T19:06:02.597 INFO:tasks.workunit.client.0.smithi027.stdout:8/588: rename d2/d14/d13/d2e/f4d to d2/d14/d13/d2e/fbe 0 2024-09-20T19:06:02.598 INFO:tasks.workunit.client.0.smithi027.stdout:8/589: chown d2/d2a/caa 2423127 1 2024-09-20T19:06:02.602 INFO:tasks.workunit.client.0.smithi027.stdout:8/590: mkdir d2/d3/d9a/dbf 0 2024-09-20T19:06:02.602 INFO:tasks.workunit.client.0.smithi027.stdout:8/591: write d2/d14/d13/f3b [650538,96429] 0 2024-09-20T19:06:02.603 INFO:tasks.workunit.client.0.smithi027.stdout:8/592: symlink d2/d14/d13/lc0 0 2024-09-20T19:06:02.615 INFO:tasks.workunit.client.0.smithi027.stdout:8/593: unlink d2/d14/d13/d43/d5d/d86/lb8 0 2024-09-20T19:06:02.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/599: rename d3/d10/d16/d17/d33/d37/da0/da8 to d3/d10/d16/dc1 0 2024-09-20T19:06:02.619 INFO:tasks.workunit.client.0.smithi027.stdout:8/594: creat d2/d14/d13/d2e/d6c/fc1 x:0 0 0 2024-09-20T19:06:02.619 INFO:tasks.workunit.client.0.smithi027.stdout:8/595: write d2/f47 [3024089,49150] 0 2024-09-20T19:06:02.621 INFO:tasks.workunit.client.1.smithi098.stdout:0/365: dwrite d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:06:02.622 INFO:tasks.workunit.client.1.smithi098.stdout:5/475: rename d1/d1b/f4a to d1/d46/d69/d84/d87/f8e 0 2024-09-20T19:06:02.623 INFO:tasks.workunit.client.1.smithi098.stdout:7/600: dread d3/d10/d16/d17/d33/d1f/d2d/f75 [4194304,4194304] 0 2024-09-20T19:06:02.623 INFO:tasks.workunit.client.1.smithi098.stdout:7/601: stat d3 0 2024-09-20T19:06:02.627 INFO:tasks.workunit.client.1.smithi098.stdout:0/366: mkdir d0/d6/d28/d31/d69 0 2024-09-20T19:06:02.631 INFO:tasks.workunit.client.1.smithi098.stdout:1/522: rename d1/d3/df/d34/d43/f35 to d1/d3/fa5 0 2024-09-20T19:06:02.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/523: mknod d1/d3/d62/d9e/ca6 0 2024-09-20T19:06:02.637 INFO:tasks.workunit.client.1.smithi098.stdout:4/642: mkdir d3/d5e/de4 0 2024-09-20T19:06:02.639 INFO:tasks.workunit.client.1.smithi098.stdout:1/524: creat d1/d3/d62/d9e/fa7 x:0 0 0 2024-09-20T19:06:02.642 INFO:tasks.workunit.client.1.smithi098.stdout:4/643: unlink d3/d6/d11/d1e/c21 0 2024-09-20T19:06:02.644 INFO:tasks.workunit.client.1.smithi098.stdout:4/644: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab 31762909 1 2024-09-20T19:06:02.644 INFO:tasks.workunit.client.1.smithi098.stdout:1/525: creat d1/d3/df/d4a/fa8 x:0 0 0 2024-09-20T19:06:02.646 INFO:tasks.workunit.client.1.smithi098.stdout:4/645: dread - d3/d6/d8c/fda zero size 2024-09-20T19:06:02.651 INFO:tasks.workunit.client.1.smithi098.stdout:9/613: dwrite d4/f10 [0,4194304] 0 2024-09-20T19:06:02.654 INFO:tasks.workunit.client.1.smithi098.stdout:0/367: dread d0/f3 [0,4194304] 0 2024-09-20T19:06:02.654 INFO:tasks.workunit.client.1.smithi098.stdout:7/602: dread d3/d10/d16/f79 [0,4194304] 0 2024-09-20T19:06:02.657 INFO:tasks.workunit.client.1.smithi098.stdout:0/368: readlink d0/d6/d28/l2d 0 2024-09-20T19:06:02.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/526: rename d1/d3/df/d34/d52/d77/f82 to d1/d3/df/d34/d52/d77/fa9 0 2024-09-20T19:06:02.658 INFO:tasks.workunit.client.1.smithi098.stdout:0/369: dread - d0/f57 zero size 2024-09-20T19:06:02.661 INFO:tasks.workunit.client.1.smithi098.stdout:9/614: creat d4/de/d24/d35/dc4/fcc x:0 0 0 2024-09-20T19:06:02.662 INFO:tasks.workunit.client.1.smithi098.stdout:1/527: mkdir d1/d3/df/d34/d43/daa 0 2024-09-20T19:06:02.663 INFO:tasks.workunit.client.1.smithi098.stdout:4/646: dwrite d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f53 [0,4194304] 0 2024-09-20T19:06:02.665 INFO:tasks.workunit.client.1.smithi098.stdout:9/615: write d4/de/d27/d4a/d21/fb3 [475607,18926] 0 2024-09-20T19:06:02.666 INFO:tasks.workunit.client.1.smithi098.stdout:7/603: mkdir d3/d10/d16/d90/dc2 0 2024-09-20T19:06:02.668 INFO:tasks.workunit.client.1.smithi098.stdout:1/528: unlink d1/d3/f8c 0 2024-09-20T19:06:02.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/616: truncate d4/de/d27/d6c/fa7 292559 0 2024-09-20T19:06:02.670 INFO:tasks.workunit.client.1.smithi098.stdout:1/529: fdatasync d1/f84 0 2024-09-20T19:06:02.673 INFO:tasks.workunit.client.0.smithi027.stdout:5/661: rename d4/da/d98/db2 to d4/da/de/d3e/dd5 0 2024-09-20T19:06:02.674 INFO:tasks.workunit.client.1.smithi098.stdout:6/368: dwrite d0/de/d1b/d37/d44/d24/f3e [0,4194304] 0 2024-09-20T19:06:02.676 INFO:tasks.workunit.client.1.smithi098.stdout:7/604: unlink d3/d10/f13 0 2024-09-20T19:06:02.677 INFO:tasks.workunit.client.1.smithi098.stdout:4/647: symlink d3/d6/d11/le5 0 2024-09-20T19:06:02.684 INFO:tasks.workunit.client.1.smithi098.stdout:8/642: mknod d7/de/d11/ce5 0 2024-09-20T19:06:02.686 INFO:tasks.workunit.client.1.smithi098.stdout:1/530: rmdir d1/d3/df/d34/d43 39 2024-09-20T19:06:02.686 INFO:tasks.workunit.client.0.smithi027.stdout:5/662: dwrite d4/da/de/d3e/d44/f52 [0,4194304] 0 2024-09-20T19:06:02.687 INFO:tasks.workunit.client.1.smithi098.stdout:8/643: read - d7/de/dbb/fdb zero size 2024-09-20T19:06:02.687 INFO:tasks.workunit.client.0.smithi027.stdout:5/663: write d4/da/de/d3e/d44/f76 [266422,37044] 0 2024-09-20T19:06:02.687 INFO:tasks.workunit.client.1.smithi098.stdout:1/531: chown d1/f14 28728675 1 2024-09-20T19:06:02.688 INFO:tasks.workunit.client.1.smithi098.stdout:0/370: dread d0/d6/f16 [0,4194304] 0 2024-09-20T19:06:02.689 INFO:tasks.workunit.client.0.smithi027.stdout:5/664: dread - d4/da/de/d3e/db7/dc2/f97 zero size 2024-09-20T19:06:02.690 INFO:tasks.workunit.client.1.smithi098.stdout:0/371: chown d0/d6 1894708 1 2024-09-20T19:06:02.693 INFO:tasks.workunit.client.1.smithi098.stdout:0/372: write d0/d6/d28/f5c [497904,48852] 0 2024-09-20T19:06:02.693 INFO:tasks.workunit.client.1.smithi098.stdout:4/648: dread d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d [0,4194304] 0 2024-09-20T19:06:02.697 INFO:tasks.workunit.client.1.smithi098.stdout:4/649: write d3/fc [2657188,54335] 0 2024-09-20T19:06:02.698 INFO:tasks.workunit.client.0.smithi027.stdout:9/733: rename d0/d9/df/d1c/c26 to d0/d9/df/d1b/cee 0 2024-09-20T19:06:02.698 INFO:tasks.workunit.client.0.smithi027.stdout:9/734: read - d0/d9/df/d1b/fe4 zero size 2024-09-20T19:06:02.699 INFO:tasks.workunit.client.1.smithi098.stdout:8/644: dwrite d7/de/d11/d19/d30/d55/fe4 [0,4194304] 0 2024-09-20T19:06:02.700 INFO:tasks.workunit.client.1.smithi098.stdout:4/650: chown d3/d6/d5b/f65 2 1 2024-09-20T19:06:02.700 INFO:tasks.workunit.client.0.smithi027.stdout:5/665: creat d4/d6c/d6f/d92/fd6 x:0 0 0 2024-09-20T19:06:02.701 INFO:tasks.workunit.client.1.smithi098.stdout:8/645: stat d7/de/d11/dca 0 2024-09-20T19:06:02.705 INFO:tasks.workunit.client.0.smithi027.stdout:6/595: rename d4/d15/d37/d7a/d46/d53/f8c to d4/d15/d37/d7a/d46/fbd 0 2024-09-20T19:06:02.706 INFO:tasks.workunit.client.1.smithi098.stdout:6/369: mknod d0/de/d1b/c70 0 2024-09-20T19:06:02.707 INFO:tasks.workunit.client.0.smithi027.stdout:9/735: truncate d0/d9/df/d1b/d64/f6f 1307248 0 2024-09-20T19:06:02.708 INFO:tasks.workunit.client.0.smithi027.stdout:9/736: write d0/d9/df/d1b/d9c/d4f/d8d/fb1 [899926,88505] 0 2024-09-20T19:06:02.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/532: rename d1/d3/f2c to d1/d3/d2e/d68/d7a/fab 0 2024-09-20T19:06:02.709 INFO:tasks.workunit.client.0.smithi027.stdout:0/665: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 3824853 0 2024-09-20T19:06:02.710 INFO:tasks.workunit.client.0.smithi027.stdout:0/666: fsync d2/da2/fa8 0 2024-09-20T19:06:02.712 INFO:tasks.workunit.client.0.smithi027.stdout:1/593: rename d2/d8/d3b/d82/d90/la6 to d2/d8/d2b/d2d/d73/lc2 0 2024-09-20T19:06:02.714 INFO:tasks.workunit.client.0.smithi027.stdout:6/596: creat d4/d15/d37/d7a/d8e/fbe x:0 0 0 2024-09-20T19:06:02.715 INFO:tasks.workunit.client.0.smithi027.stdout:6/597: fsync d4/d15/d37/fad 0 2024-09-20T19:06:02.716 INFO:tasks.workunit.client.0.smithi027.stdout:5/666: creat d4/d6c/d6f/d92/dc8/fd7 x:0 0 0 2024-09-20T19:06:02.717 INFO:tasks.workunit.client.0.smithi027.stdout:1/594: dread d2/d8/d74/f91 [0,4194304] 0 2024-09-20T19:06:02.717 INFO:tasks.workunit.client.0.smithi027.stdout:1/595: stat d2/d8/d74/d9a/da3/dad 0 2024-09-20T19:06:02.720 INFO:tasks.workunit.client.1.smithi098.stdout:0/373: creat d0/db/d1d/f6a x:0 0 0 2024-09-20T19:06:02.722 INFO:tasks.workunit.client.0.smithi027.stdout:9/737: mknod d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/cef 0 2024-09-20T19:06:02.722 INFO:tasks.workunit.client.0.smithi027.stdout:9/738: readlink d0/d9/df/d57/l7e 0 2024-09-20T19:06:02.723 INFO:tasks.workunit.client.1.smithi098.stdout:4/651: mknod d3/d2e/ce6 0 2024-09-20T19:06:02.725 INFO:tasks.workunit.client.0.smithi027.stdout:0/667: creat d2/d48/d6b/d79/d9f/da4/ff4 x:0 0 0 2024-09-20T19:06:02.726 INFO:tasks.workunit.client.0.smithi027.stdout:0/668: read d2/da2/fc8 [240717,71316] 0 2024-09-20T19:06:02.726 INFO:tasks.workunit.client.1.smithi098.stdout:4/652: truncate d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/f80 769232 0 2024-09-20T19:06:02.727 INFO:tasks.workunit.client.0.smithi027.stdout:9/739: dread d0/d9/df/f24 [0,4194304] 0 2024-09-20T19:06:02.727 INFO:tasks.workunit.client.1.smithi098.stdout:4/653: readlink d3/d7d/da3/d3c/lbd 0 2024-09-20T19:06:02.727 INFO:tasks.workunit.client.1.smithi098.stdout:8/646: creat d7/de/d11/d1f/d57/fe6 x:0 0 0 2024-09-20T19:06:02.729 INFO:tasks.workunit.client.0.smithi027.stdout:2/556: rename d3/d1c/d26/d2a/d63/c91 to d3/d24/d8b/cab 0 2024-09-20T19:06:02.730 INFO:tasks.workunit.client.1.smithi098.stdout:6/370: symlink d0/de/d1b/d37/d43/d51/l71 0 2024-09-20T19:06:02.733 INFO:tasks.workunit.client.1.smithi098.stdout:7/605: rmdir d3/d10/d16/d90/dc2 0 2024-09-20T19:06:02.734 INFO:tasks.workunit.client.0.smithi027.stdout:3/584: link d0/d1/d13/f1c d0/d19/d54/fbe 0 2024-09-20T19:06:02.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/606: chown d3/d10/d16/d17/d33/d1f/d28/d7d/f54 6548162 1 2024-09-20T19:06:02.734 INFO:tasks.workunit.client.0.smithi027.stdout:5/667: rmdir d4/da/de/d3e/d69 39 2024-09-20T19:06:02.735 INFO:tasks.workunit.client.0.smithi027.stdout:2/557: dwrite d3/d1c/d26/f67 [4194304,4194304] 0 2024-09-20T19:06:02.736 INFO:tasks.workunit.client.1.smithi098.stdout:0/374: creat d0/d6/d19/d4f/f6b x:0 0 0 2024-09-20T19:06:02.737 INFO:tasks.workunit.client.1.smithi098.stdout:5/476: fdatasync d1/d1b/f5a 0 2024-09-20T19:06:02.738 INFO:tasks.workunit.client.1.smithi098.stdout:5/477: chown d1/d46/d69/d84/d87/f8e 191895 1 2024-09-20T19:06:02.739 INFO:tasks.workunit.client.0.smithi027.stdout:0/669: mknod d2/d48/d6b/d79/d9f/da4/cf5 0 2024-09-20T19:06:02.740 INFO:tasks.workunit.client.1.smithi098.stdout:4/654: mkdir d3/d6/d8c/de7 0 2024-09-20T19:06:02.741 INFO:tasks.workunit.client.1.smithi098.stdout:4/655: dread - d3/d7d/fc1 zero size 2024-09-20T19:06:02.741 INFO:tasks.workunit.client.0.smithi027.stdout:6/598: dwrite d4/d6/f11 [0,4194304] 0 2024-09-20T19:06:02.743 INFO:tasks.workunit.client.1.smithi098.stdout:8/647: creat d7/de/d11/d19/d47/fe7 x:0 0 0 2024-09-20T19:06:02.743 INFO:tasks.workunit.client.0.smithi027.stdout:9/740: creat d0/d9/df/d1b/ff0 x:0 0 0 2024-09-20T19:06:02.746 INFO:tasks.workunit.client.1.smithi098.stdout:6/371: creat d0/de/d1b/d37/d43/d51/f72 x:0 0 0 2024-09-20T19:06:02.748 INFO:tasks.workunit.client.0.smithi027.stdout:3/585: dwrite d0/d1/d5e/f1e [0,4194304] 0 2024-09-20T19:06:02.749 INFO:tasks.workunit.client.0.smithi027.stdout:3/586: chown d0/d1/d13/d15/c63 115337749 1 2024-09-20T19:06:02.758 INFO:tasks.workunit.client.0.smithi027.stdout:5/668: read d4/da/de/f66 [3855899,116951] 0 2024-09-20T19:06:02.758 INFO:tasks.workunit.client.1.smithi098.stdout:5/478: creat d1/d46/d69/f8f x:0 0 0 2024-09-20T19:06:02.760 INFO:tasks.workunit.client.1.smithi098.stdout:4/656: creat d3/d6/d11/d1e/d2a/d45/fe8 x:0 0 0 2024-09-20T19:06:02.761 INFO:tasks.workunit.client.1.smithi098.stdout:8/648: mkdir d7/de/d11/d1f/d57/d72/de8 0 2024-09-20T19:06:02.762 INFO:tasks.workunit.client.1.smithi098.stdout:9/617: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:06:02.764 INFO:tasks.workunit.client.1.smithi098.stdout:9/618: readlink d4/de/d24/d35/d2d/l5d 0 2024-09-20T19:06:02.765 INFO:tasks.workunit.client.0.smithi027.stdout:6/599: unlink d4/d15/l86 0 2024-09-20T19:06:02.766 INFO:tasks.workunit.client.1.smithi098.stdout:9/619: truncate d4/de/d24/d35/d2d/da6/dae/d86/fcb 376139 0 2024-09-20T19:06:02.769 INFO:tasks.workunit.client.0.smithi027.stdout:7/573: rename d3/d8/da/d2e/d49/lbe to d3/d8/da/d2e/d39/lc6 0 2024-09-20T19:06:02.771 INFO:tasks.workunit.client.1.smithi098.stdout:8/649: dwrite d7/de/d11/d19/d47/f99 [4194304,4194304] 0 2024-09-20T19:06:02.775 INFO:tasks.workunit.client.0.smithi027.stdout:7/574: dread d3/d8/f96 [0,4194304] 0 2024-09-20T19:06:02.781 INFO:tasks.workunit.client.0.smithi027.stdout:5/669: mknod d4/da/d98/cd8 0 2024-09-20T19:06:02.787 INFO:tasks.workunit.client.0.smithi027.stdout:4/532: rename d5/d13/d16/f22 to d5/d11/d3d/fa8 0 2024-09-20T19:06:02.788 INFO:tasks.workunit.client.1.smithi098.stdout:1/533: link d1/d3/df/d34/d43/c5d d1/d3/df/d34/d43/cac 0 2024-09-20T19:06:02.789 INFO:tasks.workunit.client.0.smithi027.stdout:4/533: truncate d5/d11/d17/d1b/d8d/d26/f47 348032 0 2024-09-20T19:06:02.789 INFO:tasks.workunit.client.1.smithi098.stdout:6/372: dread d0/de/d1b/f1c [0,4194304] 0 2024-09-20T19:06:02.795 INFO:tasks.workunit.client.0.smithi027.stdout:1/596: getdents d2/d8/d2b 0 2024-09-20T19:06:02.795 INFO:tasks.workunit.client.1.smithi098.stdout:8/650: read d7/de/d11/d19/d30/d55/d9d/fd3 [18369,7082] 0 2024-09-20T19:06:02.797 INFO:tasks.workunit.client.1.smithi098.stdout:1/534: dwrite d1/f9f [0,4194304] 0 2024-09-20T19:06:02.798 INFO:tasks.workunit.client.0.smithi027.stdout:7/575: write d3/d8/d26/f73 [1037594,77815] 0 2024-09-20T19:06:02.799 INFO:tasks.workunit.client.1.smithi098.stdout:6/373: dwrite d0/de/d1b/d37/d44/d24/f3e [0,4194304] 0 2024-09-20T19:06:02.806 INFO:tasks.workunit.client.0.smithi027.stdout:0/670: creat d2/ff6 x:0 0 0 2024-09-20T19:06:02.806 INFO:tasks.workunit.client.1.smithi098.stdout:6/374: dread - d0/de/d1b/d37/d44/dc/f5c zero size 2024-09-20T19:06:02.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/651: dread d7/de/d11/d19/d47/f63 [0,4194304] 0 2024-09-20T19:06:02.807 INFO:tasks.workunit.client.1.smithi098.stdout:6/375: chown d0/f60 804618 1 2024-09-20T19:06:02.808 INFO:tasks.workunit.client.0.smithi027.stdout:0/671: write d2/d48/d6b/d79/fb4 [242837,3535] 0 2024-09-20T19:06:02.810 INFO:tasks.workunit.client.0.smithi027.stdout:9/741: creat d0/d9/ff1 x:0 0 0 2024-09-20T19:06:02.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/535: dwrite d1/d3/df/d34/d43/d53/f7f [0,4194304] 0 2024-09-20T19:06:02.814 INFO:tasks.workunit.client.1.smithi098.stdout:1/536: stat d1/d3/df/d34/d43/d53/f74 0 2024-09-20T19:06:02.817 INFO:tasks.workunit.client.0.smithi027.stdout:8/596: rename d2/d14/d13/f7c to d2/d14/d13/d51/fc2 0 2024-09-20T19:06:02.818 INFO:tasks.workunit.client.1.smithi098.stdout:1/537: dread d1/d3/df/d4a/f5c [0,4194304] 0 2024-09-20T19:06:02.820 INFO:tasks.workunit.client.0.smithi027.stdout:4/534: unlink d5/d13/d16/l2f 0 2024-09-20T19:06:02.822 INFO:tasks.workunit.client.1.smithi098.stdout:0/375: link d0/f47 d0/d55/d38/f6c 0 2024-09-20T19:06:02.825 INFO:tasks.workunit.client.1.smithi098.stdout:7/607: truncate d3/d10/d16/d17/d33/d1f/f43 1629767 0 2024-09-20T19:06:02.831 INFO:tasks.workunit.client.1.smithi098.stdout:4/657: rename d3/d5e/d9f/fa0 to d3/d6/d11/fe9 0 2024-09-20T19:06:02.831 INFO:tasks.workunit.client.0.smithi027.stdout:0/672: rmdir d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4 39 2024-09-20T19:06:02.832 INFO:tasks.workunit.client.0.smithi027.stdout:9/742: truncate d0/f75 1452838 0 2024-09-20T19:06:02.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/652: unlink d7/de/d11/d1d/l2b 0 2024-09-20T19:06:02.834 INFO:tasks.workunit.client.0.smithi027.stdout:4/535: dread d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:02.834 INFO:tasks.workunit.client.0.smithi027.stdout:4/536: fsync d5/d13/f90 0 2024-09-20T19:06:02.837 INFO:tasks.workunit.client.0.smithi027.stdout:2/558: rename d3/c6b to d3/d1c/d31/d9e/cac 0 2024-09-20T19:06:02.838 INFO:tasks.workunit.client.0.smithi027.stdout:4/537: dread d5/d11/d17/d1b/d8d/f33 [0,4194304] 0 2024-09-20T19:06:02.838 INFO:tasks.workunit.client.1.smithi098.stdout:6/376: symlink d0/de/d1b/d37/l73 0 2024-09-20T19:06:02.839 INFO:tasks.workunit.client.0.smithi027.stdout:4/538: write d5/d13/f30 [2803245,64038] 0 2024-09-20T19:06:02.839 INFO:tasks.workunit.client.1.smithi098.stdout:6/377: truncate d0/de/f6c 405037 0 2024-09-20T19:06:02.840 INFO:tasks.workunit.client.0.smithi027.stdout:4/539: stat d5/d11/d17/d1b/d8d 0 2024-09-20T19:06:02.842 INFO:tasks.workunit.client.0.smithi027.stdout:4/540: fdatasync d5/d13/d36/d48/d3f/f86 0 2024-09-20T19:06:02.843 INFO:tasks.workunit.client.1.smithi098.stdout:1/538: unlink d1/d3/df/d34/d43/d65/f6b 0 2024-09-20T19:06:02.845 INFO:tasks.workunit.client.0.smithi027.stdout:8/597: dwrite d2/d14/d13/d2e/d6c/d77/f8a [0,4194304] 0 2024-09-20T19:06:02.845 INFO:tasks.workunit.client.0.smithi027.stdout:1/597: link d2/d8/d74/f5a d2/d8/d3b/d82/d90/fc3 0 2024-09-20T19:06:02.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/376: creat d0/d55/d67/f6d x:0 0 0 2024-09-20T19:06:02.856 INFO:tasks.workunit.client.1.smithi098.stdout:5/479: link d1/d1b/d40/f4c d1/d17/d25/f90 0 2024-09-20T19:06:02.857 INFO:tasks.workunit.client.1.smithi098.stdout:5/480: write d1/d46/f83 [730229,55982] 0 2024-09-20T19:06:02.858 INFO:tasks.workunit.client.0.smithi027.stdout:2/559: dread d3/d1c/f23 [0,4194304] 0 2024-09-20T19:06:02.863 INFO:tasks.workunit.client.1.smithi098.stdout:6/378: mkdir d0/de/d1b/d37/d44/dc/d74 0 2024-09-20T19:06:02.864 INFO:tasks.workunit.client.1.smithi098.stdout:6/379: write d0/de/d1b/d37/d44/dc/f41 [908911,39424] 0 2024-09-20T19:06:02.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/620: link d4/de/d24/d35/d2d/da6/lad d4/de/d27/d4a/d21/lcd 0 2024-09-20T19:06:02.868 INFO:tasks.workunit.client.1.smithi098.stdout:1/539: mkdir d1/d3/df/d34/d43/dad 0 2024-09-20T19:06:02.869 INFO:tasks.workunit.client.1.smithi098.stdout:1/540: stat d1/d3/df/d34/d43/d65 0 2024-09-20T19:06:02.871 INFO:tasks.workunit.client.1.smithi098.stdout:0/377: symlink d0/db/d32/l6e 0 2024-09-20T19:06:02.874 INFO:tasks.workunit.client.0.smithi027.stdout:1/598: unlink d2/d8/d3b/cb0 0 2024-09-20T19:06:02.875 INFO:tasks.workunit.client.0.smithi027.stdout:1/599: fdatasync d2/d8/d2b/d2d/d3e/f6e 0 2024-09-20T19:06:02.875 INFO:tasks.workunit.client.0.smithi027.stdout:1/600: fdatasync d2/d1b/d56/d71/f7a 0 2024-09-20T19:06:02.876 INFO:tasks.workunit.client.0.smithi027.stdout:5/670: creat d4/da/de/d3e/d69/d75/fd9 x:0 0 0 2024-09-20T19:06:02.878 INFO:tasks.workunit.client.0.smithi027.stdout:5/671: chown d4/da/de/d3e/db7/dc2/f97 29 1 2024-09-20T19:06:02.879 INFO:tasks.workunit.client.1.smithi098.stdout:9/621: dread d4/de/d27/d4a/d21/f36 [0,4194304] 0 2024-09-20T19:06:02.879 INFO:tasks.workunit.client.1.smithi098.stdout:4/658: rename d3/c20 to d3/d7d/da3/d3c/d6b/d73/d98/de0/cea 0 2024-09-20T19:06:02.880 INFO:tasks.workunit.client.0.smithi027.stdout:3/587: sync 2024-09-20T19:06:02.880 INFO:tasks.workunit.client.1.smithi098.stdout:9/622: chown d4/de/d27/d4a/d8e/f95 14 1 2024-09-20T19:06:02.881 INFO:tasks.workunit.client.1.smithi098.stdout:8/653: mknod d7/de/d11/d19/d30/d55/da9/dbe/ce9 0 2024-09-20T19:06:02.881 INFO:tasks.workunit.client.0.smithi027.stdout:9/743: dwrite d0/d9/df/d1c/d6a/d6d/dd/f38 [0,4194304] 0 2024-09-20T19:06:02.881 INFO:tasks.workunit.client.1.smithi098.stdout:4/659: read - d3/d7d/da3/d3c/d6b/d73/d98/db3/fdd zero size 2024-09-20T19:06:02.882 INFO:tasks.workunit.client.1.smithi098.stdout:8/654: write d7/de/d11/d1f/d9c/f9e [579999,116055] 0 2024-09-20T19:06:02.883 INFO:tasks.workunit.client.1.smithi098.stdout:4/660: fdatasync d3/d6/d8c/f8e 0 2024-09-20T19:06:02.885 INFO:tasks.workunit.client.0.smithi027.stdout:9/744: dread d0/d9/df/f74 [0,4194304] 0 2024-09-20T19:06:02.887 INFO:tasks.workunit.client.0.smithi027.stdout:2/560: mkdir d3/d13/d3c/d48/dad 0 2024-09-20T19:06:02.888 INFO:tasks.workunit.client.1.smithi098.stdout:4/661: dread d3/f5 [0,4194304] 0 2024-09-20T19:06:02.891 INFO:tasks.workunit.client.1.smithi098.stdout:1/541: symlink d1/d3/d62/lae 0 2024-09-20T19:06:02.893 INFO:tasks.workunit.client.1.smithi098.stdout:0/378: creat d0/d6/d28/f6f x:0 0 0 2024-09-20T19:06:02.894 INFO:tasks.workunit.client.0.smithi027.stdout:4/541: dwrite d5/d13/d36/d49/f8c [0,4194304] 0 2024-09-20T19:06:02.895 INFO:tasks.workunit.client.0.smithi027.stdout:4/542: fsync d5/d11/d3d/d6e/f6b 0 2024-09-20T19:06:02.901 INFO:tasks.workunit.client.1.smithi098.stdout:5/481: write d1/f33 [1115839,34510] 0 2024-09-20T19:06:02.902 INFO:tasks.workunit.client.0.smithi027.stdout:3/588: mknod d0/d1/d13/d15/d55/cbf 0 2024-09-20T19:06:02.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/623: fsync d4/de/d27/d4a/d21/f46 0 2024-09-20T19:06:02.908 INFO:tasks.workunit.client.0.smithi027.stdout:9/745: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2 0 2024-09-20T19:06:02.910 INFO:tasks.workunit.client.0.smithi027.stdout:6/600: rename d4/d15/d37/d85 to d4/d15/d37/d6a/dbf 0 2024-09-20T19:06:02.911 INFO:tasks.workunit.client.1.smithi098.stdout:8/655: rmdir d7/de/d11/d19/d30 39 2024-09-20T19:06:02.914 INFO:tasks.workunit.client.1.smithi098.stdout:6/380: creat d0/de/d1b/d37/d43/d6d/f75 x:0 0 0 2024-09-20T19:06:02.915 INFO:tasks.workunit.client.0.smithi027.stdout:4/543: fsync d5/d9b/f4e 0 2024-09-20T19:06:02.916 INFO:tasks.workunit.client.1.smithi098.stdout:4/662: rmdir d3/d7d/da3/d3c 39 2024-09-20T19:06:02.916 INFO:tasks.workunit.client.0.smithi027.stdout:4/544: chown d5/d11/d17/d1b/d8d/l72 6704 1 2024-09-20T19:06:02.918 INFO:tasks.workunit.client.0.smithi027.stdout:3/589: symlink d0/d1/d13/lc0 0 2024-09-20T19:06:02.919 INFO:tasks.workunit.client.0.smithi027.stdout:1/601: dwrite d2/d1b/f49 [0,4194304] 0 2024-09-20T19:06:02.922 INFO:tasks.workunit.client.0.smithi027.stdout:9/746: creat d0/d9/df/d1c/d6a/d6d/dd/d66/ff3 x:0 0 0 2024-09-20T19:06:02.923 INFO:tasks.workunit.client.1.smithi098.stdout:7/608: dread d3/d10/d16/d17/d33/d1f/d2d/f77 [0,4194304] 0 2024-09-20T19:06:02.927 INFO:tasks.workunit.client.0.smithi027.stdout:4/545: write d5/f34 [1405321,101839] 0 2024-09-20T19:06:02.931 INFO:tasks.workunit.client.0.smithi027.stdout:3/590: mknod d0/d1/d13/d15/d55/d70/cc1 0 2024-09-20T19:06:02.933 INFO:tasks.workunit.client.1.smithi098.stdout:5/482: mknod d1/d1b/c91 0 2024-09-20T19:06:02.937 INFO:tasks.workunit.client.0.smithi027.stdout:6/601: creat d4/d15/d37/d6a/d91/fc0 x:0 0 0 2024-09-20T19:06:02.938 INFO:tasks.workunit.client.0.smithi027.stdout:4/546: mkdir d5/d11/d17/d1b/da9 0 2024-09-20T19:06:02.939 INFO:tasks.workunit.client.0.smithi027.stdout:3/591: mkdir d0/d19/dc2 0 2024-09-20T19:06:02.939 INFO:tasks.workunit.client.0.smithi027.stdout:6/602: write d4/d15/d37/d7a/f58 [873509,26410] 0 2024-09-20T19:06:02.940 INFO:tasks.workunit.client.0.smithi027.stdout:1/602: dwrite d2/d8/f70 [0,4194304] 0 2024-09-20T19:06:02.941 INFO:tasks.workunit.client.0.smithi027.stdout:4/547: fsync d5/d13/d36/d49/fa5 0 2024-09-20T19:06:02.942 INFO:tasks.workunit.client.0.smithi027.stdout:3/592: chown d0/d1/d5e/d1d/f84 282 1 2024-09-20T19:06:02.943 INFO:tasks.workunit.client.1.smithi098.stdout:6/381: link d0/de/d1b/f28 d0/de/d1b/d37/d44/d24/d29/d50/f76 0 2024-09-20T19:06:02.943 INFO:tasks.workunit.client.0.smithi027.stdout:4/548: write d5/d9b/f4e [3758464,33779] 0 2024-09-20T19:06:02.943 INFO:tasks.workunit.client.1.smithi098.stdout:9/624: dread d4/de/d27/d6c/d73/db5/fbe [0,4194304] 0 2024-09-20T19:06:02.950 INFO:tasks.workunit.client.0.smithi027.stdout:0/673: rename d2/da2/ld1 to d2/d48/d6b/d79/d84/d1b/dc5/lf7 0 2024-09-20T19:06:02.951 INFO:tasks.workunit.client.0.smithi027.stdout:4/549: dwrite d5/d13/d36/d48/d3f/d4c/d52/d87/d99/f61 [0,4194304] 0 2024-09-20T19:06:02.953 INFO:tasks.workunit.client.1.smithi098.stdout:6/382: dwrite d0/de/f6c [0,4194304] 0 2024-09-20T19:06:02.953 INFO:tasks.workunit.client.1.smithi098.stdout:1/542: dread d1/d3/df/d34/d43/f59 [0,4194304] 0 2024-09-20T19:06:02.954 INFO:tasks.workunit.client.0.smithi027.stdout:9/747: link d0/d9/df/d1b/d9c/c41 d0/d9/df/cf4 0 2024-09-20T19:06:02.955 INFO:tasks.workunit.client.0.smithi027.stdout:9/748: chown d0/d9/df/d1c/d6a/d6d/dd/d58/l80 12 1 2024-09-20T19:06:02.957 INFO:tasks.workunit.client.1.smithi098.stdout:9/625: getdents d4/de/d27/dc9 0 2024-09-20T19:06:02.957 INFO:tasks.workunit.client.1.smithi098.stdout:7/609: write d3/d10/d16/f6c [672468,95038] 0 2024-09-20T19:06:02.959 INFO:tasks.workunit.client.0.smithi027.stdout:1/603: symlink d2/d8/d74/d9a/da3/dad/db1/lc4 0 2024-09-20T19:06:02.959 INFO:tasks.workunit.client.1.smithi098.stdout:8/656: dwrite d7/de/d11/d19/d47/f73 [0,4194304] 0 2024-09-20T19:06:02.961 INFO:tasks.workunit.client.0.smithi027.stdout:4/550: creat d5/d13/d36/d48/d3f/d4c/d52/faa x:0 0 0 2024-09-20T19:06:02.962 INFO:tasks.workunit.client.0.smithi027.stdout:1/604: rmdir d2/d8/d3b/d82 39 2024-09-20T19:06:02.963 INFO:tasks.workunit.client.0.smithi027.stdout:1/605: readlink d2/d8/d3b/d4b/l5b 0 2024-09-20T19:06:02.966 INFO:tasks.workunit.client.0.smithi027.stdout:8/598: rename d2/d3/f31 to d2/fc3 0 2024-09-20T19:06:02.968 INFO:tasks.workunit.client.0.smithi027.stdout:4/551: creat d5/d13/d36/d60/fab x:0 0 0 2024-09-20T19:06:02.970 INFO:tasks.workunit.client.1.smithi098.stdout:1/543: truncate d1/d3/df/d34/d43/f56 587731 0 2024-09-20T19:06:02.972 INFO:tasks.workunit.client.0.smithi027.stdout:8/599: dread d2/d3/f57 [0,4194304] 0 2024-09-20T19:06:02.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/610: unlink d3/l6e 0 2024-09-20T19:06:02.975 INFO:tasks.workunit.client.1.smithi098.stdout:6/383: dwrite d0/de/d1b/d37/d44/d24/d29/d2b/d65/f6a [0,4194304] 0 2024-09-20T19:06:02.977 INFO:tasks.workunit.client.1.smithi098.stdout:9/626: dwrite d4/de/d27/d4a/d21/d25/d51/d7b/fc5 [0,4194304] 0 2024-09-20T19:06:02.981 INFO:tasks.workunit.client.0.smithi027.stdout:1/606: dread - d2/d8/d3b/d82/d87/fa2 zero size 2024-09-20T19:06:02.982 INFO:tasks.workunit.client.1.smithi098.stdout:5/483: write d1/f2c [759558,70395] 0 2024-09-20T19:06:02.982 INFO:tasks.workunit.client.1.smithi098.stdout:7/611: rename d3/d10/d16/d17/d33/d1f to d3/d10/d16/d17/d33/d1f/dba/dc3 22 2024-09-20T19:06:02.984 INFO:tasks.workunit.client.1.smithi098.stdout:6/384: dread d0/de/d1b/d37/d44/dc/fd [0,4194304] 0 2024-09-20T19:06:02.987 INFO:tasks.workunit.client.0.smithi027.stdout:3/593: rename d0/d80 to d0/d1/d13/d98/dc3 0 2024-09-20T19:06:02.987 INFO:tasks.workunit.client.1.smithi098.stdout:8/657: mknod d7/de/d11/d1f/d57/daa/cea 0 2024-09-20T19:06:02.989 INFO:tasks.workunit.client.0.smithi027.stdout:6/603: truncate f0 7739954 0 2024-09-20T19:06:02.991 INFO:tasks.workunit.client.0.smithi027.stdout:6/604: chown d4/d15/l5e 121 1 2024-09-20T19:06:02.995 INFO:tasks.workunit.client.1.smithi098.stdout:1/544: creat d1/d3/d2e/d71/faf x:0 0 0 2024-09-20T19:06:02.995 INFO:tasks.workunit.client.0.smithi027.stdout:4/552: creat d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fac x:0 0 0 2024-09-20T19:06:02.995 INFO:tasks.workunit.client.0.smithi027.stdout:4/553: truncate d5/d13/d16/f8b 224504 0 2024-09-20T19:06:02.996 INFO:tasks.workunit.client.1.smithi098.stdout:9/627: creat d4/de/d27/d6c/d73/fce x:0 0 0 2024-09-20T19:06:02.996 INFO:tasks.workunit.client.0.smithi027.stdout:4/554: truncate d5/d13/d16/f79 217865 0 2024-09-20T19:06:02.997 INFO:tasks.workunit.client.0.smithi027.stdout:1/607: symlink d2/d8/d41/lc5 0 2024-09-20T19:06:02.998 INFO:tasks.workunit.client.0.smithi027.stdout:4/555: read - d5/d13/f98 zero size 2024-09-20T19:06:02.999 INFO:tasks.workunit.client.0.smithi027.stdout:6/605: dwrite d4/d15/d37/d7a/d8e/fa4 [0,4194304] 0 2024-09-20T19:06:03.000 INFO:tasks.workunit.client.0.smithi027.stdout:0/674: rename d2/d48/d6b/f80 to d2/da2/ff8 0 2024-09-20T19:06:03.003 INFO:tasks.workunit.client.0.smithi027.stdout:1/608: dread d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:03.007 INFO:tasks.workunit.client.1.smithi098.stdout:1/545: rename d1/d3/d2e/d68/d89 to d1/d3/d2e/d68/d7a/db0 0 2024-09-20T19:06:03.008 INFO:tasks.workunit.client.1.smithi098.stdout:9/628: symlink d4/de/d24/d35/d2d/da6/dae/lcf 0 2024-09-20T19:06:03.009 INFO:tasks.workunit.client.0.smithi027.stdout:1/609: dwrite d2/d61/fae [0,4194304] 0 2024-09-20T19:06:03.010 INFO:tasks.workunit.client.0.smithi027.stdout:1/610: write d2/d1b/d56/d71/f95 [263131,41105] 0 2024-09-20T19:06:03.010 INFO:tasks.workunit.client.1.smithi098.stdout:9/629: write d4/de/d27/d4a/d21/d25/f59 [5182699,76445] 0 2024-09-20T19:06:03.012 INFO:tasks.workunit.client.0.smithi027.stdout:7/576: sync 2024-09-20T19:06:03.014 INFO:tasks.workunit.client.0.smithi027.stdout:3/594: dread d0/f5 [0,4194304] 0 2024-09-20T19:06:03.014 INFO:tasks.workunit.client.0.smithi027.stdout:8/600: dread d2/d14/d13/f3b [0,4194304] 0 2024-09-20T19:06:03.016 INFO:tasks.workunit.client.1.smithi098.stdout:1/546: symlink d1/d3/df/d34/d52/lb1 0 2024-09-20T19:06:03.019 INFO:tasks.workunit.client.0.smithi027.stdout:0/675: rename d2/le0 to d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/lf9 0 2024-09-20T19:06:03.020 INFO:tasks.workunit.client.0.smithi027.stdout:7/577: rmdir d3/d8/da/d2e 39 2024-09-20T19:06:03.020 INFO:tasks.workunit.client.1.smithi098.stdout:7/612: creat d3/d10/d16/d17/d33/d1f/d28/d7d/fc4 x:0 0 0 2024-09-20T19:06:03.021 INFO:tasks.workunit.client.1.smithi098.stdout:9/630: creat d4/de/d27/d4a/d58/d5b/fd0 x:0 0 0 2024-09-20T19:06:03.022 INFO:tasks.workunit.client.1.smithi098.stdout:1/547: chown d1/d3/df/d34/d43/dad 101817734 1 2024-09-20T19:06:03.023 INFO:tasks.workunit.client.0.smithi027.stdout:3/595: symlink d0/d1/d13/d15/d55/d70/lc4 0 2024-09-20T19:06:03.024 INFO:tasks.workunit.client.0.smithi027.stdout:8/601: mknod d2/d14/d13/d43/cc4 0 2024-09-20T19:06:03.026 INFO:tasks.workunit.client.1.smithi098.stdout:8/658: dread d7/de/d11/d19/d30/d55/d9d/fd3 [0,4194304] 0 2024-09-20T19:06:03.028 INFO:tasks.workunit.client.0.smithi027.stdout:7/578: chown d3/d8/da/d2e/d49/d8b/f42 2378234 1 2024-09-20T19:06:03.029 INFO:tasks.workunit.client.0.smithi027.stdout:7/579: stat d3/d8/da/d2e/d50/c81 0 2024-09-20T19:06:03.029 INFO:tasks.workunit.client.1.smithi098.stdout:1/548: write d1/d3/df/d34/d43/d53/f7f [1611221,18098] 0 2024-09-20T19:06:03.029 INFO:tasks.workunit.client.0.smithi027.stdout:7/580: write d3/d8/da/f46 [3937912,13476] 0 2024-09-20T19:06:03.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/631: mknod d4/cd1 0 2024-09-20T19:06:03.033 INFO:tasks.workunit.client.0.smithi027.stdout:3/596: unlink d0/d1/d13/d3c/f7e 0 2024-09-20T19:06:03.034 INFO:tasks.workunit.client.1.smithi098.stdout:8/659: creat d7/de/d11/d19/d30/d55/da9/dbe/feb x:0 0 0 2024-09-20T19:06:03.034 INFO:tasks.workunit.client.0.smithi027.stdout:8/602: rmdir d2/d3/d6/d6d/d75 39 2024-09-20T19:06:03.036 INFO:tasks.workunit.client.1.smithi098.stdout:8/660: stat d7/de/d11/d19/d30/d55/fd9 0 2024-09-20T19:06:03.036 INFO:tasks.workunit.client.0.smithi027.stdout:7/581: mkdir d3/d5e/dc7 0 2024-09-20T19:06:03.037 INFO:tasks.workunit.client.1.smithi098.stdout:1/549: dwrite d1/d3/d62/f8e [0,4194304] 0 2024-09-20T19:06:03.040 INFO:tasks.workunit.client.1.smithi098.stdout:7/613: getdents d3/daa 0 2024-09-20T19:06:03.042 INFO:tasks.workunit.client.1.smithi098.stdout:1/550: creat d1/d3/d2e/d68/d7a/fb2 x:0 0 0 2024-09-20T19:06:03.044 INFO:tasks.workunit.client.0.smithi027.stdout:8/603: creat d2/d3/d1b/d35/fc5 x:0 0 0 2024-09-20T19:06:03.045 INFO:tasks.workunit.client.0.smithi027.stdout:8/604: write d2/f39 [5919187,100820] 0 2024-09-20T19:06:03.049 INFO:tasks.workunit.client.0.smithi027.stdout:3/597: mkdir d0/dc5 0 2024-09-20T19:06:03.052 INFO:tasks.workunit.client.1.smithi098.stdout:7/614: dread d3/d10/d16/d17/d33/d37/da0/f4d [0,4194304] 0 2024-09-20T19:06:03.055 INFO:tasks.workunit.client.1.smithi098.stdout:8/661: creat d7/de/d11/d1f/dcd/db3/dcb/fec x:0 0 0 2024-09-20T19:06:03.055 INFO:tasks.workunit.client.0.smithi027.stdout:3/598: dwrite d0/d1/fb [4194304,4194304] 0 2024-09-20T19:06:03.057 INFO:tasks.workunit.client.0.smithi027.stdout:0/676: getdents d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29 0 2024-09-20T19:06:03.060 INFO:tasks.workunit.client.0.smithi027.stdout:8/605: symlink d2/d14/d13/db5/lc6 0 2024-09-20T19:06:03.062 INFO:tasks.workunit.client.1.smithi098.stdout:5/484: dwrite d1/f2 [0,4194304] 0 2024-09-20T19:06:03.065 INFO:tasks.workunit.client.1.smithi098.stdout:1/551: symlink d1/d3/lb3 0 2024-09-20T19:06:03.069 INFO:tasks.workunit.client.1.smithi098.stdout:7/615: write d3/d10/d16/d17/d33/d1f/d28/f4a [506898,85728] 0 2024-09-20T19:06:03.069 INFO:tasks.workunit.client.1.smithi098.stdout:6/385: truncate d0/de/d1b/d37/d44/dc/f1a 487209 0 2024-09-20T19:06:03.073 INFO:tasks.workunit.client.1.smithi098.stdout:1/552: dwrite d1/f90 [0,4194304] 0 2024-09-20T19:06:03.076 INFO:tasks.workunit.client.0.smithi027.stdout:4/556: write d5/d11/d51/f56 [1170246,45043] 0 2024-09-20T19:06:03.076 INFO:tasks.workunit.client.0.smithi027.stdout:3/599: mkdir d0/d1/d13/d98/dab/dba/dc6 0 2024-09-20T19:06:03.077 INFO:tasks.workunit.client.0.smithi027.stdout:4/557: chown d5/d13/d36/f7b 228983 1 2024-09-20T19:06:03.080 INFO:tasks.workunit.client.0.smithi027.stdout:0/677: fdatasync d2/fe 0 2024-09-20T19:06:03.084 INFO:tasks.workunit.client.0.smithi027.stdout:8/606: mknod d2/d3/d6/d21/d33/cc7 0 2024-09-20T19:06:03.084 INFO:tasks.workunit.client.0.smithi027.stdout:8/607: fsync d2/d3/d6/d21/d33/fa1 0 2024-09-20T19:06:03.085 INFO:tasks.workunit.client.0.smithi027.stdout:8/608: chown d2/d3/d1b/l6b 16323 1 2024-09-20T19:06:03.086 INFO:tasks.workunit.client.1.smithi098.stdout:8/662: creat d7/de/d11/dca/fed x:0 0 0 2024-09-20T19:06:03.088 INFO:tasks.workunit.client.0.smithi027.stdout:3/600: rename d0/d1/d13/d64/db9 to d0/d1/d5e/d1d/da7/db0/dc7 0 2024-09-20T19:06:03.089 INFO:tasks.workunit.client.0.smithi027.stdout:3/601: write d0/d19/f4a [1075992,33210] 0 2024-09-20T19:06:03.090 INFO:tasks.workunit.client.1.smithi098.stdout:6/386: mknod d0/de/d1b/d37/d44/d24/d29/d42/c77 0 2024-09-20T19:06:03.090 INFO:tasks.workunit.client.0.smithi027.stdout:3/602: fdatasync d0/d19/f9c 0 2024-09-20T19:06:03.091 INFO:tasks.workunit.client.0.smithi027.stdout:4/558: symlink d5/d13/d36/d48/d3f/d4c/d52/lad 0 2024-09-20T19:06:03.092 INFO:tasks.workunit.client.0.smithi027.stdout:1/611: truncate d2/d8/d2b/d2d/d73/f85 3212284 0 2024-09-20T19:06:03.093 INFO:tasks.workunit.client.0.smithi027.stdout:1/612: fdatasync d2/f50 0 2024-09-20T19:06:03.103 INFO:tasks.workunit.client.1.smithi098.stdout:1/553: mknod d1/d3/df/cb4 0 2024-09-20T19:06:03.104 INFO:tasks.workunit.client.1.smithi098.stdout:7/616: link d3/d10/d16/d17/d33/d37/da0/f63 d3/d10/d16/d17/d33/d1f/dba/fc5 0 2024-09-20T19:06:03.104 INFO:tasks.workunit.client.1.smithi098.stdout:9/632: dwrite d4/de/d27/d4a/d21/d25/d51/f55 [0,4194304] 0 2024-09-20T19:06:03.105 INFO:tasks.workunit.client.1.smithi098.stdout:9/633: chown d4/f47 48726 1 2024-09-20T19:06:03.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/387: unlink d0/de/d1b/d37/d44/d24/d29/d50/f76 0 2024-09-20T19:06:03.110 INFO:tasks.workunit.client.1.smithi098.stdout:5/485: rename d1/d17/d35/l75 to d1/d17/d25/d56/l92 0 2024-09-20T19:06:03.111 INFO:tasks.workunit.client.1.smithi098.stdout:7/617: symlink d3/d10/d16/d17/d7c/lc6 0 2024-09-20T19:06:03.113 INFO:tasks.workunit.client.1.smithi098.stdout:9/634: creat d4/de/d27/d4a/d8e/fd2 x:0 0 0 2024-09-20T19:06:03.113 INFO:tasks.workunit.client.1.smithi098.stdout:9/635: chown f0 672394097 1 2024-09-20T19:06:03.116 INFO:tasks.workunit.client.1.smithi098.stdout:7/618: symlink d3/d10/d16/dc1/lc7 0 2024-09-20T19:06:03.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/619: write d3/d10/d16/f2c [4116546,106549] 0 2024-09-20T19:06:03.118 INFO:tasks.workunit.client.1.smithi098.stdout:9/636: creat d4/de/d27/d4a/d58/d5b/d8f/d9e/fd3 x:0 0 0 2024-09-20T19:06:03.119 INFO:tasks.workunit.client.1.smithi098.stdout:9/637: fdatasync d4/f10 0 2024-09-20T19:06:03.120 INFO:tasks.workunit.client.1.smithi098.stdout:7/620: write d3/d76/d86/fb1 [683549,26330] 0 2024-09-20T19:06:03.121 INFO:tasks.workunit.client.1.smithi098.stdout:7/621: chown d3/d10/d16/d17/d33/d37/l89 29 1 2024-09-20T19:06:03.124 INFO:tasks.workunit.client.1.smithi098.stdout:7/622: write d3/d10/d16/d17/d33/d37/f98 [3867098,30332] 0 2024-09-20T19:06:03.125 INFO:tasks.workunit.client.1.smithi098.stdout:9/638: dread d4/de/f1f [0,4194304] 0 2024-09-20T19:06:03.128 INFO:tasks.workunit.client.1.smithi098.stdout:7/623: dread - d3/d76/d7a/fbc zero size 2024-09-20T19:06:03.128 INFO:tasks.workunit.client.0.smithi027.stdout:8/609: rmdir d2/d65 39 2024-09-20T19:06:03.130 INFO:tasks.workunit.client.0.smithi027.stdout:1/613: read d2/d8/d2b/d2d/f34 [1644752,10006] 0 2024-09-20T19:06:03.130 INFO:tasks.workunit.client.0.smithi027.stdout:3/603: creat d0/d1/d13/d15/db3/fc8 x:0 0 0 2024-09-20T19:06:03.131 INFO:tasks.workunit.client.1.smithi098.stdout:7/624: rmdir d3/d10/d16/d17/d33/d1f 39 2024-09-20T19:06:03.131 INFO:tasks.workunit.client.0.smithi027.stdout:1/614: read d2/f50 [3242905,86243] 0 2024-09-20T19:06:03.133 INFO:tasks.workunit.client.1.smithi098.stdout:9/639: creat d4/de/d27/d4a/fd4 x:0 0 0 2024-09-20T19:06:03.135 INFO:tasks.workunit.client.0.smithi027.stdout:8/610: write d2/d3/d6/f94 [257035,118369] 0 2024-09-20T19:06:03.136 INFO:tasks.workunit.client.1.smithi098.stdout:9/640: dread d4/de/d27/d4a/d21/d25/d51/f9d [0,4194304] 0 2024-09-20T19:06:03.137 INFO:tasks.workunit.client.0.smithi027.stdout:3/604: mkdir d0/d1/d65/dc9 0 2024-09-20T19:06:03.138 INFO:tasks.workunit.client.1.smithi098.stdout:9/641: chown d4/de/d27/d4a/d58/fab 62 1 2024-09-20T19:06:03.139 INFO:tasks.workunit.client.1.smithi098.stdout:9/642: fdatasync d4/de/d24/f8b 0 2024-09-20T19:06:03.140 INFO:tasks.workunit.client.0.smithi027.stdout:1/615: mknod d2/d8/d2b/cc6 0 2024-09-20T19:06:03.140 INFO:tasks.workunit.client.0.smithi027.stdout:3/605: truncate d0/d1/d13/f8c 1018163 0 2024-09-20T19:06:03.140 INFO:tasks.workunit.client.1.smithi098.stdout:8/663: write d7/de/d11/f6b [773512,213] 0 2024-09-20T19:06:03.143 INFO:tasks.workunit.client.1.smithi098.stdout:7/625: rename d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/cb5 to d3/d76/db8/da6/cc8 0 2024-09-20T19:06:03.143 INFO:tasks.workunit.client.1.smithi098.stdout:8/664: symlink d7/de/d11/d1f/d57/lee 0 2024-09-20T19:06:03.144 INFO:tasks.workunit.client.1.smithi098.stdout:9/643: mkdir d4/de/d27/d4a/d58/d5b/d8f/dd5 0 2024-09-20T19:06:03.145 INFO:tasks.workunit.client.1.smithi098.stdout:8/665: write d7/de/d11/d19/d30/d55/fa8 [790655,8033] 0 2024-09-20T19:06:03.146 INFO:tasks.workunit.client.1.smithi098.stdout:9/644: chown d4/de/d27/d4a/d58/c62 58395707 1 2024-09-20T19:06:03.149 INFO:tasks.workunit.client.1.smithi098.stdout:9/645: readlink d4/de/d24/d35/d6d/l77 0 2024-09-20T19:06:03.154 INFO:tasks.workunit.client.1.smithi098.stdout:5/486: write d1/d17/f63 [1807665,129310] 0 2024-09-20T19:06:03.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/487: mkdir d1/d17/d35/d93 0 2024-09-20T19:06:03.163 INFO:tasks.workunit.client.1.smithi098.stdout:6/388: dwrite d0/de/d1b/f1c [0,4194304] 0 2024-09-20T19:06:03.164 INFO:tasks.workunit.client.1.smithi098.stdout:9/646: dwrite d4/de/d27/d4a/d8e/f95 [0,4194304] 0 2024-09-20T19:06:03.175 INFO:tasks.workunit.client.1.smithi098.stdout:7/626: dwrite d3/d10/d16/d17/d33/d37/f74 [0,4194304] 0 2024-09-20T19:06:03.176 INFO:tasks.workunit.client.1.smithi098.stdout:8/666: dwrite d7/de/d11/d19/f4c [0,4194304] 0 2024-09-20T19:06:03.189 INFO:tasks.workunit.client.1.smithi098.stdout:6/389: mknod d0/de/d1b/d37/d43/d51/c78 0 2024-09-20T19:06:03.189 INFO:tasks.workunit.client.0.smithi027.stdout:0/678: dread d2/d48/d6b/d79/d84/d1b/dc5/f3d [0,4194304] 0 2024-09-20T19:06:03.191 INFO:tasks.workunit.client.1.smithi098.stdout:6/390: write d0/de/d1b/d37/d44/d24/d29/f35 [4695182,102109] 0 2024-09-20T19:06:03.192 INFO:tasks.workunit.client.1.smithi098.stdout:9/647: mknod d4/de/d24/d35/cd6 0 2024-09-20T19:06:03.193 INFO:tasks.workunit.client.0.smithi027.stdout:3/606: symlink d0/d1/d13/d15/d6f/d7f/lca 0 2024-09-20T19:06:03.194 INFO:tasks.workunit.client.1.smithi098.stdout:9/648: write d4/de/d24/d35/d2d/da6/dae/d86/fcb [602592,47213] 0 2024-09-20T19:06:03.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/649: fdatasync d4/de/d27/d4a/f4b 0 2024-09-20T19:06:03.196 INFO:tasks.workunit.client.0.smithi027.stdout:0/679: mkdir d2/d48/d6b/d79/d84/dfa 0 2024-09-20T19:06:03.196 INFO:tasks.workunit.client.1.smithi098.stdout:6/391: readlink d0/de/d1b/l67 0 2024-09-20T19:06:03.198 INFO:tasks.workunit.client.1.smithi098.stdout:7/627: dread d3/d10/d16/d17/d33/d1f/d2d/f3b [0,4194304] 0 2024-09-20T19:06:03.199 INFO:tasks.workunit.client.1.smithi098.stdout:9/650: mkdir d4/de/d24/d35/dc4/dd7 0 2024-09-20T19:06:03.200 INFO:tasks.workunit.client.0.smithi027.stdout:8/611: dwrite d2/fc3 [0,4194304] 0 2024-09-20T19:06:03.201 INFO:tasks.workunit.client.0.smithi027.stdout:1/616: dwrite d2/d8/d2b/d2d/f80 [0,4194304] 0 2024-09-20T19:06:03.202 INFO:tasks.workunit.client.1.smithi098.stdout:7/628: chown d3/d10/d16/d17/d33/d1f/d28/d7d/f3f 160499 1 2024-09-20T19:06:03.203 INFO:tasks.workunit.client.1.smithi098.stdout:9/651: truncate d4/de/d24/d35/dc4/fcc 373258 0 2024-09-20T19:06:03.203 INFO:tasks.workunit.client.1.smithi098.stdout:7/629: rmdir d3 39 2024-09-20T19:06:03.204 INFO:tasks.workunit.client.1.smithi098.stdout:6/392: dwrite d0/de/f6c [0,4194304] 0 2024-09-20T19:06:03.205 INFO:tasks.workunit.client.1.smithi098.stdout:9/652: stat d4/de/d24/d35/dc4/fcc 0 2024-09-20T19:06:03.214 INFO:tasks.workunit.client.0.smithi027.stdout:0/680: creat d2/d48/d6b/d79/d84/ffb x:0 0 0 2024-09-20T19:06:03.215 INFO:tasks.workunit.client.1.smithi098.stdout:6/393: dwrite d0/de/d1b/d37/d44/d24/f3e [0,4194304] 0 2024-09-20T19:06:03.216 INFO:tasks.workunit.client.1.smithi098.stdout:7/630: symlink d3/daa/lc9 0 2024-09-20T19:06:03.224 INFO:tasks.workunit.client.1.smithi098.stdout:6/394: rmdir d0/de/d1b/d37/d43/d51 39 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:8/612: unlink d2/d14/d13/d2e/d6c/d77/l81 0 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:2/561: sync 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:5/672: sync 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:2/562: chown d3/f78 4209 1 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:1/617: symlink d2/d8/d3b/d4b/lc7 0 2024-09-20T19:06:03.225 INFO:tasks.workunit.client.0.smithi027.stdout:1/618: fdatasync d2/d61/fae 0 2024-09-20T19:06:03.226 INFO:tasks.workunit.client.0.smithi027.stdout:8/613: creat d2/d14/d13/d43/d7a/fc8 x:0 0 0 2024-09-20T19:06:03.227 INFO:tasks.workunit.client.1.smithi098.stdout:6/395: dwrite d0/de/d1b/d37/d44/d24/f52 [0,4194304] 0 2024-09-20T19:06:03.229 INFO:tasks.workunit.client.1.smithi098.stdout:7/631: rename d3/d10/d16/d17/d33/d37/da0/l96 to d3/d10/d16/d17/d33/d37/lca 0 2024-09-20T19:06:03.231 INFO:tasks.workunit.client.0.smithi027.stdout:2/563: symlink d3/d13/lae 0 2024-09-20T19:06:03.234 INFO:tasks.workunit.client.1.smithi098.stdout:6/396: creat d0/de/d1b/d37/d44/d24/d29/d42/d4c/f79 x:0 0 0 2024-09-20T19:06:03.241 INFO:tasks.workunit.client.0.smithi027.stdout:8/614: creat d2/d14/d13/d43/d5d/d90/fc9 x:0 0 0 2024-09-20T19:06:03.243 INFO:tasks.workunit.client.0.smithi027.stdout:5/673: mkdir d4/da/de/dda 0 2024-09-20T19:06:03.246 INFO:tasks.workunit.client.0.smithi027.stdout:0/681: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/lbc to d2/d48/d6b/d79/d84/d1b/dc5/d2e/lfc 0 2024-09-20T19:06:03.247 INFO:tasks.workunit.client.1.smithi098.stdout:8/667: dwrite d7/de/d11/d1f/f4d [4194304,4194304] 0 2024-09-20T19:06:03.247 INFO:tasks.workunit.client.1.smithi098.stdout:6/397: rmdir d0/de/d1b/d37/d44/dc/d74 0 2024-09-20T19:06:03.252 INFO:tasks.workunit.client.1.smithi098.stdout:5/488: truncate d1/d1b/f6f 73321 0 2024-09-20T19:06:03.258 INFO:tasks.workunit.client.1.smithi098.stdout:8/668: dread d7/de/d11/d19/d30/f70 [0,4194304] 0 2024-09-20T19:06:03.258 INFO:tasks.workunit.client.0.smithi027.stdout:8/615: rename d2/d3/d6/ff to d2/d3/d6/d9e/fca 0 2024-09-20T19:06:03.260 INFO:tasks.workunit.client.1.smithi098.stdout:6/398: fsync d0/de/d1b/d37/d44/dc/f1a 0 2024-09-20T19:06:03.261 INFO:tasks.workunit.client.1.smithi098.stdout:6/399: chown d0/de/d1b/d37 958186 1 2024-09-20T19:06:03.262 INFO:tasks.workunit.client.0.smithi027.stdout:3/607: truncate d0/d1/d13/d15/f68 1771678 0 2024-09-20T19:06:03.263 INFO:tasks.workunit.client.1.smithi098.stdout:6/400: fsync d0/de/d1b/d37/d44/d24/d29/d42/d4c/f6e 0 2024-09-20T19:06:03.264 INFO:tasks.workunit.client.0.smithi027.stdout:2/564: link d3/d1c/d31/d9e/ca5 d3/d1c/d26/d2a/d63/d6f/caf 0 2024-09-20T19:06:03.269 INFO:tasks.workunit.client.1.smithi098.stdout:7/632: write d3/f6a [4223449,46932] 0 2024-09-20T19:06:03.270 INFO:tasks.workunit.client.0.smithi027.stdout:2/565: dwrite d3/d13/d3c/f8c [0,4194304] 0 2024-09-20T19:06:03.270 INFO:tasks.workunit.client.1.smithi098.stdout:7/633: dread - d3/d10/d16/d17/d33/d4b/fb0 zero size 2024-09-20T19:06:03.271 INFO:tasks.workunit.client.0.smithi027.stdout:8/616: fsync d2/d3/d1b/f2c 0 2024-09-20T19:06:03.272 INFO:tasks.workunit.client.1.smithi098.stdout:7/634: dread - d3/d10/d16/d17/d33/d1f/d28/d7d/fc4 zero size 2024-09-20T19:06:03.272 INFO:tasks.workunit.client.0.smithi027.stdout:9/749: sync 2024-09-20T19:06:03.272 INFO:tasks.workunit.client.0.smithi027.stdout:6/606: sync 2024-09-20T19:06:03.273 INFO:tasks.workunit.client.1.smithi098.stdout:6/401: mknod d0/de/d1b/d37/d44/d24/d29/c7a 0 2024-09-20T19:06:03.275 INFO:tasks.workunit.client.1.smithi098.stdout:8/669: dread d7/f61 [0,4194304] 0 2024-09-20T19:06:03.276 INFO:tasks.workunit.client.0.smithi027.stdout:5/674: creat d4/da/de/fdb x:0 0 0 2024-09-20T19:06:03.278 INFO:tasks.workunit.client.1.smithi098.stdout:5/489: rename d1/d1b/l27 to d1/d1b/d40/l94 0 2024-09-20T19:06:03.280 INFO:tasks.workunit.client.0.smithi027.stdout:3/608: creat d0/d1/d13/d15/d6f/fcb x:0 0 0 2024-09-20T19:06:03.282 INFO:tasks.workunit.client.0.smithi027.stdout:2/566: dread d3/d13/d3c/d48/f88 [0,4194304] 0 2024-09-20T19:06:03.282 INFO:tasks.workunit.client.1.smithi098.stdout:8/670: dwrite d7/de/d11/fa7 [0,4194304] 0 2024-09-20T19:06:03.285 INFO:tasks.workunit.client.0.smithi027.stdout:0/682: write d2/fe [80069,5440] 0 2024-09-20T19:06:03.285 INFO:tasks.workunit.client.0.smithi027.stdout:1/619: dwrite d2/f5c [0,4194304] 0 2024-09-20T19:06:03.286 INFO:tasks.workunit.client.0.smithi027.stdout:3/609: fsync d0/d1/d13/d98/dc3/da2/fa6 0 2024-09-20T19:06:03.287 INFO:tasks.workunit.client.1.smithi098.stdout:7/635: rename d3/l9 to d3/d10/d16/d17/d33/d4b/lcb 0 2024-09-20T19:06:03.288 INFO:tasks.workunit.client.1.smithi098.stdout:7/636: fdatasync d3/d76/d86/fb1 0 2024-09-20T19:06:03.291 INFO:tasks.workunit.client.0.smithi027.stdout:3/610: write d0/d1/f35 [2815953,13192] 0 2024-09-20T19:06:03.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/402: rename d0/de/d1b/d37/d44/dc/f4a to d0/f7b 0 2024-09-20T19:06:03.303 INFO:tasks.workunit.client.0.smithi027.stdout:2/567: fdatasync d3/d13/f15 0 2024-09-20T19:06:03.305 INFO:tasks.workunit.client.0.smithi027.stdout:0/683: creat d2/d48/d6b/d79/d84/d1b/d39/dc7/ffd x:0 0 0 2024-09-20T19:06:03.307 INFO:tasks.workunit.client.1.smithi098.stdout:6/403: mkdir d0/de/d1b/d37/d44/d24/d29/d2b/d7c 0 2024-09-20T19:06:03.309 INFO:tasks.workunit.client.0.smithi027.stdout:3/611: mkdir d0/d1/d13/d15/d6f/dcc 0 2024-09-20T19:06:03.312 INFO:tasks.workunit.client.1.smithi098.stdout:8/671: write d7/de/d11/f1b [1155289,85941] 0 2024-09-20T19:06:03.312 INFO:tasks.workunit.client.0.smithi027.stdout:8/617: link d2/d14/d13/d51/f98 d2/d14/d13/db5/fcb 0 2024-09-20T19:06:03.313 INFO:tasks.workunit.client.1.smithi098.stdout:8/672: fsync d7/de/d11/d1f/dcd/db3/dcb/fec 0 2024-09-20T19:06:03.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/490: link d1/d1b/f7e d1/d46/d69/f95 0 2024-09-20T19:06:03.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/491: chown d1/d17/d25 96491801 1 2024-09-20T19:06:03.315 INFO:tasks.workunit.client.0.smithi027.stdout:3/612: write d0/d1/d13/d15/d6f/f83 [1177249,128802] 0 2024-09-20T19:06:03.315 INFO:tasks.workunit.client.0.smithi027.stdout:5/675: symlink d4/d1f/ldc 0 2024-09-20T19:06:03.317 INFO:tasks.workunit.client.1.smithi098.stdout:6/404: mknod d0/de/d1b/c7d 0 2024-09-20T19:06:03.317 INFO:tasks.workunit.client.0.smithi027.stdout:6/607: dwrite d4/d1b/f29 [0,4194304] 0 2024-09-20T19:06:03.318 INFO:tasks.workunit.client.1.smithi098.stdout:8/673: creat d7/de/d11/d1f/d57/daa/fef x:0 0 0 2024-09-20T19:06:03.319 INFO:tasks.workunit.client.0.smithi027.stdout:1/620: dwrite d2/d8/d3b/d44/d96/fa4 [0,4194304] 0 2024-09-20T19:06:03.320 INFO:tasks.workunit.client.1.smithi098.stdout:7/637: dwrite d3/d10/d16/d17/d33/d1f/d2d/f31 [0,4194304] 0 2024-09-20T19:06:03.320 INFO:tasks.workunit.client.0.smithi027.stdout:2/568: unlink d3/d1c/c5f 0 2024-09-20T19:06:03.321 INFO:tasks.workunit.client.1.smithi098.stdout:5/492: mknod d1/d46/c96 0 2024-09-20T19:06:03.323 INFO:tasks.workunit.client.1.smithi098.stdout:6/405: rmdir d0/de/d1b/d37/d43/d6d 39 2024-09-20T19:06:03.323 INFO:tasks.workunit.client.0.smithi027.stdout:0/684: unlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/lc6 0 2024-09-20T19:06:03.326 INFO:tasks.workunit.client.1.smithi098.stdout:8/674: chown d7/de/d11/c21 69 1 2024-09-20T19:06:03.328 INFO:tasks.workunit.client.0.smithi027.stdout:9/750: creat d0/d9/ff5 x:0 0 0 2024-09-20T19:06:03.329 INFO:tasks.workunit.client.0.smithi027.stdout:2/569: dwrite d3/d13/d3c/d48/d6a/f72 [0,4194304] 0 2024-09-20T19:06:03.334 INFO:tasks.workunit.client.1.smithi098.stdout:8/675: dwrite d7/de/d11/d1f/f4d [4194304,4194304] 0 2024-09-20T19:06:03.337 INFO:tasks.workunit.client.1.smithi098.stdout:7/638: rename d3/d10/d16/d17/d33/d1f/d28/d66/f9a to d3/d76/db8/da6/fcc 0 2024-09-20T19:06:03.338 INFO:tasks.workunit.client.0.smithi027.stdout:5/676: dread d4/f45 [0,4194304] 0 2024-09-20T19:06:03.338 INFO:tasks.workunit.client.0.smithi027.stdout:6/608: rmdir d4/d6/d4b/d7c 39 2024-09-20T19:06:03.339 INFO:tasks.workunit.client.0.smithi027.stdout:1/621: rmdir d2/d8/d74/d9a/da3/dad 39 2024-09-20T19:06:03.341 INFO:tasks.workunit.client.0.smithi027.stdout:6/609: stat d4/d15/d37/d7a/d46/l82 0 2024-09-20T19:06:03.343 INFO:tasks.workunit.client.0.smithi027.stdout:9/751: dwrite d0/d9/df/d1b/d9c/d5a/f63 [0,4194304] 0 2024-09-20T19:06:03.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/406: getdents d0/de/d1b/d37/d44/d24/d29/d50 0 2024-09-20T19:06:03.344 INFO:tasks.workunit.client.0.smithi027.stdout:0/685: creat d2/d48/ffe x:0 0 0 2024-09-20T19:06:03.345 INFO:tasks.workunit.client.0.smithi027.stdout:0/686: stat d2/d48/d6b/d79/d9f/da4 0 2024-09-20T19:06:03.348 INFO:tasks.workunit.client.0.smithi027.stdout:2/570: write d3/d13/f4d [83435,60393] 0 2024-09-20T19:06:03.350 INFO:tasks.workunit.client.0.smithi027.stdout:7/582: sync 2024-09-20T19:06:03.350 INFO:tasks.workunit.client.0.smithi027.stdout:4/559: sync 2024-09-20T19:06:03.351 INFO:tasks.workunit.client.0.smithi027.stdout:6/610: dread d4/d15/f4f [0,4194304] 0 2024-09-20T19:06:03.351 INFO:tasks.workunit.client.1.smithi098.stdout:7/639: getdents d3/d10/d16/d17/d33/d1f/d28/d7d 0 2024-09-20T19:06:03.352 INFO:tasks.workunit.client.0.smithi027.stdout:5/677: dread d4/d1f/d28/f3f [0,4194304] 0 2024-09-20T19:06:03.354 INFO:tasks.workunit.client.0.smithi027.stdout:8/618: creat d2/d3/d6/d6d/fcc x:0 0 0 2024-09-20T19:06:03.355 INFO:tasks.workunit.client.1.smithi098.stdout:6/407: dwrite d0/de/d1b/d37/d44/f13 [12582912,4194304] 0 2024-09-20T19:06:03.356 INFO:tasks.workunit.client.0.smithi027.stdout:8/619: chown d2/d14/d13/d2e/f60 8 1 2024-09-20T19:06:03.356 INFO:tasks.workunit.client.0.smithi027.stdout:1/622: symlink d2/d8/lc8 0 2024-09-20T19:06:03.356 INFO:tasks.workunit.client.0.smithi027.stdout:1/623: chown d2/d8/d2b/d2d/l94 47457 1 2024-09-20T19:06:03.358 INFO:tasks.workunit.client.0.smithi027.stdout:4/560: creat d5/d11/d3d/d6e/fae x:0 0 0 2024-09-20T19:06:03.359 INFO:tasks.workunit.client.1.smithi098.stdout:6/408: rmdir d0/de/d1b/d37/d44/d24/d29/d42 39 2024-09-20T19:06:03.360 INFO:tasks.workunit.client.0.smithi027.stdout:6/611: fsync d4/d6/d4b/d7c/f8b 0 2024-09-20T19:06:03.361 INFO:tasks.workunit.client.0.smithi027.stdout:7/583: mkdir d3/d8/d26/d45/d56/d8d/dc8 0 2024-09-20T19:06:03.363 INFO:tasks.workunit.client.0.smithi027.stdout:5/678: mknod d4/d1f/d91/cdd 0 2024-09-20T19:06:03.363 INFO:tasks.workunit.client.0.smithi027.stdout:6/612: chown d4/d15/d2c 3366 1 2024-09-20T19:06:03.365 INFO:tasks.workunit.client.0.smithi027.stdout:8/620: dwrite d2/d3/d1b/fbb [0,4194304] 0 2024-09-20T19:06:03.366 INFO:tasks.workunit.client.1.smithi098.stdout:6/409: creat d0/de/d1b/d37/d43/f7e x:0 0 0 2024-09-20T19:06:03.367 INFO:tasks.workunit.client.0.smithi027.stdout:8/621: fdatasync d2/d3/f37 0 2024-09-20T19:06:03.368 INFO:tasks.workunit.client.1.smithi098.stdout:6/410: write d0/de/d1b/d37/d44/f62 [2156882,58808] 0 2024-09-20T19:06:03.370 INFO:tasks.workunit.client.1.smithi098.stdout:6/411: chown d0/de/d1b/d37/l73 81 1 2024-09-20T19:06:03.381 INFO:tasks.workunit.client.0.smithi027.stdout:9/752: creat d0/ff6 x:0 0 0 2024-09-20T19:06:03.384 INFO:tasks.workunit.client.0.smithi027.stdout:9/753: fdatasync d0/d9/df/d1b/d9c/fb4 0 2024-09-20T19:06:03.385 INFO:tasks.workunit.client.0.smithi027.stdout:5/679: dwrite d4/d1f/f74 [0,4194304] 0 2024-09-20T19:06:03.387 INFO:tasks.workunit.client.0.smithi027.stdout:9/754: write d0/d9/df/d1b/d9c/d4f/fb9 [1028053,97781] 0 2024-09-20T19:06:03.390 INFO:tasks.workunit.client.0.smithi027.stdout:0/687: dread d2/d20/f47 [0,4194304] 0 2024-09-20T19:06:03.391 INFO:tasks.workunit.client.1.smithi098.stdout:5/493: write d1/f9 [5066071,62652] 0 2024-09-20T19:06:03.393 INFO:tasks.workunit.client.1.smithi098.stdout:7/640: dread d3/d10/d16/d17/d33/d1f/f6d [0,4194304] 0 2024-09-20T19:06:03.398 INFO:tasks.workunit.client.1.smithi098.stdout:7/641: mkdir d3/d10/d16/d17/d33/d1f/d28/d7d/dcd 0 2024-09-20T19:06:03.401 INFO:tasks.workunit.client.1.smithi098.stdout:8/676: dwrite d7/de/d11/d19/d30/d55/f87 [0,4194304] 0 2024-09-20T19:06:03.401 INFO:tasks.workunit.client.0.smithi027.stdout:3/613: truncate d0/d1/d13/d15/d55/f6a 881373 0 2024-09-20T19:06:03.404 INFO:tasks.workunit.client.1.smithi098.stdout:7/642: mkdir d3/d76/d7a/dce 0 2024-09-20T19:06:03.404 INFO:tasks.workunit.client.1.smithi098.stdout:7/643: stat d3/d10/d16/d17/d7c 0 2024-09-20T19:06:03.406 INFO:tasks.workunit.client.1.smithi098.stdout:8/677: symlink d7/de/d11/d1f/d57/db6/lf0 0 2024-09-20T19:06:03.407 INFO:tasks.workunit.client.1.smithi098.stdout:7/644: rmdir d3/d76/db8 39 2024-09-20T19:06:03.417 INFO:tasks.workunit.client.0.smithi027.stdout:2/571: link d3/d13/c41 d3/d1c/d26/d2a/cb0 0 2024-09-20T19:06:03.417 INFO:tasks.workunit.client.0.smithi027.stdout:1/624: dwrite d2/d8/d3b/d4b/f2c [0,4194304] 0 2024-09-20T19:06:03.418 INFO:tasks.workunit.client.1.smithi098.stdout:7/645: mkdir d3/d10/dcf 0 2024-09-20T19:06:03.419 INFO:tasks.workunit.client.0.smithi027.stdout:1/625: chown d2/d8/d3b/l6c 14 1 2024-09-20T19:06:03.420 INFO:tasks.workunit.client.0.smithi027.stdout:8/622: mknod d2/d3/d6/d21/d80/ccd 0 2024-09-20T19:06:03.420 INFO:tasks.workunit.client.1.smithi098.stdout:6/412: truncate d0/de/d1b/d37/d44/f62 887779 0 2024-09-20T19:06:03.423 INFO:tasks.workunit.client.1.smithi098.stdout:7/646: fsync d3/d10/d16/d17/f3d 0 2024-09-20T19:06:03.426 INFO:tasks.workunit.client.1.smithi098.stdout:5/494: dread d1/fc [4194304,4194304] 0 2024-09-20T19:06:03.427 INFO:tasks.workunit.client.1.smithi098.stdout:5/495: truncate d1/d46/d69/f8f 665859 0 2024-09-20T19:06:03.432 INFO:tasks.workunit.client.1.smithi098.stdout:5/496: unlink d1/d17/d35/d54/d68/f7c 0 2024-09-20T19:06:03.434 INFO:tasks.workunit.client.0.smithi027.stdout:7/584: creat d3/d8/d1c/d80/db2/fc9 x:0 0 0 2024-09-20T19:06:03.434 INFO:tasks.workunit.client.0.smithi027.stdout:4/561: dwrite d5/d13/d36/d49/f76 [4194304,4194304] 0 2024-09-20T19:06:03.436 INFO:tasks.workunit.client.0.smithi027.stdout:4/562: readlink d5/d11/d51/l73 0 2024-09-20T19:06:03.436 INFO:tasks.workunit.client.0.smithi027.stdout:8/623: mkdir d2/d3/d9a/dce 0 2024-09-20T19:06:03.436 INFO:tasks.workunit.client.0.smithi027.stdout:1/626: rename d2/d8/d2b/l63 to d2/d8/d3b/d82/d87/lc9 0 2024-09-20T19:06:03.438 INFO:tasks.workunit.client.0.smithi027.stdout:4/563: write d5/f34 [402445,128058] 0 2024-09-20T19:06:03.438 INFO:tasks.workunit.client.0.smithi027.stdout:0/688: symlink d2/d48/d6b/d79/d9f/da4/de6/lff 0 2024-09-20T19:06:03.438 INFO:tasks.workunit.client.0.smithi027.stdout:5/680: creat d4/d6c/dc7/fde x:0 0 0 2024-09-20T19:06:03.446 INFO:tasks.workunit.client.0.smithi027.stdout:7/585: dwrite d3/d8/d1c/d61/fa1 [0,4194304] 0 2024-09-20T19:06:03.447 INFO:tasks.workunit.client.0.smithi027.stdout:3/614: link d0/d1/d13/d3c/f66 d0/d19/d54/fcd 0 2024-09-20T19:06:03.447 INFO:tasks.workunit.client.0.smithi027.stdout:7/586: chown d3/d8/da/d2e/d39/lba 19 1 2024-09-20T19:06:03.449 INFO:tasks.workunit.client.0.smithi027.stdout:8/624: mkdir d2/d3/d6/d21/d33/d79/dcf 0 2024-09-20T19:06:03.450 INFO:tasks.workunit.client.0.smithi027.stdout:6/613: link d4/d6/d4b/d7c/d64/l99 d4/d15/d37/d7a/lc1 0 2024-09-20T19:06:03.454 INFO:tasks.workunit.client.1.smithi098.stdout:8/678: truncate d7/de/d11/d19/d30/d55/f87 3808584 0 2024-09-20T19:06:03.454 INFO:tasks.workunit.client.1.smithi098.stdout:8/679: readlink d7/de/d11/d1f/d57/l5b 0 2024-09-20T19:06:03.456 INFO:tasks.workunit.client.0.smithi027.stdout:3/615: creat d0/d1/d13/d15/d55/fce x:0 0 0 2024-09-20T19:06:03.457 INFO:tasks.workunit.client.0.smithi027.stdout:8/625: dwrite d2/d3/d1b/d36/f4c [0,4194304] 0 2024-09-20T19:06:03.461 INFO:tasks.workunit.client.1.smithi098.stdout:7/647: write d3/d10/d16/d17/d33/d1f/d2d/f3b [1095096,5005] 0 2024-09-20T19:06:03.462 INFO:tasks.workunit.client.0.smithi027.stdout:7/587: creat d3/d8/d26/d65/dc4/fca x:0 0 0 2024-09-20T19:06:03.465 INFO:tasks.workunit.client.0.smithi027.stdout:5/681: rename d4/d1f/fb0 to d4/fdf 0 2024-09-20T19:06:03.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/648: rename d3/d4c/f71 to d3/d10/dcf/fd0 0 2024-09-20T19:06:03.470 INFO:tasks.workunit.client.0.smithi027.stdout:8/626: dwrite d2/d3/d1b/d35/fc5 [0,4194304] 0 2024-09-20T19:06:03.472 INFO:tasks.workunit.client.0.smithi027.stdout:9/755: dwrite d0/d9/df/d1c/d6a/d6d/f68 [0,4194304] 0 2024-09-20T19:06:03.472 INFO:tasks.workunit.client.0.smithi027.stdout:0/689: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [0,4194304] 0 2024-09-20T19:06:03.473 INFO:tasks.workunit.client.0.smithi027.stdout:3/616: symlink d0/d19/dc2/lcf 0 2024-09-20T19:06:03.473 INFO:tasks.workunit.client.0.smithi027.stdout:8/627: chown d2/d14/d13/d43 0 1 2024-09-20T19:06:03.473 INFO:tasks.workunit.client.0.smithi027.stdout:3/617: readlink d0/d19/l6e 0 2024-09-20T19:06:03.474 INFO:tasks.workunit.client.0.smithi027.stdout:9/756: readlink d0/d9/df/d1c/d6a/d6d/dd/l56 0 2024-09-20T19:06:03.476 INFO:tasks.workunit.client.0.smithi027.stdout:9/757: dread - d0/d9/df/d1b/d9c/d5a/fb6 zero size 2024-09-20T19:06:03.476 INFO:tasks.workunit.client.1.smithi098.stdout:7/649: creat d3/d4c/fd1 x:0 0 0 2024-09-20T19:06:03.478 INFO:tasks.workunit.client.0.smithi027.stdout:7/588: truncate d3/d24/f83 2619320 0 2024-09-20T19:06:03.479 INFO:tasks.workunit.client.0.smithi027.stdout:1/627: write d2/d8/d74/f91 [1116957,77246] 0 2024-09-20T19:06:03.484 INFO:tasks.workunit.client.0.smithi027.stdout:3/618: rename d0/d1/l45 to d0/d1/d65/dbb/ld0 0 2024-09-20T19:06:03.488 INFO:tasks.workunit.client.0.smithi027.stdout:0/690: dwrite d2/d49/f45 [0,4194304] 0 2024-09-20T19:06:03.489 INFO:tasks.workunit.client.0.smithi027.stdout:1/628: mkdir d2/d8/d74/d84/dca 0 2024-09-20T19:06:03.490 INFO:tasks.workunit.client.0.smithi027.stdout:4/564: truncate d5/d11/d51/f56 702417 0 2024-09-20T19:06:03.492 INFO:tasks.workunit.client.0.smithi027.stdout:1/629: truncate d2/d1b/d56/d71/f95 686570 0 2024-09-20T19:06:03.492 INFO:tasks.workunit.client.0.smithi027.stdout:0/691: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fa0 [0,4194304] 0 2024-09-20T19:06:03.493 INFO:tasks.workunit.client.0.smithi027.stdout:1/630: chown d2/d8/d2b/f4a 4807084 1 2024-09-20T19:06:03.494 INFO:tasks.workunit.client.0.smithi027.stdout:7/589: rename d3/d8/d1c/c9e to d3/d24/d84/ccb 0 2024-09-20T19:06:03.495 INFO:tasks.workunit.client.0.smithi027.stdout:6/614: truncate d4/d15/d37/d7a/d46/d53/f96 3143681 0 2024-09-20T19:06:03.495 INFO:tasks.workunit.client.0.smithi027.stdout:4/565: rename d5 to d5/d13/d36/d48/daf 22 2024-09-20T19:06:03.496 INFO:tasks.workunit.client.0.smithi027.stdout:9/758: mkdir d0/d9/df/d1c/d6a/df7 0 2024-09-20T19:06:03.498 INFO:tasks.workunit.client.0.smithi027.stdout:5/682: link d4/d1f/d7f/da4/dcf/fd4 d4/d1f/d28/fe0 0 2024-09-20T19:06:03.498 INFO:tasks.workunit.client.0.smithi027.stdout:6/615: read d4/d15/d2c/f49 [3626272,55423] 0 2024-09-20T19:06:03.499 INFO:tasks.workunit.client.0.smithi027.stdout:3/619: symlink d0/dc5/ld1 0 2024-09-20T19:06:03.499 INFO:tasks.workunit.client.0.smithi027.stdout:0/692: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/fda 1032573 0 2024-09-20T19:06:03.500 INFO:tasks.workunit.client.0.smithi027.stdout:4/566: mkdir d5/d9b/db0 0 2024-09-20T19:06:03.500 INFO:tasks.workunit.client.0.smithi027.stdout:6/616: chown d4/d15/d37/d6a/d7f 0 1 2024-09-20T19:06:03.501 INFO:tasks.workunit.client.0.smithi027.stdout:3/620: read - d0/d1/d13/d15/faf zero size 2024-09-20T19:06:03.502 INFO:tasks.workunit.client.0.smithi027.stdout:3/621: chown d0/d1/d5e 47959 1 2024-09-20T19:06:03.502 INFO:tasks.workunit.client.0.smithi027.stdout:0/693: readlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/l18 0 2024-09-20T19:06:03.503 INFO:tasks.workunit.client.0.smithi027.stdout:6/617: truncate d4/d6/d4b/d7c/d64/f68 1094928 0 2024-09-20T19:06:03.504 INFO:tasks.workunit.client.0.smithi027.stdout:6/618: stat d4/d15/d37/f7b 0 2024-09-20T19:06:03.504 INFO:tasks.workunit.client.0.smithi027.stdout:0/694: truncate d2/d48/d6b/d79/d84/ffb 477734 0 2024-09-20T19:06:03.506 INFO:tasks.workunit.client.0.smithi027.stdout:7/590: rename d3/d8/da/d51/dc0 to d3/d8/d26/d45/dcc 0 2024-09-20T19:06:03.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/650: dwrite d3/d10/d16/d17/f3d [0,4194304] 0 2024-09-20T19:06:03.512 INFO:tasks.workunit.client.0.smithi027.stdout:1/631: link d2/d8/d74/d9a/fb3 d2/d8/d3b/d44/d93/fcb 0 2024-09-20T19:06:03.515 INFO:tasks.workunit.client.0.smithi027.stdout:6/619: dwrite d4/d6/f88 [0,4194304] 0 2024-09-20T19:06:03.517 INFO:tasks.workunit.client.0.smithi027.stdout:6/620: fdatasync d4/d15/f9e 0 2024-09-20T19:06:03.519 INFO:tasks.workunit.client.0.smithi027.stdout:8/628: dwrite d2/d3/d1b/f26 [0,4194304] 0 2024-09-20T19:06:03.521 INFO:tasks.workunit.client.0.smithi027.stdout:0/695: mknod d2/d48/d6b/d79/d9f/da4/c100 0 2024-09-20T19:06:03.522 INFO:tasks.workunit.client.0.smithi027.stdout:4/567: dwrite d5/fa [0,4194304] 0 2024-09-20T19:06:03.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/651: rename d3/d10/d16/d17/d33/d1f/dba/fc5 to d3/d10/d16/d17/d33/fd2 0 2024-09-20T19:06:03.524 INFO:tasks.workunit.client.0.smithi027.stdout:7/591: rmdir d3/d8/d26/d45/d56/d8d 39 2024-09-20T19:06:03.532 INFO:tasks.workunit.client.0.smithi027.stdout:5/683: getdents d4/da/de/d3e/d69/d6a/d9e 0 2024-09-20T19:06:03.534 INFO:tasks.workunit.client.0.smithi027.stdout:5/684: write d4/d1f/d28/f85 [218401,59935] 0 2024-09-20T19:06:03.534 INFO:tasks.workunit.client.0.smithi027.stdout:1/632: mknod d2/d1b/ccc 0 2024-09-20T19:06:03.536 INFO:tasks.workunit.client.0.smithi027.stdout:9/759: dwrite d0/d9/df/d1b/d9c/da4/fb0 [0,4194304] 0 2024-09-20T19:06:03.536 INFO:tasks.workunit.client.0.smithi027.stdout:5/685: read - d4/d6c/d6f/d92/dc8/fd7 zero size 2024-09-20T19:06:03.537 INFO:tasks.workunit.client.0.smithi027.stdout:8/629: rename d2/d3/f41 to d2/d2a/fd0 0 2024-09-20T19:06:03.543 INFO:tasks.workunit.client.0.smithi027.stdout:6/621: creat d4/d6/d4b/fc2 x:0 0 0 2024-09-20T19:06:03.547 INFO:tasks.workunit.client.0.smithi027.stdout:8/630: rename d2/d3/d9a/dce to d2/d3/d6/d21/d33/d79/dcf/dd1 0 2024-09-20T19:06:03.548 INFO:tasks.workunit.client.0.smithi027.stdout:9/760: mkdir d0/d9/df/da2/de9/df8 0 2024-09-20T19:06:03.553 INFO:tasks.workunit.client.0.smithi027.stdout:1/633: getdents d2/d8/d74/d9a/da3/dad 0 2024-09-20T19:06:03.554 INFO:tasks.workunit.client.0.smithi027.stdout:8/631: dread d2/d3/d1b/fbb [0,4194304] 0 2024-09-20T19:06:03.559 INFO:tasks.workunit.client.0.smithi027.stdout:6/622: dwrite d4/d15/d37/d6a/d7f/fac [0,4194304] 0 2024-09-20T19:06:03.560 INFO:tasks.workunit.client.0.smithi027.stdout:6/623: readlink d4/l2e 0 2024-09-20T19:06:03.560 INFO:tasks.workunit.client.0.smithi027.stdout:9/761: dread d0/fa [0,4194304] 0 2024-09-20T19:06:03.562 INFO:tasks.workunit.client.0.smithi027.stdout:4/568: truncate d5/d13/d16/f8b 150983 0 2024-09-20T19:06:03.565 INFO:tasks.workunit.client.0.smithi027.stdout:9/762: chown d0/d9/la9 22967 1 2024-09-20T19:06:03.567 INFO:tasks.workunit.client.1.smithi098.stdout:7/652: dread d3/d10/d16/d17/d33/d1f/d2d/f53 [0,4194304] 0 2024-09-20T19:06:03.567 INFO:tasks.workunit.client.0.smithi027.stdout:1/634: dwrite d2/d8/f52 [0,4194304] 0 2024-09-20T19:06:03.567 INFO:tasks.workunit.client.0.smithi027.stdout:6/624: rmdir d4/d15/d37/d7a/d33 39 2024-09-20T19:06:03.569 INFO:tasks.workunit.client.0.smithi027.stdout:4/569: write d5/d13/d36/d48/d3f/d4c/d52/fa1 [1011376,127008] 0 2024-09-20T19:06:03.571 INFO:tasks.workunit.client.0.smithi027.stdout:8/632: dwrite d2/d3/d6/d6d/d75/fad [0,4194304] 0 2024-09-20T19:06:03.572 INFO:tasks.workunit.client.0.smithi027.stdout:1/635: creat d2/d8/d3b/d44/d93/fcd x:0 0 0 2024-09-20T19:06:03.573 INFO:tasks.workunit.client.0.smithi027.stdout:6/625: chown d4/d15/d37/d7a/d33/ca8 513212283 1 2024-09-20T19:06:03.573 INFO:tasks.workunit.client.0.smithi027.stdout:9/763: mknod d0/d9/df/d1b/d9c/d4f/d8d/cf9 0 2024-09-20T19:06:03.574 INFO:tasks.workunit.client.0.smithi027.stdout:1/636: readlink d2/d8/l4d 0 2024-09-20T19:06:03.577 INFO:tasks.workunit.client.0.smithi027.stdout:1/637: write d2/d8/f52 [3551034,118906] 0 2024-09-20T19:06:03.577 INFO:tasks.workunit.client.0.smithi027.stdout:5/686: dread d4/da/de/d3e/d44/f4c [0,4194304] 0 2024-09-20T19:06:03.578 INFO:tasks.workunit.client.0.smithi027.stdout:9/764: write d0/d9/df/d1b/d9c/f54 [6551749,28699] 0 2024-09-20T19:06:03.583 INFO:tasks.workunit.client.0.smithi027.stdout:9/765: write d0/d9/df/d1b/d9c/d5a/f63 [3162928,44261] 0 2024-09-20T19:06:03.583 INFO:tasks.workunit.client.0.smithi027.stdout:8/633: dread d2/d3/d6/d21/d80/fb4 [0,4194304] 0 2024-09-20T19:06:03.587 INFO:tasks.workunit.client.0.smithi027.stdout:1/638: dwrite d2/d1b/d56/d71/f95 [0,4194304] 0 2024-09-20T19:06:03.595 INFO:tasks.workunit.client.0.smithi027.stdout:4/570: dread d5/d13/f74 [0,4194304] 0 2024-09-20T19:06:03.657 INFO:tasks.workunit.client.0.smithi027.stdout:1/639: symlink d2/d8/d3b/d44/d96/lce 0 2024-09-20T19:06:03.657 INFO:tasks.workunit.client.0.smithi027.stdout:4/571: creat d5/d80/fb1 x:0 0 0 2024-09-20T19:06:03.658 INFO:tasks.workunit.client.0.smithi027.stdout:6/626: fsync d4/d6/f56 0 2024-09-20T19:06:03.659 INFO:tasks.workunit.client.1.smithi098.stdout:7/653: dwrite d3/d10/d16/d17/d33/d1f/d2d/f77 [0,4194304] 0 2024-09-20T19:06:03.659 INFO:tasks.workunit.client.0.smithi027.stdout:4/572: fdatasync d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fac 0 2024-09-20T19:06:03.659 INFO:tasks.workunit.client.0.smithi027.stdout:6/627: dread - d4/d15/d37/d6a/fa3 zero size 2024-09-20T19:06:03.661 INFO:tasks.workunit.client.0.smithi027.stdout:1/640: mkdir d2/d8/d3b/d82/d87/dcf 0 2024-09-20T19:06:03.662 INFO:tasks.workunit.client.1.smithi098.stdout:7/654: dread d3/d10/d16/f39 [4194304,4194304] 0 2024-09-20T19:06:03.662 INFO:tasks.workunit.client.0.smithi027.stdout:1/641: dread d2/d1b/f7b [0,4194304] 0 2024-09-20T19:06:03.665 INFO:tasks.workunit.client.0.smithi027.stdout:4/573: symlink d5/d11/lb2 0 2024-09-20T19:06:03.666 INFO:tasks.workunit.client.0.smithi027.stdout:4/574: fsync d5/d13/d36/d49/f76 0 2024-09-20T19:06:03.667 INFO:tasks.workunit.client.1.smithi098.stdout:7/655: mknod d3/d10/d16/d17/d33/d1f/d28/d7d/cd3 0 2024-09-20T19:06:03.668 INFO:tasks.workunit.client.0.smithi027.stdout:4/575: write d5/d13/d36/d48/d3f/d4c/d52/fa2 [662591,82742] 0 2024-09-20T19:06:03.669 INFO:tasks.workunit.client.0.smithi027.stdout:6/628: rename d4/d1b/l89 to d4/d15/d37/d5a/d78/lc3 0 2024-09-20T19:06:03.670 INFO:tasks.workunit.client.1.smithi098.stdout:7/656: mkdir d3/daa/dd4 0 2024-09-20T19:06:03.672 INFO:tasks.workunit.client.0.smithi027.stdout:4/576: creat d5/d11/d17/fb3 x:0 0 0 2024-09-20T19:06:03.673 INFO:tasks.workunit.client.0.smithi027.stdout:1/642: rename d2/d8/d3b/d44/d96/c9b to d2/d8/d3b/d82/d90/d9f/cd0 0 2024-09-20T19:06:03.674 INFO:tasks.workunit.client.1.smithi098.stdout:7/657: dread d3/d10/d16/d17/d33/d37/da0/f63 [0,4194304] 0 2024-09-20T19:06:03.675 INFO:tasks.workunit.client.0.smithi027.stdout:4/577: chown d5/d11/d17/d1b/f91 32128565 1 2024-09-20T19:06:03.676 INFO:tasks.workunit.client.0.smithi027.stdout:4/578: write d5/d13/d7c/f9c [839127,34626] 0 2024-09-20T19:06:03.676 INFO:tasks.workunit.client.0.smithi027.stdout:6/629: fsync d4/d15/d37/d39/f97 0 2024-09-20T19:06:03.677 INFO:tasks.workunit.client.0.smithi027.stdout:1/643: symlink d2/d8/d3b/d4b/ld1 0 2024-09-20T19:06:03.679 INFO:tasks.workunit.client.0.smithi027.stdout:4/579: write d5/d9b/f4e [2640015,51743] 0 2024-09-20T19:06:03.679 INFO:tasks.workunit.client.0.smithi027.stdout:6/630: truncate d4/d6/f11 4448328 0 2024-09-20T19:06:03.680 INFO:tasks.workunit.client.1.smithi098.stdout:7/658: fsync d3/d10/d16/d17/d33/d37/da0/f4d 0 2024-09-20T19:06:03.683 INFO:tasks.workunit.client.0.smithi027.stdout:6/631: creat d4/d15/d37/d7a/d8e/fc4 x:0 0 0 2024-09-20T19:06:03.684 INFO:tasks.workunit.client.1.smithi098.stdout:7/659: truncate d3/f11 424175 0 2024-09-20T19:06:03.685 INFO:tasks.workunit.client.0.smithi027.stdout:8/634: dread d2/d14/f27 [0,4194304] 0 2024-09-20T19:06:03.685 INFO:tasks.workunit.client.0.smithi027.stdout:1/644: mknod d2/d8/d74/d84/dca/cd2 0 2024-09-20T19:06:03.686 INFO:tasks.workunit.client.0.smithi027.stdout:9/766: write d0/f42 [3962900,32195] 0 2024-09-20T19:06:03.690 INFO:tasks.workunit.client.0.smithi027.stdout:5/687: truncate d4/da/de/d3e/d44/f52 4102737 0 2024-09-20T19:06:03.690 INFO:tasks.workunit.client.1.smithi098.stdout:7/660: mkdir d3/d76/d7a/dce/dd5 0 2024-09-20T19:06:03.692 INFO:tasks.workunit.client.0.smithi027.stdout:6/632: getdents d4/d15/d37/d6a/dbf 0 2024-09-20T19:06:03.693 INFO:tasks.workunit.client.1.smithi098.stdout:7/661: creat d3/d10/dcf/fd6 x:0 0 0 2024-09-20T19:06:03.695 INFO:tasks.workunit.client.0.smithi027.stdout:8/635: dwrite d2/d3/d6/fa0 [0,4194304] 0 2024-09-20T19:06:03.695 INFO:tasks.workunit.client.0.smithi027.stdout:1/645: dwrite d2/d8/d74/d9a/da3/fc1 [0,4194304] 0 2024-09-20T19:06:03.697 INFO:tasks.workunit.client.0.smithi027.stdout:5/688: mknod d4/da/de/d3e/d61/ce1 0 2024-09-20T19:06:03.698 INFO:tasks.workunit.client.0.smithi027.stdout:1/646: write d2/d8/d3b/d44/d96/fa4 [2374147,122030] 0 2024-09-20T19:06:03.700 INFO:tasks.workunit.client.0.smithi027.stdout:9/767: truncate d0/d9/f28 3740151 0 2024-09-20T19:06:03.701 INFO:tasks.workunit.client.0.smithi027.stdout:5/689: write d4/d6c/d6f/d92/fd6 [900131,108541] 0 2024-09-20T19:06:03.703 INFO:tasks.workunit.client.0.smithi027.stdout:1/647: write d2/d8/d2b/d2d/f80 [187906,48734] 0 2024-09-20T19:06:03.705 INFO:tasks.workunit.client.1.smithi098.stdout:7/662: getdents d3/d10/d16/d17/d33/d1f/d28/d7d 0 2024-09-20T19:06:03.708 INFO:tasks.workunit.client.0.smithi027.stdout:8/636: dwrite d2/d14/d13/d43/d7a/fc8 [0,4194304] 0 2024-09-20T19:06:03.708 INFO:tasks.workunit.client.0.smithi027.stdout:5/690: creat d4/d6c/d6f/fe2 x:0 0 0 2024-09-20T19:06:03.710 INFO:tasks.workunit.client.0.smithi027.stdout:9/768: mkdir d0/d9/df/d1b/d9c/d4f/d8d/da0/dfa 0 2024-09-20T19:06:03.712 INFO:tasks.workunit.client.1.smithi098.stdout:7/663: creat d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/fd7 x:0 0 0 2024-09-20T19:06:03.714 INFO:tasks.workunit.client.1.smithi098.stdout:7/664: truncate d3/d10/d16/d90/f9c 69765 0 2024-09-20T19:06:03.714 INFO:tasks.workunit.client.0.smithi027.stdout:1/648: fsync d2/d8/d3b/f6f 0 2024-09-20T19:06:03.714 INFO:tasks.workunit.client.0.smithi027.stdout:1/649: stat d2/d8/d2b/d5e 0 2024-09-20T19:06:03.715 INFO:tasks.workunit.client.0.smithi027.stdout:1/650: readlink d2/d8/d3b/l6c 0 2024-09-20T19:06:03.720 INFO:tasks.workunit.client.0.smithi027.stdout:4/580: truncate d5/d13/d36/d49/f8c 1838494 0 2024-09-20T19:06:03.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/665: mknod d3/d76/db8/da6/cd8 0 2024-09-20T19:06:03.724 INFO:tasks.workunit.client.0.smithi027.stdout:6/633: link d4/c74 d4/d15/cc5 0 2024-09-20T19:06:03.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/666: rmdir d3/d10/d16/d17/d33/d37 39 2024-09-20T19:06:03.727 INFO:tasks.workunit.client.0.smithi027.stdout:1/651: creat d2/d8/d3b/d82/d87/fd3 x:0 0 0 2024-09-20T19:06:03.728 INFO:tasks.workunit.client.0.smithi027.stdout:4/581: dread d5/d11/d3d/f6a [0,4194304] 0 2024-09-20T19:06:03.730 INFO:tasks.workunit.client.0.smithi027.stdout:9/769: getdents d0/d9/df/d1c/d6a/d6d/de5 0 2024-09-20T19:06:03.731 INFO:tasks.workunit.client.1.smithi098.stdout:7/667: dread d3/d10/d16/d17/d33/d37/da0/f46 [0,4194304] 0 2024-09-20T19:06:03.734 INFO:tasks.workunit.client.0.smithi027.stdout:4/582: dwrite d5/f37 [0,4194304] 0 2024-09-20T19:06:03.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/668: mknod d3/d10/dcf/cd9 0 2024-09-20T19:06:03.735 INFO:tasks.workunit.client.0.smithi027.stdout:4/583: truncate d5/d13/d7c/f9c 1662551 0 2024-09-20T19:06:03.736 INFO:tasks.workunit.client.0.smithi027.stdout:8/637: rename d2/d2a/l34 to d2/d14/d13/d2e/d6c/d77/ld2 0 2024-09-20T19:06:03.744 INFO:tasks.workunit.client.0.smithi027.stdout:5/691: getdents d4/d1f 0 2024-09-20T19:06:03.745 INFO:tasks.workunit.client.0.smithi027.stdout:4/584: mkdir d5/d11/d3d/db4 0 2024-09-20T19:06:03.745 INFO:tasks.workunit.client.0.smithi027.stdout:8/638: dread d2/d2a/f2f [0,4194304] 0 2024-09-20T19:06:03.746 INFO:tasks.workunit.client.0.smithi027.stdout:4/585: readlink d5/d13/d16/l39 0 2024-09-20T19:06:03.747 INFO:tasks.workunit.client.0.smithi027.stdout:1/652: mknod d2/d8/d74/d9a/da3/cd4 0 2024-09-20T19:06:03.747 INFO:tasks.workunit.client.0.smithi027.stdout:8/639: write d2/d3/d1b/fa2 [756467,79028] 0 2024-09-20T19:06:03.747 INFO:tasks.workunit.client.0.smithi027.stdout:6/634: rmdir d4/d15/d37/d5a/d78/dae 0 2024-09-20T19:06:03.749 INFO:tasks.workunit.client.0.smithi027.stdout:1/653: fsync d2/d8/d3b/d82/d90/d9f/fb4 0 2024-09-20T19:06:03.749 INFO:tasks.workunit.client.0.smithi027.stdout:3/622: sync 2024-09-20T19:06:03.750 INFO:tasks.workunit.client.0.smithi027.stdout:2/572: sync 2024-09-20T19:06:03.750 INFO:tasks.workunit.client.0.smithi027.stdout:7/592: sync 2024-09-20T19:06:03.750 INFO:tasks.workunit.client.0.smithi027.stdout:0/696: sync 2024-09-20T19:06:03.750 INFO:tasks.workunit.client.0.smithi027.stdout:1/654: readlink d2/d8/d3b/d82/d87/l97 0 2024-09-20T19:06:03.751 INFO:tasks.workunit.client.0.smithi027.stdout:1/655: read - d2/d8/d74/fb6 zero size 2024-09-20T19:06:03.757 INFO:tasks.workunit.client.0.smithi027.stdout:0/697: dwrite d2/db7/fde [0,4194304] 0 2024-09-20T19:06:03.758 INFO:tasks.workunit.client.0.smithi027.stdout:7/593: creat d3/d8/da/d51/fcd x:0 0 0 2024-09-20T19:06:03.760 INFO:tasks.workunit.client.0.smithi027.stdout:0/698: write d2/d48/d6b/d79/d84/d1b/d39/f66 [421623,38890] 0 2024-09-20T19:06:03.760 INFO:tasks.workunit.client.0.smithi027.stdout:1/656: dwrite d2/d1b/f4f [0,4194304] 0 2024-09-20T19:06:03.761 INFO:tasks.workunit.client.0.smithi027.stdout:4/586: mknod d5/cb5 0 2024-09-20T19:06:03.762 INFO:tasks.workunit.client.0.smithi027.stdout:9/770: truncate d0/d9/df/d1c/d6a/d6d/dd/d66/f89 886822 0 2024-09-20T19:06:03.765 INFO:tasks.workunit.client.0.smithi027.stdout:0/699: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 [423044,87820] 0 2024-09-20T19:06:03.765 INFO:tasks.workunit.client.0.smithi027.stdout:8/640: creat d2/d65/fd3 x:0 0 0 2024-09-20T19:06:03.766 INFO:tasks.workunit.client.0.smithi027.stdout:8/641: write d2/f47 [2336998,108770] 0 2024-09-20T19:06:03.769 INFO:tasks.workunit.client.0.smithi027.stdout:7/594: fsync d3/d8/da/f4e 0 2024-09-20T19:06:03.772 INFO:tasks.workunit.client.0.smithi027.stdout:1/657: rmdir d2/d8/d74/d84 39 2024-09-20T19:06:03.775 INFO:tasks.workunit.client.0.smithi027.stdout:6/635: link d4/d6/c23 d4/d15/d37/d6a/dbf/cc6 0 2024-09-20T19:06:03.777 INFO:tasks.workunit.client.0.smithi027.stdout:5/692: truncate d4/da/de/d3e/d44/f77 2599630 0 2024-09-20T19:06:03.779 INFO:tasks.workunit.client.0.smithi027.stdout:8/642: mkdir d2/d2a/dd4 0 2024-09-20T19:06:03.779 INFO:tasks.workunit.client.0.smithi027.stdout:8/643: chown d2/d3/d1b/d36/c68 1 1 2024-09-20T19:06:03.781 INFO:tasks.workunit.client.0.smithi027.stdout:4/587: unlink d5/d11/d51/f56 0 2024-09-20T19:06:03.782 INFO:tasks.workunit.client.0.smithi027.stdout:9/771: mkdir d0/d9/dfb 0 2024-09-20T19:06:03.784 INFO:tasks.workunit.client.0.smithi027.stdout:6/636: unlink d4/d15/d37/d7a/d33/f8a 0 2024-09-20T19:06:03.784 INFO:tasks.workunit.client.0.smithi027.stdout:6/637: readlink d4/l2e 0 2024-09-20T19:06:03.785 INFO:tasks.workunit.client.0.smithi027.stdout:2/573: getdents d3/d2f 0 2024-09-20T19:06:03.786 INFO:tasks.workunit.client.0.smithi027.stdout:7/595: mknod d3/d8/da/cce 0 2024-09-20T19:06:03.786 INFO:tasks.workunit.client.0.smithi027.stdout:8/644: mknod d2/d3/cd5 0 2024-09-20T19:06:03.787 INFO:tasks.workunit.client.0.smithi027.stdout:3/623: truncate d0/d1/d13/d15/d55/fa0 2085780 0 2024-09-20T19:06:03.787 INFO:tasks.workunit.client.0.smithi027.stdout:8/645: chown d2/d3/d1b/f6f 971133 1 2024-09-20T19:06:03.789 INFO:tasks.workunit.client.0.smithi027.stdout:3/624: write d0/d1/d5e/d1d/f84 [2301821,108767] 0 2024-09-20T19:06:03.789 INFO:tasks.workunit.client.0.smithi027.stdout:6/638: mkdir d4/dc7 0 2024-09-20T19:06:03.792 INFO:tasks.workunit.client.0.smithi027.stdout:6/639: read d4/d6/f56 [278139,7652] 0 2024-09-20T19:06:03.794 INFO:tasks.workunit.client.0.smithi027.stdout:2/574: dread d3/d13/f15 [0,4194304] 0 2024-09-20T19:06:03.797 INFO:tasks.workunit.client.0.smithi027.stdout:4/588: rename d5/d11/d17/d1b/f5f to d5/d13/d36/d48/d3f/fb6 0 2024-09-20T19:06:03.799 INFO:tasks.workunit.client.0.smithi027.stdout:3/625: dwrite d0/d19/f4a [0,4194304] 0 2024-09-20T19:06:03.800 INFO:tasks.workunit.client.0.smithi027.stdout:8/646: truncate d2/d3/f37 1805767 0 2024-09-20T19:06:03.801 INFO:tasks.workunit.client.0.smithi027.stdout:1/658: dwrite d2/d8/d74/f60 [0,4194304] 0 2024-09-20T19:06:03.801 INFO:tasks.workunit.client.0.smithi027.stdout:6/640: rmdir d4/d6/d4b 39 2024-09-20T19:06:03.803 INFO:tasks.workunit.client.0.smithi027.stdout:3/626: write d0/d1/d13/d15/d55/fce [514489,118767] 0 2024-09-20T19:06:03.805 INFO:tasks.workunit.client.0.smithi027.stdout:7/596: symlink d3/d8/d26/d45/d56/d8d/dc8/lcf 0 2024-09-20T19:06:03.806 INFO:tasks.workunit.client.0.smithi027.stdout:7/597: stat d3/d8/da/d51/f53 0 2024-09-20T19:06:03.808 INFO:tasks.workunit.client.0.smithi027.stdout:4/589: unlink d5/d13/d16/c3e 0 2024-09-20T19:06:03.809 INFO:tasks.workunit.client.0.smithi027.stdout:8/647: rmdir d2/d3/d6/d21 39 2024-09-20T19:06:03.810 INFO:tasks.workunit.client.0.smithi027.stdout:6/641: symlink d4/d15/d37/lc8 0 2024-09-20T19:06:03.813 INFO:tasks.workunit.client.0.smithi027.stdout:1/659: read d2/d1b/f1e [6641801,39797] 0 2024-09-20T19:06:03.813 INFO:tasks.workunit.client.0.smithi027.stdout:1/660: fdatasync d2/d8/d3b/d44/fb2 0 2024-09-20T19:06:03.814 INFO:tasks.workunit.client.0.smithi027.stdout:2/575: mknod d3/d13/d3c/d48/dad/cb1 0 2024-09-20T19:06:03.820 INFO:tasks.workunit.client.0.smithi027.stdout:6/642: creat d4/d1b/fc9 x:0 0 0 2024-09-20T19:06:03.820 INFO:tasks.workunit.client.0.smithi027.stdout:1/661: unlink d2/d8/d74/f4e 0 2024-09-20T19:06:03.821 INFO:tasks.workunit.client.0.smithi027.stdout:2/576: dwrite d3/d13/f25 [0,4194304] 0 2024-09-20T19:06:03.822 INFO:tasks.workunit.client.0.smithi027.stdout:4/590: mknod d5/d13/d36/d48/d9f/cb7 0 2024-09-20T19:06:03.825 INFO:tasks.workunit.client.0.smithi027.stdout:3/627: rename d0/d19/d54/f73 to d0/d1/fd2 0 2024-09-20T19:06:03.826 INFO:tasks.workunit.client.0.smithi027.stdout:6/643: fsync d4/d6/d4b/d7c/d64/f68 0 2024-09-20T19:06:03.827 INFO:tasks.workunit.client.0.smithi027.stdout:1/662: mknod d2/d8/d2b/cd5 0 2024-09-20T19:06:03.828 INFO:tasks.workunit.client.0.smithi027.stdout:1/663: readlink d2/d8/d2b/d2d/d3e/l4c 0 2024-09-20T19:06:03.829 INFO:tasks.workunit.client.0.smithi027.stdout:2/577: creat d3/d13/d3c/d48/d6a/fb2 x:0 0 0 2024-09-20T19:06:03.829 INFO:tasks.workunit.client.0.smithi027.stdout:8/648: link d2/d14/d13/d43/c87 d2/d14/d13/d43/d5d/cd6 0 2024-09-20T19:06:03.830 INFO:tasks.workunit.client.0.smithi027.stdout:1/664: write d2/d1b/d56/d71/f95 [865478,60786] 0 2024-09-20T19:06:03.831 INFO:tasks.workunit.client.0.smithi027.stdout:8/649: chown d2/d14/d13/f3b 1 1 2024-09-20T19:06:03.834 INFO:tasks.workunit.client.0.smithi027.stdout:3/628: rename d0/d1/d13/d15/l39 to d0/d1/d13/d3c/d93/ld3 0 2024-09-20T19:06:03.835 INFO:tasks.workunit.client.0.smithi027.stdout:6/644: mkdir d4/d6/d4b/dca 0 2024-09-20T19:06:03.837 INFO:tasks.workunit.client.0.smithi027.stdout:1/665: rename d2/d8/f52 to d2/d8/d3b/d82/d87/dcf/fd6 0 2024-09-20T19:06:03.837 INFO:tasks.workunit.client.0.smithi027.stdout:6/645: write d4/d1b/fc9 [199076,39230] 0 2024-09-20T19:06:03.839 INFO:tasks.workunit.client.0.smithi027.stdout:8/650: creat d2/d3/d6/d21/d33/d79/dcf/dd1/fd7 x:0 0 0 2024-09-20T19:06:03.841 INFO:tasks.workunit.client.0.smithi027.stdout:2/578: dwrite d3/d1c/d26/d2a/d63/d6f/fa0 [0,4194304] 0 2024-09-20T19:06:03.841 INFO:tasks.workunit.client.0.smithi027.stdout:6/646: mkdir d4/d15/d2c/dcb 0 2024-09-20T19:06:03.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/629: getdents d0/d1/d65/dbb 0 2024-09-20T19:06:03.843 INFO:tasks.workunit.client.0.smithi027.stdout:8/651: chown d2/d3/f37 0 1 2024-09-20T19:06:03.845 INFO:tasks.workunit.client.0.smithi027.stdout:4/591: dread d5/d11/d3d/fa8 [0,4194304] 0 2024-09-20T19:06:03.845 INFO:tasks.workunit.client.0.smithi027.stdout:1/666: rename d2/d8/d41/lc5 to d2/d8/d3b/d44/ld7 0 2024-09-20T19:06:03.846 INFO:tasks.workunit.client.0.smithi027.stdout:3/630: creat d0/d1/d13/d98/dab/dba/fd4 x:0 0 0 2024-09-20T19:06:03.847 INFO:tasks.workunit.client.0.smithi027.stdout:6/647: rmdir d4/d15/d37/d6a/db7 0 2024-09-20T19:06:03.849 INFO:tasks.workunit.client.0.smithi027.stdout:4/592: creat d5/d13/d36/fb8 x:0 0 0 2024-09-20T19:06:03.852 INFO:tasks.workunit.client.0.smithi027.stdout:2/579: rename d3/d13/f17 to d3/d24/fb3 0 2024-09-20T19:06:03.852 INFO:tasks.workunit.client.0.smithi027.stdout:8/652: read d2/d14/d13/d51/fb6 [1334232,55830] 0 2024-09-20T19:06:03.853 INFO:tasks.workunit.client.0.smithi027.stdout:3/631: symlink d0/dc5/ld5 0 2024-09-20T19:06:03.854 INFO:tasks.workunit.client.0.smithi027.stdout:6/648: creat d4/d15/d37/d7a/d8e/fcc x:0 0 0 2024-09-20T19:06:03.855 INFO:tasks.workunit.client.0.smithi027.stdout:7/598: dread d3/f23 [0,4194304] 0 2024-09-20T19:06:03.858 INFO:tasks.workunit.client.0.smithi027.stdout:6/649: symlink d4/lcd 0 2024-09-20T19:06:03.859 INFO:tasks.workunit.client.0.smithi027.stdout:2/580: read d3/d24/f60 [730204,93236] 0 2024-09-20T19:06:03.859 INFO:tasks.workunit.client.0.smithi027.stdout:4/593: mkdir d5/d9b/db0/db9 0 2024-09-20T19:06:03.860 INFO:tasks.workunit.client.0.smithi027.stdout:3/632: creat d0/d1/d13/d3c/d93/fd6 x:0 0 0 2024-09-20T19:06:03.862 INFO:tasks.workunit.client.0.smithi027.stdout:8/653: mknod d2/d3/d6/d21/d33/cd8 0 2024-09-20T19:06:03.863 INFO:tasks.workunit.client.0.smithi027.stdout:2/581: mknod d3/d24/d8b/cb4 0 2024-09-20T19:06:03.867 INFO:tasks.workunit.client.0.smithi027.stdout:2/582: creat d3/d1c/d26/fb5 x:0 0 0 2024-09-20T19:06:03.868 INFO:tasks.workunit.client.0.smithi027.stdout:2/583: chown d3/d13/d3c/d48/d6a/fb2 1847193 1 2024-09-20T19:06:03.868 INFO:tasks.workunit.client.0.smithi027.stdout:2/584: fsync d3/d96/f9a 0 2024-09-20T19:06:03.871 INFO:tasks.workunit.client.0.smithi027.stdout:3/633: link d0/d1/d13/d3c/d93/c97 d0/d1/d13/d98/dab/dba/cd7 0 2024-09-20T19:06:03.872 INFO:tasks.workunit.client.0.smithi027.stdout:2/585: creat d3/d1c/d31/fb6 x:0 0 0 2024-09-20T19:06:03.873 INFO:tasks.workunit.client.0.smithi027.stdout:8/654: creat d2/d3/d6/d21/fd9 x:0 0 0 2024-09-20T19:06:03.874 INFO:tasks.workunit.client.0.smithi027.stdout:4/594: getdents d5/d13/d16 0 2024-09-20T19:06:03.875 INFO:tasks.workunit.client.0.smithi027.stdout:2/586: write d3/d1c/d26/d2a/f53 [5162029,26703] 0 2024-09-20T19:06:03.877 INFO:tasks.workunit.client.0.smithi027.stdout:4/595: read d5/f10 [621422,30057] 0 2024-09-20T19:06:03.877 INFO:tasks.workunit.client.0.smithi027.stdout:8/655: rmdir d2/d3/d6/d21/d33/d79/dcf 39 2024-09-20T19:06:03.878 INFO:tasks.workunit.client.0.smithi027.stdout:3/634: dwrite d0/d1/f35 [0,4194304] 0 2024-09-20T19:06:03.880 INFO:tasks.workunit.client.0.smithi027.stdout:8/656: chown d2/d3/d1b/fbb 22 1 2024-09-20T19:06:03.880 INFO:tasks.workunit.client.0.smithi027.stdout:2/587: symlink d3/d24/d8b/lb7 0 2024-09-20T19:06:03.883 INFO:tasks.workunit.client.0.smithi027.stdout:3/635: unlink d0/dc5/ld5 0 2024-09-20T19:06:03.884 INFO:tasks.workunit.client.0.smithi027.stdout:1/667: dwrite d2/d8/d74/d9a/fb3 [0,4194304] 0 2024-09-20T19:06:03.884 INFO:tasks.workunit.client.0.smithi027.stdout:3/636: readlink d0/dc5/ld1 0 2024-09-20T19:06:03.885 INFO:tasks.workunit.client.0.smithi027.stdout:2/588: symlink d3/d13/d3c/d48/lb8 0 2024-09-20T19:06:03.886 INFO:tasks.workunit.client.0.smithi027.stdout:4/596: read d5/d13/d36/d48/d3f/d4c/d52/fa2 [160104,3810] 0 2024-09-20T19:06:03.886 INFO:tasks.workunit.client.0.smithi027.stdout:3/637: fdatasync d0/d1/d13/d15/faf 0 2024-09-20T19:06:03.886 INFO:tasks.workunit.client.0.smithi027.stdout:8/657: mkdir d2/d3/d1b/dda 0 2024-09-20T19:06:03.889 INFO:tasks.workunit.client.0.smithi027.stdout:1/668: mknod d2/d8/d2b/cd8 0 2024-09-20T19:06:03.891 INFO:tasks.workunit.client.0.smithi027.stdout:2/589: creat d3/d1c/d26/d75/fb9 x:0 0 0 2024-09-20T19:06:03.892 INFO:tasks.workunit.client.0.smithi027.stdout:7/599: write d3/d8/da/dc/f87 [387952,7203] 0 2024-09-20T19:06:03.895 INFO:tasks.workunit.client.0.smithi027.stdout:4/597: rename d5/d11/f23 to d5/d9b/db0/fba 0 2024-09-20T19:06:03.897 INFO:tasks.workunit.client.0.smithi027.stdout:4/598: chown d5/cb5 455 1 2024-09-20T19:06:03.897 INFO:tasks.workunit.client.0.smithi027.stdout:8/658: write d2/d14/d13/d2e/d6c/f6e [5070766,125157] 0 2024-09-20T19:06:03.899 INFO:tasks.workunit.client.0.smithi027.stdout:7/600: fsync d3/d8/da/d51/f53 0 2024-09-20T19:06:03.899 INFO:tasks.workunit.client.0.smithi027.stdout:2/590: dwrite d3/d1c/d26/d2a/f85 [0,4194304] 0 2024-09-20T19:06:03.901 INFO:tasks.workunit.client.0.smithi027.stdout:8/659: write d2/d14/d13/f3b [596615,95582] 0 2024-09-20T19:06:03.903 INFO:tasks.workunit.client.0.smithi027.stdout:2/591: mkdir d3/d13/d3c/d48/dba 0 2024-09-20T19:06:03.903 INFO:tasks.workunit.client.0.smithi027.stdout:7/601: readlink d3/d8/da/d2e/d49/d8b/l60 0 2024-09-20T19:06:03.904 INFO:tasks.workunit.client.0.smithi027.stdout:8/660: fdatasync d2/d14/d13/d43/f5b 0 2024-09-20T19:06:03.906 INFO:tasks.workunit.client.0.smithi027.stdout:4/599: link d5/d13/d36/fb8 d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fbb 0 2024-09-20T19:06:03.908 INFO:tasks.workunit.client.0.smithi027.stdout:7/602: rmdir d3/d8/da/d2e/d49/d8b 39 2024-09-20T19:06:03.909 INFO:tasks.workunit.client.0.smithi027.stdout:8/661: symlink d2/d3/d1b/d35/ldb 0 2024-09-20T19:06:03.910 INFO:tasks.workunit.client.0.smithi027.stdout:2/592: mknod d3/de/d34/cbb 0 2024-09-20T19:06:03.911 INFO:tasks.workunit.client.0.smithi027.stdout:7/603: mkdir d3/d8/d1c/d80/db2/dd0 0 2024-09-20T19:06:03.911 INFO:tasks.workunit.client.0.smithi027.stdout:8/662: readlink d2/d14/d13/d43/d5d/l69 0 2024-09-20T19:06:03.911 INFO:tasks.workunit.client.0.smithi027.stdout:4/600: stat d5/d13/d36/d49/d8f/c93 0 2024-09-20T19:06:03.913 INFO:tasks.workunit.client.0.smithi027.stdout:2/593: unlink d3/d1c/d26/f9f 0 2024-09-20T19:06:03.914 INFO:tasks.workunit.client.0.smithi027.stdout:7/604: symlink d3/ld1 0 2024-09-20T19:06:03.915 INFO:tasks.workunit.client.0.smithi027.stdout:8/663: rename d2/d3/d6/d21/d80/fb4 to d2/d3/d6/d21/d80/fdc 0 2024-09-20T19:06:03.916 INFO:tasks.workunit.client.0.smithi027.stdout:2/594: creat d3/d24/d8b/fbc x:0 0 0 2024-09-20T19:06:03.916 INFO:tasks.workunit.client.0.smithi027.stdout:4/601: mknod d5/d13/cbc 0 2024-09-20T19:06:03.917 INFO:tasks.workunit.client.0.smithi027.stdout:7/605: creat d3/d5e/fd2 x:0 0 0 2024-09-20T19:06:03.917 INFO:tasks.workunit.client.0.smithi027.stdout:8/664: symlink d2/d3/d9a/ldd 0 2024-09-20T19:06:03.919 INFO:tasks.workunit.client.0.smithi027.stdout:2/595: mknod d3/d13/d3c/cbd 0 2024-09-20T19:06:03.919 INFO:tasks.workunit.client.0.smithi027.stdout:2/596: fdatasync d3/d24/f28 0 2024-09-20T19:06:03.920 INFO:tasks.workunit.client.0.smithi027.stdout:2/597: chown d3 201408604 1 2024-09-20T19:06:03.980 INFO:tasks.workunit.client.0.smithi027.stdout:4/602: mknod d5/d13/d36/d48/d3f/cbd 0 2024-09-20T19:06:03.981 INFO:tasks.workunit.client.0.smithi027.stdout:3/638: truncate d0/f47 1020303 0 2024-09-20T19:06:03.981 INFO:tasks.workunit.client.0.smithi027.stdout:1/669: write d2/d8/d2b/d2d/f34 [2732793,112351] 0 2024-09-20T19:06:03.984 INFO:tasks.workunit.client.0.smithi027.stdout:3/639: write d0/d1/d13/d15/d55/fce [1422833,109785] 0 2024-09-20T19:06:03.985 INFO:tasks.workunit.client.0.smithi027.stdout:8/665: creat d2/fde x:0 0 0 2024-09-20T19:06:03.986 INFO:tasks.workunit.client.0.smithi027.stdout:4/603: creat d5/d13/d36/d48/d3f/d4c/d52/d87/fbe x:0 0 0 2024-09-20T19:06:03.987 INFO:tasks.workunit.client.0.smithi027.stdout:1/670: write d2/d8/d3b/d44/d96/fa4 [466136,1181] 0 2024-09-20T19:06:03.989 INFO:tasks.workunit.client.0.smithi027.stdout:2/598: truncate d3/d1c/d26/d2a/f53 3297496 0 2024-09-20T19:06:03.989 INFO:tasks.workunit.client.0.smithi027.stdout:3/640: chown d0/d1/d5e/d1d/d7d/c9a 208 1 2024-09-20T19:06:03.992 INFO:tasks.workunit.client.0.smithi027.stdout:2/599: chown d3/de/c22 22476452 1 2024-09-20T19:06:03.995 INFO:tasks.workunit.client.0.smithi027.stdout:1/671: dread - d2/d8/d3b/d82/d90/fc3 zero size 2024-09-20T19:06:03.995 INFO:tasks.workunit.client.0.smithi027.stdout:7/606: dwrite d3/d8/d26/d45/f52 [0,4194304] 0 2024-09-20T19:06:03.996 INFO:tasks.workunit.client.0.smithi027.stdout:8/666: unlink d2/d14/d13/d43/d5d/d86/c99 0 2024-09-20T19:06:03.999 INFO:tasks.workunit.client.0.smithi027.stdout:3/641: mknod d0/d1/d5e/d1d/d7d/db4/cd8 0 2024-09-20T19:06:04.002 INFO:tasks.workunit.client.0.smithi027.stdout:3/642: readlink d0/d19/l43 0 2024-09-20T19:06:04.005 INFO:tasks.workunit.client.0.smithi027.stdout:3/643: stat d0/d1/d13/d3c/cbc 0 2024-09-20T19:06:04.005 INFO:tasks.workunit.client.0.smithi027.stdout:2/600: dwrite d3/de/d34/f76 [0,4194304] 0 2024-09-20T19:06:04.007 INFO:tasks.workunit.client.0.smithi027.stdout:4/604: rename d5/d11/d3d/d6e/f6b to d5/d13/d36/d48/d3f/fbf 0 2024-09-20T19:06:04.008 INFO:tasks.workunit.client.0.smithi027.stdout:1/672: creat d2/d8/d74/d9a/da3/fd9 x:0 0 0 2024-09-20T19:06:04.010 INFO:tasks.workunit.client.0.smithi027.stdout:8/667: mknod d2/d14/d13/d2e/d6c/d77/cdf 0 2024-09-20T19:06:04.011 INFO:tasks.workunit.client.0.smithi027.stdout:7/607: dread d3/d8/da/d2e/d49/d8b/f3a [0,4194304] 0 2024-09-20T19:06:04.012 INFO:tasks.workunit.client.0.smithi027.stdout:3/644: mknod d0/dc5/cd9 0 2024-09-20T19:06:04.012 INFO:tasks.workunit.client.0.smithi027.stdout:8/668: read - d2/d65/f6a zero size 2024-09-20T19:06:04.014 INFO:tasks.workunit.client.0.smithi027.stdout:4/605: write d5/f6d [2544549,55480] 0 2024-09-20T19:06:04.015 INFO:tasks.workunit.client.0.smithi027.stdout:2/601: creat d3/d13/d3c/fbe x:0 0 0 2024-09-20T19:06:04.016 INFO:tasks.workunit.client.0.smithi027.stdout:8/669: dread - d2/d3/d1b/f9c zero size 2024-09-20T19:06:04.016 INFO:tasks.workunit.client.0.smithi027.stdout:3/645: symlink d0/d1/d13/d3c/lda 0 2024-09-20T19:06:04.016 INFO:tasks.workunit.client.0.smithi027.stdout:1/673: dread d2/f5c [0,4194304] 0 2024-09-20T19:06:04.017 INFO:tasks.workunit.client.0.smithi027.stdout:2/602: stat d3/d1c/c1d 0 2024-09-20T19:06:04.017 INFO:tasks.workunit.client.0.smithi027.stdout:4/606: mknod d5/d11/cc0 0 2024-09-20T19:06:04.019 INFO:tasks.workunit.client.0.smithi027.stdout:8/670: mkdir d2/d3/d6/de0 0 2024-09-20T19:06:04.020 INFO:tasks.workunit.client.0.smithi027.stdout:3/646: truncate d0/d1/d5e/f2c 3779542 0 2024-09-20T19:06:04.021 INFO:tasks.workunit.client.0.smithi027.stdout:8/671: stat d2/f39 0 2024-09-20T19:06:04.022 INFO:tasks.workunit.client.0.smithi027.stdout:2/603: truncate d3/d1c/d26/fa7 509311 0 2024-09-20T19:06:04.024 INFO:tasks.workunit.client.0.smithi027.stdout:3/647: chown d0/d1/d5e/d1d/d7d/f87 8 1 2024-09-20T19:06:04.025 INFO:tasks.workunit.client.0.smithi027.stdout:7/608: dwrite d3/d8/da/d2e/d50/f8e [0,4194304] 0 2024-09-20T19:06:04.031 INFO:tasks.workunit.client.0.smithi027.stdout:1/674: dwrite d2/d8/d74/fb6 [0,4194304] 0 2024-09-20T19:06:04.031 INFO:tasks.workunit.client.0.smithi027.stdout:3/648: truncate d0/d1/d13/d15/f29 5057999 0 2024-09-20T19:06:04.035 INFO:tasks.workunit.client.0.smithi027.stdout:1/675: creat d2/d8/d3b/d82/fda x:0 0 0 2024-09-20T19:06:04.035 INFO:tasks.workunit.client.0.smithi027.stdout:7/609: read d3/d24/f83 [380472,40726] 0 2024-09-20T19:06:04.037 INFO:tasks.workunit.client.0.smithi027.stdout:1/676: read d2/d8/d74/d9a/da3/fc1 [2647440,39886] 0 2024-09-20T19:06:04.039 INFO:tasks.workunit.client.0.smithi027.stdout:1/677: write d2/d8/f8c [132113,79832] 0 2024-09-20T19:06:04.042 INFO:tasks.workunit.client.0.smithi027.stdout:3/649: link d0/d19/d54/l71 d0/d1/d13/d98/dc3/da2/ldb 0 2024-09-20T19:06:04.043 INFO:tasks.workunit.client.0.smithi027.stdout:2/604: unlink d3/d1c/d26/d2a/f53 0 2024-09-20T19:06:04.044 INFO:tasks.workunit.client.0.smithi027.stdout:7/610: dwrite d3/d24/fc5 [0,4194304] 0 2024-09-20T19:06:04.045 INFO:tasks.workunit.client.0.smithi027.stdout:1/678: mknod d2/d8/d2b/cdb 0 2024-09-20T19:06:04.046 INFO:tasks.workunit.client.0.smithi027.stdout:3/650: fsync d0/f11 0 2024-09-20T19:06:04.047 INFO:tasks.workunit.client.0.smithi027.stdout:8/672: truncate d2/d65/f4f 1509912 0 2024-09-20T19:06:04.048 INFO:tasks.workunit.client.0.smithi027.stdout:2/605: fsync d3/d24/d8b/f99 0 2024-09-20T19:06:04.049 INFO:tasks.workunit.client.0.smithi027.stdout:7/611: creat d3/d8/d26/d45/d56/d8d/fd3 x:0 0 0 2024-09-20T19:06:04.050 INFO:tasks.workunit.client.0.smithi027.stdout:2/606: fdatasync d3/d2f/f33 0 2024-09-20T19:06:04.051 INFO:tasks.workunit.client.0.smithi027.stdout:3/651: creat d0/d1/d13/d15/d6f/dcc/fdc x:0 0 0 2024-09-20T19:06:04.054 INFO:tasks.workunit.client.0.smithi027.stdout:8/673: link d2/d3/f57 d2/d3/d6/d21/d33/fe1 0 2024-09-20T19:06:04.055 INFO:tasks.workunit.client.0.smithi027.stdout:7/612: truncate d3/d8/da/dc/da9/dbc/fc1 115098 0 2024-09-20T19:06:04.056 INFO:tasks.workunit.client.0.smithi027.stdout:2/607: dread d3/d13/d3c/d48/f62 [0,4194304] 0 2024-09-20T19:06:04.056 INFO:tasks.workunit.client.0.smithi027.stdout:3/652: unlink d0/d1/d5e/d1d/d7d/db4/l88 0 2024-09-20T19:06:04.057 INFO:tasks.workunit.client.0.smithi027.stdout:2/608: read - d3/d1c/d26/fa2 zero size 2024-09-20T19:06:04.058 INFO:tasks.workunit.client.0.smithi027.stdout:8/674: rename d2/fde to d2/d14/d13/d2e/fe2 0 2024-09-20T19:06:04.059 INFO:tasks.workunit.client.0.smithi027.stdout:8/675: readlink d2/d3/d1b/l6b 0 2024-09-20T19:06:04.061 INFO:tasks.workunit.client.0.smithi027.stdout:2/609: write d3/d24/fb3 [1955199,57979] 0 2024-09-20T19:06:04.062 INFO:tasks.workunit.client.0.smithi027.stdout:2/610: chown d3/de/d34/cbb 27865363 1 2024-09-20T19:06:04.066 INFO:tasks.workunit.client.0.smithi027.stdout:1/679: dread d2/d8/d2b/d2d/d73/f85 [0,4194304] 0 2024-09-20T19:06:04.068 INFO:tasks.workunit.client.0.smithi027.stdout:1/680: mknod d2/d8/d74/d9a/da3/dad/cdc 0 2024-09-20T19:06:04.070 INFO:tasks.workunit.client.0.smithi027.stdout:7/613: write d3/d8/d26/f7f [422964,51412] 0 2024-09-20T19:06:04.120 INFO:tasks.workunit.client.0.smithi027.stdout:3/653: truncate d0/d1/d5e/f2c 3217560 0 2024-09-20T19:06:04.121 INFO:tasks.workunit.client.0.smithi027.stdout:1/681: creat d2/d8/d74/d84/fdd x:0 0 0 2024-09-20T19:06:04.121 INFO:tasks.workunit.client.0.smithi027.stdout:2/611: write d3/d13/f15 [1613094,36756] 0 2024-09-20T19:06:04.122 INFO:tasks.workunit.client.0.smithi027.stdout:7/614: getdents d3/d8/d1c/d61 0 2024-09-20T19:06:04.123 INFO:tasks.workunit.client.0.smithi027.stdout:1/682: chown d2/d8/d3b/d44/fb2 2956 1 2024-09-20T19:06:04.124 INFO:tasks.workunit.client.0.smithi027.stdout:3/654: unlink d0/d1/d5e/d1d/d7d/db4/c9f 0 2024-09-20T19:06:04.125 INFO:tasks.workunit.client.0.smithi027.stdout:7/615: mkdir d3/d8/d1c/d80/db2/dd4 0 2024-09-20T19:06:04.127 INFO:tasks.workunit.client.0.smithi027.stdout:2/612: dread d3/de/d34/f76 [0,4194304] 0 2024-09-20T19:06:04.128 INFO:tasks.workunit.client.0.smithi027.stdout:7/616: stat d3/d8/da/dc/c22 0 2024-09-20T19:06:04.131 INFO:tasks.workunit.client.0.smithi027.stdout:3/655: dwrite d0/d19/f4a [0,4194304] 0 2024-09-20T19:06:04.131 INFO:tasks.workunit.client.0.smithi027.stdout:7/617: creat d3/d8/da/dc/da9/dbc/fd5 x:0 0 0 2024-09-20T19:06:04.134 INFO:tasks.workunit.client.0.smithi027.stdout:3/656: mknod d0/d1/d13/d64/cdd 0 2024-09-20T19:06:04.137 INFO:tasks.workunit.client.0.smithi027.stdout:7/618: symlink d3/d8/d1c/d80/db2/ld6 0 2024-09-20T19:06:04.141 INFO:tasks.workunit.client.0.smithi027.stdout:7/619: symlink d3/d8/d26/d45/ld7 0 2024-09-20T19:06:04.143 INFO:tasks.workunit.client.0.smithi027.stdout:3/657: dwrite d0/d1/d13/d3c/d93/fd6 [0,4194304] 0 2024-09-20T19:06:04.144 INFO:tasks.workunit.client.0.smithi027.stdout:2/613: dread d3/d2f/f42 [0,4194304] 0 2024-09-20T19:06:04.145 INFO:tasks.workunit.client.0.smithi027.stdout:3/658: mknod d0/d1/d5e/cde 0 2024-09-20T19:06:04.148 INFO:tasks.workunit.client.0.smithi027.stdout:2/614: symlink d3/d13/d3c/d48/dad/lbf 0 2024-09-20T19:06:04.149 INFO:tasks.workunit.client.0.smithi027.stdout:3/659: creat d0/d1/d13/d98/dc3/fdf x:0 0 0 2024-09-20T19:06:04.150 INFO:tasks.workunit.client.0.smithi027.stdout:2/615: mknod d3/d1c/d26/cc0 0 2024-09-20T19:06:04.150 INFO:tasks.workunit.client.0.smithi027.stdout:2/616: stat d3/d13/d3c/d48 0 2024-09-20T19:06:04.151 INFO:tasks.workunit.client.0.smithi027.stdout:3/660: fdatasync d0/d1/d5e/f77 0 2024-09-20T19:06:04.151 INFO:tasks.workunit.client.0.smithi027.stdout:3/661: chown d0/fbd 1482 1 2024-09-20T19:06:04.154 INFO:tasks.workunit.client.0.smithi027.stdout:3/662: creat d0/d1/d5e/d1d/d7d/db4/fe0 x:0 0 0 2024-09-20T19:06:04.155 INFO:tasks.workunit.client.0.smithi027.stdout:3/663: mkdir d0/d1/d13/d98/de1 0 2024-09-20T19:06:04.157 INFO:tasks.workunit.client.0.smithi027.stdout:1/683: dread d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:04.161 INFO:tasks.workunit.client.0.smithi027.stdout:1/684: rename d2/d8/d74/d9a/da3/dad/db1 to d2/d1b/dde 0 2024-09-20T19:06:04.162 INFO:tasks.workunit.client.0.smithi027.stdout:1/685: rmdir d2/d8/d2b/d2d/d3e 39 2024-09-20T19:06:04.162 INFO:tasks.workunit.client.0.smithi027.stdout:1/686: read d2/d1b/f4f [1716509,76107] 0 2024-09-20T19:06:04.167 INFO:tasks.workunit.client.0.smithi027.stdout:0/700: sync 2024-09-20T19:06:04.168 INFO:tasks.workunit.client.0.smithi027.stdout:1/687: dwrite d2/d8/d3b/d44/d96/fa4 [0,4194304] 0 2024-09-20T19:06:04.175 INFO:tasks.workunit.client.0.smithi027.stdout:2/617: dwrite d3/f9 [4194304,4194304] 0 2024-09-20T19:06:04.180 INFO:tasks.workunit.client.0.smithi027.stdout:2/618: symlink d3/d13/d3c/d48/dad/lc1 0 2024-09-20T19:06:04.183 INFO:tasks.workunit.client.0.smithi027.stdout:3/664: dwrite d0/d1/d13/d3c/f66 [0,4194304] 0 2024-09-20T19:06:04.185 INFO:tasks.workunit.client.0.smithi027.stdout:2/619: truncate d3/de/d34/f4e 194541 0 2024-09-20T19:06:04.186 INFO:tasks.workunit.client.0.smithi027.stdout:2/620: fsync d3/d13/f2b 0 2024-09-20T19:06:04.188 INFO:tasks.workunit.client.0.smithi027.stdout:3/665: dwrite d0/d1/d13/d64/f7c [0,4194304] 0 2024-09-20T19:06:04.189 INFO:tasks.workunit.client.0.smithi027.stdout:3/666: stat d0/d1/d13/l6d 0 2024-09-20T19:06:04.192 INFO:tasks.workunit.client.0.smithi027.stdout:3/667: truncate d0/f5 1085120 0 2024-09-20T19:06:04.200 INFO:tasks.workunit.client.0.smithi027.stdout:1/688: truncate d2/d1b/d56/d71/f95 13740 0 2024-09-20T19:06:04.204 INFO:tasks.workunit.client.0.smithi027.stdout:2/621: dread d3/d13/f6d [0,4194304] 0 2024-09-20T19:06:04.204 INFO:tasks.workunit.client.0.smithi027.stdout:1/689: rename d2/d8/d3b/d4b/l57 to d2/d8/d3b/d82/d90/d9f/ldf 0 2024-09-20T19:06:04.205 INFO:tasks.workunit.client.0.smithi027.stdout:1/690: stat d2/d8/d3b/d82/cb5 0 2024-09-20T19:06:04.207 INFO:tasks.workunit.client.0.smithi027.stdout:2/622: rename d3/d1c/d26/d2a/d63 to d3/d1c/d26/d2a/dc2 0 2024-09-20T19:06:04.208 INFO:tasks.workunit.client.0.smithi027.stdout:2/623: chown d3/d13/lae 240 1 2024-09-20T19:06:04.208 INFO:tasks.workunit.client.0.smithi027.stdout:1/691: creat d2/d8/d41/fe0 x:0 0 0 2024-09-20T19:06:04.209 INFO:tasks.workunit.client.0.smithi027.stdout:2/624: write d3/f78 [1686268,51582] 0 2024-09-20T19:06:04.209 INFO:tasks.workunit.client.0.smithi027.stdout:1/692: fsync d2/d8/d74/d9a/fb3 0 2024-09-20T19:06:04.210 INFO:tasks.workunit.client.0.smithi027.stdout:1/693: stat d2/d8/d3b/fb9 0 2024-09-20T19:06:04.212 INFO:tasks.workunit.client.0.smithi027.stdout:1/694: creat d2/d1b/d56/d71/fe1 x:0 0 0 2024-09-20T19:06:04.214 INFO:tasks.workunit.client.0.smithi027.stdout:1/695: unlink d2/d8/d3b/d82/d90/fc3 0 2024-09-20T19:06:04.223 INFO:tasks.workunit.client.0.smithi027.stdout:2/625: dread d3/d2f/f33 [0,4194304] 0 2024-09-20T19:06:04.224 INFO:tasks.workunit.client.0.smithi027.stdout:2/626: symlink d3/de/lc3 0 2024-09-20T19:06:04.230 INFO:tasks.workunit.client.0.smithi027.stdout:2/627: dwrite d3/d13/f87 [4194304,4194304] 0 2024-09-20T19:06:04.232 INFO:tasks.workunit.client.0.smithi027.stdout:2/628: mknod d3/d1c/d31/d9e/cc4 0 2024-09-20T19:06:04.234 INFO:tasks.workunit.client.0.smithi027.stdout:2/629: write d3/de/f46 [192238,111903] 0 2024-09-20T19:06:04.235 INFO:tasks.workunit.client.0.smithi027.stdout:2/630: stat d3/d24/d8b/fbc 0 2024-09-20T19:06:04.236 INFO:tasks.workunit.client.0.smithi027.stdout:2/631: readlink d3/de/l58 0 2024-09-20T19:06:04.237 INFO:tasks.workunit.client.0.smithi027.stdout:2/632: fsync d3/d13/d3c/d48/d6a/fb2 0 2024-09-20T19:06:04.238 INFO:tasks.workunit.client.0.smithi027.stdout:2/633: truncate d3/d1c/d31/f70 1416162 0 2024-09-20T19:06:04.241 INFO:tasks.workunit.client.0.smithi027.stdout:3/668: write d0/d1/f30 [395424,8903] 0 2024-09-20T19:06:04.242 INFO:tasks.workunit.client.0.smithi027.stdout:3/669: fsync d0/d1/f91 0 2024-09-20T19:06:04.246 INFO:tasks.workunit.client.0.smithi027.stdout:2/634: dwrite d3/d1c/d26/d2a/fa1 [0,4194304] 0 2024-09-20T19:06:04.246 INFO:tasks.workunit.client.0.smithi027.stdout:3/670: mkdir d0/d1/d65/dc9/de2 0 2024-09-20T19:06:04.247 INFO:tasks.workunit.client.0.smithi027.stdout:3/671: mkdir d0/d1/d13/d15/d55/d70/de3 0 2024-09-20T19:06:04.248 INFO:tasks.workunit.client.0.smithi027.stdout:3/672: chown d0/d1/fb 119 1 2024-09-20T19:06:04.249 INFO:tasks.workunit.client.0.smithi027.stdout:3/673: chown d0/d1/d13/d15/d55/f96 15270705 1 2024-09-20T19:06:04.252 INFO:tasks.workunit.client.0.smithi027.stdout:3/674: write d0/d19/f1a [2558692,29215] 0 2024-09-20T19:06:04.252 INFO:tasks.workunit.client.0.smithi027.stdout:4/607: sync 2024-09-20T19:06:04.253 INFO:tasks.workunit.client.0.smithi027.stdout:6/650: sync 2024-09-20T19:06:04.253 INFO:tasks.workunit.client.0.smithi027.stdout:5/693: sync 2024-09-20T19:06:04.253 INFO:tasks.workunit.client.0.smithi027.stdout:9/772: sync 2024-09-20T19:06:04.254 INFO:tasks.workunit.client.0.smithi027.stdout:4/608: fsync d5/d13/d16/f8e 0 2024-09-20T19:06:04.255 INFO:tasks.workunit.client.0.smithi027.stdout:3/675: symlink d0/d1/d5e/d1d/da7/db0/le4 0 2024-09-20T19:06:04.256 INFO:tasks.workunit.client.0.smithi027.stdout:3/676: readlink d0/l3d 0 2024-09-20T19:06:04.256 INFO:tasks.workunit.client.0.smithi027.stdout:5/694: creat d4/da/de/d3e/d61/fe3 x:0 0 0 2024-09-20T19:06:04.257 INFO:tasks.workunit.client.0.smithi027.stdout:6/651: creat d4/d15/d37/d5a/d78/dbc/fce x:0 0 0 2024-09-20T19:06:04.258 INFO:tasks.workunit.client.0.smithi027.stdout:3/677: mknod d0/d1/d5e/d1d/d7d/ce5 0 2024-09-20T19:06:04.259 INFO:tasks.workunit.client.0.smithi027.stdout:9/773: creat d0/d9/df/d1b/d9c/d4f/dd5/ffc x:0 0 0 2024-09-20T19:06:04.260 INFO:tasks.workunit.client.0.smithi027.stdout:4/609: getdents d5/d11/d1a/d2a/da3 0 2024-09-20T19:06:04.261 INFO:tasks.workunit.client.0.smithi027.stdout:5/695: mkdir d4/da/de/d3e/d69/d75/db4/de4 0 2024-09-20T19:06:04.262 INFO:tasks.workunit.client.0.smithi027.stdout:5/696: chown d4/da/de/d3e/d61/c93 2 1 2024-09-20T19:06:04.262 INFO:tasks.workunit.client.0.smithi027.stdout:3/678: mkdir d0/d1/d13/d98/dc3/da2/de6 0 2024-09-20T19:06:04.263 INFO:tasks.workunit.client.0.smithi027.stdout:6/652: creat d4/d15/d2c/dcb/fcf x:0 0 0 2024-09-20T19:06:04.264 INFO:tasks.workunit.client.0.smithi027.stdout:9/774: symlink d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/lfd 0 2024-09-20T19:06:04.266 INFO:tasks.workunit.client.0.smithi027.stdout:5/697: write d4/da/de/d3e/db7/dc2/d87/f9a [5177917,18243] 0 2024-09-20T19:06:04.267 INFO:tasks.workunit.client.0.smithi027.stdout:6/653: symlink d4/d15/d37/d7a/d46/d53/ld0 0 2024-09-20T19:06:04.268 INFO:tasks.workunit.client.0.smithi027.stdout:6/654: stat d4/d6/d4b/d7c 0 2024-09-20T19:06:04.268 INFO:tasks.workunit.client.0.smithi027.stdout:4/610: getdents d5/d11/d17/d1b/d8d 0 2024-09-20T19:06:04.268 INFO:tasks.workunit.client.0.smithi027.stdout:9/775: rmdir d0/d9/df/d1b 39 2024-09-20T19:06:04.269 INFO:tasks.workunit.client.0.smithi027.stdout:5/698: creat d4/da/d1a/fe5 x:0 0 0 2024-09-20T19:06:04.270 INFO:tasks.workunit.client.0.smithi027.stdout:6/655: creat d4/d9c/fd1 x:0 0 0 2024-09-20T19:06:04.271 INFO:tasks.workunit.client.0.smithi027.stdout:3/679: getdents d0/d1/d13 0 2024-09-20T19:06:04.273 INFO:tasks.workunit.client.0.smithi027.stdout:5/699: write d4/fdf [448393,102872] 0 2024-09-20T19:06:04.273 INFO:tasks.workunit.client.0.smithi027.stdout:4/611: creat d5/d13/d36/d48/d3f/d4c/d52/fc1 x:0 0 0 2024-09-20T19:06:04.274 INFO:tasks.workunit.client.0.smithi027.stdout:4/612: chown d5/d9b/db0 446455 1 2024-09-20T19:06:04.277 INFO:tasks.workunit.client.0.smithi027.stdout:6/656: link d4/fb3 d4/d15/d37/d6a/da5/fd2 0 2024-09-20T19:06:04.277 INFO:tasks.workunit.client.0.smithi027.stdout:5/700: readlink d4/da/de/d3e/d44/lc1 0 2024-09-20T19:06:04.278 INFO:tasks.workunit.client.0.smithi027.stdout:5/701: fsync d4/da/de/d3e/f59 0 2024-09-20T19:06:04.278 INFO:tasks.workunit.client.0.smithi027.stdout:3/680: rmdir d0/d1/d13/d3c/da1 0 2024-09-20T19:06:04.278 INFO:tasks.workunit.client.1.smithi098.stdout:2/842: sync 2024-09-20T19:06:04.279 INFO:tasks.workunit.client.0.smithi027.stdout:9/776: rename d0/d9/df/d1b/cc6 to d0/d9/df/cfe 0 2024-09-20T19:06:04.279 INFO:tasks.workunit.client.0.smithi027.stdout:3/681: read d0/d1/d13/d15/d6f/f90 [327523,125266] 0 2024-09-20T19:06:04.279 INFO:tasks.workunit.client.0.smithi027.stdout:6/657: chown d4/d15/d37/d6a/dbf/cc6 406 1 2024-09-20T19:06:04.292 INFO:tasks.workunit.client.1.smithi098.stdout:2/843: dread d3/df/d13/f2c [8388608,4194304] 0 2024-09-20T19:06:04.293 INFO:tasks.workunit.client.1.smithi098.stdout:2/844: symlink d3/d16/d1d/d2b/d99/da2/l111 0 2024-09-20T19:06:04.296 INFO:tasks.workunit.client.1.smithi098.stdout:3/522: sync 2024-09-20T19:06:04.296 INFO:tasks.workunit.client.1.smithi098.stdout:0/379: sync 2024-09-20T19:06:04.297 INFO:tasks.workunit.client.1.smithi098.stdout:0/380: fsync d0/db/d1d/f4d 0 2024-09-20T19:06:04.298 INFO:tasks.workunit.client.1.smithi098.stdout:3/523: chown d4/f16 1 1 2024-09-20T19:06:04.299 INFO:tasks.workunit.client.1.smithi098.stdout:3/524: fsync d4/d19/d1d/d22/f9b 0 2024-09-20T19:06:04.300 INFO:tasks.workunit.client.1.smithi098.stdout:0/381: unlink d0/d6/d19/f1c 0 2024-09-20T19:06:04.304 INFO:tasks.workunit.client.1.smithi098.stdout:0/382: mkdir d0/d6/d19/d4f/d70 0 2024-09-20T19:06:04.306 INFO:tasks.workunit.client.0.smithi027.stdout:5/702: symlink d4/da/de/le6 0 2024-09-20T19:06:04.306 INFO:tasks.workunit.client.1.smithi098.stdout:2/845: dwrite d3/db0/dcc/fce [0,4194304] 0 2024-09-20T19:06:04.309 INFO:tasks.workunit.client.1.smithi098.stdout:0/383: mknod d0/d55/d38/c71 0 2024-09-20T19:06:04.310 INFO:tasks.workunit.client.1.smithi098.stdout:3/525: getdents d4/d19/d1d/d2f/d4e/d59 0 2024-09-20T19:06:04.310 INFO:tasks.workunit.client.0.smithi027.stdout:6/658: truncate d4/d15/d2c/f49 2431020 0 2024-09-20T19:06:04.312 INFO:tasks.workunit.client.0.smithi027.stdout:9/777: dwrite d0/d2e/f76 [0,4194304] 0 2024-09-20T19:06:04.313 INFO:tasks.workunit.client.1.smithi098.stdout:2/846: mknod d3/d16/d1d/db5/c112 0 2024-09-20T19:06:04.314 INFO:tasks.workunit.client.0.smithi027.stdout:9/778: chown d0/d97/lbe 33312 1 2024-09-20T19:06:04.315 INFO:tasks.workunit.client.0.smithi027.stdout:5/703: mkdir d4/da/de/d3e/d69/d75/d3d/de7 0 2024-09-20T19:06:04.316 INFO:tasks.workunit.client.1.smithi098.stdout:0/384: creat d0/d6/d19/d4f/f72 x:0 0 0 2024-09-20T19:06:04.318 INFO:tasks.workunit.client.1.smithi098.stdout:3/526: dwrite d4/d19/d1d/d22/f9b [0,4194304] 0 2024-09-20T19:06:04.318 INFO:tasks.workunit.client.1.smithi098.stdout:0/385: rename d0/d55/d38 to d0/d55/d38/d51/d73 22 2024-09-20T19:06:04.323 INFO:tasks.workunit.client.1.smithi098.stdout:3/527: stat d4/d19/d1d/d2f/l37 0 2024-09-20T19:06:04.323 INFO:tasks.workunit.client.0.smithi027.stdout:3/682: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:06:04.324 INFO:tasks.workunit.client.1.smithi098.stdout:0/386: symlink d0/d55/d38/l74 0 2024-09-20T19:06:04.324 INFO:tasks.workunit.client.0.smithi027.stdout:3/683: chown d0/d1/d65/dc9 167 1 2024-09-20T19:06:04.324 INFO:tasks.workunit.client.1.smithi098.stdout:0/387: fsync d0/db/d1d/f2a 0 2024-09-20T19:06:04.325 INFO:tasks.workunit.client.1.smithi098.stdout:3/528: write d4/d19/d1d/d22/f9f [751172,55612] 0 2024-09-20T19:06:04.328 INFO:tasks.workunit.client.0.smithi027.stdout:9/779: mknod d0/d9/df/d1c/d6a/d9a/cff 0 2024-09-20T19:06:04.328 INFO:tasks.workunit.client.0.smithi027.stdout:5/704: mkdir d4/d1f/d91/d9b/de8 0 2024-09-20T19:06:04.330 INFO:tasks.workunit.client.0.smithi027.stdout:5/705: dread - d4/da/de/d3e/db7/fce zero size 2024-09-20T19:06:04.333 INFO:tasks.workunit.client.0.smithi027.stdout:5/706: creat d4/d1f/fe9 x:0 0 0 2024-09-20T19:06:04.334 INFO:tasks.workunit.client.1.smithi098.stdout:3/529: dwrite d4/d25/f35 [0,4194304] 0 2024-09-20T19:06:04.334 INFO:tasks.workunit.client.0.smithi027.stdout:3/684: getdents d0/dc5 0 2024-09-20T19:06:04.336 INFO:tasks.workunit.client.1.smithi098.stdout:0/388: getdents d0 0 2024-09-20T19:06:04.338 INFO:tasks.workunit.client.1.smithi098.stdout:3/530: symlink d4/d38/d48/d60/la5 0 2024-09-20T19:06:04.338 INFO:tasks.workunit.client.0.smithi027.stdout:9/780: dwrite d0/d9/df/fcf [0,4194304] 0 2024-09-20T19:06:04.338 INFO:tasks.workunit.client.0.smithi027.stdout:3/685: symlink d0/d1/d13/d3c/le7 0 2024-09-20T19:06:04.340 INFO:tasks.workunit.client.0.smithi027.stdout:5/707: creat d4/da/de/dda/fea x:0 0 0 2024-09-20T19:06:04.343 INFO:tasks.workunit.client.0.smithi027.stdout:9/781: stat d0/d9/ce3 0 2024-09-20T19:06:04.345 INFO:tasks.workunit.client.0.smithi027.stdout:9/782: readlink d0/d9/df/d57/l88 0 2024-09-20T19:06:04.347 INFO:tasks.workunit.client.0.smithi027.stdout:3/686: dwrite d0/d1/f3b [0,4194304] 0 2024-09-20T19:06:04.349 INFO:tasks.workunit.client.0.smithi027.stdout:7/620: sync 2024-09-20T19:06:04.350 INFO:tasks.workunit.client.0.smithi027.stdout:8/676: sync 2024-09-20T19:06:04.350 INFO:tasks.workunit.client.0.smithi027.stdout:9/783: creat d0/d9/df/d1b/f100 x:0 0 0 2024-09-20T19:06:04.352 INFO:tasks.workunit.client.0.smithi027.stdout:5/708: dwrite d4/da/de/d3e/db7/fc9 [0,4194304] 0 2024-09-20T19:06:04.353 INFO:tasks.workunit.client.0.smithi027.stdout:3/687: stat d0/d1/d5e/d1d/d7d/db4/l8d 0 2024-09-20T19:06:04.356 INFO:tasks.workunit.client.0.smithi027.stdout:5/709: fdatasync d4/f45 0 2024-09-20T19:06:04.356 INFO:tasks.workunit.client.0.smithi027.stdout:9/784: mknod d0/d9/df/da2/c101 0 2024-09-20T19:06:04.358 INFO:tasks.workunit.client.0.smithi027.stdout:7/621: write d3/d8/d26/d45/d56/d8d/fad [1802821,67998] 0 2024-09-20T19:06:04.360 INFO:tasks.workunit.client.0.smithi027.stdout:3/688: creat d0/d1/d5e/d1d/da7/db0/dc7/fe8 x:0 0 0 2024-09-20T19:06:04.360 INFO:tasks.workunit.client.0.smithi027.stdout:9/785: rmdir d0/d9/df/d1c/d6a/d6d 39 2024-09-20T19:06:04.361 INFO:tasks.workunit.client.0.smithi027.stdout:5/710: dread d4/da/de/d3e/d69/d6a/fcb [0,4194304] 0 2024-09-20T19:06:04.362 INFO:tasks.workunit.client.0.smithi027.stdout:7/622: mknod d3/d8/da/d2e/cd8 0 2024-09-20T19:06:04.364 INFO:tasks.workunit.client.0.smithi027.stdout:8/677: getdents d2/d3/d1b 0 2024-09-20T19:06:04.366 INFO:tasks.workunit.client.0.smithi027.stdout:8/678: fsync d2/d14/d13/d43/fb0 0 2024-09-20T19:06:04.367 INFO:tasks.workunit.client.0.smithi027.stdout:3/689: rename d0/d1/d5e/d1d/da7/db0/fb7 to d0/d1/d13/d98/dab/fe9 0 2024-09-20T19:06:04.369 INFO:tasks.workunit.client.0.smithi027.stdout:8/679: fdatasync d2/d65/f6a 0 2024-09-20T19:06:04.372 INFO:tasks.workunit.client.0.smithi027.stdout:8/680: chown d2/d14/c24 1732 1 2024-09-20T19:06:04.373 INFO:tasks.workunit.client.0.smithi027.stdout:5/711: dwrite d4/da/d1a/f53 [0,4194304] 0 2024-09-20T19:06:04.374 INFO:tasks.workunit.client.0.smithi027.stdout:7/623: dwrite d3/d8/d26/f71 [0,4194304] 0 2024-09-20T19:06:04.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/389: write d0/d55/d38/f44 [3262245,126631] 0 2024-09-20T19:06:04.378 INFO:tasks.workunit.client.1.smithi098.stdout:0/390: symlink d0/db/d32/l75 0 2024-09-20T19:06:04.380 INFO:tasks.workunit.client.0.smithi027.stdout:8/681: dread - d2/d14/d13/d2e/fa8 zero size 2024-09-20T19:06:04.384 INFO:tasks.workunit.client.1.smithi098.stdout:3/531: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:06:04.385 INFO:tasks.workunit.client.1.smithi098.stdout:0/391: creat d0/d55/f76 x:0 0 0 2024-09-20T19:06:04.389 INFO:tasks.workunit.client.0.smithi027.stdout:5/712: dwrite d4/da/de/d3e/fb1 [0,4194304] 0 2024-09-20T19:06:04.391 INFO:tasks.workunit.client.0.smithi027.stdout:0/701: sync 2024-09-20T19:06:04.391 INFO:tasks.workunit.client.1.smithi098.stdout:0/392: mkdir d0/d6/d28/d31/d69/d77 0 2024-09-20T19:06:04.404 INFO:tasks.workunit.client.0.smithi027.stdout:3/690: write d0/f47 [1811062,35498] 0 2024-09-20T19:06:04.407 INFO:tasks.workunit.client.0.smithi027.stdout:9/786: dwrite d0/d9/df/d1b/d9c/d5a/f82 [0,4194304] 0 2024-09-20T19:06:04.408 INFO:tasks.workunit.client.0.smithi027.stdout:9/787: chown d0/d9/df/d1b/d64/fe0 23572043 1 2024-09-20T19:06:04.411 INFO:tasks.workunit.client.1.smithi098.stdout:0/393: fsync d0/d55/d38/f44 0 2024-09-20T19:06:04.414 INFO:tasks.workunit.client.0.smithi027.stdout:7/624: mkdir d3/d8/da/dc/dd9 0 2024-09-20T19:06:04.415 INFO:tasks.workunit.client.1.smithi098.stdout:0/394: fdatasync d0/d6/d28/d31/f53 0 2024-09-20T19:06:04.415 INFO:tasks.workunit.client.0.smithi027.stdout:6/659: dread d4/d15/d2c/f49 [0,4194304] 0 2024-09-20T19:06:04.418 INFO:tasks.workunit.client.0.smithi027.stdout:0/702: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/l101 0 2024-09-20T19:06:04.420 INFO:tasks.workunit.client.0.smithi027.stdout:7/625: mknod d3/d8/da/d2e/d49/d8b/cda 0 2024-09-20T19:06:04.421 INFO:tasks.workunit.client.1.smithi098.stdout:0/395: mkdir d0/d6/d28/d31/d45/d60/d78 0 2024-09-20T19:06:04.423 INFO:tasks.workunit.client.0.smithi027.stdout:6/660: symlink d4/d15/d37/d7a/d46/d53/ld3 0 2024-09-20T19:06:04.427 INFO:tasks.workunit.client.1.smithi098.stdout:0/396: dwrite d0/f4a [0,4194304] 0 2024-09-20T19:06:04.427 INFO:tasks.workunit.client.0.smithi027.stdout:9/788: creat d0/d2e/f102 x:0 0 0 2024-09-20T19:06:04.430 INFO:tasks.workunit.client.0.smithi027.stdout:6/661: dwrite d4/d15/d37/d7a/d8e/fbe [0,4194304] 0 2024-09-20T19:06:04.432 INFO:tasks.workunit.client.0.smithi027.stdout:7/626: creat d3/d5e/dc7/fdb x:0 0 0 2024-09-20T19:06:04.434 INFO:tasks.workunit.client.1.smithi098.stdout:0/397: dwrite d0/db/f5d [0,4194304] 0 2024-09-20T19:06:04.436 INFO:tasks.workunit.client.1.smithi098.stdout:0/398: write d0/d6/fe [6711077,27664] 0 2024-09-20T19:06:04.436 INFO:tasks.workunit.client.0.smithi027.stdout:9/789: creat d0/d9/df/da2/f103 x:0 0 0 2024-09-20T19:06:04.439 INFO:tasks.workunit.client.1.smithi098.stdout:3/532: write d4/d25/f49 [1650512,27812] 0 2024-09-20T19:06:04.442 INFO:tasks.workunit.client.1.smithi098.stdout:0/399: chown d0/db/d1d/l4c 181 1 2024-09-20T19:06:04.444 INFO:tasks.workunit.client.1.smithi098.stdout:3/533: readlink d4/da/l1a 0 2024-09-20T19:06:04.446 INFO:tasks.workunit.client.1.smithi098.stdout:3/534: stat d4/d19/d1d/d2f/f53 0 2024-09-20T19:06:04.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/535: readlink d4/d38/l84 0 2024-09-20T19:06:04.447 INFO:tasks.workunit.client.1.smithi098.stdout:0/400: getdents d0/d6/d19/d4f/d70 0 2024-09-20T19:06:04.449 INFO:tasks.workunit.client.0.smithi027.stdout:5/713: dread d4/d1f/d7f/fb3 [0,4194304] 0 2024-09-20T19:06:04.449 INFO:tasks.workunit.client.1.smithi098.stdout:3/536: fsync d4/d19/d1d/d22/f2c 0 2024-09-20T19:06:04.454 INFO:tasks.workunit.client.1.smithi098.stdout:3/537: mknod d4/ca6 0 2024-09-20T19:06:04.455 INFO:tasks.workunit.client.0.smithi027.stdout:7/627: dwrite d3/d8/d1c/d61/f97 [0,4194304] 0 2024-09-20T19:06:04.455 INFO:tasks.workunit.client.0.smithi027.stdout:5/714: write d4/da/de/d3e/d69/d75/d3d/f68 [2710924,9545] 0 2024-09-20T19:06:04.455 INFO:tasks.workunit.client.0.smithi027.stdout:5/715: chown d4/da/f2c 414896284 1 2024-09-20T19:06:04.456 INFO:tasks.workunit.client.1.smithi098.stdout:0/401: rename d0/d6/c46 to d0/d55/c79 0 2024-09-20T19:06:04.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/538: rename d4/d19/d1d to d4/d19/d1d/d2f/d4e/da7 22 2024-09-20T19:06:04.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/539: chown d4/d19/d1d/d22 16 1 2024-09-20T19:06:04.461 INFO:tasks.workunit.client.1.smithi098.stdout:3/540: symlink d4/d19/d1d/d2f/d4e/la8 0 2024-09-20T19:06:04.463 INFO:tasks.workunit.client.1.smithi098.stdout:6/413: sync 2024-09-20T19:06:04.463 INFO:tasks.workunit.client.1.smithi098.stdout:9/653: sync 2024-09-20T19:06:04.464 INFO:tasks.workunit.client.0.smithi027.stdout:5/716: link d4/d6c/dc7/fde d4/da/de/feb 0 2024-09-20T19:06:04.465 INFO:tasks.workunit.client.0.smithi027.stdout:5/717: chown d4/d6c/dc7 668 1 2024-09-20T19:06:04.465 INFO:tasks.workunit.client.1.smithi098.stdout:3/541: mknod d4/da/d50/ca9 0 2024-09-20T19:06:04.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/669: sync 2024-09-20T19:06:04.467 INFO:tasks.workunit.client.1.smithi098.stdout:4/663: sync 2024-09-20T19:06:04.467 INFO:tasks.workunit.client.1.smithi098.stdout:1/554: sync 2024-09-20T19:06:04.467 INFO:tasks.workunit.client.1.smithi098.stdout:5/497: sync 2024-09-20T19:06:04.467 INFO:tasks.workunit.client.1.smithi098.stdout:8/680: sync 2024-09-20T19:06:04.468 INFO:tasks.workunit.client.0.smithi027.stdout:8/682: dwrite d2/d14/d13/d2e/f53 [0,4194304] 0 2024-09-20T19:06:04.468 INFO:tasks.workunit.client.1.smithi098.stdout:4/664: chown d3 86336358 1 2024-09-20T19:06:04.472 INFO:tasks.workunit.client.0.smithi027.stdout:3/691: write d0/d1/d13/d15/d55/f6a [1688049,43973] 0 2024-09-20T19:06:04.472 INFO:tasks.workunit.client.1.smithi098.stdout:8/681: fdatasync d7/f10 0 2024-09-20T19:06:04.474 INFO:tasks.workunit.client.0.smithi027.stdout:5/718: dwrite d4/da/fba [0,4194304] 0 2024-09-20T19:06:04.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:04 smithi098 ceph-mon[35737]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 69 MiB/s rd, 233 MiB/s wr, 433 op/s 2024-09-20T19:06:04.477 INFO:tasks.workunit.client.1.smithi098.stdout:7/670: dwrite d3/d76/d86/faf [0,4194304] 0 2024-09-20T19:06:04.479 INFO:tasks.workunit.client.0.smithi027.stdout:8/683: mknod d2/d3/d6/d21/d33/d79/d9f/ce3 0 2024-09-20T19:06:04.482 INFO:tasks.workunit.client.0.smithi027.stdout:0/703: dwrite d2/d48/d6b/d79/d84/d1b/dc5/f6c [0,4194304] 0 2024-09-20T19:06:04.483 INFO:tasks.workunit.client.0.smithi027.stdout:4/613: sync 2024-09-20T19:06:04.483 INFO:tasks.workunit.client.0.smithi027.stdout:2/635: sync 2024-09-20T19:06:04.483 INFO:tasks.workunit.client.0.smithi027.stdout:1/696: sync 2024-09-20T19:06:04.485 INFO:tasks.workunit.client.1.smithi098.stdout:3/542: mknod d4/d38/d48/caa 0 2024-09-20T19:06:04.490 INFO:tasks.workunit.client.1.smithi098.stdout:8/682: mkdir d7/de/d11/d19/d30/d59/d80/df1 0 2024-09-20T19:06:04.490 INFO:tasks.workunit.client.1.smithi098.stdout:0/402: dread d0/d55/d38/f6c [0,4194304] 0 2024-09-20T19:06:04.491 INFO:tasks.workunit.client.0.smithi027.stdout:1/697: write d2/d1b/d56/d71/f7a [1640362,8261] 0 2024-09-20T19:06:04.494 INFO:tasks.workunit.client.0.smithi027.stdout:2/636: chown d3/d13/d3c/d48/f74 20 1 2024-09-20T19:06:04.494 INFO:tasks.workunit.client.0.smithi027.stdout:4/614: read d5/fa [4911124,102842] 0 2024-09-20T19:06:04.495 INFO:tasks.workunit.client.0.smithi027.stdout:5/719: read d4/da/de/f66 [691446,25067] 0 2024-09-20T19:06:04.496 INFO:tasks.workunit.client.1.smithi098.stdout:4/665: getdents d3/d6/de3 0 2024-09-20T19:06:04.497 INFO:tasks.workunit.client.1.smithi098.stdout:2/847: sync 2024-09-20T19:06:04.498 INFO:tasks.workunit.client.0.smithi027.stdout:1/698: write d2/d1b/d56/d71/fe1 [465242,88834] 0 2024-09-20T19:06:04.498 INFO:tasks.workunit.client.1.smithi098.stdout:8/683: dwrite d7/de/d11/d19/d30/d55/fe4 [0,4194304] 0 2024-09-20T19:06:04.499 INFO:tasks.workunit.client.1.smithi098.stdout:3/543: fdatasync d4/f1b 0 2024-09-20T19:06:04.499 INFO:tasks.workunit.client.0.smithi027.stdout:9/790: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:06:04.503 INFO:tasks.workunit.client.0.smithi027.stdout:0/704: dwrite d2/d48/d6b/d79/d84/d1b/d39/f57 [0,4194304] 0 2024-09-20T19:06:04.505 INFO:tasks.workunit.client.1.smithi098.stdout:6/414: write d0/de/d1b/f5d [893158,116270] 0 2024-09-20T19:06:04.507 INFO:tasks.workunit.client.1.smithi098.stdout:9/654: write d4/de/d27/d4a/d58/d5b/f97 [1030433,38438] 0 2024-09-20T19:06:04.509 INFO:tasks.workunit.client.0.smithi027.stdout:2/637: mknod d3/de/cc5 0 2024-09-20T19:06:04.509 INFO:tasks.workunit.client.1.smithi098.stdout:9/655: chown d4/de/d27/d6c/fa7 1830978 1 2024-09-20T19:06:04.509 INFO:tasks.workunit.client.0.smithi027.stdout:4/615: creat d5/d11/d1a/d2a/fc2 x:0 0 0 2024-09-20T19:06:04.512 INFO:tasks.workunit.client.0.smithi027.stdout:6/662: dwrite d4/d15/d37/d7a/d46/d53/f96 [0,4194304] 0 2024-09-20T19:06:04.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/684: write d7/f3a [940983,107409] 0 2024-09-20T19:06:04.514 INFO:tasks.workunit.client.0.smithi027.stdout:1/699: mkdir d2/d8/d74/d9a/de2 0 2024-09-20T19:06:04.517 INFO:tasks.workunit.client.0.smithi027.stdout:2/638: write d3/d24/f28 [249349,27060] 0 2024-09-20T19:06:04.517 INFO:tasks.workunit.client.0.smithi027.stdout:0/705: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 0 2024-09-20T19:06:04.517 INFO:tasks.workunit.client.0.smithi027.stdout:4/616: chown d5/d11/d1a/d2a/l88 36 1 2024-09-20T19:06:04.517 INFO:tasks.workunit.client.1.smithi098.stdout:3/544: rename d4/d25/f68 to d4/d25/d8d/fab 0 2024-09-20T19:06:04.517 INFO:tasks.workunit.client.0.smithi027.stdout:7/628: dwrite d3/d8/d26/d45/f95 [0,4194304] 0 2024-09-20T19:06:04.519 INFO:tasks.workunit.client.1.smithi098.stdout:6/415: rmdir d0/de/d1b/d37/d44/d24/d29 39 2024-09-20T19:06:04.521 INFO:tasks.workunit.client.1.smithi098.stdout:4/666: dwrite d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/fdf [0,4194304] 0 2024-09-20T19:06:04.522 INFO:tasks.workunit.client.1.smithi098.stdout:1/555: write d1/d3/df/d4a/f63 [64987,88540] 0 2024-09-20T19:06:04.523 INFO:tasks.workunit.client.1.smithi098.stdout:8/685: stat d7/de/d11/d19/d30/d55/da9/dbe 0 2024-09-20T19:06:04.523 INFO:tasks.workunit.client.0.smithi027.stdout:2/639: read d3/d1c/d26/f67 [3802581,79618] 0 2024-09-20T19:06:04.525 INFO:tasks.workunit.client.1.smithi098.stdout:4/667: stat d3/d6/l17 0 2024-09-20T19:06:04.525 INFO:tasks.workunit.client.0.smithi027.stdout:2/640: chown d3/d96/la9 7965036 1 2024-09-20T19:06:04.527 INFO:tasks.workunit.client.0.smithi027.stdout:6/663: dwrite d4/d15/d37/fad [0,4194304] 0 2024-09-20T19:06:04.529 INFO:tasks.workunit.client.0.smithi027.stdout:9/791: rename d0/d97/leb to d0/d9/df/d1b/d9c/d4f/d8d/da0/dfa/l104 0 2024-09-20T19:06:04.530 INFO:tasks.workunit.client.0.smithi027.stdout:0/706: mknod d2/d49/ded/c102 0 2024-09-20T19:06:04.530 INFO:tasks.workunit.client.0.smithi027.stdout:3/692: dread d0/d1/d5e/f77 [0,4194304] 0 2024-09-20T19:06:04.530 INFO:tasks.workunit.client.0.smithi027.stdout:6/664: readlink d4/d15/d37/d7a/d46/l82 0 2024-09-20T19:06:04.533 INFO:tasks.workunit.client.1.smithi098.stdout:5/498: dread d1/d17/d35/f41 [0,4194304] 0 2024-09-20T19:06:04.534 INFO:tasks.workunit.client.1.smithi098.stdout:3/545: creat d4/d25/d40/d80/d94/fac x:0 0 0 2024-09-20T19:06:04.536 INFO:tasks.workunit.client.1.smithi098.stdout:8/686: unlink d7/de/d11/d19/d30/d55/d9d/ld1 0 2024-09-20T19:06:04.537 INFO:tasks.workunit.client.0.smithi027.stdout:1/700: mkdir d2/d8/d3b/de3 0 2024-09-20T19:06:04.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/556: creat d1/d3/df/d4a/d6d/fb5 x:0 0 0 2024-09-20T19:06:04.542 INFO:tasks.workunit.client.1.smithi098.stdout:7/671: dread d3/d10/d16/d17/d33/d1f/f44 [0,4194304] 0 2024-09-20T19:06:04.544 INFO:tasks.workunit.client.1.smithi098.stdout:0/403: getdents d0/db/d1d 0 2024-09-20T19:06:04.548 INFO:tasks.workunit.client.1.smithi098.stdout:1/557: rmdir d1/d3/d2e/d71 39 2024-09-20T19:06:04.548 INFO:tasks.workunit.client.1.smithi098.stdout:9/656: dread d4/de/d27/d6c/d73/f99 [0,4194304] 0 2024-09-20T19:06:04.548 INFO:tasks.workunit.client.0.smithi027.stdout:8/684: dwrite d2/d2a/fd0 [0,4194304] 0 2024-09-20T19:06:04.549 INFO:tasks.workunit.client.0.smithi027.stdout:4/617: mkdir d5/d11/d17/d1b/da9/dc3 0 2024-09-20T19:06:04.549 INFO:tasks.workunit.client.0.smithi027.stdout:4/618: dread - d5/d13/d36/fb8 zero size 2024-09-20T19:06:04.550 INFO:tasks.workunit.client.1.smithi098.stdout:8/687: creat d7/de/d11/d19/d30/d55/ff2 x:0 0 0 2024-09-20T19:06:04.552 INFO:tasks.workunit.client.1.smithi098.stdout:7/672: dwrite d3/f6a [0,4194304] 0 2024-09-20T19:06:04.552 INFO:tasks.workunit.client.0.smithi027.stdout:0/707: dread - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fb3 zero size 2024-09-20T19:06:04.553 INFO:tasks.workunit.client.1.smithi098.stdout:8/688: write d7/de/d11/d19/d30/d68/f6a [5203651,16450] 0 2024-09-20T19:06:04.554 INFO:tasks.workunit.client.0.smithi027.stdout:5/720: dwrite d4/f16 [0,4194304] 0 2024-09-20T19:06:04.558 INFO:tasks.workunit.client.0.smithi027.stdout:2/641: creat d3/d13/d3c/d48/dba/fc6 x:0 0 0 2024-09-20T19:06:04.564 INFO:tasks.workunit.client.0.smithi027.stdout:9/792: creat d0/d9/df/da2/de9/df8/f105 x:0 0 0 2024-09-20T19:06:04.569 INFO:tasks.workunit.client.1.smithi098.stdout:2/848: dwrite d3/df/f7a [0,4194304] 0 2024-09-20T19:06:04.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:04 smithi027 ceph-mon[28196]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 69 MiB/s rd, 233 MiB/s wr, 433 op/s 2024-09-20T19:06:04.570 INFO:tasks.workunit.client.0.smithi027.stdout:8/685: rename d2/d3/d6/ca7 to d2/d3/d6/d6d/d75/ce4 0 2024-09-20T19:06:04.576 INFO:tasks.workunit.client.0.smithi027.stdout:0/708: unlink d2/da2/ff8 0 2024-09-20T19:06:04.580 INFO:tasks.workunit.client.1.smithi098.stdout:1/558: unlink d1/d3/d2e/d68/d7a/fab 0 2024-09-20T19:06:04.581 INFO:tasks.workunit.client.0.smithi027.stdout:5/721: truncate d4/da/d1a/f1b 697747 0 2024-09-20T19:06:04.581 INFO:tasks.workunit.client.1.smithi098.stdout:1/559: truncate d1/d3/df/d4a/fa8 237502 0 2024-09-20T19:06:04.583 INFO:tasks.workunit.client.0.smithi027.stdout:5/722: truncate d4/d6c/d6f/fe2 50784 0 2024-09-20T19:06:04.584 INFO:tasks.workunit.client.0.smithi027.stdout:5/723: readlink d4/d6c/d6f/la9 0 2024-09-20T19:06:04.584 INFO:tasks.workunit.client.0.smithi027.stdout:3/693: creat d0/d1/d13/d15/fea x:0 0 0 2024-09-20T19:06:04.587 INFO:tasks.workunit.client.1.smithi098.stdout:6/416: rename d0/de/d1b/d37/d44/dc/c59 to d0/de/d1b/d37/d44/d24/d29/d42/d4c/c7f 0 2024-09-20T19:06:04.588 INFO:tasks.workunit.client.0.smithi027.stdout:2/642: mknod d3/d13/d3c/d48/dad/cc7 0 2024-09-20T19:06:04.589 INFO:tasks.workunit.client.0.smithi027.stdout:2/643: write d3/d24/f95 [728084,88801] 0 2024-09-20T19:06:04.589 INFO:tasks.workunit.client.0.smithi027.stdout:9/793: mknod d0/d9/df/d1b/c106 0 2024-09-20T19:06:04.590 INFO:tasks.workunit.client.1.smithi098.stdout:3/546: truncate d4/d25/d40/f58 1733523 0 2024-09-20T19:06:04.590 INFO:tasks.workunit.client.0.smithi027.stdout:2/644: fsync d3/d13/d3c/f79 0 2024-09-20T19:06:04.590 INFO:tasks.workunit.client.0.smithi027.stdout:9/794: fdatasync d0/d97/fcc 0 2024-09-20T19:06:04.591 INFO:tasks.workunit.client.0.smithi027.stdout:9/795: readlink d0/d97/lbe 0 2024-09-20T19:06:04.591 INFO:tasks.workunit.client.1.smithi098.stdout:2/849: creat d3/d16/d1d/d2b/d46/dc0/f113 x:0 0 0 2024-09-20T19:06:04.591 INFO:tasks.workunit.client.1.smithi098.stdout:0/404: write d0/f5 [3246212,131001] 0 2024-09-20T19:06:04.592 INFO:tasks.workunit.client.0.smithi027.stdout:9/796: stat d0/d9/df/d1b/d9c/d5a 0 2024-09-20T19:06:04.593 INFO:tasks.workunit.client.0.smithi027.stdout:0/709: rmdir d2/d48/d6b/d79/d84/d1b/d39/dc7 39 2024-09-20T19:06:04.593 INFO:tasks.workunit.client.0.smithi027.stdout:9/797: fdatasync d0/d9/df/d1b/d9c/d4f/d8d/fb1 0 2024-09-20T19:06:04.593 INFO:tasks.workunit.client.1.smithi098.stdout:5/499: link d1/d17/f1a d1/d17/f97 0 2024-09-20T19:06:04.594 INFO:tasks.workunit.client.0.smithi027.stdout:7/629: getdents d3/d8/d26/d65 0 2024-09-20T19:06:04.595 INFO:tasks.workunit.client.1.smithi098.stdout:5/500: write d1/d46/f6e [960186,11324] 0 2024-09-20T19:06:04.595 INFO:tasks.workunit.client.0.smithi027.stdout:9/798: fsync d0/d9/df/d1b/f100 0 2024-09-20T19:06:04.595 INFO:tasks.workunit.client.1.smithi098.stdout:1/560: mknod d1/d3/d2e/d61/cb6 0 2024-09-20T19:06:04.595 INFO:tasks.workunit.client.1.smithi098.stdout:1/561: chown d1/f84 1 1 2024-09-20T19:06:04.596 INFO:tasks.workunit.client.1.smithi098.stdout:9/657: link d4/de/d27/d4a/d8e/cb8 d4/d74/cd8 0 2024-09-20T19:06:04.598 INFO:tasks.workunit.client.1.smithi098.stdout:3/547: fsync d4/d19/d1d/d2f/f53 0 2024-09-20T19:06:04.601 INFO:tasks.workunit.client.1.smithi098.stdout:1/562: dread d1/f4e [0,4194304] 0 2024-09-20T19:06:04.601 INFO:tasks.workunit.client.0.smithi027.stdout:4/619: dread d5/d11/d17/f65 [0,4194304] 0 2024-09-20T19:06:04.602 INFO:tasks.workunit.client.0.smithi027.stdout:7/630: dwrite d3/d5e/dc7/fdb [0,4194304] 0 2024-09-20T19:06:04.603 INFO:tasks.workunit.client.1.smithi098.stdout:6/417: dread d0/de/d1b/d37/f40 [0,4194304] 0 2024-09-20T19:06:04.603 INFO:tasks.workunit.client.0.smithi027.stdout:4/620: chown d5/d13/f5c 184406 1 2024-09-20T19:06:04.604 INFO:tasks.workunit.client.1.smithi098.stdout:6/418: fdatasync d0/de/d1b/f5d 0 2024-09-20T19:06:04.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/658: dread d4/de/d27/d4a/d58/d5b/d8f/d9e/f53 [0,4194304] 0 2024-09-20T19:06:04.605 INFO:tasks.workunit.client.0.smithi027.stdout:2/645: symlink d3/d13/d3c/lc8 0 2024-09-20T19:06:04.606 INFO:tasks.workunit.client.0.smithi027.stdout:7/631: truncate d3/d8/d26/d45/d56/d8d/fad 4918648 0 2024-09-20T19:06:04.607 INFO:tasks.workunit.client.0.smithi027.stdout:2/646: chown d3/d1c/d26/d2a/dc2/f98 5 1 2024-09-20T19:06:04.607 INFO:tasks.workunit.client.1.smithi098.stdout:3/548: fdatasync d4/d38/d48/f79 0 2024-09-20T19:06:04.608 INFO:tasks.workunit.client.0.smithi027.stdout:0/710: mkdir d2/d48/d6b/d79/d84/dfa/d103 0 2024-09-20T19:06:04.610 INFO:tasks.workunit.client.1.smithi098.stdout:3/549: write d4/d19/d1d/d2f/d4e/f93 [546466,4719] 0 2024-09-20T19:06:04.611 INFO:tasks.workunit.client.0.smithi027.stdout:4/621: dread d5/d13/d36/d48/d3f/f77 [0,4194304] 0 2024-09-20T19:06:04.611 INFO:tasks.workunit.client.0.smithi027.stdout:5/724: creat d4/da/de/d3e/fec x:0 0 0 2024-09-20T19:06:04.611 INFO:tasks.workunit.client.1.smithi098.stdout:5/501: getdents d1/d82 0 2024-09-20T19:06:04.612 INFO:tasks.workunit.client.0.smithi027.stdout:5/725: stat d4/d1f/d7f/f54 0 2024-09-20T19:06:04.613 INFO:tasks.workunit.client.1.smithi098.stdout:3/550: chown d4/d19/d1d/d2f/d4e/d59/d7c/ca0 607 1 2024-09-20T19:06:04.614 INFO:tasks.workunit.client.1.smithi098.stdout:5/502: chown d1/d17/d35/d54/f62 3747632 1 2024-09-20T19:06:04.614 INFO:tasks.workunit.client.0.smithi027.stdout:7/632: read d3/d24/f37 [297964,93741] 0 2024-09-20T19:06:04.614 INFO:tasks.workunit.client.0.smithi027.stdout:8/686: dread d2/d65/f3c [0,4194304] 0 2024-09-20T19:06:04.615 INFO:tasks.workunit.client.1.smithi098.stdout:0/405: dread d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:06:04.617 INFO:tasks.workunit.client.1.smithi098.stdout:0/406: write d0/db/d1d/f6a [564756,71203] 0 2024-09-20T19:06:04.619 INFO:tasks.workunit.client.0.smithi027.stdout:5/726: dwrite d4/da/de/d3e/d44/fa6 [0,4194304] 0 2024-09-20T19:06:04.620 INFO:tasks.workunit.client.0.smithi027.stdout:9/799: rename d0/d9/df/da2/ccd to d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/c107 0 2024-09-20T19:06:04.621 INFO:tasks.workunit.client.0.smithi027.stdout:6/665: write d4/d6/d4b/d7c/f6c [1100125,52476] 0 2024-09-20T19:06:04.621 INFO:tasks.workunit.client.1.smithi098.stdout:8/689: dwrite d7/de/d11/d1d/f1e [0,4194304] 0 2024-09-20T19:06:04.623 INFO:tasks.workunit.client.0.smithi027.stdout:5/727: dread d4/fdf [0,4194304] 0 2024-09-20T19:06:04.625 INFO:tasks.workunit.client.0.smithi027.stdout:2/647: mkdir d3/de/d34/dc9 0 2024-09-20T19:06:04.627 INFO:tasks.workunit.client.1.smithi098.stdout:7/673: dwrite d3/d10/d16/d17/d33/d1f/d28/d7d/f94 [0,4194304] 0 2024-09-20T19:06:04.627 INFO:tasks.workunit.client.0.smithi027.stdout:9/800: dwrite d0/d9/df/da2/de9/df8/f105 [0,4194304] 0 2024-09-20T19:06:04.630 INFO:tasks.workunit.client.1.smithi098.stdout:6/419: mknod d0/de/d1b/d37/d44/d24/d29/d50/c80 0 2024-09-20T19:06:04.635 INFO:tasks.workunit.client.1.smithi098.stdout:8/690: dwrite d7/de/d11/d1f/f4d [4194304,4194304] 0 2024-09-20T19:06:04.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/420: dread - d0/de/d1b/d37/d44/d24/d29/d42/d4c/f79 zero size 2024-09-20T19:06:04.638 INFO:tasks.workunit.client.1.smithi098.stdout:2/850: link d3/d16/d1a/c4a d3/d16/d1d/d2b/d46/d74/d7b/c114 0 2024-09-20T19:06:04.640 INFO:tasks.workunit.client.0.smithi027.stdout:4/622: fsync d5/d13/f8a 0 2024-09-20T19:06:04.645 INFO:tasks.workunit.client.0.smithi027.stdout:7/633: chown d3/d8/da/dc/f63 440208 1 2024-09-20T19:06:04.647 INFO:tasks.workunit.client.0.smithi027.stdout:8/687: creat d2/d14/d13/d43/d5d/d90/fe5 x:0 0 0 2024-09-20T19:06:04.648 INFO:tasks.workunit.client.1.smithi098.stdout:0/407: mknod d0/d55/d67/c7a 0 2024-09-20T19:06:04.652 INFO:tasks.workunit.client.0.smithi027.stdout:6/666: mknod d4/d15/d37/d5a/cd4 0 2024-09-20T19:06:04.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/659: symlink d4/ld9 0 2024-09-20T19:06:04.654 INFO:tasks.workunit.client.0.smithi027.stdout:3/694: dwrite d0/d19/d54/fbe [0,4194304] 0 2024-09-20T19:06:04.658 INFO:tasks.workunit.client.1.smithi098.stdout:9/660: truncate d4/de/d27/d4a/d21/fb3 919509 0 2024-09-20T19:06:04.658 INFO:tasks.workunit.client.0.smithi027.stdout:8/688: dwrite d2/d14/d13/d43/d5d/d90/fb2 [0,4194304] 0 2024-09-20T19:06:04.658 INFO:tasks.workunit.client.0.smithi027.stdout:3/695: dread - d0/d1/d13/d98/dab/dba/fd4 zero size 2024-09-20T19:06:04.660 INFO:tasks.workunit.client.1.smithi098.stdout:2/851: rename d3/d16/d1d/d2b/d46/d74/d7b/c9e to d3/d51/d68/c115 0 2024-09-20T19:06:04.662 INFO:tasks.workunit.client.0.smithi027.stdout:9/801: mknod d0/d9/df/d1b/d9c/d4f/d8d/da0/c108 0 2024-09-20T19:06:04.663 INFO:tasks.workunit.client.1.smithi098.stdout:1/563: dwrite d1/d3/f2d [0,4194304] 0 2024-09-20T19:06:04.664 INFO:tasks.workunit.client.1.smithi098.stdout:3/551: fsync d4/d19/d1d/f4c 0 2024-09-20T19:06:04.665 INFO:tasks.workunit.client.1.smithi098.stdout:1/564: readlink d1/d3/d62/lae 0 2024-09-20T19:06:04.666 INFO:tasks.workunit.client.1.smithi098.stdout:1/565: readlink d1/d3/l39 0 2024-09-20T19:06:04.668 INFO:tasks.workunit.client.0.smithi027.stdout:4/623: mkdir d5/d80/dc4 0 2024-09-20T19:06:04.671 INFO:tasks.workunit.client.0.smithi027.stdout:7/634: mknod d3/d8/d1c/cdc 0 2024-09-20T19:06:04.675 INFO:tasks.workunit.client.1.smithi098.stdout:8/691: mkdir d7/de/d11/df3 0 2024-09-20T19:06:04.675 INFO:tasks.workunit.client.0.smithi027.stdout:5/728: unlink d4/d1f/d7f/l99 0 2024-09-20T19:06:04.676 INFO:tasks.workunit.client.0.smithi027.stdout:6/667: mkdir d4/d15/d93/dd5 0 2024-09-20T19:06:04.677 INFO:tasks.workunit.client.1.smithi098.stdout:2/852: symlink d3/d51/d68/l116 0 2024-09-20T19:06:04.679 INFO:tasks.workunit.client.0.smithi027.stdout:3/696: mkdir d0/dc5/deb 0 2024-09-20T19:06:04.682 INFO:tasks.workunit.client.0.smithi027.stdout:4/624: mkdir d5/d13/d36/d49/d8f/dc5 0 2024-09-20T19:06:04.684 INFO:tasks.workunit.client.0.smithi027.stdout:6/668: fdatasync d4/d15/d37/f4a 0 2024-09-20T19:06:04.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/692: creat d7/de/d11/d19/d30/d55/da9/ff4 x:0 0 0 2024-09-20T19:06:04.686 INFO:tasks.workunit.client.0.smithi027.stdout:8/689: mknod d2/d3/d6/d21/d33/ce6 0 2024-09-20T19:06:04.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/503: dread d1/d1b/f26 [4194304,4194304] 0 2024-09-20T19:06:04.687 INFO:tasks.workunit.client.1.smithi098.stdout:8/693: read - d7/de/d11/d19/d30/d55/fd9 zero size 2024-09-20T19:06:04.688 INFO:tasks.workunit.client.0.smithi027.stdout:9/802: creat d0/d9/dfb/f109 x:0 0 0 2024-09-20T19:06:04.689 INFO:tasks.workunit.client.1.smithi098.stdout:8/694: write d7/de/d11/d1f/d57/daa/fef [771652,51315] 0 2024-09-20T19:06:04.691 INFO:tasks.workunit.client.0.smithi027.stdout:3/697: creat d0/d1/d13/d98/dc3/da2/fec x:0 0 0 2024-09-20T19:06:04.691 INFO:tasks.workunit.client.1.smithi098.stdout:0/408: link d0/c27 d0/d55/d67/c7b 0 2024-09-20T19:06:04.693 INFO:tasks.workunit.client.0.smithi027.stdout:4/625: unlink d5/d11/d3d/f6a 0 2024-09-20T19:06:04.694 INFO:tasks.workunit.client.1.smithi098.stdout:7/674: getdents d3/d10/d16/d17 0 2024-09-20T19:06:04.694 INFO:tasks.workunit.client.0.smithi027.stdout:9/803: dwrite d0/d9/df/d1c/fbc [0,4194304] 0 2024-09-20T19:06:04.697 INFO:tasks.workunit.client.0.smithi027.stdout:0/711: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/f54 [1108248,54970] 0 2024-09-20T19:06:04.697 INFO:tasks.workunit.client.1.smithi098.stdout:1/566: dread d1/d3/df/d34/d43/d65/f88 [0,4194304] 0 2024-09-20T19:06:04.697 INFO:tasks.workunit.client.1.smithi098.stdout:3/552: link d4/d19/d1d/d22/l30 d4/d38/d39/lad 0 2024-09-20T19:06:04.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/553: chown d4/d25/d40/d80/ca1 0 1 2024-09-20T19:06:04.701 INFO:tasks.workunit.client.1.smithi098.stdout:8/695: read d7/de/d11/d1f/d57/d72/f79 [114264,65586] 0 2024-09-20T19:06:04.703 INFO:tasks.workunit.client.1.smithi098.stdout:0/409: creat d0/db/d32/f7c x:0 0 0 2024-09-20T19:06:04.704 INFO:tasks.workunit.client.1.smithi098.stdout:8/696: chown d7/de/d11/d1f/d57/d72/f79 4206425 1 2024-09-20T19:06:04.705 INFO:tasks.workunit.client.1.smithi098.stdout:9/661: getdents d4/de/d27/d4a/d58/d5b/d8f 0 2024-09-20T19:06:04.705 INFO:tasks.workunit.client.0.smithi027.stdout:3/698: rmdir d0/d19/d54/d7a 39 2024-09-20T19:06:04.706 INFO:tasks.workunit.client.0.smithi027.stdout:4/626: dread d5/d9b/f4e [0,4194304] 0 2024-09-20T19:06:04.706 INFO:tasks.workunit.client.0.smithi027.stdout:3/699: read - d0/d1/f91 zero size 2024-09-20T19:06:04.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/554: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:06:04.707 INFO:tasks.workunit.client.0.smithi027.stdout:4/627: chown d5/d11/d1a/d2a/fc2 23 1 2024-09-20T19:06:04.708 INFO:tasks.workunit.client.1.smithi098.stdout:8/697: dread - d7/de/d11/d1f/dcd/db3/dcb/fec zero size 2024-09-20T19:06:04.708 INFO:tasks.workunit.client.1.smithi098.stdout:7/675: readlink d3/d10/d16/d17/d33/d4b/lcb 0 2024-09-20T19:06:04.709 INFO:tasks.workunit.client.0.smithi027.stdout:4/628: truncate d5/d11/d17/d1b/d8d/f7a 237700 0 2024-09-20T19:06:04.712 INFO:tasks.workunit.client.0.smithi027.stdout:4/629: write d5/d11/d1a/f81 [611477,91285] 0 2024-09-20T19:06:04.715 INFO:tasks.workunit.client.0.smithi027.stdout:6/669: truncate f0 2442578 0 2024-09-20T19:06:04.716 INFO:tasks.workunit.client.0.smithi027.stdout:3/700: dwrite d0/d1/d13/f37 [4194304,4194304] 0 2024-09-20T19:06:04.717 INFO:tasks.workunit.client.1.smithi098.stdout:1/567: creat d1/d3/d2e/d68/d7a/db0/fb7 x:0 0 0 2024-09-20T19:06:04.717 INFO:tasks.workunit.client.0.smithi027.stdout:1/701: sync 2024-09-20T19:06:04.717 INFO:tasks.workunit.client.0.smithi027.stdout:0/712: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fd 3280107 0 2024-09-20T19:06:04.719 INFO:tasks.workunit.client.0.smithi027.stdout:3/701: chown d0/d1/f30 21 1 2024-09-20T19:06:04.720 INFO:tasks.workunit.client.0.smithi027.stdout:8/690: creat d2/d3/d6/d21/d33/d79/dcf/fe7 x:0 0 0 2024-09-20T19:06:04.720 INFO:tasks.workunit.client.0.smithi027.stdout:1/702: dread - d2/d8/d3b/fb9 zero size 2024-09-20T19:06:04.721 INFO:tasks.workunit.client.1.smithi098.stdout:0/410: mkdir d0/d7d 0 2024-09-20T19:06:04.723 INFO:tasks.workunit.client.0.smithi027.stdout:0/713: write d2/d49/f45 [1778783,88415] 0 2024-09-20T19:06:04.723 INFO:tasks.workunit.client.0.smithi027.stdout:2/648: dwrite d3/d1c/f54 [0,4194304] 0 2024-09-20T19:06:04.727 INFO:tasks.workunit.client.1.smithi098.stdout:6/421: truncate d0/de/d1b/d37/d44/d24/f52 3870822 0 2024-09-20T19:06:04.729 INFO:tasks.workunit.client.0.smithi027.stdout:7/635: getdents d3/d8/da/d2e/d49 0 2024-09-20T19:06:04.729 INFO:tasks.workunit.client.0.smithi027.stdout:4/630: dwrite d5/d11/d1a/f81 [0,4194304] 0 2024-09-20T19:06:04.730 INFO:tasks.workunit.client.0.smithi027.stdout:7/636: readlink d3/d8/d26/d45/ld7 0 2024-09-20T19:06:04.730 INFO:tasks.workunit.client.0.smithi027.stdout:4/631: chown d5/d13/d7c 94214238 1 2024-09-20T19:06:04.731 INFO:tasks.workunit.client.1.smithi098.stdout:7/676: unlink d3/d10/d16/d17/d33/d1f/d2d/f31 0 2024-09-20T19:06:04.732 INFO:tasks.workunit.client.1.smithi098.stdout:7/677: chown d3/d10/d16/d90 1965 1 2024-09-20T19:06:04.734 INFO:tasks.workunit.client.1.smithi098.stdout:1/568: fsync d1/d3/fa5 0 2024-09-20T19:06:04.741 INFO:tasks.workunit.client.1.smithi098.stdout:8/698: creat d7/de/d11/d19/daf/ff5 x:0 0 0 2024-09-20T19:06:04.742 INFO:tasks.workunit.client.0.smithi027.stdout:5/729: truncate d4/f16 2301626 0 2024-09-20T19:06:04.749 INFO:tasks.workunit.client.0.smithi027.stdout:8/691: rename d2/d14/d13/c55 to d2/d2a/dd4/ce8 0 2024-09-20T19:06:04.750 INFO:tasks.workunit.client.1.smithi098.stdout:6/422: dwrite d0/de/d1b/d37/d43/d51/f72 [0,4194304] 0 2024-09-20T19:06:04.750 INFO:tasks.workunit.client.1.smithi098.stdout:6/423: chown d0 695 1 2024-09-20T19:06:04.752 INFO:tasks.workunit.client.1.smithi098.stdout:5/504: truncate d1/d46/d69/f6d 1422901 0 2024-09-20T19:06:04.755 INFO:tasks.workunit.client.0.smithi027.stdout:9/804: dread d0/d9/f28 [0,4194304] 0 2024-09-20T19:06:04.756 INFO:tasks.workunit.client.0.smithi027.stdout:7/637: mkdir d3/d8/da/dc/da9/ddd 0 2024-09-20T19:06:04.760 INFO:tasks.workunit.client.0.smithi027.stdout:6/670: creat d4/d6/d4b/dca/fd6 x:0 0 0 2024-09-20T19:06:04.761 INFO:tasks.workunit.client.0.smithi027.stdout:3/702: mknod d0/ced 0 2024-09-20T19:06:04.761 INFO:tasks.workunit.client.0.smithi027.stdout:3/703: readlink d0/l4d 0 2024-09-20T19:06:04.763 INFO:tasks.workunit.client.1.smithi098.stdout:5/505: mkdir d1/d71/d98 0 2024-09-20T19:06:04.766 INFO:tasks.workunit.client.0.smithi027.stdout:0/714: dread d2/d48/d6b/d79/d84/f31 [0,4194304] 0 2024-09-20T19:06:04.766 INFO:tasks.workunit.client.1.smithi098.stdout:1/569: unlink d1/d3/d2e/d71/faf 0 2024-09-20T19:06:04.767 INFO:tasks.workunit.client.1.smithi098.stdout:6/424: dread d0/de/d1b/f26 [4194304,4194304] 0 2024-09-20T19:06:04.768 INFO:tasks.workunit.client.0.smithi027.stdout:1/703: rename d2/d8/d3b/d82/d87/fd3 to d2/d8/d3b/d82/d90/fe4 0 2024-09-20T19:06:04.769 INFO:tasks.workunit.client.1.smithi098.stdout:7/678: creat d3/fda x:0 0 0 2024-09-20T19:06:04.770 INFO:tasks.workunit.client.1.smithi098.stdout:6/425: read d0/de/d1b/d37/d44/dc/f1a [349247,8281] 0 2024-09-20T19:06:04.770 INFO:tasks.workunit.client.0.smithi027.stdout:8/692: fsync d2/d65/f6a 0 2024-09-20T19:06:04.771 INFO:tasks.workunit.client.1.smithi098.stdout:7/679: stat d3/d10/d16/d17/f7e 0 2024-09-20T19:06:04.772 INFO:tasks.workunit.client.0.smithi027.stdout:0/715: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 [0,4194304] 0 2024-09-20T19:06:04.772 INFO:tasks.workunit.client.1.smithi098.stdout:5/506: dread - d1/d17/d2e/f5f zero size 2024-09-20T19:06:04.772 INFO:tasks.workunit.client.1.smithi098.stdout:6/426: stat d0/de/d1b/d37/d44/f62 0 2024-09-20T19:06:04.773 INFO:tasks.workunit.client.1.smithi098.stdout:7/680: read d3/d10/d16/d17/d33/d1f/d2d/f77 [3160394,22133] 0 2024-09-20T19:06:04.775 INFO:tasks.workunit.client.1.smithi098.stdout:1/570: rename d1/d3/df/d34/f48 to d1/d3/df/d34/d52/fb8 0 2024-09-20T19:06:04.776 INFO:tasks.workunit.client.0.smithi027.stdout:7/638: creat d3/d8/da/d51/fde x:0 0 0 2024-09-20T19:06:04.777 INFO:tasks.workunit.client.1.smithi098.stdout:8/699: getdents d7/de/d11/d19/d30/d82 0 2024-09-20T19:06:04.778 INFO:tasks.workunit.client.1.smithi098.stdout:8/700: fdatasync d7/de/d11/fa7 0 2024-09-20T19:06:04.782 INFO:tasks.workunit.client.0.smithi027.stdout:6/671: creat d4/d1b/fd7 x:0 0 0 2024-09-20T19:06:04.787 INFO:tasks.workunit.client.1.smithi098.stdout:9/662: write d4/de/f1f [4758927,37874] 0 2024-09-20T19:06:04.788 INFO:tasks.workunit.client.1.smithi098.stdout:9/663: chown d4/cd1 25461811 1 2024-09-20T19:06:04.789 INFO:tasks.workunit.client.1.smithi098.stdout:9/664: fdatasync d4/de/d27/d4a/d21/f50 0 2024-09-20T19:06:04.791 INFO:tasks.workunit.client.1.smithi098.stdout:7/681: symlink d3/d10/d16/d17/d33/d37/ldb 0 2024-09-20T19:06:04.794 INFO:tasks.workunit.client.1.smithi098.stdout:1/571: rename d1/f4e to d1/d3/d2e/d68/d7a/da1/fb9 0 2024-09-20T19:06:04.802 INFO:tasks.workunit.client.1.smithi098.stdout:8/701: dread d7/de/d11/d1f/d9c/f9e [0,4194304] 0 2024-09-20T19:06:04.810 INFO:tasks.workunit.client.1.smithi098.stdout:6/427: mkdir d0/de/d1b/d37/d44/d24/d29/d2b/d66/d81 0 2024-09-20T19:06:04.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/682: creat d3/d10/d16/d90/fdc x:0 0 0 2024-09-20T19:06:04.815 INFO:tasks.workunit.client.0.smithi027.stdout:3/704: creat d0/d1/d5e/d1d/da7/db0/fee x:0 0 0 2024-09-20T19:06:04.816 INFO:tasks.workunit.client.0.smithi027.stdout:2/649: rename d3/d2f/f42 to d3/d1c/d26/d75/fca 0 2024-09-20T19:06:04.816 INFO:tasks.workunit.client.0.smithi027.stdout:9/805: mkdir d0/d9/df/d1b/d9c/d10a 0 2024-09-20T19:06:04.817 INFO:tasks.workunit.client.0.smithi027.stdout:0/716: mknod d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/c104 0 2024-09-20T19:06:04.818 INFO:tasks.workunit.client.1.smithi098.stdout:8/702: unlink d7/de/d11/d19/d47/fe7 0 2024-09-20T19:06:04.818 INFO:tasks.workunit.client.0.smithi027.stdout:4/632: write d5/d11/d17/d1b/f91 [1213134,50528] 0 2024-09-20T19:06:04.820 INFO:tasks.workunit.client.1.smithi098.stdout:8/703: read - d7/de/d11/d19/d30/d55/da9/dbe/feb zero size 2024-09-20T19:06:04.821 INFO:tasks.workunit.client.0.smithi027.stdout:9/806: truncate d0/d2e/f102 572439 0 2024-09-20T19:06:04.821 INFO:tasks.workunit.client.0.smithi027.stdout:4/633: stat d5/d13/d16/f8e 0 2024-09-20T19:06:04.824 INFO:tasks.workunit.client.1.smithi098.stdout:9/665: symlink d4/de/d27/d4a/d58/d5b/d8f/dd5/lda 0 2024-09-20T19:06:04.824 INFO:tasks.workunit.client.0.smithi027.stdout:5/730: dwrite d4/d6c/dc7/fde [0,4194304] 0 2024-09-20T19:06:04.825 INFO:tasks.workunit.client.1.smithi098.stdout:9/666: write d4/de/f1f [5178816,70186] 0 2024-09-20T19:06:04.826 INFO:tasks.workunit.client.1.smithi098.stdout:9/667: readlink d4/de/d27/d4a/l45 0 2024-09-20T19:06:04.827 INFO:tasks.workunit.client.0.smithi027.stdout:7/639: rename f2 to d3/d8/da/d2e/d49/d8b/fdf 0 2024-09-20T19:06:04.829 INFO:tasks.workunit.client.1.smithi098.stdout:7/683: creat d3/d10/d16/d17/d33/d1f/dba/fdd x:0 0 0 2024-09-20T19:06:04.829 INFO:tasks.workunit.client.0.smithi027.stdout:7/640: chown d3/d8/d26/d65/dc4/fca 5696 1 2024-09-20T19:06:04.830 INFO:tasks.workunit.client.0.smithi027.stdout:6/672: dread d4/d6/d4b/d7c/f6c [0,4194304] 0 2024-09-20T19:06:04.832 INFO:tasks.workunit.client.1.smithi098.stdout:5/507: write d1/d46/d69/f95 [3240291,108401] 0 2024-09-20T19:06:04.833 INFO:tasks.workunit.client.1.smithi098.stdout:5/508: chown d1/f2 1200 1 2024-09-20T19:06:04.833 INFO:tasks.workunit.client.0.smithi027.stdout:0/717: creat d2/da2/f105 x:0 0 0 2024-09-20T19:06:04.833 INFO:tasks.workunit.client.0.smithi027.stdout:0/718: readlink d2/d48/l7b 0 2024-09-20T19:06:04.835 INFO:tasks.workunit.client.0.smithi027.stdout:0/719: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/f4d 0 2024-09-20T19:06:04.835 INFO:tasks.workunit.client.1.smithi098.stdout:9/668: dwrite d4/de/d27/d4a/d58/d5b/d8f/d9e/fd3 [0,4194304] 0 2024-09-20T19:06:04.836 INFO:tasks.workunit.client.0.smithi027.stdout:0/720: chown d2/fc 24829884 1 2024-09-20T19:06:04.837 INFO:tasks.workunit.client.0.smithi027.stdout:7/641: dwrite d3/d8/d1c/d61/fa1 [0,4194304] 0 2024-09-20T19:06:04.837 INFO:tasks.workunit.client.1.smithi098.stdout:9/669: chown d4/de/d27/d4a/d21/d25/f26 122021554 1 2024-09-20T19:06:04.837 INFO:tasks.workunit.client.1.smithi098.stdout:0/411: rename d0/d55/d38/l74 to d0/d6/d19/d4f/d70/l7e 0 2024-09-20T19:06:04.838 INFO:tasks.workunit.client.1.smithi098.stdout:0/412: chown d0/d55 35303649 1 2024-09-20T19:06:04.839 INFO:tasks.workunit.client.0.smithi027.stdout:4/634: unlink d5/d13/f5c 0 2024-09-20T19:06:04.839 INFO:tasks.workunit.client.0.smithi027.stdout:2/650: dread d3/d13/d3c/d48/f74 [0,4194304] 0 2024-09-20T19:06:04.840 INFO:tasks.workunit.client.0.smithi027.stdout:2/651: write d3/d24/f80 [4850364,13060] 0 2024-09-20T19:06:04.845 INFO:tasks.workunit.client.1.smithi098.stdout:6/428: mkdir d0/d55/d82 0 2024-09-20T19:06:04.852 INFO:tasks.workunit.client.1.smithi098.stdout:5/509: fdatasync d1/d17/f55 0 2024-09-20T19:06:04.854 INFO:tasks.workunit.client.1.smithi098.stdout:7/684: dwrite d3/d10/d16/d17/d33/d1f/f6d [0,4194304] 0 2024-09-20T19:06:04.856 INFO:tasks.workunit.client.1.smithi098.stdout:0/413: readlink d0/db/d1d/l4c 0 2024-09-20T19:06:04.856 INFO:tasks.workunit.client.1.smithi098.stdout:7/685: chown d3/d10/d16/d17/d33/d1f/d2d/l41 961460348 1 2024-09-20T19:06:04.856 INFO:tasks.workunit.client.0.smithi027.stdout:3/705: truncate d0/d1/d13/d15/d55/f5f 1606119 0 2024-09-20T19:06:04.857 INFO:tasks.workunit.client.1.smithi098.stdout:7/686: readlink d3/d10/d16/d17/d33/d1f/d28/l93 0 2024-09-20T19:06:04.858 INFO:tasks.workunit.client.1.smithi098.stdout:0/414: read d0/d55/d38/f44 [1240189,120157] 0 2024-09-20T19:06:04.862 INFO:tasks.workunit.client.1.smithi098.stdout:9/670: creat d4/de/d27/d4a/d58/d5b/d9c/fdb x:0 0 0 2024-09-20T19:06:04.862 INFO:tasks.workunit.client.1.smithi098.stdout:0/415: write d0/db/d1d/f6a [1457936,129532] 0 2024-09-20T19:06:04.862 INFO:tasks.workunit.client.1.smithi098.stdout:1/572: write d1/f25 [2225423,8495] 0 2024-09-20T19:06:04.865 INFO:tasks.workunit.client.1.smithi098.stdout:6/429: mkdir d0/d83 0 2024-09-20T19:06:04.869 INFO:tasks.workunit.client.1.smithi098.stdout:7/687: write d3/d10/d16/d17/d33/d1f/d28/d66/f8e [467557,35127] 0 2024-09-20T19:06:04.870 INFO:tasks.workunit.client.0.smithi027.stdout:2/652: dwrite d3/de/d34/f76 [0,4194304] 0 2024-09-20T19:06:04.872 INFO:tasks.workunit.client.0.smithi027.stdout:3/706: creat d0/d1/d65/dc9/fef x:0 0 0 2024-09-20T19:06:04.872 INFO:tasks.workunit.client.1.smithi098.stdout:0/416: stat d0/d6/d28/c48 0 2024-09-20T19:06:04.874 INFO:tasks.workunit.client.0.smithi027.stdout:0/721: mkdir d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106 0 2024-09-20T19:06:04.875 INFO:tasks.workunit.client.1.smithi098.stdout:8/704: rmdir d7/de/d11/d19/d30/d55/dcf 0 2024-09-20T19:06:04.877 INFO:tasks.workunit.client.1.smithi098.stdout:1/573: mknod d1/d3/d2e/d68/d7a/da1/cba 0 2024-09-20T19:06:04.878 INFO:tasks.workunit.client.0.smithi027.stdout:7/642: truncate d3/d24/d84/fa2 1594725 0 2024-09-20T19:06:04.878 INFO:tasks.workunit.client.1.smithi098.stdout:1/574: write d1/d3/f2b [3413500,80716] 0 2024-09-20T19:06:04.881 INFO:tasks.workunit.client.1.smithi098.stdout:7/688: creat d3/d76/d7a/dce/fde x:0 0 0 2024-09-20T19:06:04.883 INFO:tasks.workunit.client.0.smithi027.stdout:9/807: creat d0/d9/df/d1c/d6a/d6d/dd/f10b x:0 0 0 2024-09-20T19:06:04.886 INFO:tasks.workunit.client.0.smithi027.stdout:5/731: rename d4/da/d1a/c7e to d4/d1f/d7f/ced 0 2024-09-20T19:06:04.887 INFO:tasks.workunit.client.1.smithi098.stdout:1/575: dwrite d1/d3/df/d34/d43/d53/f60 [4194304,4194304] 0 2024-09-20T19:06:04.889 INFO:tasks.workunit.client.1.smithi098.stdout:7/689: dwrite d3/d76/d86/fb1 [0,4194304] 0 2024-09-20T19:06:04.891 INFO:tasks.workunit.client.0.smithi027.stdout:2/653: creat d3/d13/d3c/d48/dba/fcb x:0 0 0 2024-09-20T19:06:04.891 INFO:tasks.workunit.client.0.smithi027.stdout:2/654: chown d3/d2f/f33 255115592 1 2024-09-20T19:06:04.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/430: mknod d0/de/d1b/d37/d44/d24/c84 0 2024-09-20T19:06:04.899 INFO:tasks.workunit.client.1.smithi098.stdout:8/705: creat d7/de/d35/ff6 x:0 0 0 2024-09-20T19:06:04.900 INFO:tasks.workunit.client.0.smithi027.stdout:7/643: creat d3/d8/d26/d45/dcc/fe0 x:0 0 0 2024-09-20T19:06:04.900 INFO:tasks.workunit.client.1.smithi098.stdout:0/417: dwrite d0/f4a [0,4194304] 0 2024-09-20T19:06:04.902 INFO:tasks.workunit.client.0.smithi027.stdout:4/635: mknod d5/d13/d36/d48/d3f/d4c/d52/d87/cc6 0 2024-09-20T19:06:04.904 INFO:tasks.workunit.client.0.smithi027.stdout:6/673: dread f0 [0,4194304] 0 2024-09-20T19:06:04.905 INFO:tasks.workunit.client.0.smithi027.stdout:6/674: chown d4/d15/f4f 28378632 1 2024-09-20T19:06:04.906 INFO:tasks.workunit.client.0.smithi027.stdout:9/808: mknod d0/d9/df/da2/de9/df8/c10c 0 2024-09-20T19:06:04.906 INFO:tasks.workunit.client.0.smithi027.stdout:6/675: write d4/d6/d4b/f6b [367594,80210] 0 2024-09-20T19:06:04.909 INFO:tasks.workunit.client.0.smithi027.stdout:5/732: mkdir d4/da/de/dda/dee 0 2024-09-20T19:06:04.909 INFO:tasks.workunit.client.1.smithi098.stdout:7/690: mkdir d3/d10/d16/d17/d33/d1f/d28/d66/ddf 0 2024-09-20T19:06:04.911 INFO:tasks.workunit.client.0.smithi027.stdout:2/655: symlink d3/d1c/d26/d2a/dc2/d6f/lcc 0 2024-09-20T19:06:04.914 INFO:tasks.workunit.client.0.smithi027.stdout:3/707: link d0/d1/d13/d3c/d93/fd6 d0/dc5/deb/ff0 0 2024-09-20T19:06:04.915 INFO:tasks.workunit.client.0.smithi027.stdout:0/722: mknod d2/d48/d6b/d79/d84/dfa/d103/c107 0 2024-09-20T19:06:04.917 INFO:tasks.workunit.client.1.smithi098.stdout:8/706: mknod d7/de/d11/d19/cf7 0 2024-09-20T19:06:04.918 INFO:tasks.workunit.client.0.smithi027.stdout:7/644: mknod d3/d8/d1c/ce1 0 2024-09-20T19:06:04.919 INFO:tasks.workunit.client.0.smithi027.stdout:7/645: readlink d3/d8/da/d2e/d49/d8b/l60 0 2024-09-20T19:06:04.920 INFO:tasks.workunit.client.0.smithi027.stdout:7/646: readlink d3/d8/d26/d45/d56/d8d/dc8/lcf 0 2024-09-20T19:06:04.921 INFO:tasks.workunit.client.1.smithi098.stdout:7/691: creat d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/fe0 x:0 0 0 2024-09-20T19:06:04.921 INFO:tasks.workunit.client.1.smithi098.stdout:7/692: stat d3/d76/db8/lac 0 2024-09-20T19:06:04.921 INFO:tasks.workunit.client.0.smithi027.stdout:7/647: chown d3/d8/d26/d45/daa 16 1 2024-09-20T19:06:04.921 INFO:tasks.workunit.client.0.smithi027.stdout:4/636: write d5/fa [7371077,71423] 0 2024-09-20T19:06:04.922 INFO:tasks.workunit.client.0.smithi027.stdout:7/648: fsync d3/d8/da/dc/da9/dbc/fd5 0 2024-09-20T19:06:04.922 INFO:tasks.workunit.client.0.smithi027.stdout:4/637: chown d5/d13/fa4 3407997 1 2024-09-20T19:06:04.923 INFO:tasks.workunit.client.0.smithi027.stdout:4/638: dread - d5/d13/d36/d48/d3f/d4c/d52/d87/fbe zero size 2024-09-20T19:06:04.924 INFO:tasks.workunit.client.0.smithi027.stdout:6/676: symlink d4/d15/d37/d7a/d8e/ld8 0 2024-09-20T19:06:04.925 INFO:tasks.workunit.client.0.smithi027.stdout:6/677: write d4/d15/d37/d39/f83 [27930,73499] 0 2024-09-20T19:06:04.927 INFO:tasks.workunit.client.1.smithi098.stdout:8/707: rename d7/de/d11/d19/l52 to d7/de/d11/d19/d30/d55/d9d/lf8 0 2024-09-20T19:06:04.927 INFO:tasks.workunit.client.0.smithi027.stdout:1/704: sync 2024-09-20T19:06:04.927 INFO:tasks.workunit.client.0.smithi027.stdout:8/693: sync 2024-09-20T19:06:04.928 INFO:tasks.workunit.client.1.smithi098.stdout:9/671: write d4/de/d27/d4a/f69 [98552,593] 0 2024-09-20T19:06:04.929 INFO:tasks.workunit.client.1.smithi098.stdout:1/576: dread d1/d3/d2e/f3b [0,4194304] 0 2024-09-20T19:06:04.931 INFO:tasks.workunit.client.0.smithi027.stdout:2/656: creat d3/d1c/d31/d9e/fcd x:0 0 0 2024-09-20T19:06:04.932 INFO:tasks.workunit.client.1.smithi098.stdout:7/693: mknod d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/ce1 0 2024-09-20T19:06:04.934 INFO:tasks.workunit.client.0.smithi027.stdout:3/708: mkdir d0/d1/d13/d15/d55/d70/df1 0 2024-09-20T19:06:04.935 INFO:tasks.workunit.client.0.smithi027.stdout:7/649: dread d3/d8/da/d2e/d39/f8a [4194304,4194304] 0 2024-09-20T19:06:04.940 INFO:tasks.workunit.client.1.smithi098.stdout:4/668: sync 2024-09-20T19:06:04.940 INFO:tasks.workunit.client.1.smithi098.stdout:0/418: getdents d0/d55 0 2024-09-20T19:06:04.941 INFO:tasks.workunit.client.1.smithi098.stdout:4/669: chown d3/d6/d5b 164 1 2024-09-20T19:06:04.944 INFO:tasks.workunit.client.1.smithi098.stdout:9/672: write d4/de/d27/d4a/d21/d25/f26 [3683328,78920] 0 2024-09-20T19:06:04.944 INFO:tasks.workunit.client.0.smithi027.stdout:8/694: dread d2/d3/d1b/f2c [4194304,4194304] 0 2024-09-20T19:06:04.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/694: creat d3/d10/dcf/fe2 x:0 0 0 2024-09-20T19:06:04.946 INFO:tasks.workunit.client.1.smithi098.stdout:9/673: read d4/de/d27/d4a/d58/d5b/fa4 [2287124,62551] 0 2024-09-20T19:06:04.947 INFO:tasks.workunit.client.0.smithi027.stdout:6/678: mknod d4/d15/d37/d6a/da5/cd9 0 2024-09-20T19:06:04.948 INFO:tasks.workunit.client.1.smithi098.stdout:7/695: fdatasync d3/d10/d16/d17/d33/d1f/dba/fdd 0 2024-09-20T19:06:04.948 INFO:tasks.workunit.client.0.smithi027.stdout:6/679: fsync d4/d15/d37/d5a/d78/dbc/fce 0 2024-09-20T19:06:04.949 INFO:tasks.workunit.client.1.smithi098.stdout:6/431: link d0/de/d1b/d37/d44/dc/f1a d0/de/d1b/d37/d44/f85 0 2024-09-20T19:06:04.951 INFO:tasks.workunit.client.1.smithi098.stdout:7/696: read d3/d10/d16/d17/d33/d1f/d2d/f3b [958082,106640] 0 2024-09-20T19:06:04.951 INFO:tasks.workunit.client.0.smithi027.stdout:1/705: symlink d2/d8/d74/d9a/da3/dad/le5 0 2024-09-20T19:06:04.953 INFO:tasks.workunit.client.0.smithi027.stdout:2/657: rmdir d3 39 2024-09-20T19:06:04.954 INFO:tasks.workunit.client.0.smithi027.stdout:8/695: dread d2/d14/f27 [0,4194304] 0 2024-09-20T19:06:04.954 INFO:tasks.workunit.client.1.smithi098.stdout:9/674: dwrite d4/de/d27/d4a/d21/d25/d51/d7b/fc5 [0,4194304] 0 2024-09-20T19:06:04.954 INFO:tasks.workunit.client.1.smithi098.stdout:4/670: mknod d3/d4f/ceb 0 2024-09-20T19:06:04.955 INFO:tasks.workunit.client.0.smithi027.stdout:8/696: dread - d2/d14/d13/d43/d5d/d90/fe5 zero size 2024-09-20T19:06:04.956 INFO:tasks.workunit.client.0.smithi027.stdout:3/709: chown d0/d19/d54/d7a/f9e 36 1 2024-09-20T19:06:04.956 INFO:tasks.workunit.client.1.smithi098.stdout:4/671: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/dcc 0 1 2024-09-20T19:06:04.957 INFO:tasks.workunit.client.1.smithi098.stdout:1/577: mkdir d1/dbb 0 2024-09-20T19:06:04.958 INFO:tasks.workunit.client.1.smithi098.stdout:4/672: truncate d3/d7d/fad 4255661 0 2024-09-20T19:06:04.963 INFO:tasks.workunit.client.0.smithi027.stdout:9/809: write d0/d9/df/d1b/d64/f6c [395824,68842] 0 2024-09-20T19:06:04.966 INFO:tasks.workunit.client.0.smithi027.stdout:5/733: write d4/da/de/d3e/d69/d75/f20 [8721334,25876] 0 2024-09-20T19:06:04.968 INFO:tasks.workunit.client.0.smithi027.stdout:4/639: creat d5/d13/d36/d48/d3f/d7e/fc7 x:0 0 0 2024-09-20T19:06:04.968 INFO:tasks.workunit.client.0.smithi027.stdout:5/734: dread - d4/da/de/d3e/db7/fc6 zero size 2024-09-20T19:06:04.969 INFO:tasks.workunit.client.1.smithi098.stdout:0/419: mkdir d0/db/d7f 0 2024-09-20T19:06:04.969 INFO:tasks.workunit.client.0.smithi027.stdout:9/810: dwrite d0/d9/df/d1b/d64/fe0 [0,4194304] 0 2024-09-20T19:06:04.972 INFO:tasks.workunit.client.1.smithi098.stdout:7/697: truncate d3/d10/d16/d17/d33/d1f/d2d/f77 4147737 0 2024-09-20T19:06:04.976 INFO:tasks.workunit.client.1.smithi098.stdout:0/420: dwrite d0/db/f5d [0,4194304] 0 2024-09-20T19:06:04.976 INFO:tasks.workunit.client.0.smithi027.stdout:1/706: mknod d2/d8/d3b/d82/d87/ce6 0 2024-09-20T19:06:04.977 INFO:tasks.workunit.client.0.smithi027.stdout:6/680: dread d4/d15/f4f [0,4194304] 0 2024-09-20T19:06:04.978 INFO:tasks.workunit.client.0.smithi027.stdout:0/723: write d2/d48/f76 [636908,48949] 0 2024-09-20T19:06:04.978 INFO:tasks.workunit.client.1.smithi098.stdout:1/578: truncate d1/d3/f9 1080264 0 2024-09-20T19:06:04.981 INFO:tasks.workunit.client.0.smithi027.stdout:8/697: symlink d2/d3/d1b/d36/le9 0 2024-09-20T19:06:04.982 INFO:tasks.workunit.client.1.smithi098.stdout:8/708: dwrite d7/f1c [0,4194304] 0 2024-09-20T19:06:04.983 INFO:tasks.workunit.client.1.smithi098.stdout:4/673: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/ld8 0 2024-09-20T19:06:04.988 INFO:tasks.workunit.client.0.smithi027.stdout:3/710: mknod d0/d1/d13/d15/d55/d70/cf2 0 2024-09-20T19:06:04.989 INFO:tasks.workunit.client.1.smithi098.stdout:6/432: symlink d0/de/d1b/d37/d43/d6d/l86 0 2024-09-20T19:06:04.990 INFO:tasks.workunit.client.1.smithi098.stdout:8/709: dwrite d7/de/d11/d19/d30/d59/fa6 [4194304,4194304] 0 2024-09-20T19:06:04.992 INFO:tasks.workunit.client.1.smithi098.stdout:8/710: truncate d7/de/dbb/fdb 615062 0 2024-09-20T19:06:04.995 INFO:tasks.workunit.client.0.smithi027.stdout:2/658: dwrite d3/d1c/d26/fb5 [0,4194304] 0 2024-09-20T19:06:04.995 INFO:tasks.workunit.client.1.smithi098.stdout:7/698: creat d3/d10/d16/d17/d7c/fe3 x:0 0 0 2024-09-20T19:06:04.998 INFO:tasks.workunit.client.0.smithi027.stdout:0/724: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/f54 [0,4194304] 0 2024-09-20T19:06:05.000 INFO:tasks.workunit.client.0.smithi027.stdout:2/659: chown d3/de/d34/f64 296720 1 2024-09-20T19:06:05.000 INFO:tasks.workunit.client.1.smithi098.stdout:1/579: mkdir d1/d3/df/d34/d43/d65/dbc 0 2024-09-20T19:06:05.003 INFO:tasks.workunit.client.0.smithi027.stdout:2/660: chown d3/d13/d3c 396188816 1 2024-09-20T19:06:05.003 INFO:tasks.workunit.client.1.smithi098.stdout:4/674: creat d3/d6/d8c/fec x:0 0 0 2024-09-20T19:06:05.006 INFO:tasks.workunit.client.1.smithi098.stdout:6/433: mknod d0/de/d1b/d37/d44/d24/d29/d2b/c87 0 2024-09-20T19:06:05.007 INFO:tasks.workunit.client.0.smithi027.stdout:1/707: mknod d2/d8/d3b/d82/ce7 0 2024-09-20T19:06:05.007 INFO:tasks.workunit.client.0.smithi027.stdout:6/681: mknod d4/d15/d37/cda 0 2024-09-20T19:06:05.009 INFO:tasks.workunit.client.1.smithi098.stdout:1/580: dwrite d1/d3/df/f58 [0,4194304] 0 2024-09-20T19:06:05.009 INFO:tasks.workunit.client.0.smithi027.stdout:8/698: creat d2/d3/d6/d21/d33/d79/d9f/fea x:0 0 0 2024-09-20T19:06:05.009 INFO:tasks.workunit.client.0.smithi027.stdout:7/650: dwrite d3/f5 [0,4194304] 0 2024-09-20T19:06:05.012 INFO:tasks.workunit.client.0.smithi027.stdout:5/735: dwrite d4/d1f/d28/f85 [0,4194304] 0 2024-09-20T19:06:05.012 INFO:tasks.workunit.client.1.smithi098.stdout:0/421: creat d0/d7d/f80 x:0 0 0 2024-09-20T19:06:05.014 INFO:tasks.workunit.client.0.smithi027.stdout:5/736: write d4/da/de/d3e/d69/d75/fd9 [419867,35981] 0 2024-09-20T19:06:05.015 INFO:tasks.workunit.client.0.smithi027.stdout:5/737: readlink d4/l2f 0 2024-09-20T19:06:05.017 INFO:tasks.workunit.client.1.smithi098.stdout:9/675: getdents d4/de/d24/d35/d2d/da6/dae/d86 0 2024-09-20T19:06:05.017 INFO:tasks.workunit.client.1.smithi098.stdout:4/675: creat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/fed x:0 0 0 2024-09-20T19:06:05.017 INFO:tasks.workunit.client.0.smithi027.stdout:4/640: fdatasync d5/d13/d36/d48/d3f/fbf 0 2024-09-20T19:06:05.019 INFO:tasks.workunit.client.0.smithi027.stdout:4/641: chown d5/d13/d36/d48/d3f/d4c/d52/faa 1585492 1 2024-09-20T19:06:05.020 INFO:tasks.workunit.client.0.smithi027.stdout:9/811: unlink d0/d9/df/d1b/d9c/d4f/c78 0 2024-09-20T19:06:05.021 INFO:tasks.workunit.client.0.smithi027.stdout:9/812: dread - d0/d9/df/d1b/ff0 zero size 2024-09-20T19:06:05.022 INFO:tasks.workunit.client.1.smithi098.stdout:1/581: fsync d1/d3/f1e 0 2024-09-20T19:06:05.023 INFO:tasks.workunit.client.0.smithi027.stdout:0/725: mkdir d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/d108 0 2024-09-20T19:06:05.025 INFO:tasks.workunit.client.1.smithi098.stdout:2/853: sync 2024-09-20T19:06:05.025 INFO:tasks.workunit.client.1.smithi098.stdout:7/699: dread d3/f8 [0,4194304] 0 2024-09-20T19:06:05.026 INFO:tasks.workunit.client.0.smithi027.stdout:0/726: truncate d2/d48/d6b/d79/fd9 963562 0 2024-09-20T19:06:05.026 INFO:tasks.workunit.client.1.smithi098.stdout:8/711: link d7/de/d11/d1d/f56 d7/de/d11/d1f/d57/d72/ff9 0 2024-09-20T19:06:05.027 INFO:tasks.workunit.client.0.smithi027.stdout:1/708: chown d2/d8/d3b/d4b/l3d 3299 1 2024-09-20T19:06:05.028 INFO:tasks.workunit.client.1.smithi098.stdout:9/676: rmdir d4/de/d24/d35/d6d 39 2024-09-20T19:06:05.028 INFO:tasks.workunit.client.0.smithi027.stdout:6/682: symlink d4/d15/d2c/dcb/ldb 0 2024-09-20T19:06:05.029 INFO:tasks.workunit.client.1.smithi098.stdout:4/676: truncate d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/fed 66475 0 2024-09-20T19:06:05.031 INFO:tasks.workunit.client.1.smithi098.stdout:7/700: write d3/d10/d16/d17/d33/d37/f98 [1422808,67621] 0 2024-09-20T19:06:05.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/677: chown d4/d74/d8a/fa2 1967447 1 2024-09-20T19:06:05.032 INFO:tasks.workunit.client.0.smithi027.stdout:4/642: write d5/d13/f74 [2436901,45262] 0 2024-09-20T19:06:05.033 INFO:tasks.workunit.client.0.smithi027.stdout:4/643: dread - d5/d11/d17/fb3 zero size 2024-09-20T19:06:05.034 INFO:tasks.workunit.client.1.smithi098.stdout:2/854: creat d3/d16/d1d/db5/f117 x:0 0 0 2024-09-20T19:06:05.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/582: dwrite d1/d3/df/f58 [4194304,4194304] 0 2024-09-20T19:06:05.038 INFO:tasks.workunit.client.1.smithi098.stdout:9/678: write d4/de/d27/d4a/d58/d5b/d8f/d9e/fd3 [3839605,110756] 0 2024-09-20T19:06:05.038 INFO:tasks.workunit.client.1.smithi098.stdout:2/855: write d3/df/f7a [3390633,27855] 0 2024-09-20T19:06:05.038 INFO:tasks.workunit.client.1.smithi098.stdout:4/677: getdents d3/d5e/d9f/da7 0 2024-09-20T19:06:05.040 INFO:tasks.workunit.client.1.smithi098.stdout:7/701: write d3/d10/d16/d17/fbb [1659635,4458] 0 2024-09-20T19:06:05.040 INFO:tasks.workunit.client.1.smithi098.stdout:1/583: write d1/d3/df/d4a/d6d/f70 [1029670,67525] 0 2024-09-20T19:06:05.043 INFO:tasks.workunit.client.0.smithi027.stdout:9/813: unlink d0/d9/df/d1b/d64/f6f 0 2024-09-20T19:06:05.044 INFO:tasks.workunit.client.1.smithi098.stdout:4/678: write d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f53 [415288,123962] 0 2024-09-20T19:06:05.044 INFO:tasks.workunit.client.0.smithi027.stdout:2/661: rename d3/d1c/d26/d75 to d3/d13/d3c/dce 0 2024-09-20T19:06:05.046 INFO:tasks.workunit.client.0.smithi027.stdout:9/814: write d0/d9/df/d1b/d9c/d4f/d8d/fb1 [1265251,27088] 0 2024-09-20T19:06:05.048 INFO:tasks.workunit.client.1.smithi098.stdout:8/712: getdents d7/de 0 2024-09-20T19:06:05.050 INFO:tasks.workunit.client.0.smithi027.stdout:5/738: creat d4/fef x:0 0 0 2024-09-20T19:06:05.051 INFO:tasks.workunit.client.0.smithi027.stdout:5/739: truncate d4/da/de/d3e/d44/f76 1164866 0 2024-09-20T19:06:05.052 INFO:tasks.workunit.client.0.smithi027.stdout:6/683: link d4/d15/d37/d6a/d7f/f92 d4/d15/d37/d6a/d7f/fdc 0 2024-09-20T19:06:05.052 INFO:tasks.workunit.client.1.smithi098.stdout:8/713: dread - d7/de/d11/d1f/dcd/db3/dcb/fec zero size 2024-09-20T19:06:05.052 INFO:tasks.workunit.client.1.smithi098.stdout:1/584: dwrite d1/d3/df/d34/d43/d53/f7f [4194304,4194304] 0 2024-09-20T19:06:05.054 INFO:tasks.workunit.client.0.smithi027.stdout:4/644: creat d5/d11/d1a/d2a/da3/fc8 x:0 0 0 2024-09-20T19:06:05.054 INFO:tasks.workunit.client.0.smithi027.stdout:4/645: dread - d5/d13/d36/d49/fa5 zero size 2024-09-20T19:06:05.055 INFO:tasks.workunit.client.0.smithi027.stdout:0/727: creat d2/d48/d6b/d79/f109 x:0 0 0 2024-09-20T19:06:05.056 INFO:tasks.workunit.client.0.smithi027.stdout:2/662: creat d3/d1c/d26/d2a/dc2/d6f/fcf x:0 0 0 2024-09-20T19:06:05.059 INFO:tasks.workunit.client.0.smithi027.stdout:5/740: mkdir d4/da/de/d3e/db7/dc2/d87/df0 0 2024-09-20T19:06:05.061 INFO:tasks.workunit.client.1.smithi098.stdout:1/585: creat d1/d3/d2e/d68/d7a/da1/fbd x:0 0 0 2024-09-20T19:06:05.062 INFO:tasks.workunit.client.0.smithi027.stdout:6/684: fsync d4/d15/d37/d6a/f73 0 2024-09-20T19:06:05.062 INFO:tasks.workunit.client.1.smithi098.stdout:1/586: fdatasync d1/d3/d2e/f3b 0 2024-09-20T19:06:05.063 INFO:tasks.workunit.client.1.smithi098.stdout:6/434: dread d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:06:05.063 INFO:tasks.workunit.client.1.smithi098.stdout:9/679: rmdir d4/db9 0 2024-09-20T19:06:05.066 INFO:tasks.workunit.client.0.smithi027.stdout:4/646: rmdir d5/d11/d1a 39 2024-09-20T19:06:05.066 INFO:tasks.workunit.client.0.smithi027.stdout:0/728: chown d2/d49/ded/df2/c92 33 1 2024-09-20T19:06:05.066 INFO:tasks.workunit.client.1.smithi098.stdout:8/714: symlink d7/de/d11/d19/d30/lfa 0 2024-09-20T19:06:05.067 INFO:tasks.workunit.client.1.smithi098.stdout:6/435: chown d0/de/d1b/d37/d44/f13 4471728 1 2024-09-20T19:06:05.067 INFO:tasks.workunit.client.1.smithi098.stdout:1/587: unlink d1/d3/df/d34/d43/f59 0 2024-09-20T19:06:05.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/715: write d7/f1c [4250859,78083] 0 2024-09-20T19:06:05.068 INFO:tasks.workunit.client.0.smithi027.stdout:0/729: chown d2/d48/f76 39529216 1 2024-09-20T19:06:05.068 INFO:tasks.workunit.client.0.smithi027.stdout:1/709: getdents d2/d1b/dde 0 2024-09-20T19:06:05.069 INFO:tasks.workunit.client.1.smithi098.stdout:6/436: unlink d0/f60 0 2024-09-20T19:06:05.070 INFO:tasks.workunit.client.1.smithi098.stdout:6/437: chown d0/c64 1087 1 2024-09-20T19:06:05.072 INFO:tasks.workunit.client.1.smithi098.stdout:9/680: symlink d4/de/d24/d35/d2d/da6/dae/ldc 0 2024-09-20T19:06:05.072 INFO:tasks.workunit.client.0.smithi027.stdout:5/741: creat d4/d1f/d7f/da4/ff1 x:0 0 0 2024-09-20T19:06:05.074 INFO:tasks.workunit.client.1.smithi098.stdout:1/588: fsync d1/d3/d2e/f47 0 2024-09-20T19:06:05.074 INFO:tasks.workunit.client.1.smithi098.stdout:9/681: read - d4/de/d27/d4a/d21/d25/d51/d7b/fba zero size 2024-09-20T19:06:05.077 INFO:tasks.workunit.client.1.smithi098.stdout:8/716: symlink d7/de/d11/d19/d30/d59/d80/da5/lfb 0 2024-09-20T19:06:05.079 INFO:tasks.workunit.client.0.smithi027.stdout:7/651: dread d3/f23 [0,4194304] 0 2024-09-20T19:06:05.083 INFO:tasks.workunit.client.1.smithi098.stdout:4/679: dread d3/f5 [4194304,4194304] 0 2024-09-20T19:06:05.084 INFO:tasks.workunit.client.0.smithi027.stdout:2/663: dwrite d3/d13/f6d [4194304,4194304] 0 2024-09-20T19:06:05.085 INFO:tasks.workunit.client.0.smithi027.stdout:4/647: unlink d5/d11/d1a/d2a/c5a 0 2024-09-20T19:06:05.085 INFO:tasks.workunit.client.1.smithi098.stdout:2/856: dread d3/d16/d1d/d2b/d46/d74/f7d [0,4194304] 0 2024-09-20T19:06:05.086 INFO:tasks.workunit.client.1.smithi098.stdout:9/682: creat d4/de/d27/d4a/d21/d25/d51/fdd x:0 0 0 2024-09-20T19:06:05.088 INFO:tasks.workunit.client.1.smithi098.stdout:9/683: read d4/de/d27/d4a/d21/f50 [214483,90545] 0 2024-09-20T19:06:05.093 INFO:tasks.workunit.client.0.smithi027.stdout:5/742: dwrite d4/da/de/d3e/d44/f76 [0,4194304] 0 2024-09-20T19:06:05.093 INFO:tasks.workunit.client.0.smithi027.stdout:7/652: fsync d3/d24/f83 0 2024-09-20T19:06:05.093 INFO:tasks.workunit.client.1.smithi098.stdout:8/717: creat d7/de/d11/d1f/ffc x:0 0 0 2024-09-20T19:06:05.098 INFO:tasks.workunit.client.1.smithi098.stdout:3/555: sync 2024-09-20T19:06:05.098 INFO:tasks.workunit.client.1.smithi098.stdout:5/510: sync 2024-09-20T19:06:05.100 INFO:tasks.workunit.client.1.smithi098.stdout:4/680: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f53 0 2024-09-20T19:06:05.101 INFO:tasks.workunit.client.1.smithi098.stdout:4/681: truncate d3/f7 4738637 0 2024-09-20T19:06:05.102 INFO:tasks.workunit.client.0.smithi027.stdout:1/710: dread d2/f50 [0,4194304] 0 2024-09-20T19:06:05.103 INFO:tasks.workunit.client.0.smithi027.stdout:7/653: dread d3/d8/d1c/d61/f97 [0,4194304] 0 2024-09-20T19:06:05.104 INFO:tasks.workunit.client.0.smithi027.stdout:0/730: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [0,4194304] 0 2024-09-20T19:06:05.105 INFO:tasks.workunit.client.1.smithi098.stdout:9/684: mknod d4/de/d27/d4a/d58/d5b/cde 0 2024-09-20T19:06:05.106 INFO:tasks.workunit.client.0.smithi027.stdout:2/664: mknod d3/d1c/d26/d2a/dc2/d6f/cd0 0 2024-09-20T19:06:05.107 INFO:tasks.workunit.client.0.smithi027.stdout:4/648: dwrite d5/d13/f74 [0,4194304] 0 2024-09-20T19:06:05.108 INFO:tasks.workunit.client.1.smithi098.stdout:4/682: dwrite d3/d7d/fc1 [0,4194304] 0 2024-09-20T19:06:05.113 INFO:tasks.workunit.client.1.smithi098.stdout:8/718: dread d7/de/d11/d1f/d9c/f9e [0,4194304] 0 2024-09-20T19:06:05.116 INFO:tasks.workunit.client.1.smithi098.stdout:0/422: write d0/d55/f1e [1785813,40310] 0 2024-09-20T19:06:05.116 INFO:tasks.workunit.client.1.smithi098.stdout:0/423: readlink d0/d55/l41 0 2024-09-20T19:06:05.117 INFO:tasks.workunit.client.0.smithi027.stdout:0/731: fsync d2/d48/d6b/d79/d84/d1b/dc5/d2e/fe5 0 2024-09-20T19:06:05.117 INFO:tasks.workunit.client.1.smithi098.stdout:0/424: fsync d0/db/f20 0 2024-09-20T19:06:05.119 INFO:tasks.workunit.client.1.smithi098.stdout:0/425: chown d0/db/d32/f7c 2492412 1 2024-09-20T19:06:05.122 INFO:tasks.workunit.client.1.smithi098.stdout:9/685: symlink d4/de/d27/ldf 0 2024-09-20T19:06:05.125 INFO:tasks.workunit.client.1.smithi098.stdout:1/589: rename d1/d3/d2e/d68/d7a/db0 to d1/d3/df/dbe 0 2024-09-20T19:06:05.125 INFO:tasks.workunit.client.1.smithi098.stdout:5/511: rename d1/d1b/d40 to d1/d1b/d40/d99 22 2024-09-20T19:06:05.127 INFO:tasks.workunit.client.1.smithi098.stdout:5/512: write d1/d17/d35/f89 [165834,109747] 0 2024-09-20T19:06:05.129 INFO:tasks.workunit.client.1.smithi098.stdout:4/683: mkdir d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab/dee 0 2024-09-20T19:06:05.130 INFO:tasks.workunit.client.1.smithi098.stdout:4/684: chown d3/d7d/da3/l38 864088 1 2024-09-20T19:06:05.131 INFO:tasks.workunit.client.1.smithi098.stdout:4/685: chown d3/d6/d11/d57/l79 13718375 1 2024-09-20T19:06:05.133 INFO:tasks.workunit.client.1.smithi098.stdout:3/556: symlink d4/d19/lae 0 2024-09-20T19:06:05.133 INFO:tasks.workunit.client.0.smithi027.stdout:5/743: dwrite d4/d6c/d6f/d92/dc8/fd7 [0,4194304] 0 2024-09-20T19:06:05.134 INFO:tasks.workunit.client.0.smithi027.stdout:2/665: dwrite d3/d13/f15 [0,4194304] 0 2024-09-20T19:06:05.135 INFO:tasks.workunit.client.0.smithi027.stdout:0/732: symlink d2/da2/l10a 0 2024-09-20T19:06:05.135 INFO:tasks.workunit.client.0.smithi027.stdout:7/654: dread d3/d8/da/d2e/d49/d8b/f3a [0,4194304] 0 2024-09-20T19:06:05.141 INFO:tasks.workunit.client.0.smithi027.stdout:3/711: dwrite d0/d1/d13/d15/f68 [0,4194304] 0 2024-09-20T19:06:05.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/590: truncate d1/d3/f1e 4636809 0 2024-09-20T19:06:05.144 INFO:tasks.workunit.client.0.smithi027.stdout:4/649: dwrite d5/d13/d36/d48/d3f/d4c/f55 [4194304,4194304] 0 2024-09-20T19:06:05.147 INFO:tasks.workunit.client.1.smithi098.stdout:0/426: dwrite d0/f57 [0,4194304] 0 2024-09-20T19:06:05.148 INFO:tasks.workunit.client.1.smithi098.stdout:0/427: stat d0/d55/l49 0 2024-09-20T19:06:05.149 INFO:tasks.workunit.client.0.smithi027.stdout:5/744: mknod d4/da/de/d3e/db7/dc2/cf2 0 2024-09-20T19:06:05.152 INFO:tasks.workunit.client.1.smithi098.stdout:8/719: symlink d7/de/d11/lfd 0 2024-09-20T19:06:05.153 INFO:tasks.workunit.client.0.smithi027.stdout:5/745: dread - d4/da/de/dda/fea zero size 2024-09-20T19:06:05.155 INFO:tasks.workunit.client.0.smithi027.stdout:8/699: dwrite d2/d3/f4a [0,4194304] 0 2024-09-20T19:06:05.155 INFO:tasks.workunit.client.0.smithi027.stdout:9/815: write d0/d9/df/d1c/f69 [318826,7167] 0 2024-09-20T19:06:05.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/720: read d7/de/d11/d19/d30/d68/f6a [1572971,24324] 0 2024-09-20T19:06:05.157 INFO:tasks.workunit.client.0.smithi027.stdout:3/712: dread d0/d19/d54/f5c [0,4194304] 0 2024-09-20T19:06:05.158 INFO:tasks.workunit.client.1.smithi098.stdout:4/686: dread d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d [0,4194304] 0 2024-09-20T19:06:05.159 INFO:tasks.workunit.client.0.smithi027.stdout:9/816: dread - d0/d9/df/d1b/fcb zero size 2024-09-20T19:06:05.160 INFO:tasks.workunit.client.0.smithi027.stdout:2/666: dwrite d3/d13/f6d [4194304,4194304] 0 2024-09-20T19:06:05.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/857: link d3/d16/d1d/d2b/d46/d74/d82/la9 d3/d16/l118 0 2024-09-20T19:06:05.162 INFO:tasks.workunit.client.1.smithi098.stdout:4/687: dread d3/f5 [4194304,4194304] 0 2024-09-20T19:06:05.163 INFO:tasks.workunit.client.0.smithi027.stdout:3/713: read d0/d1/fd2 [2303488,33284] 0 2024-09-20T19:06:05.166 INFO:tasks.workunit.client.0.smithi027.stdout:4/650: stat d5/lf 0 2024-09-20T19:06:05.170 INFO:tasks.workunit.client.0.smithi027.stdout:2/667: dwrite d3/de/f18 [0,4194304] 0 2024-09-20T19:06:05.171 INFO:tasks.workunit.client.0.smithi027.stdout:7/655: rename d3/d8/d26/d45/d56/la8 to d3/d8/da/d2e/d39/le2 0 2024-09-20T19:06:05.172 INFO:tasks.workunit.client.0.smithi027.stdout:2/668: readlink d3/d13/d3c/d48/l5c 0 2024-09-20T19:06:05.174 INFO:tasks.workunit.client.0.smithi027.stdout:6/685: sync 2024-09-20T19:06:05.174 INFO:tasks.workunit.client.0.smithi027.stdout:7/656: truncate d3/d8/da/d51/f72 231131 0 2024-09-20T19:06:05.175 INFO:tasks.workunit.client.0.smithi027.stdout:7/657: readlink d3/d24/l27 0 2024-09-20T19:06:05.175 INFO:tasks.workunit.client.1.smithi098.stdout:1/591: truncate d1/d3/f57 960671 0 2024-09-20T19:06:05.176 INFO:tasks.workunit.client.0.smithi027.stdout:5/746: rmdir d4/da/de/d3e/db7 39 2024-09-20T19:06:05.176 INFO:tasks.workunit.client.0.smithi027.stdout:5/747: fsync d4/d1f/d28/f3f 0 2024-09-20T19:06:05.180 INFO:tasks.workunit.client.1.smithi098.stdout:7/702: write d3/d10/d16/d17/d33/d1f/f43 [3094254,66826] 0 2024-09-20T19:06:05.180 INFO:tasks.workunit.client.1.smithi098.stdout:2/858: dwrite d3/d16/d1a/ded/ffb [0,4194304] 0 2024-09-20T19:06:05.184 INFO:tasks.workunit.client.1.smithi098.stdout:8/721: rename d7/de/d11/d1f/d57/daa/cea to d7/de/d11/d1f/cfe 0 2024-09-20T19:06:05.186 INFO:tasks.workunit.client.1.smithi098.stdout:1/592: dread d1/d3/df/f58 [4194304,4194304] 0 2024-09-20T19:06:05.186 INFO:tasks.workunit.client.0.smithi027.stdout:3/714: unlink d0/d1/d13/d15/d55/cbf 0 2024-09-20T19:06:05.189 INFO:tasks.workunit.client.0.smithi027.stdout:6/686: creat d4/d15/d37/d6a/d91/fdd x:0 0 0 2024-09-20T19:06:05.191 INFO:tasks.workunit.client.0.smithi027.stdout:7/658: rename d3/f23 to d3/d8/da/d2e/d39/fe3 0 2024-09-20T19:06:05.192 INFO:tasks.workunit.client.0.smithi027.stdout:5/748: readlink d4/da/d1a/lcc 0 2024-09-20T19:06:05.194 INFO:tasks.workunit.client.0.smithi027.stdout:0/733: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/f10b x:0 0 0 2024-09-20T19:06:05.195 INFO:tasks.workunit.client.0.smithi027.stdout:3/715: rmdir d0/d1/d5e 39 2024-09-20T19:06:05.197 INFO:tasks.workunit.client.0.smithi027.stdout:6/687: fdatasync d4/d6/f56 0 2024-09-20T19:06:05.198 INFO:tasks.workunit.client.0.smithi027.stdout:6/688: chown d4/d15/d37/d6a/dbf 2776 1 2024-09-20T19:06:05.199 INFO:tasks.workunit.client.0.smithi027.stdout:7/659: symlink d3/d8/d1c/le4 0 2024-09-20T19:06:05.202 INFO:tasks.workunit.client.1.smithi098.stdout:6/438: write d0/de/d1b/d37/d44/dc/f1a [1239038,114721] 0 2024-09-20T19:06:05.203 INFO:tasks.workunit.client.0.smithi027.stdout:3/716: readlink d0/d1/d5e/l34 0 2024-09-20T19:06:05.208 INFO:tasks.workunit.client.0.smithi027.stdout:7/660: mkdir d3/d8/de5 0 2024-09-20T19:06:05.209 INFO:tasks.workunit.client.0.smithi027.stdout:2/669: dread d3/de/f1a [0,4194304] 0 2024-09-20T19:06:05.210 INFO:tasks.workunit.client.0.smithi027.stdout:5/749: symlink d4/d1f/d91/lf3 0 2024-09-20T19:06:05.212 INFO:tasks.workunit.client.0.smithi027.stdout:1/711: truncate d2/d8/d2b/f4a 4516635 0 2024-09-20T19:06:05.214 INFO:tasks.workunit.client.0.smithi027.stdout:1/712: write d2/d8/d3b/d82/d87/fa2 [665793,54746] 0 2024-09-20T19:06:05.217 INFO:tasks.workunit.client.0.smithi027.stdout:1/713: chown d2/d8/d41/l48 4644669 1 2024-09-20T19:06:05.217 INFO:tasks.workunit.client.0.smithi027.stdout:8/700: dread d2/d3/d6/d21/f4e [0,4194304] 0 2024-09-20T19:06:05.218 INFO:tasks.workunit.client.0.smithi027.stdout:1/714: stat d2/d8/d2b 0 2024-09-20T19:06:05.218 INFO:tasks.workunit.client.0.smithi027.stdout:5/750: dwrite d4/da/de/d3e/fec [0,4194304] 0 2024-09-20T19:06:05.222 INFO:tasks.workunit.client.0.smithi027.stdout:2/670: mknod d3/d1c/d26/cd1 0 2024-09-20T19:06:05.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/686: truncate d4/de/d27/d4a/d8e/f95 136714 0 2024-09-20T19:06:05.231 INFO:tasks.workunit.client.0.smithi027.stdout:6/689: rename d4/d15/d37/d6a/c79 to d4/d6/d4b/cde 0 2024-09-20T19:06:05.231 INFO:tasks.workunit.client.1.smithi098.stdout:5/513: write d1/d17/f1a [13679,11957] 0 2024-09-20T19:06:05.232 INFO:tasks.workunit.client.0.smithi027.stdout:6/690: read - d4/d15/d37/d6a/fb6 zero size 2024-09-20T19:06:05.232 INFO:tasks.workunit.client.0.smithi027.stdout:6/691: chown d4/dc7 1001747 1 2024-09-20T19:06:05.234 INFO:tasks.workunit.client.0.smithi027.stdout:1/715: creat d2/d8/d41/fe8 x:0 0 0 2024-09-20T19:06:05.235 INFO:tasks.workunit.client.0.smithi027.stdout:8/701: dread d2/d14/d13/d2e/d6c/d77/f8a [0,4194304] 0 2024-09-20T19:06:05.235 INFO:tasks.workunit.client.0.smithi027.stdout:1/716: write d2/f50 [1888508,79688] 0 2024-09-20T19:06:05.236 INFO:tasks.workunit.client.0.smithi027.stdout:8/702: fdatasync d2/d3/d6/d21/d33/f74 0 2024-09-20T19:06:05.238 INFO:tasks.workunit.client.0.smithi027.stdout:7/661: mknod d3/d8/d1c/d80/db2/dd4/ce6 0 2024-09-20T19:06:05.238 INFO:tasks.workunit.client.1.smithi098.stdout:4/688: write d3/f16 [2058211,130037] 0 2024-09-20T19:06:05.242 INFO:tasks.workunit.client.0.smithi027.stdout:2/671: symlink d3/d1c/d26/ld2 0 2024-09-20T19:06:05.243 INFO:tasks.workunit.client.0.smithi027.stdout:0/734: link d2/d49/ded/df2/c92 d2/c10c 0 2024-09-20T19:06:05.245 INFO:tasks.workunit.client.0.smithi027.stdout:9/817: rename d0/d9/df/d1c/d6a/d6d/dd/f29 to d0/d9/df/d1c/d6a/d6d/dd/d66/f10d 0 2024-09-20T19:06:05.246 INFO:tasks.workunit.client.0.smithi027.stdout:6/692: creat d4/d15/d37/d7a/d8e/fdf x:0 0 0 2024-09-20T19:06:05.247 INFO:tasks.workunit.client.0.smithi027.stdout:6/693: write d4/d6/d4b/dca/fd6 [417624,53507] 0 2024-09-20T19:06:05.248 INFO:tasks.workunit.client.0.smithi027.stdout:6/694: write d4/d15/d37/d6a/f8f [3516057,121681] 0 2024-09-20T19:06:05.257 INFO:tasks.workunit.client.0.smithi027.stdout:3/717: write d0/f12 [4333010,88588] 0 2024-09-20T19:06:05.258 INFO:tasks.workunit.client.0.smithi027.stdout:3/718: dread - d0/d1/f56 zero size 2024-09-20T19:06:05.261 INFO:tasks.workunit.client.0.smithi027.stdout:0/735: rename d2/da2/l10a to d2/d49/ded/l10d 0 2024-09-20T19:06:05.261 INFO:tasks.workunit.client.0.smithi027.stdout:2/672: dwrite d3/d13/d3c/d48/f74 [0,4194304] 0 2024-09-20T19:06:05.263 INFO:tasks.workunit.client.0.smithi027.stdout:6/695: mkdir d4/d15/d37/d6a/dbf/de0 0 2024-09-20T19:06:05.270 INFO:tasks.workunit.client.0.smithi027.stdout:5/751: link d4/da/de/feb d4/d1f/d28/ff4 0 2024-09-20T19:06:05.272 INFO:tasks.workunit.client.0.smithi027.stdout:3/719: mknod d0/dc5/cf3 0 2024-09-20T19:06:05.274 INFO:tasks.workunit.client.0.smithi027.stdout:9/818: mknod d0/d2e/c10e 0 2024-09-20T19:06:05.275 INFO:tasks.workunit.client.0.smithi027.stdout:0/736: fsync d2/d48/d6b/d79/d84/d1b/f5f 0 2024-09-20T19:06:05.279 INFO:tasks.workunit.client.0.smithi027.stdout:6/696: symlink d4/d15/d37/d6a/d91/le1 0 2024-09-20T19:06:05.279 INFO:tasks.workunit.client.0.smithi027.stdout:6/697: fsync d4/d15/d37/d7a/d8e/fa4 0 2024-09-20T19:06:05.284 INFO:tasks.workunit.client.0.smithi027.stdout:6/698: dwrite d4/f42 [0,4194304] 0 2024-09-20T19:06:05.285 INFO:tasks.workunit.client.0.smithi027.stdout:6/699: dread - d4/d15/d93/faa zero size 2024-09-20T19:06:05.286 INFO:tasks.workunit.client.0.smithi027.stdout:6/700: chown d4/d15/d37/d6a/f73 2045 1 2024-09-20T19:06:05.286 INFO:tasks.workunit.client.0.smithi027.stdout:3/720: creat d0/d1/d13/d98/dc3/ff4 x:0 0 0 2024-09-20T19:06:05.289 INFO:tasks.workunit.client.0.smithi027.stdout:9/819: creat d0/d9/df/d1c/d6a/d9a/f10f x:0 0 0 2024-09-20T19:06:05.291 INFO:tasks.workunit.client.0.smithi027.stdout:9/820: truncate d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/fed 152074 0 2024-09-20T19:06:05.292 INFO:tasks.workunit.client.0.smithi027.stdout:0/737: creat d2/d49/ded/f10e x:0 0 0 2024-09-20T19:06:05.292 INFO:tasks.workunit.client.0.smithi027.stdout:0/738: readlink d2/d48/d6b/d79/d84/l1f 0 2024-09-20T19:06:05.294 INFO:tasks.workunit.client.0.smithi027.stdout:2/673: unlink d3/d1c/d26/d2a/dc2/d6f/caf 0 2024-09-20T19:06:05.295 INFO:tasks.workunit.client.0.smithi027.stdout:2/674: dread - d3/d96/f9a zero size 2024-09-20T19:06:05.299 INFO:tasks.workunit.client.0.smithi027.stdout:0/739: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f8e [0,4194304] 0 2024-09-20T19:06:05.300 INFO:tasks.workunit.client.0.smithi027.stdout:1/717: getdents d2/d8/d3b/d82/d90 0 2024-09-20T19:06:05.301 INFO:tasks.workunit.client.0.smithi027.stdout:0/740: truncate d2/d48/d6b/d79/d84/fcf 512430 0 2024-09-20T19:06:05.301 INFO:tasks.workunit.client.0.smithi027.stdout:2/675: dread d3/d13/d3c/d48/f62 [0,4194304] 0 2024-09-20T19:06:05.302 INFO:tasks.workunit.client.0.smithi027.stdout:8/703: getdents d2/d3/d6/d21/d33/d79/dcf 0 2024-09-20T19:06:05.303 INFO:tasks.workunit.client.0.smithi027.stdout:7/662: link d3/d8/d26/l94 d3/d5e/dc7/le7 0 2024-09-20T19:06:05.304 INFO:tasks.workunit.client.0.smithi027.stdout:0/741: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/f4d 1 1 2024-09-20T19:06:05.304 INFO:tasks.workunit.client.1.smithi098.stdout:3/557: creat d4/d19/d1d/d2f/faf x:0 0 0 2024-09-20T19:06:05.305 INFO:tasks.workunit.client.0.smithi027.stdout:0/742: chown d2/d48/d6b/d79/d9f/da4/c100 45 1 2024-09-20T19:06:05.305 INFO:tasks.workunit.client.0.smithi027.stdout:0/743: chown d2/d48/l5d 416924477 1 2024-09-20T19:06:05.306 INFO:tasks.workunit.client.0.smithi027.stdout:6/701: rename d4/d6/d4b/f6b to d4/dc7/fe2 0 2024-09-20T19:06:05.309 INFO:tasks.workunit.client.0.smithi027.stdout:3/721: creat d0/d1/d13/d15/db3/ff5 x:0 0 0 2024-09-20T19:06:05.311 INFO:tasks.workunit.client.0.smithi027.stdout:3/722: write d0/d1/d13/d98/dc3/ff4 [931453,34061] 0 2024-09-20T19:06:05.312 INFO:tasks.workunit.client.1.smithi098.stdout:2/859: truncate d3/df/d104/d38/fc2 2314962 0 2024-09-20T19:06:05.313 INFO:tasks.workunit.client.0.smithi027.stdout:6/702: dwrite d4/d6/d4b/dca/fd6 [0,4194304] 0 2024-09-20T19:06:05.316 INFO:tasks.workunit.client.0.smithi027.stdout:1/718: creat d2/d8/d74/d9a/fe9 x:0 0 0 2024-09-20T19:06:05.323 INFO:tasks.workunit.client.1.smithi098.stdout:9/687: symlink d4/de/d27/d4a/d58/d5b/d8f/dd5/le0 0 2024-09-20T19:06:05.324 INFO:tasks.workunit.client.1.smithi098.stdout:9/688: fdatasync d4/de/d27/d4a/d21/d25/d51/d7b/fba 0 2024-09-20T19:06:05.325 INFO:tasks.workunit.client.0.smithi027.stdout:0/744: symlink d2/d49/l10f 0 2024-09-20T19:06:05.325 INFO:tasks.workunit.client.0.smithi027.stdout:7/663: dwrite d3/d24/d84/f92 [4194304,4194304] 0 2024-09-20T19:06:05.326 INFO:tasks.workunit.client.1.smithi098.stdout:9/689: dread - d4/de/d27/d4a/d58/d5b/d9c/fdb zero size 2024-09-20T19:06:05.328 INFO:tasks.workunit.client.0.smithi027.stdout:9/821: mkdir d0/d2e/d110 0 2024-09-20T19:06:05.330 INFO:tasks.workunit.client.0.smithi027.stdout:9/822: truncate d0/d9/df/d1b/d9c/d4f/d8d/da0/fd0 1031190 0 2024-09-20T19:06:05.330 INFO:tasks.workunit.client.0.smithi027.stdout:3/723: symlink d0/d1/d5e/d1d/lf6 0 2024-09-20T19:06:05.333 INFO:tasks.workunit.client.1.smithi098.stdout:3/558: dread - d4/d19/d1d/d2f/d4e/f90 zero size 2024-09-20T19:06:05.338 INFO:tasks.workunit.client.1.smithi098.stdout:2/860: rename d3/db0/fba to d3/dd9/f119 0 2024-09-20T19:06:05.340 INFO:tasks.workunit.client.1.smithi098.stdout:1/593: fdatasync d1/d3/d2e/d68/d7a/da1/fb9 0 2024-09-20T19:06:05.343 INFO:tasks.workunit.client.0.smithi027.stdout:3/724: rename d0/d1/d13/l6d to d0/d1/d13/d15/d55/d70/df1/lf7 0 2024-09-20T19:06:05.345 INFO:tasks.workunit.client.0.smithi027.stdout:6/703: mkdir d4/d6/de3 0 2024-09-20T19:06:05.346 INFO:tasks.workunit.client.1.smithi098.stdout:8/722: write d7/fb7 [452034,119397] 0 2024-09-20T19:06:05.346 INFO:tasks.workunit.client.1.smithi098.stdout:7/703: dwrite d3/d10/d16/d17/d33/d37/da0/f51 [0,4194304] 0 2024-09-20T19:06:05.348 INFO:tasks.workunit.client.1.smithi098.stdout:4/689: mkdir d3/d6/de3/def 0 2024-09-20T19:06:05.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/690: readlink d4/de/d27/d4a/d58/d5b/lb6 0 2024-09-20T19:06:05.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/514: write d1/d17/d5e/f7d [1018183,123483] 0 2024-09-20T19:06:05.354 INFO:tasks.workunit.client.1.smithi098.stdout:3/559: dread d4/d19/d1d/d22/f9b [0,4194304] 0 2024-09-20T19:06:05.354 INFO:tasks.workunit.client.0.smithi027.stdout:0/745: symlink d2/d48/d6b/d79/d84/l110 0 2024-09-20T19:06:05.355 INFO:tasks.workunit.client.1.smithi098.stdout:3/560: dread - d4/d19/d1d/d2f/faf zero size 2024-09-20T19:06:05.356 INFO:tasks.workunit.client.0.smithi027.stdout:9/823: symlink d0/d9/df/d1c/l111 0 2024-09-20T19:06:05.358 INFO:tasks.workunit.client.0.smithi027.stdout:8/704: write d2/d14/d13/d2e/fbe [574598,122543] 0 2024-09-20T19:06:05.359 INFO:tasks.workunit.client.0.smithi027.stdout:8/705: fsync d2/d3/d1b/f26 0 2024-09-20T19:06:05.359 INFO:tasks.workunit.client.0.smithi027.stdout:3/725: creat d0/d1/d13/d15/d6f/dcc/ff8 x:0 0 0 2024-09-20T19:06:05.361 INFO:tasks.workunit.client.0.smithi027.stdout:6/704: symlink d4/dc7/le4 0 2024-09-20T19:06:05.364 INFO:tasks.workunit.client.1.smithi098.stdout:8/723: mkdir d7/de/d11/d19/d30/d59/dff 0 2024-09-20T19:06:05.364 INFO:tasks.workunit.client.0.smithi027.stdout:8/706: read d2/fc3 [2147827,35847] 0 2024-09-20T19:06:05.365 INFO:tasks.workunit.client.1.smithi098.stdout:8/724: chown d7/de/d11/d19/f36 124 1 2024-09-20T19:06:05.365 INFO:tasks.workunit.client.0.smithi027.stdout:1/719: write d2/d8/d74/f5a [733292,129642] 0 2024-09-20T19:06:05.368 INFO:tasks.workunit.client.0.smithi027.stdout:1/720: read d2/d61/fae [1625505,27756] 0 2024-09-20T19:06:05.369 INFO:tasks.workunit.client.0.smithi027.stdout:6/705: dwrite d4/d15/d37/d7a/d8e/fa4 [0,4194304] 0 2024-09-20T19:06:05.370 INFO:tasks.workunit.client.1.smithi098.stdout:9/691: fsync d4/de/d27/d4a/d58/d5b/d8f/d9e/f53 0 2024-09-20T19:06:05.373 INFO:tasks.workunit.client.0.smithi027.stdout:3/726: mknod d0/d1/d13/d15/d6f/cf9 0 2024-09-20T19:06:05.374 INFO:tasks.workunit.client.0.smithi027.stdout:1/721: dread d2/d8/d3b/d82/d87/fa2 [0,4194304] 0 2024-09-20T19:06:05.374 INFO:tasks.workunit.client.1.smithi098.stdout:8/725: dwrite d7/de/d11/d19/d30/d55/ff2 [0,4194304] 0 2024-09-20T19:06:05.374 INFO:tasks.workunit.client.0.smithi027.stdout:3/727: dread - d0/d1/d65/dc9/fef zero size 2024-09-20T19:06:05.375 INFO:tasks.workunit.client.1.smithi098.stdout:3/561: dread d4/d19/d1d/d2f/f53 [0,4194304] 0 2024-09-20T19:06:05.376 INFO:tasks.workunit.client.1.smithi098.stdout:1/594: mkdir d1/d3/df/d34/d43/d65/dbc/dbf 0 2024-09-20T19:06:05.377 INFO:tasks.workunit.client.0.smithi027.stdout:7/664: getdents d3/d24 0 2024-09-20T19:06:05.379 INFO:tasks.workunit.client.0.smithi027.stdout:4/651: sync 2024-09-20T19:06:05.379 INFO:tasks.workunit.client.0.smithi027.stdout:5/752: sync 2024-09-20T19:06:05.380 INFO:tasks.workunit.client.1.smithi098.stdout:6/439: getdents d0/de/d1b/d37/d44/dc 0 2024-09-20T19:06:05.384 INFO:tasks.workunit.client.1.smithi098.stdout:1/595: dwrite d1/d3/df/d4a/f63 [0,4194304] 0 2024-09-20T19:06:05.385 INFO:tasks.workunit.client.1.smithi098.stdout:4/690: rename d3/d7d/da3/d3c/d6b/l6c to d3/d6/d11/d57/d7f/lf0 0 2024-09-20T19:06:05.387 INFO:tasks.workunit.client.0.smithi027.stdout:8/707: creat d2/d3/d6/d6d/d75/feb x:0 0 0 2024-09-20T19:06:05.387 INFO:tasks.workunit.client.0.smithi027.stdout:0/746: mknod d2/d48/d6b/d79/d84/d1b/d39/c111 0 2024-09-20T19:06:05.388 INFO:tasks.workunit.client.1.smithi098.stdout:5/515: fsync d1/fb 0 2024-09-20T19:06:05.388 INFO:tasks.workunit.client.0.smithi027.stdout:5/753: readlink d4/da/d1a/lcc 0 2024-09-20T19:06:05.389 INFO:tasks.workunit.client.0.smithi027.stdout:8/708: fdatasync d2/d14/d13/f22 0 2024-09-20T19:06:05.391 INFO:tasks.workunit.client.0.smithi027.stdout:6/706: mknod d4/d15/d37/d7a/d46/d53/ce5 0 2024-09-20T19:06:05.391 INFO:tasks.workunit.client.1.smithi098.stdout:7/704: dwrite d3/d10/d16/d17/d33/fd2 [4194304,4194304] 0 2024-09-20T19:06:05.391 INFO:tasks.workunit.client.0.smithi027.stdout:8/709: readlink d2/d14/d13/lc0 0 2024-09-20T19:06:05.391 INFO:tasks.workunit.client.0.smithi027.stdout:6/707: readlink d4/lcd 0 2024-09-20T19:06:05.392 INFO:tasks.workunit.client.0.smithi027.stdout:8/710: fsync d2/d14/d13/d2e/f53 0 2024-09-20T19:06:05.396 INFO:tasks.workunit.client.0.smithi027.stdout:7/665: unlink d3/d8/c5d 0 2024-09-20T19:06:05.397 INFO:tasks.workunit.client.1.smithi098.stdout:8/726: symlink d7/de/d11/d1f/d57/l100 0 2024-09-20T19:06:05.400 INFO:tasks.workunit.client.1.smithi098.stdout:7/705: dwrite d3/d10/dcf/fd6 [0,4194304] 0 2024-09-20T19:06:05.402 INFO:tasks.workunit.client.1.smithi098.stdout:7/706: readlink d3/d10/d16/d17/d33/d1f/d2d/l41 0 2024-09-20T19:06:05.402 INFO:tasks.workunit.client.1.smithi098.stdout:1/596: symlink d1/d3/d62/lc0 0 2024-09-20T19:06:05.404 INFO:tasks.workunit.client.0.smithi027.stdout:7/666: dread d3/d8/da/d2e/d49/d8b/f6c [0,4194304] 0 2024-09-20T19:06:05.406 INFO:tasks.workunit.client.1.smithi098.stdout:3/562: dread d4/d25/d40/d80/f86 [0,4194304] 0 2024-09-20T19:06:05.406 INFO:tasks.workunit.client.1.smithi098.stdout:5/516: mknod d1/d46/d69/d84/d87/c9a 0 2024-09-20T19:06:05.408 INFO:tasks.workunit.client.1.smithi098.stdout:4/691: truncate d3/d7d/da3/d3c/fa6 217442 0 2024-09-20T19:06:05.410 INFO:tasks.workunit.client.1.smithi098.stdout:2/861: link d3/d51/d9f/fc6 d3/d16/d1d/d2b/f11a 0 2024-09-20T19:06:05.415 INFO:tasks.workunit.client.1.smithi098.stdout:4/692: dwrite d3/d7d/fc1 [0,4194304] 0 2024-09-20T19:06:05.416 INFO:tasks.workunit.client.1.smithi098.stdout:1/597: rmdir d1/d3/df/d4a/d6d 39 2024-09-20T19:06:05.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/692: dread d4/de/d27/d4a/d58/d5b/d8f/d9e/f5a [4194304,4194304] 0 2024-09-20T19:06:05.424 INFO:tasks.workunit.client.1.smithi098.stdout:6/440: write d0/f22 [4043891,89586] 0 2024-09-20T19:06:05.425 INFO:tasks.workunit.client.1.smithi098.stdout:6/441: write d0/f22 [3354782,34750] 0 2024-09-20T19:06:05.428 INFO:tasks.workunit.client.1.smithi098.stdout:8/727: mknod d7/c101 0 2024-09-20T19:06:05.431 INFO:tasks.workunit.client.1.smithi098.stdout:2/862: dread d3/d16/d1a/fae [0,4194304] 0 2024-09-20T19:06:05.434 INFO:tasks.workunit.client.1.smithi098.stdout:5/517: mknod d1/d17/c9b 0 2024-09-20T19:06:05.438 INFO:tasks.workunit.client.0.smithi027.stdout:9/824: creat d0/d9/df/f112 x:0 0 0 2024-09-20T19:06:05.440 INFO:tasks.workunit.client.1.smithi098.stdout:6/442: symlink d0/l88 0 2024-09-20T19:06:05.442 INFO:tasks.workunit.client.0.smithi027.stdout:0/747: symlink d2/d48/d6b/d79/d84/dfa/l112 0 2024-09-20T19:06:05.443 INFO:tasks.workunit.client.0.smithi027.stdout:0/748: chown d2/d48/d6b/d79/d84/d1b/d39/c53 319598859 1 2024-09-20T19:06:05.444 INFO:tasks.workunit.client.1.smithi098.stdout:8/728: rename d7/de/d11/d1d/l27 to d7/de/d11/d1f/dcd/db3/l102 0 2024-09-20T19:06:05.444 INFO:tasks.workunit.client.0.smithi027.stdout:2/676: sync 2024-09-20T19:06:05.445 INFO:tasks.workunit.client.0.smithi027.stdout:2/677: chown d3/d1c/d26/ld2 12 1 2024-09-20T19:06:05.447 INFO:tasks.workunit.client.0.smithi027.stdout:4/652: rename d5/d13/d36/d49 to d5/d13/d36/d48/d9f/dc9 0 2024-09-20T19:06:05.448 INFO:tasks.workunit.client.1.smithi098.stdout:7/707: truncate d3/d10/d16/d17/d33/d37/da0/f63 4963034 0 2024-09-20T19:06:05.448 INFO:tasks.workunit.client.1.smithi098.stdout:2/863: fsync d3/d16/d1d/d2b/d46/fc9 0 2024-09-20T19:06:05.451 INFO:tasks.workunit.client.1.smithi098.stdout:3/563: write d4/d19/d1d/d2f/d3e/f52 [4838917,62421] 0 2024-09-20T19:06:05.453 INFO:tasks.workunit.client.0.smithi027.stdout:3/728: getdents d0/d1/d65/d8e 0 2024-09-20T19:06:05.454 INFO:tasks.workunit.client.0.smithi027.stdout:3/729: fdatasync d0/d1/d5e/d1d/f3a 0 2024-09-20T19:06:05.458 INFO:tasks.workunit.client.0.smithi027.stdout:7/667: write d3/d8/d26/fa4 [310663,38390] 0 2024-09-20T19:06:05.460 INFO:tasks.workunit.client.0.smithi027.stdout:9/825: dread - d0/d9/df/d1b/fad zero size 2024-09-20T19:06:05.461 INFO:tasks.workunit.client.1.smithi098.stdout:8/729: rmdir d7/de 39 2024-09-20T19:06:05.462 INFO:tasks.workunit.client.1.smithi098.stdout:8/730: write d7/dd2/fe3 [1036666,37269] 0 2024-09-20T19:06:05.463 INFO:tasks.workunit.client.0.smithi027.stdout:6/708: write d4/d15/d37/f7b [1248599,97067] 0 2024-09-20T19:06:05.463 INFO:tasks.workunit.client.0.smithi027.stdout:2/678: symlink d3/d1c/d26/d2a/ld3 0 2024-09-20T19:06:05.464 INFO:tasks.workunit.client.1.smithi098.stdout:9/693: truncate d4/de/d27/d4a/d21/d25/d51/d7b/fc5 1599281 0 2024-09-20T19:06:05.465 INFO:tasks.workunit.client.0.smithi027.stdout:0/749: read d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fd [1037977,78520] 0 2024-09-20T19:06:05.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/708: rename d3/daa/lbf to d3/d76/d7a/dce/le4 0 2024-09-20T19:06:05.466 INFO:tasks.workunit.client.0.smithi027.stdout:5/754: dwrite d4/d1f/d28/ff4 [0,4194304] 0 2024-09-20T19:06:05.467 INFO:tasks.workunit.client.0.smithi027.stdout:0/750: dread - d2/d48/d6b/d79/d9f/da4/ff4 zero size 2024-09-20T19:06:05.468 INFO:tasks.workunit.client.0.smithi027.stdout:4/653: rename d5/d80/fb1 to d5/d11/d1a/d2a/da3/fca 0 2024-09-20T19:06:05.469 INFO:tasks.workunit.client.1.smithi098.stdout:5/518: creat d1/d71/d98/f9c x:0 0 0 2024-09-20T19:06:05.472 INFO:tasks.workunit.client.1.smithi098.stdout:1/598: getdents d1/d3/d2e 0 2024-09-20T19:06:05.473 INFO:tasks.workunit.client.0.smithi027.stdout:8/711: symlink d2/d14/d13/d2e/d6c/d77/lec 0 2024-09-20T19:06:05.473 INFO:tasks.workunit.client.1.smithi098.stdout:8/731: readlink d7/de/d11/d19/d30/d68/d78/lba 0 2024-09-20T19:06:05.476 INFO:tasks.workunit.client.1.smithi098.stdout:7/709: fdatasync d3/d10/d16/d17/d33/d4b/f55 0 2024-09-20T19:06:05.477 INFO:tasks.workunit.client.1.smithi098.stdout:7/710: readlink d3/d10/d16/d17/d33/d1f/d28/l93 0 2024-09-20T19:06:05.477 INFO:tasks.workunit.client.1.smithi098.stdout:2/864: truncate d3/d16/d1d/f107 836567 0 2024-09-20T19:06:05.477 INFO:tasks.workunit.client.0.smithi027.stdout:9/826: rmdir d0/d9/df/d1c 39 2024-09-20T19:06:05.479 INFO:tasks.workunit.client.1.smithi098.stdout:5/519: unlink d1/d46/f6e 0 2024-09-20T19:06:05.481 INFO:tasks.workunit.client.1.smithi098.stdout:6/443: creat d0/de/d1b/f89 x:0 0 0 2024-09-20T19:06:05.482 INFO:tasks.workunit.client.0.smithi027.stdout:5/755: mknod d4/d1f/d91/d9b/cf5 0 2024-09-20T19:06:05.484 INFO:tasks.workunit.client.1.smithi098.stdout:8/732: creat d7/de/d11/d19/d30/d55/da9/f103 x:0 0 0 2024-09-20T19:06:05.484 INFO:tasks.workunit.client.0.smithi027.stdout:4/654: write d5/d13/d36/d48/d3f/f86 [831691,95922] 0 2024-09-20T19:06:05.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/520: dread d1/d17/f1a [0,4194304] 0 2024-09-20T19:06:05.485 INFO:tasks.workunit.client.1.smithi098.stdout:9/694: unlink d4/d74/cd8 0 2024-09-20T19:06:05.487 INFO:tasks.workunit.client.0.smithi027.stdout:1/722: link d2/d8/d2b/l76 d2/d8/d2b/d5e/lea 0 2024-09-20T19:06:05.487 INFO:tasks.workunit.client.1.smithi098.stdout:8/733: write d7/de/d11/d19/f4e [1987983,34664] 0 2024-09-20T19:06:05.488 INFO:tasks.workunit.client.0.smithi027.stdout:1/723: write d2/d8/d74/d9a/fe9 [956881,88125] 0 2024-09-20T19:06:05.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/865: read d3/db0/f6a [256068,210] 0 2024-09-20T19:06:05.490 INFO:tasks.workunit.client.1.smithi098.stdout:6/444: dwrite d0/de/d1b/d37/d43/f5e [0,4194304] 0 2024-09-20T19:06:05.492 INFO:tasks.workunit.client.1.smithi098.stdout:8/734: fsync d7/de/d35/f5a 0 2024-09-20T19:06:05.493 INFO:tasks.workunit.client.1.smithi098.stdout:7/711: symlink d3/daa/le5 0 2024-09-20T19:06:05.496 INFO:tasks.workunit.client.1.smithi098.stdout:7/712: chown d3/d10/d16/d17/d33 2333017 1 2024-09-20T19:06:05.498 INFO:tasks.workunit.client.1.smithi098.stdout:7/713: fdatasync d3/d10/d16/d17/d33/d37/da0/f51 0 2024-09-20T19:06:05.500 INFO:tasks.workunit.client.0.smithi027.stdout:2/679: fsync d3/d1c/f90 0 2024-09-20T19:06:05.500 INFO:tasks.workunit.client.1.smithi098.stdout:8/735: dread d7/de/d11/d1d/f1e [0,4194304] 0 2024-09-20T19:06:05.500 INFO:tasks.workunit.client.1.smithi098.stdout:7/714: read d3/d10/d16/f6c [285409,30428] 0 2024-09-20T19:06:05.500 INFO:tasks.workunit.client.0.smithi027.stdout:2/680: chown d3/d13/d3c/f79 159 1 2024-09-20T19:06:05.501 INFO:tasks.workunit.client.1.smithi098.stdout:1/599: mkdir d1/d3/df/d34/d43/dad/dc1 0 2024-09-20T19:06:05.501 INFO:tasks.workunit.client.0.smithi027.stdout:2/681: readlink d3/d13/d3c/dce/l81 0 2024-09-20T19:06:05.503 INFO:tasks.workunit.client.0.smithi027.stdout:8/712: dread d2/d14/d13/d2e/f53 [0,4194304] 0 2024-09-20T19:06:05.503 INFO:tasks.workunit.client.1.smithi098.stdout:3/564: dread d4/da/f32 [0,4194304] 0 2024-09-20T19:06:05.504 INFO:tasks.workunit.client.1.smithi098.stdout:9/695: dread d4/de/d27/d4a/d8e/fbb [0,4194304] 0 2024-09-20T19:06:05.504 INFO:tasks.workunit.client.0.smithi027.stdout:5/756: unlink d4/fef 0 2024-09-20T19:06:05.505 INFO:tasks.workunit.client.1.smithi098.stdout:9/696: readlink d4/de/d24/d35/d2d/da6/dae/lca 0 2024-09-20T19:06:05.506 INFO:tasks.workunit.client.0.smithi027.stdout:2/682: dread d3/d13/d3c/d48/f74 [0,4194304] 0 2024-09-20T19:06:05.506 INFO:tasks.workunit.client.0.smithi027.stdout:2/683: fsync d3/d24/f95 0 2024-09-20T19:06:05.511 INFO:tasks.workunit.client.0.smithi027.stdout:1/724: mkdir d2/d8/d74/d84/dca/deb 0 2024-09-20T19:06:05.512 INFO:tasks.workunit.client.1.smithi098.stdout:2/866: symlink d3/d16/d1d/d2b/d99/l11b 0 2024-09-20T19:06:05.512 INFO:tasks.workunit.client.0.smithi027.stdout:3/730: link d0/d1/d5e/l3e d0/dc5/lfa 0 2024-09-20T19:06:05.513 INFO:tasks.workunit.client.0.smithi027.stdout:3/731: stat d0/d19 0 2024-09-20T19:06:05.513 INFO:tasks.workunit.client.0.smithi027.stdout:3/732: chown d0/d1/d5e/d1d/d7d/ce5 0 1 2024-09-20T19:06:05.515 INFO:tasks.workunit.client.0.smithi027.stdout:7/668: link d3/d8/d26/d45/f95 d3/d8/da/dc/fe8 0 2024-09-20T19:06:05.515 INFO:tasks.workunit.client.0.smithi027.stdout:3/733: read d0/d1/d5e/d1d/fb5 [853193,97120] 0 2024-09-20T19:06:05.522 INFO:tasks.workunit.client.0.smithi027.stdout:0/751: truncate d2/d49/ded/df2/f89 3040392 0 2024-09-20T19:06:05.524 INFO:tasks.workunit.client.0.smithi027.stdout:8/713: symlink d2/d2a/dd4/led 0 2024-09-20T19:06:05.524 INFO:tasks.workunit.client.0.smithi027.stdout:0/752: dread d2/d48/d6b/d79/fb4 [0,4194304] 0 2024-09-20T19:06:05.531 INFO:tasks.workunit.client.0.smithi027.stdout:2/684: rename d3/d24/fb3 to d3/d96/fd4 0 2024-09-20T19:06:05.532 INFO:tasks.workunit.client.1.smithi098.stdout:9/697: creat d4/de/d24/d35/dc4/fe1 x:0 0 0 2024-09-20T19:06:05.533 INFO:tasks.workunit.client.1.smithi098.stdout:9/698: chown d4/de/d24/d35/d2d/da6 460929 1 2024-09-20T19:06:05.534 INFO:tasks.workunit.client.0.smithi027.stdout:1/725: mknod d2/d61/cec 0 2024-09-20T19:06:05.535 INFO:tasks.workunit.client.1.smithi098.stdout:5/521: truncate d1/d17/d25/f48 437297 0 2024-09-20T19:06:05.536 INFO:tasks.workunit.client.1.smithi098.stdout:8/736: dread d7/fd [0,4194304] 0 2024-09-20T19:06:05.539 INFO:tasks.workunit.client.1.smithi098.stdout:2/867: dread - d3/d16/d1d/d2b/d46/d74/d7b/f9c zero size 2024-09-20T19:06:05.540 INFO:tasks.workunit.client.0.smithi027.stdout:7/669: symlink d3/d8/d1c/d80/db2/le9 0 2024-09-20T19:06:05.542 INFO:tasks.workunit.client.0.smithi027.stdout:9/827: creat d0/d9/df/d1c/d6a/d9a/f113 x:0 0 0 2024-09-20T19:06:05.543 INFO:tasks.workunit.client.0.smithi027.stdout:9/828: write d0/d9/df/d1c/d6a/d6d/dd/f10b [634445,48473] 0 2024-09-20T19:06:05.544 INFO:tasks.workunit.client.0.smithi027.stdout:6/709: link d4/d6/d4b/d7c/d64/l99 d4/dc7/le6 0 2024-09-20T19:06:05.549 INFO:tasks.workunit.client.0.smithi027.stdout:8/714: fdatasync d2/d3/d1b/f2c 0 2024-09-20T19:06:05.550 INFO:tasks.workunit.client.0.smithi027.stdout:8/715: fdatasync d2/d14/d13/d43/d5d/d90/fc9 0 2024-09-20T19:06:05.551 INFO:tasks.workunit.client.1.smithi098.stdout:8/737: dread d7/de/d11/d19/d30/d55/f87 [0,4194304] 0 2024-09-20T19:06:05.552 INFO:tasks.workunit.client.1.smithi098.stdout:3/565: creat d4/da/d7a/fb0 x:0 0 0 2024-09-20T19:06:05.554 INFO:tasks.workunit.client.1.smithi098.stdout:9/699: creat d4/d74/fe2 x:0 0 0 2024-09-20T19:06:05.556 INFO:tasks.workunit.client.1.smithi098.stdout:2/868: unlink d3/d51/d68/le9 0 2024-09-20T19:06:05.556 INFO:tasks.workunit.client.1.smithi098.stdout:2/869: chown d3/db0/d69 1646001412 1 2024-09-20T19:06:05.557 INFO:tasks.workunit.client.0.smithi027.stdout:2/685: rmdir d3/d13/d3c/dce 39 2024-09-20T19:06:05.560 INFO:tasks.workunit.client.1.smithi098.stdout:6/445: truncate d0/de/d1b/d37/d44/dc/f1a 313604 0 2024-09-20T19:06:05.562 INFO:tasks.workunit.client.0.smithi027.stdout:9/829: read - d0/d9/df/d1b/d9c/d5a/f8f zero size 2024-09-20T19:06:05.563 INFO:tasks.workunit.client.1.smithi098.stdout:8/738: rmdir d7/de/d11/d19/d30/d59/d80/da5 39 2024-09-20T19:06:05.563 INFO:tasks.workunit.client.1.smithi098.stdout:1/600: write d1/d3/df/d34/d43/f56 [278475,118796] 0 2024-09-20T19:06:05.564 INFO:tasks.workunit.client.0.smithi027.stdout:6/710: mkdir d4/d15/d37/d7a/d46/de7 0 2024-09-20T19:06:05.564 INFO:tasks.workunit.client.1.smithi098.stdout:3/566: dread d4/da/f8b [0,4194304] 0 2024-09-20T19:06:05.567 INFO:tasks.workunit.client.1.smithi098.stdout:7/715: getdents d3/d76 0 2024-09-20T19:06:05.568 INFO:tasks.workunit.client.0.smithi027.stdout:0/753: link d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f113 0 2024-09-20T19:06:05.568 INFO:tasks.workunit.client.0.smithi027.stdout:0/754: write d2/fe [1528280,5514] 0 2024-09-20T19:06:05.570 INFO:tasks.workunit.client.1.smithi098.stdout:8/739: symlink d7/de/d11/d19/d30/d59/l104 0 2024-09-20T19:06:05.571 INFO:tasks.workunit.client.0.smithi027.stdout:2/686: mknod d3/d13/d3c/d48/dad/cd5 0 2024-09-20T19:06:05.572 INFO:tasks.workunit.client.1.smithi098.stdout:1/601: mknod d1/d3/d2e/d68/d7a/cc2 0 2024-09-20T19:06:05.572 INFO:tasks.workunit.client.1.smithi098.stdout:1/602: stat d1/d3/df/d4a/l54 0 2024-09-20T19:06:05.577 INFO:tasks.workunit.client.0.smithi027.stdout:4/655: link d5/d13/d36/d48/d3f/f77 d5/d13/d36/d48/d9f/dc9/d8f/fcb 0 2024-09-20T19:06:05.577 INFO:tasks.workunit.client.0.smithi027.stdout:2/687: dwrite d3/d13/f15 [0,4194304] 0 2024-09-20T19:06:05.579 INFO:tasks.workunit.client.1.smithi098.stdout:1/603: dwrite d1/d3/f2b [4194304,4194304] 0 2024-09-20T19:06:05.584 INFO:tasks.workunit.client.1.smithi098.stdout:9/700: dwrite d4/de/f34 [4194304,4194304] 0 2024-09-20T19:06:05.584 INFO:tasks.workunit.client.1.smithi098.stdout:9/701: readlink d4/l41 0 2024-09-20T19:06:05.586 INFO:tasks.workunit.client.1.smithi098.stdout:8/740: creat d7/de/f105 x:0 0 0 2024-09-20T19:06:05.589 INFO:tasks.workunit.client.0.smithi027.stdout:5/757: rename d4/da/de/d3e/db7/dc2/cf2 to d4/da/de/d3e/cf6 0 2024-09-20T19:06:05.590 INFO:tasks.workunit.client.1.smithi098.stdout:7/716: write d3/f64 [3140846,45028] 0 2024-09-20T19:06:05.594 INFO:tasks.workunit.client.0.smithi027.stdout:2/688: rmdir d3/de/d34 39 2024-09-20T19:06:05.596 INFO:tasks.workunit.client.1.smithi098.stdout:6/446: rename d0/de/d1b/f26 to d0/de/d1b/d37/d44/f8a 0 2024-09-20T19:06:05.597 INFO:tasks.workunit.client.0.smithi027.stdout:3/734: getdents d0 0 2024-09-20T19:06:05.597 INFO:tasks.workunit.client.1.smithi098.stdout:1/604: mknod d1/d3/d2e/d71/cc3 0 2024-09-20T19:06:05.597 INFO:tasks.workunit.client.1.smithi098.stdout:6/447: fdatasync d0/de/d1b/d37/d44/dc/fd 0 2024-09-20T19:06:05.599 INFO:tasks.workunit.client.0.smithi027.stdout:5/758: symlink d4/da/de/d3e/d69/d75/db4/lf7 0 2024-09-20T19:06:05.601 INFO:tasks.workunit.client.0.smithi027.stdout:2/689: dread - d3/d13/d3c/dce/fb9 zero size 2024-09-20T19:06:05.601 INFO:tasks.workunit.client.1.smithi098.stdout:2/870: getdents d3/d16/d1d/d2b 0 2024-09-20T19:06:05.602 INFO:tasks.workunit.client.0.smithi027.stdout:9/830: creat d0/d9/df/d1b/d9c/f114 x:0 0 0 2024-09-20T19:06:05.603 INFO:tasks.workunit.client.0.smithi027.stdout:3/735: mknod d0/d38/cfb 0 2024-09-20T19:06:05.605 INFO:tasks.workunit.client.0.smithi027.stdout:0/755: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f114 x:0 0 0 2024-09-20T19:06:05.606 INFO:tasks.workunit.client.1.smithi098.stdout:7/717: fsync d3/f11 0 2024-09-20T19:06:05.607 INFO:tasks.workunit.client.0.smithi027.stdout:5/759: mkdir d4/da/d1a/df8 0 2024-09-20T19:06:05.611 INFO:tasks.workunit.client.1.smithi098.stdout:6/448: fdatasync d0/f7b 0 2024-09-20T19:06:05.611 INFO:tasks.workunit.client.1.smithi098.stdout:6/449: fdatasync d0/de/d1b/f5d 0 2024-09-20T19:06:05.612 INFO:tasks.workunit.client.1.smithi098.stdout:6/450: stat d0 0 2024-09-20T19:06:05.612 INFO:tasks.workunit.client.0.smithi027.stdout:3/736: rmdir d0/d1/d13 39 2024-09-20T19:06:05.613 INFO:tasks.workunit.client.1.smithi098.stdout:2/871: truncate d3/d16/d1a/f4b 3729522 0 2024-09-20T19:06:05.615 INFO:tasks.workunit.client.0.smithi027.stdout:8/716: rename d2/d3/d1b/l6b to d2/d14/d13/d2e/d6c/d77/lee 0 2024-09-20T19:06:05.615 INFO:tasks.workunit.client.1.smithi098.stdout:9/702: link d4/de/d27/d4a/l87 d4/de/d27/dc9/le3 0 2024-09-20T19:06:05.616 INFO:tasks.workunit.client.1.smithi098.stdout:9/703: chown d4/de/d27/d88 6122 1 2024-09-20T19:06:05.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/605: mknod d1/d3/df/d34/d43/dad/dc1/cc4 0 2024-09-20T19:06:05.620 INFO:tasks.workunit.client.0.smithi027.stdout:4/656: dwrite d5/d9b/f5e [0,4194304] 0 2024-09-20T19:06:05.621 INFO:tasks.workunit.client.1.smithi098.stdout:7/718: mknod d3/d10/d16/d17/d33/d4b/ce6 0 2024-09-20T19:06:05.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/567: link d4/d38/d39/lad d4/d19/lb1 0 2024-09-20T19:06:05.624 INFO:tasks.workunit.client.1.smithi098.stdout:3/568: chown d4/d25/d8d/fab 2 1 2024-09-20T19:06:05.627 INFO:tasks.workunit.client.0.smithi027.stdout:4/657: dwrite d5/d13/d7c/f9c [0,4194304] 0 2024-09-20T19:06:05.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/690: rename d3/d24/l69 to d3/d1c/d26/d2a/dc2/ld6 0 2024-09-20T19:06:05.629 INFO:tasks.workunit.client.0.smithi027.stdout:5/760: dread d4/da/d1a/f4f [0,4194304] 0 2024-09-20T19:06:05.630 INFO:tasks.workunit.client.0.smithi027.stdout:4/658: stat d5/d11/d17/d1b/da9 0 2024-09-20T19:06:05.631 INFO:tasks.workunit.client.1.smithi098.stdout:3/569: dwrite d4/da/fb [0,4194304] 0 2024-09-20T19:06:05.632 INFO:tasks.workunit.client.0.smithi027.stdout:5/761: read d4/da/de/d3e/d44/f76 [3563003,26580] 0 2024-09-20T19:06:05.633 INFO:tasks.workunit.client.1.smithi098.stdout:2/872: fsync d3/d51/fc3 0 2024-09-20T19:06:05.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/606: symlink d1/d3/d2e/d68/lc5 0 2024-09-20T19:06:05.638 INFO:tasks.workunit.client.0.smithi027.stdout:9/831: rmdir d0/d9/df/d1b/d9c/d10a 0 2024-09-20T19:06:05.638 INFO:tasks.workunit.client.1.smithi098.stdout:3/570: dwrite d4/f1b [0,4194304] 0 2024-09-20T19:06:05.642 INFO:tasks.workunit.client.0.smithi027.stdout:2/691: dwrite d3/d13/d3c/f79 [0,4194304] 0 2024-09-20T19:06:05.648 INFO:tasks.workunit.client.0.smithi027.stdout:4/659: dwrite d5/d11/f68 [0,4194304] 0 2024-09-20T19:06:05.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/571: dwrite d4/d19/d1d/d2f/d4e/f93 [0,4194304] 0 2024-09-20T19:06:05.651 INFO:tasks.workunit.client.0.smithi027.stdout:5/762: dwrite d4/da/de/feb [0,4194304] 0 2024-09-20T19:06:05.659 INFO:tasks.workunit.client.0.smithi027.stdout:9/832: truncate d0/d9/df/d1b/d9c/fc2 819254 0 2024-09-20T19:06:05.659 INFO:tasks.workunit.client.0.smithi027.stdout:3/737: write d0/d1/d13/d15/d6f/d7f/f86 [327326,103104] 0 2024-09-20T19:06:05.660 INFO:tasks.workunit.client.0.smithi027.stdout:8/717: write d2/d3/d6/d6d/d75/fad [2265437,123721] 0 2024-09-20T19:06:05.661 INFO:tasks.workunit.client.1.smithi098.stdout:6/451: creat d0/de/f8b x:0 0 0 2024-09-20T19:06:05.663 INFO:tasks.workunit.client.0.smithi027.stdout:0/756: getdents d2/d48/d6b/d79/d84/d1b/d39 0 2024-09-20T19:06:05.664 INFO:tasks.workunit.client.0.smithi027.stdout:2/692: creat d3/d1c/d26/d2a/dc2/fd7 x:0 0 0 2024-09-20T19:06:05.664 INFO:tasks.workunit.client.0.smithi027.stdout:4/660: rmdir d5/d11 39 2024-09-20T19:06:05.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/452: dread d0/de/d1b/d37/d44/d24/d29/d42/d4c/f6e [0,4194304] 0 2024-09-20T19:06:05.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/453: stat d0/d83 0 2024-09-20T19:06:05.669 INFO:tasks.workunit.client.1.smithi098.stdout:1/607: link d1/d3/df/d4a/f5c d1/d3/df/dbe/fc6 0 2024-09-20T19:06:05.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/873: dread d3/db0/d69/fb2 [0,4194304] 0 2024-09-20T19:06:05.670 INFO:tasks.workunit.client.0.smithi027.stdout:9/833: creat d0/d9/df/d1b/d9c/da4/f115 x:0 0 0 2024-09-20T19:06:05.672 INFO:tasks.workunit.client.0.smithi027.stdout:2/693: fsync d3/d1c/d26/d2a/dc2/f98 0 2024-09-20T19:06:05.672 INFO:tasks.workunit.client.0.smithi027.stdout:2/694: read - d3/d1c/d31/d9e/fcd zero size 2024-09-20T19:06:05.673 INFO:tasks.workunit.client.1.smithi098.stdout:1/608: mkdir d1/d3/df/d34/d43/dad/dc1/dc7 0 2024-09-20T19:06:05.674 INFO:tasks.workunit.client.1.smithi098.stdout:3/572: creat d4/d38/d48/fb2 x:0 0 0 2024-09-20T19:06:05.675 INFO:tasks.workunit.client.1.smithi098.stdout:3/573: read d4/d19/d1d/d2f/d4e/f93 [3917185,36449] 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.0.smithi027.stdout:0/757: symlink d2/d48/d6b/d79/d84/d1b/dc5/l115 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.0.smithi027.stdout:4/661: symlink d5/d11/d3d/lcc 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.0.smithi027.stdout:2/695: truncate d3/d13/d3c/d48/f74 3691581 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.1.smithi098.stdout:6/454: rename d0/de/d1b/d37/d44/d24/d29/d42 to d0/de/d1b/d37/d8c 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.1.smithi098.stdout:2/874: mkdir d3/df/d11c 0 2024-09-20T19:06:05.679 INFO:tasks.workunit.client.1.smithi098.stdout:7/719: link d3/d76/db8/da6/fcc d3/d10/d16/d17/d33/d1f/fe7 0 2024-09-20T19:06:05.680 INFO:tasks.workunit.client.0.smithi027.stdout:9/834: dwrite d0/d9/df/f74 [0,4194304] 0 2024-09-20T19:06:05.681 INFO:tasks.workunit.client.0.smithi027.stdout:2/696: fdatasync d3/d1c/d26/d2a/dc2/d6f/fcf 0 2024-09-20T19:06:05.681 INFO:tasks.workunit.client.1.smithi098.stdout:1/609: creat d1/d3/d2e/d61/fc8 x:0 0 0 2024-09-20T19:06:05.683 INFO:tasks.workunit.client.1.smithi098.stdout:1/610: dread - d1/d3/d2e/d68/d7a/fb2 zero size 2024-09-20T19:06:05.685 INFO:tasks.workunit.client.1.smithi098.stdout:3/574: fdatasync d4/d25/d40/d4b/f8e 0 2024-09-20T19:06:05.688 INFO:tasks.workunit.client.0.smithi027.stdout:2/697: creat d3/d1c/d26/d2a/dc2/fd8 x:0 0 0 2024-09-20T19:06:05.691 INFO:tasks.workunit.client.1.smithi098.stdout:8/741: dread d7/de/d11/d1f/f2a [4194304,4194304] 0 2024-09-20T19:06:05.692 INFO:tasks.workunit.client.0.smithi027.stdout:9/835: rename d0/d9/f28 to d0/d9/df/d1c/d6a/d6d/de5/f116 0 2024-09-20T19:06:05.694 INFO:tasks.workunit.client.0.smithi027.stdout:5/763: dread d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:06:05.694 INFO:tasks.workunit.client.0.smithi027.stdout:2/698: mknod d3/d24/d89/cd9 0 2024-09-20T19:06:05.695 INFO:tasks.workunit.client.0.smithi027.stdout:3/738: dread d0/d19/d54/fbe [0,4194304] 0 2024-09-20T19:06:05.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/704: dwrite d4/de/d27/d4a/d21/d25/d51/d7b/fc5 [0,4194304] 0 2024-09-20T19:06:05.699 INFO:tasks.workunit.client.1.smithi098.stdout:3/575: symlink d4/d25/d8d/lb3 0 2024-09-20T19:06:05.702 INFO:tasks.workunit.client.0.smithi027.stdout:8/718: dread d2/d3/d6/d21/d33/f74 [0,4194304] 0 2024-09-20T19:06:05.704 INFO:tasks.workunit.client.1.smithi098.stdout:7/720: mkdir d3/daa/dd4/de8 0 2024-09-20T19:06:05.706 INFO:tasks.workunit.client.0.smithi027.stdout:2/699: mknod d3/d13/d3c/d48/cda 0 2024-09-20T19:06:05.710 INFO:tasks.workunit.client.0.smithi027.stdout:9/836: truncate d0/d9/df/d1c/d6a/d6d/dd/d66/f89 111252 0 2024-09-20T19:06:05.710 INFO:tasks.workunit.client.0.smithi027.stdout:8/719: dwrite d2/d65/fd3 [0,4194304] 0 2024-09-20T19:06:05.713 INFO:tasks.workunit.client.0.smithi027.stdout:8/720: write d2/d3/d6/d6d/fcc [802824,100003] 0 2024-09-20T19:06:05.713 INFO:tasks.workunit.client.0.smithi027.stdout:3/739: mkdir d0/dc5/deb/dfc 0 2024-09-20T19:06:05.714 INFO:tasks.workunit.client.0.smithi027.stdout:8/721: dread - d2/d14/d13/d2e/fe2 zero size 2024-09-20T19:06:05.716 INFO:tasks.workunit.client.1.smithi098.stdout:6/455: rename d0/de/d1b/d37/d8c/d4c/f79 to d0/de/d1b/d37/d44/d24/d29/f8d 0 2024-09-20T19:06:05.717 INFO:tasks.workunit.client.1.smithi098.stdout:8/742: dread d7/de/d11/d19/d30/db5/fd0 [0,4194304] 0 2024-09-20T19:06:05.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/576: mkdir d4/d38/d39/db4 0 2024-09-20T19:06:05.720 INFO:tasks.workunit.client.1.smithi098.stdout:7/721: mknod d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/ce9 0 2024-09-20T19:06:05.721 INFO:tasks.workunit.client.0.smithi027.stdout:0/758: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fa0 [0,4194304] 0 2024-09-20T19:06:05.722 INFO:tasks.workunit.client.1.smithi098.stdout:9/705: mknod d4/de/d27/d4a/d21/ce4 0 2024-09-20T19:06:05.723 INFO:tasks.workunit.client.1.smithi098.stdout:2/875: write d3/dd9/fde [383128,95740] 0 2024-09-20T19:06:05.723 INFO:tasks.workunit.client.0.smithi027.stdout:4/662: dwrite d5/d11/d17/f65 [0,4194304] 0 2024-09-20T19:06:05.724 INFO:tasks.workunit.client.0.smithi027.stdout:4/663: fsync d5/d13/f98 0 2024-09-20T19:06:05.724 INFO:tasks.workunit.client.1.smithi098.stdout:2/876: chown d3/dd9 19034 1 2024-09-20T19:06:05.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/577: dwrite d4/d38/d48/f75 [4194304,4194304] 0 2024-09-20T19:06:05.726 INFO:tasks.workunit.client.0.smithi027.stdout:3/740: mknod d0/dc5/deb/cfd 0 2024-09-20T19:06:05.727 INFO:tasks.workunit.client.1.smithi098.stdout:3/578: chown d4/d19/d1d/d2f/f53 672172 1 2024-09-20T19:06:05.728 INFO:tasks.workunit.client.1.smithi098.stdout:6/456: creat d0/de/d1b/d37/d44/d24/d29/d50/f8e x:0 0 0 2024-09-20T19:06:05.730 INFO:tasks.workunit.client.1.smithi098.stdout:6/457: dread - d0/de/d1b/d37/d44/d24/d29/d50/f8e zero size 2024-09-20T19:06:05.731 INFO:tasks.workunit.client.0.smithi027.stdout:2/700: link d3/de/f46 d3/d1c/d26/d2a/dc2/fdb 0 2024-09-20T19:06:05.734 INFO:tasks.workunit.client.0.smithi027.stdout:5/764: dread d4/d1f/d28/f8f [0,4194304] 0 2024-09-20T19:06:05.736 INFO:tasks.workunit.client.0.smithi027.stdout:9/837: mkdir d0/d9/df/d1c/d6a/d6d/dd/d117 0 2024-09-20T19:06:05.739 INFO:tasks.workunit.client.0.smithi027.stdout:1/726: sync 2024-09-20T19:06:05.740 INFO:tasks.workunit.client.0.smithi027.stdout:8/722: mkdir d2/def 0 2024-09-20T19:06:05.740 INFO:tasks.workunit.client.0.smithi027.stdout:9/838: read d0/d9/df/d57/f7b [4142932,87004] 0 2024-09-20T19:06:05.740 INFO:tasks.workunit.client.1.smithi098.stdout:9/706: unlink d4/de/d27/d6c/d73/fce 0 2024-09-20T19:06:05.742 INFO:tasks.workunit.client.0.smithi027.stdout:4/664: mkdir d5/d9b/db0/dcd 0 2024-09-20T19:06:05.742 INFO:tasks.workunit.client.0.smithi027.stdout:3/741: rmdir d0/d1/d13/d15/d55 39 2024-09-20T19:06:05.743 INFO:tasks.workunit.client.0.smithi027.stdout:3/742: chown d0/d1/d13/f1c 1110 1 2024-09-20T19:06:05.745 INFO:tasks.workunit.client.0.smithi027.stdout:3/743: read d0/d1/d13/d15/d6f/f83 [701985,42136] 0 2024-09-20T19:06:05.746 INFO:tasks.workunit.client.0.smithi027.stdout:5/765: unlink d4/fdf 0 2024-09-20T19:06:05.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/743: symlink d7/de/d11/d1f/d57/db0/l106 0 2024-09-20T19:06:05.747 INFO:tasks.workunit.client.0.smithi027.stdout:5/766: stat d4/da/de/d3e/d44/f4c 0 2024-09-20T19:06:05.749 INFO:tasks.workunit.client.0.smithi027.stdout:3/744: dread d0/d1/d13/f1c [0,4194304] 0 2024-09-20T19:06:05.749 INFO:tasks.workunit.client.1.smithi098.stdout:9/707: creat d4/de/fe5 x:0 0 0 2024-09-20T19:06:05.753 INFO:tasks.workunit.client.0.smithi027.stdout:5/767: unlink d4/d6c/fb8 0 2024-09-20T19:06:05.753 INFO:tasks.workunit.client.0.smithi027.stdout:1/727: dread d2/d1b/d56/d71/f95 [0,4194304] 0 2024-09-20T19:06:05.755 INFO:tasks.workunit.client.1.smithi098.stdout:2/877: rename d3/d16/f89 to d3/f11d 0 2024-09-20T19:06:05.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/708: unlink d4/d74/d8a/cb1 0 2024-09-20T19:06:05.760 INFO:tasks.workunit.client.0.smithi027.stdout:1/728: dwrite d2/d8/f8c [4194304,4194304] 0 2024-09-20T19:06:05.760 INFO:tasks.workunit.client.1.smithi098.stdout:2/878: fsync d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/fdf 0 2024-09-20T19:06:05.766 INFO:tasks.workunit.client.1.smithi098.stdout:9/709: dwrite d4/de/d27/d4a/d58/d5b/d9c/fdb [0,4194304] 0 2024-09-20T19:06:05.767 INFO:tasks.workunit.client.1.smithi098.stdout:2/879: creat d3/d16/d1d/d2b/f11e x:0 0 0 2024-09-20T19:06:05.768 INFO:tasks.workunit.client.1.smithi098.stdout:9/710: stat d4/de/d27/d4a/d8e/fd2 0 2024-09-20T19:06:05.773 INFO:tasks.workunit.client.0.smithi027.stdout:3/745: unlink d0/d1/d13/d15/d55/d70/lc4 0 2024-09-20T19:06:05.774 INFO:tasks.workunit.client.0.smithi027.stdout:3/746: write d0/d1/d13/d15/db3/ff5 [561828,107875] 0 2024-09-20T19:06:05.777 INFO:tasks.workunit.client.0.smithi027.stdout:8/723: rename d2/c46 to d2/d14/d13/d2e/d6c/d77/cf0 0 2024-09-20T19:06:05.778 INFO:tasks.workunit.client.1.smithi098.stdout:3/579: write d4/da/f6c [1454830,77098] 0 2024-09-20T19:06:05.778 INFO:tasks.workunit.client.0.smithi027.stdout:2/701: getdents d3/d1c/d31 0 2024-09-20T19:06:05.779 INFO:tasks.workunit.client.0.smithi027.stdout:0/759: dwrite d2/da2/fc0 [0,4194304] 0 2024-09-20T19:06:05.779 INFO:tasks.workunit.client.1.smithi098.stdout:3/580: stat d4/d19/d1d/d2f/d4e/da3 0 2024-09-20T19:06:05.779 INFO:tasks.workunit.client.1.smithi098.stdout:2/880: truncate d3/df/d104/f100 100698 0 2024-09-20T19:06:05.782 INFO:tasks.workunit.client.0.smithi027.stdout:9/839: getdents d0/d9/df/d1b/d9c/d5a 0 2024-09-20T19:06:05.784 INFO:tasks.workunit.client.1.smithi098.stdout:7/722: write d3/d10/d16/d17/d33/d1f/fe7 [137640,33388] 0 2024-09-20T19:06:05.784 INFO:tasks.workunit.client.1.smithi098.stdout:6/458: dwrite d0/de/d1b/f1f [0,4194304] 0 2024-09-20T19:06:05.785 INFO:tasks.workunit.client.0.smithi027.stdout:3/747: creat d0/d1/d5e/d1d/da7/db0/ffe x:0 0 0 2024-09-20T19:06:05.786 INFO:tasks.workunit.client.0.smithi027.stdout:3/748: chown d0/d1/d13/d15/d55/f9d 77909 1 2024-09-20T19:06:05.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/581: mknod d4/d38/d48/d60/cb5 0 2024-09-20T19:06:05.789 INFO:tasks.workunit.client.1.smithi098.stdout:8/744: write d7/de/d11/d19/d47/f8b [143265,127380] 0 2024-09-20T19:06:05.789 INFO:tasks.workunit.client.0.smithi027.stdout:3/749: read d0/d1/d5e/d1d/fb5 [2106850,1221] 0 2024-09-20T19:06:05.793 INFO:tasks.workunit.client.1.smithi098.stdout:6/459: creat d0/d55/f8f x:0 0 0 2024-09-20T19:06:05.794 INFO:tasks.workunit.client.1.smithi098.stdout:6/460: stat d0/c64 0 2024-09-20T19:06:05.795 INFO:tasks.workunit.client.1.smithi098.stdout:6/461: stat d0/de/d1b/f89 0 2024-09-20T19:06:05.798 INFO:tasks.workunit.client.1.smithi098.stdout:3/582: rename d4/d19/lae to d4/d38/lb6 0 2024-09-20T19:06:05.798 INFO:tasks.workunit.client.1.smithi098.stdout:8/745: dwrite d7/de/d11/d19/f4a [0,4194304] 0 2024-09-20T19:06:05.799 INFO:tasks.workunit.client.0.smithi027.stdout:4/665: truncate d5/d11/d17/f65 1469028 0 2024-09-20T19:06:05.800 INFO:tasks.workunit.client.1.smithi098.stdout:8/746: fdatasync d7/de/d11/d19/d30/d55/fe4 0 2024-09-20T19:06:05.800 INFO:tasks.workunit.client.0.smithi027.stdout:4/666: write d5/d13/d36/d48/d3f/d4c/d52/fc1 [937733,12779] 0 2024-09-20T19:06:05.806 INFO:tasks.workunit.client.0.smithi027.stdout:9/840: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/f10d [0,4194304] 0 2024-09-20T19:06:05.807 INFO:tasks.workunit.client.1.smithi098.stdout:9/711: write d4/f1a [2097020,128081] 0 2024-09-20T19:06:05.811 INFO:tasks.workunit.client.0.smithi027.stdout:1/729: rename d2/d61/f8d to d2/d8/d74/fed 0 2024-09-20T19:06:05.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/693: sync 2024-09-20T19:06:05.812 INFO:tasks.workunit.client.1.smithi098.stdout:0/428: sync 2024-09-20T19:06:05.814 INFO:tasks.workunit.client.0.smithi027.stdout:4/667: rmdir d5/d11/d1a 39 2024-09-20T19:06:05.815 INFO:tasks.workunit.client.0.smithi027.stdout:4/668: truncate d5/d11/d17/d1b/f91 2125013 0 2024-09-20T19:06:05.821 INFO:tasks.workunit.client.1.smithi098.stdout:2/881: dwrite d3/d16/d1d/f4e [0,4194304] 0 2024-09-20T19:06:05.821 INFO:tasks.workunit.client.1.smithi098.stdout:6/462: fsync d0/de/d1b/d37/d44/d24/f52 0 2024-09-20T19:06:05.823 INFO:tasks.workunit.client.1.smithi098.stdout:3/583: mknod d4/d19/d1d/cb7 0 2024-09-20T19:06:05.824 INFO:tasks.workunit.client.1.smithi098.stdout:7/723: truncate d3/f64 3377470 0 2024-09-20T19:06:05.825 INFO:tasks.workunit.client.0.smithi027.stdout:0/760: link d2/d48/d6b/d79/d84/d1b/cbe d2/da2/c116 0 2024-09-20T19:06:05.825 INFO:tasks.workunit.client.0.smithi027.stdout:8/724: truncate d2/d3/f30 1773912 0 2024-09-20T19:06:05.830 INFO:tasks.workunit.client.0.smithi027.stdout:1/730: symlink d2/d8/d3b/d82/d90/d9f/lee 0 2024-09-20T19:06:05.832 INFO:tasks.workunit.client.1.smithi098.stdout:2/882: creat d3/db0/d69/d88/d8a/f11f x:0 0 0 2024-09-20T19:06:05.833 INFO:tasks.workunit.client.0.smithi027.stdout:9/841: mknod d0/d9/df/d1b/d9c/d4f/c118 0 2024-09-20T19:06:05.834 INFO:tasks.workunit.client.0.smithi027.stdout:2/702: dwrite d3/de/d34/f4e [0,4194304] 0 2024-09-20T19:06:05.835 INFO:tasks.workunit.client.0.smithi027.stdout:0/761: creat d2/d48/d6b/d79/d9f/f117 x:0 0 0 2024-09-20T19:06:05.836 INFO:tasks.workunit.client.1.smithi098.stdout:0/429: mknod d0/c81 0 2024-09-20T19:06:05.836 INFO:tasks.workunit.client.0.smithi027.stdout:0/762: readlink d2/d48/d6b/d79/d84/l110 0 2024-09-20T19:06:05.838 INFO:tasks.workunit.client.0.smithi027.stdout:1/731: write d2/d8/d74/fed [701683,56392] 0 2024-09-20T19:06:05.838 INFO:tasks.workunit.client.0.smithi027.stdout:0/763: chown d2/d49/ded 1 1 2024-09-20T19:06:05.840 INFO:tasks.workunit.client.0.smithi027.stdout:3/750: rename d0/d1/d5e/cf to d0/d1/d13/d15/cff 0 2024-09-20T19:06:05.842 INFO:tasks.workunit.client.0.smithi027.stdout:3/751: dread - d0/d1/f56 zero size 2024-09-20T19:06:05.842 INFO:tasks.workunit.client.0.smithi027.stdout:9/842: dwrite d0/d9/df/da2/f103 [0,4194304] 0 2024-09-20T19:06:05.842 INFO:tasks.workunit.client.1.smithi098.stdout:3/584: dwrite d4/da/f8b [0,4194304] 0 2024-09-20T19:06:05.843 INFO:tasks.workunit.client.0.smithi027.stdout:3/752: chown d0/d1/d13/d15/d6f/f90 457516236 1 2024-09-20T19:06:05.844 INFO:tasks.workunit.client.0.smithi027.stdout:9/843: chown d0/d9/df/f50 19850 1 2024-09-20T19:06:05.845 INFO:tasks.workunit.client.1.smithi098.stdout:3/585: chown d4/d19/d1d/d2f/d3e/l5b 226 1 2024-09-20T19:06:05.845 INFO:tasks.workunit.client.0.smithi027.stdout:1/732: unlink d2/d8/d2b/cc6 0 2024-09-20T19:06:05.850 INFO:tasks.workunit.client.0.smithi027.stdout:4/669: rename d5/d13/d36/d48/d3f/d7e/fc7 to d5/d13/d36/d48/d9f/dc9/d8f/fce 0 2024-09-20T19:06:05.853 INFO:tasks.workunit.client.0.smithi027.stdout:1/733: fdatasync d2/d8/d2b/f8a 0 2024-09-20T19:06:05.855 INFO:tasks.workunit.client.0.smithi027.stdout:9/844: dwrite d0/d9/df/d1b/d9c/d5a/fb6 [0,4194304] 0 2024-09-20T19:06:05.857 INFO:tasks.workunit.client.1.smithi098.stdout:4/694: link d3/ld6 d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/lf1 0 2024-09-20T19:06:05.859 INFO:tasks.workunit.client.1.smithi098.stdout:0/430: dwrite d0/db/d1d/f6a [0,4194304] 0 2024-09-20T19:06:05.859 INFO:tasks.workunit.client.1.smithi098.stdout:9/712: getdents d4/de/d27/dc9 0 2024-09-20T19:06:05.862 INFO:tasks.workunit.client.1.smithi098.stdout:3/586: mknod d4/d25/d40/d80/d94/cb8 0 2024-09-20T19:06:05.865 INFO:tasks.workunit.client.0.smithi027.stdout:8/725: rename d2/d14/d13/f22 to d2/d14/d13/d43/d5d/d86/ff1 0 2024-09-20T19:06:05.867 INFO:tasks.workunit.client.0.smithi027.stdout:8/726: chown d2/d14/d13/d51/fb6 18 1 2024-09-20T19:06:05.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/724: link d3/ld d3/d10/d16/d17/d33/d1f/d28/d7d/dcd/lea 0 2024-09-20T19:06:05.871 INFO:tasks.workunit.client.1.smithi098.stdout:7/725: chown d3/d10/d16/d17/d33/d1f/d28 214823086 1 2024-09-20T19:06:05.875 INFO:tasks.workunit.client.1.smithi098.stdout:3/587: unlink d4/d19/d1d/d22/f36 0 2024-09-20T19:06:05.877 INFO:tasks.workunit.client.0.smithi027.stdout:9/845: unlink d0/d9/df/d1b/f23 0 2024-09-20T19:06:05.878 INFO:tasks.workunit.client.0.smithi027.stdout:9/846: chown d0/d9/df/d1b/d9c/d5a/lc9 21 1 2024-09-20T19:06:05.882 INFO:tasks.workunit.client.1.smithi098.stdout:6/463: truncate d0/de/f6c 2162610 0 2024-09-20T19:06:05.882 INFO:tasks.workunit.client.1.smithi098.stdout:4/695: truncate d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/f9d 167183 0 2024-09-20T19:06:05.882 INFO:tasks.workunit.client.1.smithi098.stdout:2/883: dwrite d3/d16/d1a/fb8 [0,4194304] 0 2024-09-20T19:06:05.883 INFO:tasks.workunit.client.0.smithi027.stdout:2/703: rename d3/d24/d8b to d3/d13/d3c/dce/ddc 0 2024-09-20T19:06:05.887 INFO:tasks.workunit.client.0.smithi027.stdout:0/764: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 670496 0 2024-09-20T19:06:05.894 INFO:tasks.workunit.client.1.smithi098.stdout:7/726: dread d3/d10/d16/d17/d33/d37/f98 [4194304,4194304] 0 2024-09-20T19:06:05.895 INFO:tasks.workunit.client.0.smithi027.stdout:3/753: dwrite d0/d1/d13/d15/d55/fa0 [0,4194304] 0 2024-09-20T19:06:05.895 INFO:tasks.workunit.client.1.smithi098.stdout:7/727: write d3/d4c/fd1 [806311,62352] 0 2024-09-20T19:06:05.895 INFO:tasks.workunit.client.1.smithi098.stdout:7/728: chown d3 176 1 2024-09-20T19:06:05.896 INFO:tasks.workunit.client.1.smithi098.stdout:4/696: read d3/d6/f34 [4752238,109160] 0 2024-09-20T19:06:05.897 INFO:tasks.workunit.client.0.smithi027.stdout:9/847: creat d0/d9/df/d1c/d6a/df7/f119 x:0 0 0 2024-09-20T19:06:05.898 INFO:tasks.workunit.client.0.smithi027.stdout:1/734: dwrite d2/d1b/f1e [4194304,4194304] 0 2024-09-20T19:06:05.898 INFO:tasks.workunit.client.1.smithi098.stdout:0/431: symlink d0/d6/d28/d31/d69/d77/l82 0 2024-09-20T19:06:05.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/464: dread d0/de/d1b/f28 [0,4194304] 0 2024-09-20T19:06:05.900 INFO:tasks.workunit.client.1.smithi098.stdout:9/713: link d4/de/d27/l72 d4/de/d24/d35/d2d/da6/dae/d86/le6 0 2024-09-20T19:06:05.900 INFO:tasks.workunit.client.0.smithi027.stdout:1/735: chown d2/d8/d2b/lbc 198 1 2024-09-20T19:06:05.901 INFO:tasks.workunit.client.0.smithi027.stdout:0/765: mkdir d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/d118 0 2024-09-20T19:06:05.905 INFO:tasks.workunit.client.0.smithi027.stdout:4/670: rename d5/cb5 to d5/d13/d36/d59/ccf 0 2024-09-20T19:06:05.905 INFO:tasks.workunit.client.1.smithi098.stdout:6/465: dread d0/de/d1b/d37/d43/f5e [0,4194304] 0 2024-09-20T19:06:05.907 INFO:tasks.workunit.client.0.smithi027.stdout:8/727: getdents d2/d3/d6/d6d/d75 0 2024-09-20T19:06:05.907 INFO:tasks.workunit.client.0.smithi027.stdout:3/754: dwrite d0/d1/fb [0,4194304] 0 2024-09-20T19:06:05.909 INFO:tasks.workunit.client.0.smithi027.stdout:1/736: mkdir d2/d8/d3b/d82/def 0 2024-09-20T19:06:05.909 INFO:tasks.workunit.client.1.smithi098.stdout:3/588: creat d4/d19/fb9 x:0 0 0 2024-09-20T19:06:05.910 INFO:tasks.workunit.client.1.smithi098.stdout:3/589: chown d4/f16 6 1 2024-09-20T19:06:05.911 INFO:tasks.workunit.client.1.smithi098.stdout:0/432: mkdir d0/d7d/d83 0 2024-09-20T19:06:05.912 INFO:tasks.workunit.client.0.smithi027.stdout:9/848: dwrite d0/d9/df/d1b/f8 [4194304,4194304] 0 2024-09-20T19:06:05.913 INFO:tasks.workunit.client.0.smithi027.stdout:3/755: write d0/d1/d13/d3c/f42 [4783215,6370] 0 2024-09-20T19:06:05.913 INFO:tasks.workunit.client.1.smithi098.stdout:4/697: dwrite d3/d6/d11/d57/d7f/d84/fbe [0,4194304] 0 2024-09-20T19:06:05.915 INFO:tasks.workunit.client.0.smithi027.stdout:0/766: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 772949 0 2024-09-20T19:06:05.920 INFO:tasks.workunit.client.0.smithi027.stdout:8/728: mkdir d2/d65/df2 0 2024-09-20T19:06:05.925 INFO:tasks.workunit.client.1.smithi098.stdout:6/466: rmdir d0 39 2024-09-20T19:06:05.925 INFO:tasks.workunit.client.0.smithi027.stdout:0/767: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7a [0,4194304] 0 2024-09-20T19:06:05.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/433: symlink d0/d6/d19/d4f/d70/l84 0 2024-09-20T19:06:05.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/714: dread d4/f10 [0,4194304] 0 2024-09-20T19:06:05.935 INFO:tasks.workunit.client.0.smithi027.stdout:8/729: symlink d2/d3/d6/d6d/d75/lf3 0 2024-09-20T19:06:05.939 INFO:tasks.workunit.client.1.smithi098.stdout:7/729: rmdir d3/d76/d7a/dce/dd5 0 2024-09-20T19:06:05.939 INFO:tasks.workunit.client.1.smithi098.stdout:7/730: chown d3/d10/d16/dc1 6 1 2024-09-20T19:06:05.940 INFO:tasks.workunit.client.1.smithi098.stdout:7/731: chown d3/d10/d16/d17/d7c/lc6 94292990 1 2024-09-20T19:06:05.946 INFO:tasks.workunit.client.1.smithi098.stdout:2/884: write d3/d16/d1d/d2b/fb4 [19814,103231] 0 2024-09-20T19:06:05.946 INFO:tasks.workunit.client.0.smithi027.stdout:3/756: getdents d0/d1/d65 0 2024-09-20T19:06:05.947 INFO:tasks.workunit.client.0.smithi027.stdout:8/730: dread d2/d2a/f2f [0,4194304] 0 2024-09-20T19:06:05.949 INFO:tasks.workunit.client.1.smithi098.stdout:4/698: link d3/d5e/d97/le1 d3/d7d/da3/d3c/d6b/d73/d98/db3/lf2 0 2024-09-20T19:06:05.949 INFO:tasks.workunit.client.1.smithi098.stdout:7/732: dwrite d3/d10/d16/d17/d33/d1f/f3c [4194304,4194304] 0 2024-09-20T19:06:05.950 INFO:tasks.workunit.client.0.smithi027.stdout:3/757: mkdir d0/d1/d65/d100 0 2024-09-20T19:06:05.950 INFO:tasks.workunit.client.1.smithi098.stdout:0/434: dwrite d0/f4a [0,4194304] 0 2024-09-20T19:06:05.952 INFO:tasks.workunit.client.1.smithi098.stdout:4/699: chown d3/d6/d11/fa1 1306 1 2024-09-20T19:06:05.952 INFO:tasks.workunit.client.1.smithi098.stdout:7/733: write d3/d10/d16/d90/f9c [116023,84093] 0 2024-09-20T19:06:05.952 INFO:tasks.workunit.client.0.smithi027.stdout:1/737: dread d2/d8/d3b/d4b/f8f [0,4194304] 0 2024-09-20T19:06:05.953 INFO:tasks.workunit.client.0.smithi027.stdout:4/671: dwrite d5/d13/d16/f8b [0,4194304] 0 2024-09-20T19:06:05.953 INFO:tasks.workunit.client.1.smithi098.stdout:0/435: chown d0/d6/d19/d4f/f72 9171 1 2024-09-20T19:06:05.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/467: mknod d0/de/c90 0 2024-09-20T19:06:05.956 INFO:tasks.workunit.client.0.smithi027.stdout:8/731: truncate d2/d14/d13/d2e/d6c/d77/f8a 1010887 0 2024-09-20T19:06:05.957 INFO:tasks.workunit.client.1.smithi098.stdout:2/885: getdents d3/df/d11c 0 2024-09-20T19:06:05.961 INFO:tasks.workunit.client.0.smithi027.stdout:4/672: dwrite d5/d13/f98 [0,4194304] 0 2024-09-20T19:06:05.962 INFO:tasks.workunit.client.0.smithi027.stdout:1/738: rename d2/d8/d2b/d5e/l98 to d2/d8/lf0 0 2024-09-20T19:06:05.963 INFO:tasks.workunit.client.0.smithi027.stdout:1/739: fsync d2/f50 0 2024-09-20T19:06:05.964 INFO:tasks.workunit.client.0.smithi027.stdout:0/768: dread d2/da2/fa8 [0,4194304] 0 2024-09-20T19:06:05.964 INFO:tasks.workunit.client.1.smithi098.stdout:6/468: dwrite d0/de/f5f [0,4194304] 0 2024-09-20T19:06:05.965 INFO:tasks.workunit.client.0.smithi027.stdout:0/769: stat d2/d48/d6b/d79/d9f/da4/de6/lff 0 2024-09-20T19:06:05.965 INFO:tasks.workunit.client.1.smithi098.stdout:0/436: getdents d0/d7d/d83 0 2024-09-20T19:06:05.968 INFO:tasks.workunit.client.1.smithi098.stdout:4/700: rename d3/d2e/f77 to d3/d5e/d9f/da7/ff3 0 2024-09-20T19:06:05.970 INFO:tasks.workunit.client.0.smithi027.stdout:8/732: dread d2/d3/d1b/f6f [0,4194304] 0 2024-09-20T19:06:05.970 INFO:tasks.workunit.client.0.smithi027.stdout:8/733: fdatasync d2/d14/d13/d2e/d6c/fc1 0 2024-09-20T19:06:05.971 INFO:tasks.workunit.client.1.smithi098.stdout:6/469: dread d0/de/d1b/f5d [0,4194304] 0 2024-09-20T19:06:05.971 INFO:tasks.workunit.client.0.smithi027.stdout:4/673: unlink d5/d13/d36/d48/d3f/d4c/l5d 0 2024-09-20T19:06:05.975 INFO:tasks.workunit.client.0.smithi027.stdout:8/734: dwrite d2/d14/d13/f3b [4194304,4194304] 0 2024-09-20T19:06:05.976 INFO:tasks.workunit.client.0.smithi027.stdout:6/711: sync 2024-09-20T19:06:05.976 INFO:tasks.workunit.client.0.smithi027.stdout:7/670: sync 2024-09-20T19:06:05.976 INFO:tasks.workunit.client.1.smithi098.stdout:0/437: symlink d0/d6/d19/d4f/l85 0 2024-09-20T19:06:05.980 INFO:tasks.workunit.client.1.smithi098.stdout:4/701: rename d3/d6/d11 to d3/d6/d8c/de7/df4 0 2024-09-20T19:06:05.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/886: fsync d3/d16/d1d/d2b/f11a 0 2024-09-20T19:06:05.984 INFO:tasks.workunit.client.1.smithi098.stdout:0/438: dwrite d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:06:05.987 INFO:tasks.workunit.client.1.smithi098.stdout:4/702: read - d3/d7d/da3/d3c/d6b/d73/fd2 zero size 2024-09-20T19:06:05.987 INFO:tasks.workunit.client.1.smithi098.stdout:0/439: fdatasync d0/d6/d28/f5c 0 2024-09-20T19:06:05.993 INFO:tasks.workunit.client.0.smithi027.stdout:6/712: unlink d4/d15/d93/faa 0 2024-09-20T19:06:05.995 INFO:tasks.workunit.client.0.smithi027.stdout:7/671: write d3/d8/d26/d45/d56/f7d [1285798,103593] 0 2024-09-20T19:06:05.995 INFO:tasks.workunit.client.1.smithi098.stdout:2/887: truncate d3/db0/f6a 408100 0 2024-09-20T19:06:05.996 INFO:tasks.workunit.client.1.smithi098.stdout:7/734: dread d3/d10/dcf/fd0 [0,4194304] 0 2024-09-20T19:06:05.996 INFO:tasks.workunit.client.0.smithi027.stdout:3/758: dread d0/fbd [0,4194304] 0 2024-09-20T19:06:05.997 INFO:tasks.workunit.client.1.smithi098.stdout:2/888: write d3/d16/d1d/db5/f117 [628458,33981] 0 2024-09-20T19:06:05.998 INFO:tasks.workunit.client.1.smithi098.stdout:2/889: readlink d3/le 0 2024-09-20T19:06:05.998 INFO:tasks.workunit.client.0.smithi027.stdout:7/672: read d3/d8/da/dc/fe8 [708730,47100] 0 2024-09-20T19:06:06.000 INFO:tasks.workunit.client.0.smithi027.stdout:4/674: creat d5/d11/d3d/db4/fd0 x:0 0 0 2024-09-20T19:06:06.001 INFO:tasks.workunit.client.1.smithi098.stdout:4/703: chown d3/ld6 26300569 1 2024-09-20T19:06:06.004 INFO:tasks.workunit.client.1.smithi098.stdout:0/440: unlink d0/d6/d28/c48 0 2024-09-20T19:06:06.006 INFO:tasks.workunit.client.1.smithi098.stdout:7/735: rmdir d3 39 2024-09-20T19:06:06.007 INFO:tasks.workunit.client.0.smithi027.stdout:6/713: unlink d4/d9c/la6 0 2024-09-20T19:06:06.008 INFO:tasks.workunit.client.1.smithi098.stdout:2/890: chown d3/d16/d1d/d2b/d46/d74 126 1 2024-09-20T19:06:06.010 INFO:tasks.workunit.client.1.smithi098.stdout:0/441: unlink d0/d6/d28/d31/c3d 0 2024-09-20T19:06:06.011 INFO:tasks.workunit.client.0.smithi027.stdout:1/740: write d2/d8/d41/f72 [1390530,113072] 0 2024-09-20T19:06:06.013 INFO:tasks.workunit.client.1.smithi098.stdout:4/704: mkdir d3/d6/de3/def/df5 0 2024-09-20T19:06:06.014 INFO:tasks.workunit.client.0.smithi027.stdout:7/673: fdatasync d3/d8/da/dc/f63 0 2024-09-20T19:06:06.015 INFO:tasks.workunit.client.1.smithi098.stdout:4/705: write d3/f7 [5201562,97939] 0 2024-09-20T19:06:06.015 INFO:tasks.workunit.client.0.smithi027.stdout:4/675: readlink d5/l6 0 2024-09-20T19:06:06.018 INFO:tasks.workunit.client.1.smithi098.stdout:0/442: dwrite d0/f4a [0,4194304] 0 2024-09-20T19:06:06.019 INFO:tasks.workunit.client.0.smithi027.stdout:0/770: getdents d2 0 2024-09-20T19:06:06.020 INFO:tasks.workunit.client.1.smithi098.stdout:7/736: symlink d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/leb 0 2024-09-20T19:06:06.022 INFO:tasks.workunit.client.0.smithi027.stdout:1/741: dwrite d2/d8/d2b/f8a [4194304,4194304] 0 2024-09-20T19:06:06.028 INFO:tasks.workunit.client.0.smithi027.stdout:0/771: dwrite d2/d48/fb1 [0,4194304] 0 2024-09-20T19:06:06.030 INFO:tasks.workunit.client.1.smithi098.stdout:4/706: symlink d3/d2e/lf6 0 2024-09-20T19:06:06.030 INFO:tasks.workunit.client.1.smithi098.stdout:7/737: dwrite d3/d76/db8/da6/fcc [0,4194304] 0 2024-09-20T19:06:06.033 INFO:tasks.workunit.client.1.smithi098.stdout:4/707: read - d3/d7d/da3/d3c/d6b/d73/fd2 zero size 2024-09-20T19:06:06.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/891: creat d3/df/d104/f120 x:0 0 0 2024-09-20T19:06:06.035 INFO:tasks.workunit.client.1.smithi098.stdout:5/522: sync 2024-09-20T19:06:06.040 INFO:tasks.workunit.client.0.smithi027.stdout:7/674: mknod d3/d8/d26/d45/daa/cea 0 2024-09-20T19:06:06.040 INFO:tasks.workunit.client.0.smithi027.stdout:6/714: symlink d4/d15/d37/d7a/le8 0 2024-09-20T19:06:06.043 INFO:tasks.workunit.client.1.smithi098.stdout:2/892: fsync d3/d16/d1d/d2b/d46/dc0/de3/fea 0 2024-09-20T19:06:06.044 INFO:tasks.workunit.client.1.smithi098.stdout:7/738: dwrite d3/d10/dcf/fd6 [4194304,4194304] 0 2024-09-20T19:06:06.048 INFO:tasks.workunit.client.1.smithi098.stdout:5/523: creat d1/d71/f9d x:0 0 0 2024-09-20T19:06:06.048 INFO:tasks.workunit.client.1.smithi098.stdout:0/443: dread d0/db/d1d/f34 [0,4194304] 0 2024-09-20T19:06:06.050 INFO:tasks.workunit.client.0.smithi027.stdout:8/735: dwrite d2/d14/f3f [0,4194304] 0 2024-09-20T19:06:06.050 INFO:tasks.workunit.client.1.smithi098.stdout:4/708: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab/fa2 0 2024-09-20T19:06:06.054 INFO:tasks.workunit.client.0.smithi027.stdout:0/772: mkdir d2/d119 0 2024-09-20T19:06:06.057 INFO:tasks.workunit.client.1.smithi098.stdout:2/893: mkdir d3/d51/d9f/dbc/d121 0 2024-09-20T19:06:06.057 INFO:tasks.workunit.client.0.smithi027.stdout:6/715: mknod d4/d9c/ce9 0 2024-09-20T19:06:06.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/709: read d3/d5e/d9f/fc5 [2919406,107464] 0 2024-09-20T19:06:06.059 INFO:tasks.workunit.client.1.smithi098.stdout:7/739: truncate d3/d10/d16/d17/d7c/f92 2426513 0 2024-09-20T19:06:06.062 INFO:tasks.workunit.client.0.smithi027.stdout:7/675: unlink d3/d24/f83 0 2024-09-20T19:06:06.065 INFO:tasks.workunit.client.1.smithi098.stdout:2/894: fsync d3/df/d104/d38/f95 0 2024-09-20T19:06:06.066 INFO:tasks.workunit.client.0.smithi027.stdout:4/676: dread d5/d13/d36/d48/d9f/dc9/f8c [0,4194304] 0 2024-09-20T19:06:06.066 INFO:tasks.workunit.client.1.smithi098.stdout:2/895: stat d3/d16/d1d/d2b/d46/ce8 0 2024-09-20T19:06:06.067 INFO:tasks.workunit.client.1.smithi098.stdout:4/710: symlink d3/d6/de3/def/lf7 0 2024-09-20T19:06:06.072 INFO:tasks.workunit.client.0.smithi027.stdout:3/759: truncate d0/d1/f3b 881675 0 2024-09-20T19:06:06.074 INFO:tasks.workunit.client.1.smithi098.stdout:2/896: dwrite d3/db0/d69/d88/d8a/f11f [0,4194304] 0 2024-09-20T19:06:06.074 INFO:tasks.workunit.client.0.smithi027.stdout:7/676: chown d3/d8/da/d2e/d39/faf 2 1 2024-09-20T19:06:06.075 INFO:tasks.workunit.client.1.smithi098.stdout:2/897: write d3/df/d13/f18 [6013565,127622] 0 2024-09-20T19:06:06.076 INFO:tasks.workunit.client.0.smithi027.stdout:1/742: rmdir d2/d8/d3b/d82/def 0 2024-09-20T19:06:06.079 INFO:tasks.workunit.client.0.smithi027.stdout:4/677: symlink d5/d11/d51/ld1 0 2024-09-20T19:06:06.080 INFO:tasks.workunit.client.0.smithi027.stdout:3/760: dwrite d0/d1/fb [8388608,4194304] 0 2024-09-20T19:06:06.082 INFO:tasks.workunit.client.0.smithi027.stdout:6/716: mknod d4/d15/d37/d7a/cea 0 2024-09-20T19:06:06.087 INFO:tasks.workunit.client.1.smithi098.stdout:2/898: creat d3/db0/dcc/f122 x:0 0 0 2024-09-20T19:06:06.088 INFO:tasks.workunit.client.0.smithi027.stdout:8/736: dread d2/d2a/fd0 [0,4194304] 0 2024-09-20T19:06:06.092 INFO:tasks.workunit.client.0.smithi027.stdout:4/678: dwrite d5/d11/d17/d1b/d8d/d26/f47 [0,4194304] 0 2024-09-20T19:06:06.093 INFO:tasks.workunit.client.1.smithi098.stdout:0/444: link d0/db/d32/c4b d0/d55/d38/c86 0 2024-09-20T19:06:06.100 INFO:tasks.workunit.client.1.smithi098.stdout:2/899: dread d3/d16/d1a/fbf [0,4194304] 0 2024-09-20T19:06:06.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/445: creat d0/db/d1d/f87 x:0 0 0 2024-09-20T19:06:06.103 INFO:tasks.workunit.client.1.smithi098.stdout:4/711: getdents d3/d6 0 2024-09-20T19:06:06.107 INFO:tasks.workunit.client.0.smithi027.stdout:0/773: truncate d2/d48/d6b/d79/d84/fcf 1189033 0 2024-09-20T19:06:06.108 INFO:tasks.workunit.client.0.smithi027.stdout:4/679: creat d5/d11/d3d/db4/fd2 x:0 0 0 2024-09-20T19:06:06.109 INFO:tasks.workunit.client.1.smithi098.stdout:0/446: truncate d0/db/d1d/f26 3928105 0 2024-09-20T19:06:06.109 INFO:tasks.workunit.client.0.smithi027.stdout:5/768: sync 2024-09-20T19:06:06.110 INFO:tasks.workunit.client.0.smithi027.stdout:5/769: readlink d4/d1f/d7f/lca 0 2024-09-20T19:06:06.110 INFO:tasks.workunit.client.1.smithi098.stdout:7/740: dwrite d3/d10/d16/f84 [0,4194304] 0 2024-09-20T19:06:06.111 INFO:tasks.workunit.client.0.smithi027.stdout:5/770: read d4/d1f/d7f/fb3 [1296683,50564] 0 2024-09-20T19:06:06.112 INFO:tasks.workunit.client.1.smithi098.stdout:4/712: creat d3/d6/d8c/de7/df4/d1e/d2a/d45/ff8 x:0 0 0 2024-09-20T19:06:06.112 INFO:tasks.workunit.client.0.smithi027.stdout:6/717: creat d4/d15/d93/dd5/feb x:0 0 0 2024-09-20T19:06:06.118 INFO:tasks.workunit.client.0.smithi027.stdout:1/743: rename d2/d8/d2b/f8a to d2/d8/d74/ff1 0 2024-09-20T19:06:06.119 INFO:tasks.workunit.client.0.smithi027.stdout:3/761: dread d0/d19/d54/fcd [0,4194304] 0 2024-09-20T19:06:06.120 INFO:tasks.workunit.client.0.smithi027.stdout:7/677: write d3/d8/da/d2e/d49/d8b/f6c [175230,3303] 0 2024-09-20T19:06:06.120 INFO:tasks.workunit.client.1.smithi098.stdout:7/741: mkdir d3/d76/db8/da6/dec 0 2024-09-20T19:06:06.124 INFO:tasks.workunit.client.0.smithi027.stdout:4/680: symlink d5/d13/d7c/ld3 0 2024-09-20T19:06:06.126 INFO:tasks.workunit.client.1.smithi098.stdout:2/900: creat d3/d16/f123 x:0 0 0 2024-09-20T19:06:06.128 INFO:tasks.workunit.client.0.smithi027.stdout:6/718: symlink d4/d15/d37/d6a/dbf/lec 0 2024-09-20T19:06:06.129 INFO:tasks.workunit.client.1.smithi098.stdout:7/742: dwrite d3/d10/d16/d17/d33/d4b/fb0 [0,4194304] 0 2024-09-20T19:06:06.132 INFO:tasks.workunit.client.1.smithi098.stdout:0/447: dread d0/d55/d38/f44 [0,4194304] 0 2024-09-20T19:06:06.132 INFO:tasks.workunit.client.0.smithi027.stdout:5/771: dwrite d4/d1f/d28/f34 [0,4194304] 0 2024-09-20T19:06:06.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/713: dread d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f63 [0,4194304] 0 2024-09-20T19:06:06.133 INFO:tasks.workunit.client.1.smithi098.stdout:2/901: unlink d3/d16/d1d/d2b/d46/c87 0 2024-09-20T19:06:06.135 INFO:tasks.workunit.client.0.smithi027.stdout:6/719: dread d4/d15/d37/d6a/d7f/fdc [0,4194304] 0 2024-09-20T19:06:06.136 INFO:tasks.workunit.client.1.smithi098.stdout:4/714: truncate d3/d6/d8c/de7/df4/d1e/fd7 102148 0 2024-09-20T19:06:06.138 INFO:tasks.workunit.client.0.smithi027.stdout:1/744: rename d2/d1b/f7b to d2/d8/d3b/d44/d96/ff2 0 2024-09-20T19:06:06.142 INFO:tasks.workunit.client.0.smithi027.stdout:3/762: creat d0/d1/d13/d15/d55/d70/f101 x:0 0 0 2024-09-20T19:06:06.144 INFO:tasks.workunit.client.0.smithi027.stdout:1/745: dwrite d2/d8/d3b/fb9 [0,4194304] 0 2024-09-20T19:06:06.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/715: dwrite d3/d6/d8c/de7/df4/d64/f8f [0,4194304] 0 2024-09-20T19:06:06.145 INFO:tasks.workunit.client.0.smithi027.stdout:7/678: truncate d3/d8/da/d2e/d39/f8a 4051348 0 2024-09-20T19:06:06.147 INFO:tasks.workunit.client.0.smithi027.stdout:7/679: stat d3/d8/da/dc/da9/db6/fbb 0 2024-09-20T19:06:06.148 INFO:tasks.workunit.client.1.smithi098.stdout:7/743: rename d3/d10/d16/d17/d33/d1f/d28/d7d/cd3 to d3/d10/d16/d17/d33/d1f/d28/d66/ced 0 2024-09-20T19:06:06.150 INFO:tasks.workunit.client.0.smithi027.stdout:7/680: dread - d3/d8/da/dc/da9/fb7 zero size 2024-09-20T19:06:06.150 INFO:tasks.workunit.client.0.smithi027.stdout:4/681: unlink d5/d13/d36/d48/f97 0 2024-09-20T19:06:06.152 INFO:tasks.workunit.client.0.smithi027.stdout:3/763: dwrite d0/d1/d13/f22 [0,4194304] 0 2024-09-20T19:06:06.152 INFO:tasks.workunit.client.0.smithi027.stdout:8/737: truncate d2/d3/d6/d6d/fb3 3718897 0 2024-09-20T19:06:06.154 INFO:tasks.workunit.client.1.smithi098.stdout:4/716: dread - d3/d5e/d9f/fb7 zero size 2024-09-20T19:06:06.156 INFO:tasks.workunit.client.0.smithi027.stdout:1/746: dwrite d2/d8/d3b/d44/d93/fcb [0,4194304] 0 2024-09-20T19:06:06.160 INFO:tasks.workunit.client.0.smithi027.stdout:1/747: truncate d2/d8/d2b/f9e 701578 0 2024-09-20T19:06:06.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/902: rename d3/d16/d1d/d2b/d46/l48 to d3/d16/d1d/d2b/d46/dc0/de3/l124 0 2024-09-20T19:06:06.167 INFO:tasks.workunit.client.0.smithi027.stdout:6/720: unlink d4/d15/d37/d7a/d33/l65 0 2024-09-20T19:06:06.168 INFO:tasks.workunit.client.1.smithi098.stdout:4/717: mkdir d3/d5e/de4/df9 0 2024-09-20T19:06:06.174 INFO:tasks.workunit.client.0.smithi027.stdout:8/738: mknod d2/d14/d13/d2e/d6c/cf4 0 2024-09-20T19:06:06.176 INFO:tasks.workunit.client.0.smithi027.stdout:4/682: rename d5/d80/dc4 to d5/d11/d17/d1b/dd4 0 2024-09-20T19:06:06.176 INFO:tasks.workunit.client.0.smithi027.stdout:1/748: mkdir d2/d8/d3b/d44/d93/df3 0 2024-09-20T19:06:06.177 INFO:tasks.workunit.client.0.smithi027.stdout:4/683: write d5/d13/d7c/f9c [2048249,14688] 0 2024-09-20T19:06:06.178 INFO:tasks.workunit.client.0.smithi027.stdout:1/749: chown d2/d8/d74/d9a/caa 69780 1 2024-09-20T19:06:06.178 INFO:tasks.workunit.client.0.smithi027.stdout:6/721: truncate d4/d15/d37/d6a/f73 660810 0 2024-09-20T19:06:06.180 INFO:tasks.workunit.client.0.smithi027.stdout:4/684: read - d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fbb zero size 2024-09-20T19:06:06.180 INFO:tasks.workunit.client.0.smithi027.stdout:8/739: mknod d2/d3/d9a/cf5 0 2024-09-20T19:06:06.181 INFO:tasks.workunit.client.0.smithi027.stdout:8/740: fdatasync d2/d14/d13/d2e/f53 0 2024-09-20T19:06:06.181 INFO:tasks.workunit.client.0.smithi027.stdout:3/764: rename d0/d1/d13/d98/dab/dba/dc6 to d0/d19/d54/d7a/d102 0 2024-09-20T19:06:06.182 INFO:tasks.workunit.client.0.smithi027.stdout:6/722: truncate d4/d15/d37/d5a/d78/dbc/fce 8628 0 2024-09-20T19:06:06.188 INFO:tasks.workunit.client.0.smithi027.stdout:6/723: symlink d4/d6/d4b/d7c/led 0 2024-09-20T19:06:06.189 INFO:tasks.workunit.client.0.smithi027.stdout:4/685: dwrite d5/d9b/f62 [8388608,4194304] 0 2024-09-20T19:06:06.191 INFO:tasks.workunit.client.0.smithi027.stdout:6/724: write d4/d15/d37/d7a/d8e/fa4 [3004794,90175] 0 2024-09-20T19:06:06.195 INFO:tasks.workunit.client.0.smithi027.stdout:3/765: creat d0/d1/d13/d98/dc3/da2/f103 x:0 0 0 2024-09-20T19:06:06.196 INFO:tasks.workunit.client.0.smithi027.stdout:4/686: fsync d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fac 0 2024-09-20T19:06:06.198 INFO:tasks.workunit.client.0.smithi027.stdout:8/741: rename d2/d3/d6/d21/d33/d79/lab to d2/d14/d13/d43/d5d/d90/lf6 0 2024-09-20T19:06:06.198 INFO:tasks.workunit.client.0.smithi027.stdout:7/681: dread d3/d8/da/dc/f63 [0,4194304] 0 2024-09-20T19:06:06.199 INFO:tasks.workunit.client.0.smithi027.stdout:7/682: chown d3/d8/d1c/f47 43724706 1 2024-09-20T19:06:06.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/747: sync 2024-09-20T19:06:06.201 INFO:tasks.workunit.client.1.smithi098.stdout:1/611: sync 2024-09-20T19:06:06.201 INFO:tasks.workunit.client.0.smithi027.stdout:4/687: fsync d5/d13/f30 0 2024-09-20T19:06:06.203 INFO:tasks.workunit.client.0.smithi027.stdout:6/725: rmdir d4/d15/d37/d6a/d91 39 2024-09-20T19:06:06.205 INFO:tasks.workunit.client.0.smithi027.stdout:5/772: dwrite d4/da/de/d3e/d69/d6a/fcb [0,4194304] 0 2024-09-20T19:06:06.228 INFO:tasks.workunit.client.0.smithi027.stdout:8/742: creat d2/d3/ff7 x:0 0 0 2024-09-20T19:06:06.230 INFO:tasks.workunit.client.1.smithi098.stdout:4/718: dread d3/d2e/fb9 [0,4194304] 0 2024-09-20T19:06:06.233 INFO:tasks.workunit.client.1.smithi098.stdout:2/903: dwrite d3/df/d104/d38/fc2 [0,4194304] 0 2024-09-20T19:06:06.234 INFO:tasks.workunit.client.0.smithi027.stdout:6/726: chown d4/d15/d37/d6a/d91/fdd 16 1 2024-09-20T19:06:06.243 INFO:tasks.workunit.client.0.smithi027.stdout:8/743: rename d2/d3/d1b to d2/d2a/df8 0 2024-09-20T19:06:06.243 INFO:tasks.workunit.client.0.smithi027.stdout:1/750: write d2/d8/d74/d9a/da3/fc1 [1100045,45674] 0 2024-09-20T19:06:06.245 INFO:tasks.workunit.client.0.smithi027.stdout:6/727: truncate d4/d15/d37/d39/f83 685237 0 2024-09-20T19:06:06.246 INFO:tasks.workunit.client.0.smithi027.stdout:1/751: mknod d2/d8/d74/d9a/cf4 0 2024-09-20T19:06:06.247 INFO:tasks.workunit.client.0.smithi027.stdout:8/744: read d2/f39 [6567098,32353] 0 2024-09-20T19:06:06.250 INFO:tasks.workunit.client.0.smithi027.stdout:5/773: getdents d4/d1f/d7f/da4/dcf 0 2024-09-20T19:06:06.251 INFO:tasks.workunit.client.0.smithi027.stdout:7/683: fdatasync d3/d8/da/d2e/d39/f8a 0 2024-09-20T19:06:06.254 INFO:tasks.workunit.client.0.smithi027.stdout:1/752: dwrite d2/d8/d74/d9a/da3/fc1 [4194304,4194304] 0 2024-09-20T19:06:06.256 INFO:tasks.workunit.client.0.smithi027.stdout:1/753: fdatasync d2/d8/d74/d9a/fb3 0 2024-09-20T19:06:06.256 INFO:tasks.workunit.client.0.smithi027.stdout:8/745: rename d2/d14/d13/d51/f98 to d2/d2a/df8/dda/ff9 0 2024-09-20T19:06:06.256 INFO:tasks.workunit.client.0.smithi027.stdout:3/766: write d0/d1/d13/d15/f29 [1377554,59432] 0 2024-09-20T19:06:06.259 INFO:tasks.workunit.client.0.smithi027.stdout:7/684: getdents d3/d8/da/dc/da9/ddd 0 2024-09-20T19:06:06.260 INFO:tasks.workunit.client.0.smithi027.stdout:3/767: truncate d0/d1/d13/d15/d6f/d7f/f86 1323056 0 2024-09-20T19:06:06.260 INFO:tasks.workunit.client.0.smithi027.stdout:7/685: dread - d3/d8/da/d51/fde zero size 2024-09-20T19:06:06.260 INFO:tasks.workunit.client.0.smithi027.stdout:8/746: write d2/d2a/df8/d36/f61 [1784709,11043] 0 2024-09-20T19:06:06.262 INFO:tasks.workunit.client.0.smithi027.stdout:7/686: truncate d3/d8/fa5 694580 0 2024-09-20T19:06:06.262 INFO:tasks.workunit.client.0.smithi027.stdout:3/768: write d0/d1/d13/d15/d6f/d7f/f8b [4108958,41214] 0 2024-09-20T19:06:06.263 INFO:tasks.workunit.client.0.smithi027.stdout:1/754: link d2/d8/d3b/d82/d90/d9f/fb4 d2/d1b/dde/ff5 0 2024-09-20T19:06:06.266 INFO:tasks.workunit.client.0.smithi027.stdout:7/687: fsync d3/d8/da/dc/da9/db6/fbb 0 2024-09-20T19:06:06.269 INFO:tasks.workunit.client.0.smithi027.stdout:7/688: write d3/d24/d84/fa2 [3292254,18029] 0 2024-09-20T19:06:06.272 INFO:tasks.workunit.client.0.smithi027.stdout:3/769: dwrite d0/d1/d5e/d1d/f3a [4194304,4194304] 0 2024-09-20T19:06:06.273 INFO:tasks.workunit.client.0.smithi027.stdout:8/747: getdents d2/d3/d9a 0 2024-09-20T19:06:06.275 INFO:tasks.workunit.client.0.smithi027.stdout:1/755: rename d2/d1b/d56/c59 to d2/d8/d3b/d4b/cf6 0 2024-09-20T19:06:06.275 INFO:tasks.workunit.client.0.smithi027.stdout:5/774: dread d4/da/de/d3e/d44/f4c [0,4194304] 0 2024-09-20T19:06:06.277 INFO:tasks.workunit.client.0.smithi027.stdout:7/689: rmdir d3/d8/da/d2e/d49 39 2024-09-20T19:06:06.281 INFO:tasks.workunit.client.0.smithi027.stdout:6/728: write d4/d15/d37/d7a/fba [618185,54332] 0 2024-09-20T19:06:06.284 INFO:tasks.workunit.client.0.smithi027.stdout:7/690: rename d3/d8/d1c/le4 to d3/d8/d1c/d61/leb 0 2024-09-20T19:06:06.288 INFO:tasks.workunit.client.0.smithi027.stdout:3/770: dwrite d0/d1/d5e/d1d/da7/db0/dc7/fe8 [0,4194304] 0 2024-09-20T19:06:06.290 INFO:tasks.workunit.client.0.smithi027.stdout:5/775: dwrite d4/d6c/d6f/d92/dc8/fd7 [0,4194304] 0 2024-09-20T19:06:06.293 INFO:tasks.workunit.client.0.smithi027.stdout:7/691: rename d3/d8/da to d3/d8/d26/d45/d56/dec 0 2024-09-20T19:06:06.297 INFO:tasks.workunit.client.0.smithi027.stdout:8/748: dwrite d2/d2a/df8/f6f [0,4194304] 0 2024-09-20T19:06:06.299 INFO:tasks.workunit.client.0.smithi027.stdout:3/771: rename d0/d1/d13/d15/d55/d70 to d0/d1/d13/d98/dc3/d104 0 2024-09-20T19:06:06.300 INFO:tasks.workunit.client.0.smithi027.stdout:8/749: fdatasync d2/d3/d6/d21/d33/fa1 0 2024-09-20T19:06:06.304 INFO:tasks.workunit.client.0.smithi027.stdout:8/750: unlink d2/fc3 0 2024-09-20T19:06:06.307 INFO:tasks.workunit.client.0.smithi027.stdout:8/751: truncate d2/d3/d6/d21/fd9 859112 0 2024-09-20T19:06:06.308 INFO:tasks.workunit.client.0.smithi027.stdout:3/772: dwrite d0/d1/d13/d15/d6f/dcc/ff8 [0,4194304] 0 2024-09-20T19:06:06.310 INFO:tasks.workunit.client.0.smithi027.stdout:8/752: chown d2/d2a/dd4/led 0 1 2024-09-20T19:06:06.311 INFO:tasks.workunit.client.0.smithi027.stdout:3/773: chown d0/d1/d5e 1051532084 1 2024-09-20T19:06:06.312 INFO:tasks.workunit.client.0.smithi027.stdout:1/756: dread d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:06.314 INFO:tasks.workunit.client.0.smithi027.stdout:8/753: rename d2/d14/d13/d43/d5d/d86/ff1 to d2/d14/d13/d43/d5d/ffa 0 2024-09-20T19:06:06.316 INFO:tasks.workunit.client.0.smithi027.stdout:1/757: write d2/d8/d74/fed [84005,103971] 0 2024-09-20T19:06:06.316 INFO:tasks.workunit.client.0.smithi027.stdout:5/776: write d4/da/de/d3e/d44/f52 [860279,85840] 0 2024-09-20T19:06:06.318 INFO:tasks.workunit.client.0.smithi027.stdout:8/754: write d2/d3/d6/d6d/f8b [128692,95581] 0 2024-09-20T19:06:06.318 INFO:tasks.workunit.client.0.smithi027.stdout:5/777: stat d4/d1f/d7f/f67 0 2024-09-20T19:06:06.320 INFO:tasks.workunit.client.0.smithi027.stdout:1/758: fdatasync d2/d8/d3b/d82/d87/fa2 0 2024-09-20T19:06:06.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:06 smithi027 ceph-mon[28196]: pgmap v11: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 94 MiB/s rd, 291 MiB/s wr, 545 op/s 2024-09-20T19:06:06.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:06 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:06.323 INFO:tasks.workunit.client.1.smithi098.stdout:1/612: truncate d1/d3/df/f29 106 0 2024-09-20T19:06:06.323 INFO:tasks.workunit.client.1.smithi098.stdout:4/719: creat d3/d6/d8c/de7/df4/d1e/d2a/d45/ffa x:0 0 0 2024-09-20T19:06:06.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/748: symlink d7/de/d35/l107 0 2024-09-20T19:06:06.326 INFO:tasks.workunit.client.0.smithi027.stdout:7/692: dread d3/d8/d26/f71 [0,4194304] 0 2024-09-20T19:06:06.326 INFO:tasks.workunit.client.0.smithi027.stdout:1/759: unlink d2/d8/d2b/d2d/f80 0 2024-09-20T19:06:06.328 INFO:tasks.workunit.client.1.smithi098.stdout:2/904: unlink d3/d16/l21 0 2024-09-20T19:06:06.329 INFO:tasks.workunit.client.0.smithi027.stdout:8/755: dwrite d2/d14/d13/d2e/fe2 [0,4194304] 0 2024-09-20T19:06:06.330 INFO:tasks.workunit.client.1.smithi098.stdout:1/613: creat d1/d3/d62/fc9 x:0 0 0 2024-09-20T19:06:06.331 INFO:tasks.workunit.client.1.smithi098.stdout:1/614: chown d1/d3/df/f23 1023 1 2024-09-20T19:06:06.333 INFO:tasks.workunit.client.0.smithi027.stdout:3/774: write d0/d1/d13/d98/dab/fe9 [1529817,92157] 0 2024-09-20T19:06:06.334 INFO:tasks.workunit.client.0.smithi027.stdout:1/760: dread d2/d8/d3b/d44/d93/fcb [0,4194304] 0 2024-09-20T19:06:06.336 INFO:tasks.workunit.client.0.smithi027.stdout:5/778: write d4/da/de/d3e/d44/fa6 [4473207,7390] 0 2024-09-20T19:06:06.336 INFO:tasks.workunit.client.1.smithi098.stdout:8/749: creat d7/de/d11/d1f/dcd/db3/f108 x:0 0 0 2024-09-20T19:06:06.339 INFO:tasks.workunit.client.1.smithi098.stdout:4/720: mkdir d3/dfb 0 2024-09-20T19:06:06.341 INFO:tasks.workunit.client.0.smithi027.stdout:1/761: dread d2/d8/d74/d9a/fb3 [0,4194304] 0 2024-09-20T19:06:06.344 INFO:tasks.workunit.client.0.smithi027.stdout:5/779: dwrite d4/da/de/d3e/d69/d75/fa8 [0,4194304] 0 2024-09-20T19:06:06.344 INFO:tasks.workunit.client.0.smithi027.stdout:3/775: rename d0/d1/d13/d98/dc3/d104/df1 to d0/d19/dc2/d105 0 2024-09-20T19:06:06.345 INFO:tasks.workunit.client.0.smithi027.stdout:3/776: chown d0/d19/dc2 92 1 2024-09-20T19:06:06.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/905: rename d3/d16/d1d/d2b/d46/dc0/cdd to d3/d16/d1d/d2b/d46/d74/d82/c125 0 2024-09-20T19:06:06.346 INFO:tasks.workunit.client.0.smithi027.stdout:7/693: write d3/d8/d1c/d61/f97 [3635495,37642] 0 2024-09-20T19:06:06.347 INFO:tasks.workunit.client.0.smithi027.stdout:7/694: dread d3/d8/fa5 [0,4194304] 0 2024-09-20T19:06:06.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/750: write d7/de/d11/d19/d30/d55/f87 [1184102,112572] 0 2024-09-20T19:06:06.352 INFO:tasks.workunit.client.0.smithi027.stdout:8/756: write d2/d14/d13/f1d [2811689,103964] 0 2024-09-20T19:06:06.354 INFO:tasks.workunit.client.0.smithi027.stdout:1/762: rename d2/d1b/f2e to d2/d8/d74/d9a/de2/ff7 0 2024-09-20T19:06:06.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/751: dwrite d7/de/d11/d19/d30/d55/da9/dbe/fd5 [0,4194304] 0 2024-09-20T19:06:06.358 INFO:tasks.workunit.client.0.smithi027.stdout:3/777: creat d0/d1/d5e/d1d/f106 x:0 0 0 2024-09-20T19:06:06.359 INFO:tasks.workunit.client.0.smithi027.stdout:5/780: truncate d4/da/de/f40 1707458 0 2024-09-20T19:06:06.359 INFO:tasks.workunit.client.1.smithi098.stdout:1/615: dread d1/d3/df/d34/d43/d53/f60 [0,4194304] 0 2024-09-20T19:06:06.360 INFO:tasks.workunit.client.0.smithi027.stdout:7/695: mkdir d3/d8/d26/d45/d56/dec/dc/da9/dbc/ded 0 2024-09-20T19:06:06.361 INFO:tasks.workunit.client.1.smithi098.stdout:1/616: write d1/d3/df/dbe/fb7 [24913,85607] 0 2024-09-20T19:06:06.366 INFO:tasks.workunit.client.1.smithi098.stdout:1/617: stat d1/d3/df/d34/d43/c5d 0 2024-09-20T19:06:06.367 INFO:tasks.workunit.client.0.smithi027.stdout:8/757: creat d2/d3/d6/d6d/d75/ffb x:0 0 0 2024-09-20T19:06:06.368 INFO:tasks.workunit.client.0.smithi027.stdout:8/758: stat d2/d3/d6/d21/d33/d79/d9f/fea 0 2024-09-20T19:06:06.369 INFO:tasks.workunit.client.0.smithi027.stdout:3/778: mknod d0/d1/d13/c107 0 2024-09-20T19:06:06.371 INFO:tasks.workunit.client.0.smithi027.stdout:3/779: write d0/d1/d13/d98/dc3/ff4 [1172106,64468] 0 2024-09-20T19:06:06.371 INFO:tasks.workunit.client.1.smithi098.stdout:4/721: dwrite d3/d5e/d9f/fb7 [0,4194304] 0 2024-09-20T19:06:06.372 INFO:tasks.workunit.client.0.smithi027.stdout:3/780: chown d0/d1/d13/f22 6835 1 2024-09-20T19:06:06.372 INFO:tasks.workunit.client.0.smithi027.stdout:3/781: chown d0/d1/l2d 7 1 2024-09-20T19:06:06.375 INFO:tasks.workunit.client.1.smithi098.stdout:2/906: write d3/df/d104/d38/f44 [1412045,41583] 0 2024-09-20T19:06:06.377 INFO:tasks.workunit.client.1.smithi098.stdout:1/618: creat d1/d3/d2e/fca x:0 0 0 2024-09-20T19:06:06.383 INFO:tasks.workunit.client.0.smithi027.stdout:7/696: creat d3/d8/d26/d45/d56/dec/dc/da9/dbc/ded/fee x:0 0 0 2024-09-20T19:06:06.385 INFO:tasks.workunit.client.1.smithi098.stdout:1/619: unlink d1/d3/df/d4a/f5c 0 2024-09-20T19:06:06.385 INFO:tasks.workunit.client.0.smithi027.stdout:1/763: dwrite d2/d1b/d56/d71/f95 [0,4194304] 0 2024-09-20T19:06:06.386 INFO:tasks.workunit.client.1.smithi098.stdout:1/620: read - d1/d3/f49 zero size 2024-09-20T19:06:06.386 INFO:tasks.workunit.client.0.smithi027.stdout:3/782: mkdir d0/d1/d13/d98/dab/dba/d108 0 2024-09-20T19:06:06.388 INFO:tasks.workunit.client.1.smithi098.stdout:4/722: symlink d3/d5e/lfc 0 2024-09-20T19:06:06.391 INFO:tasks.workunit.client.1.smithi098.stdout:2/907: unlink d3/d16/d1d/d4f/cc1 0 2024-09-20T19:06:06.392 INFO:tasks.workunit.client.0.smithi027.stdout:5/781: creat d4/d1f/d7f/ff9 x:0 0 0 2024-09-20T19:06:06.393 INFO:tasks.workunit.client.1.smithi098.stdout:1/621: dwrite d1/d3/df/dbe/fb7 [0,4194304] 0 2024-09-20T19:06:06.396 INFO:tasks.workunit.client.0.smithi027.stdout:2/704: sync 2024-09-20T19:06:06.396 INFO:tasks.workunit.client.0.smithi027.stdout:9/849: sync 2024-09-20T19:06:06.396 INFO:tasks.workunit.client.0.smithi027.stdout:0/774: sync 2024-09-20T19:06:06.397 INFO:tasks.workunit.client.0.smithi027.stdout:1/764: chown d2/d8/d2b/d5e/c81 0 1 2024-09-20T19:06:06.397 INFO:tasks.workunit.client.1.smithi098.stdout:2/908: getdents d3/db0/d69/dca 0 2024-09-20T19:06:06.397 INFO:tasks.workunit.client.1.smithi098.stdout:4/723: read d3/d6/f23 [558266,84376] 0 2024-09-20T19:06:06.398 INFO:tasks.workunit.client.0.smithi027.stdout:2/705: read d3/d13/d3c/f79 [2004923,37272] 0 2024-09-20T19:06:06.399 INFO:tasks.workunit.client.0.smithi027.stdout:1/765: read d2/d1b/d56/d71/f7a [925109,110902] 0 2024-09-20T19:06:06.400 INFO:tasks.workunit.client.1.smithi098.stdout:1/622: symlink d1/d3/df/d34/d43/d53/lcb 0 2024-09-20T19:06:06.406 INFO:tasks.workunit.client.1.smithi098.stdout:2/909: truncate d3/df/fd0 515788 0 2024-09-20T19:06:06.408 INFO:tasks.workunit.client.1.smithi098.stdout:4/724: dread d3/d6/d5b/fb1 [0,4194304] 0 2024-09-20T19:06:06.412 INFO:tasks.workunit.client.1.smithi098.stdout:2/910: dread d3/d16/d1d/d2b/d99/f9d [0,4194304] 0 2024-09-20T19:06:06.414 INFO:tasks.workunit.client.1.smithi098.stdout:4/725: symlink d3/d6/d5b/dd0/lfd 0 2024-09-20T19:06:06.418 INFO:tasks.workunit.client.0.smithi027.stdout:2/706: dread d3/d1c/d26/fb5 [0,4194304] 0 2024-09-20T19:06:06.421 INFO:tasks.workunit.client.1.smithi098.stdout:4/726: mkdir d3/d6/d8c/de7/df4/dfe 0 2024-09-20T19:06:06.427 INFO:tasks.workunit.client.1.smithi098.stdout:2/911: dread d3/df/d13/f18 [4194304,4194304] 0 2024-09-20T19:06:06.432 INFO:tasks.workunit.client.1.smithi098.stdout:2/912: unlink d3/d16/d1d/d2b/d99/da2/ce1 0 2024-09-20T19:06:06.438 INFO:tasks.workunit.client.1.smithi098.stdout:4/727: write d3/d6/d8c/de7/df4/d1e/d2a/fd9 [590275,31416] 0 2024-09-20T19:06:06.444 INFO:tasks.workunit.client.1.smithi098.stdout:4/728: getdents d3/d6/d8c/de7/df4/d57/d7f 0 2024-09-20T19:06:06.445 INFO:tasks.workunit.client.0.smithi027.stdout:8/759: link d2/lb d2/d3/d6/d21/d33/d79/dcf/lfc 0 2024-09-20T19:06:06.446 INFO:tasks.workunit.client.1.smithi098.stdout:2/913: dread d3/df/d13/f3a [0,4194304] 0 2024-09-20T19:06:06.446 INFO:tasks.workunit.client.0.smithi027.stdout:3/783: creat d0/d1/d5e/d1d/da7/db0/dc7/f109 x:0 0 0 2024-09-20T19:06:06.447 INFO:tasks.workunit.client.0.smithi027.stdout:7/697: getdents d3/d8/de5 0 2024-09-20T19:06:06.448 INFO:tasks.workunit.client.0.smithi027.stdout:3/784: write d0/d1/d13/d98/dab/dba/fd4 [792686,98134] 0 2024-09-20T19:06:06.448 INFO:tasks.workunit.client.1.smithi098.stdout:4/729: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f8d 0 2024-09-20T19:06:06.449 INFO:tasks.workunit.client.0.smithi027.stdout:7/698: truncate d3/f29 4814768 0 2024-09-20T19:06:06.452 INFO:tasks.workunit.client.0.smithi027.stdout:9/850: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79/d11a 0 2024-09-20T19:06:06.454 INFO:tasks.workunit.client.1.smithi098.stdout:4/730: symlink d3/d7d/da3/d3c/d6b/d73/d98/lff 0 2024-09-20T19:06:06.457 INFO:tasks.workunit.client.0.smithi027.stdout:1/766: rename d2/d1b to d2/d61/df8 0 2024-09-20T19:06:06.457 INFO:tasks.workunit.client.1.smithi098.stdout:2/914: dwrite d3/d16/d1d/d2b/d46/dc0/f113 [0,4194304] 0 2024-09-20T19:06:06.459 INFO:tasks.workunit.client.0.smithi027.stdout:9/851: dwrite d0/d9/df/f112 [0,4194304] 0 2024-09-20T19:06:06.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/915: fdatasync d3/dd9/f119 0 2024-09-20T19:06:06.468 INFO:tasks.workunit.client.1.smithi098.stdout:4/731: rename d3/d7d/da3/d3c/d6b/d73/d98/db3/fdd to d3/f100 0 2024-09-20T19:06:06.471 INFO:tasks.workunit.client.0.smithi027.stdout:2/707: symlink d3/d1c/ldd 0 2024-09-20T19:06:06.473 INFO:tasks.workunit.client.0.smithi027.stdout:3/785: rename d0/d1/d13/d15/d6f/f90 to d0/d1/d5e/d1d/f10a 0 2024-09-20T19:06:06.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:06 smithi098 ceph-mon[35737]: pgmap v11: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 94 MiB/s rd, 291 MiB/s wr, 545 op/s 2024-09-20T19:06:06.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:06 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:06.475 INFO:tasks.workunit.client.0.smithi027.stdout:3/786: write d0/d1/d13/d15/d6f/fcb [27829,51687] 0 2024-09-20T19:06:06.475 INFO:tasks.workunit.client.1.smithi098.stdout:2/916: unlink d3/d16/d1d/d2b/d46/d74/d7b/f9c 0 2024-09-20T19:06:06.478 INFO:tasks.workunit.client.0.smithi027.stdout:9/852: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/f11b x:0 0 0 2024-09-20T19:06:06.480 INFO:tasks.workunit.client.1.smithi098.stdout:2/917: creat d3/d16/d1d/d2b/d46/d74/f126 x:0 0 0 2024-09-20T19:06:06.481 INFO:tasks.workunit.client.1.smithi098.stdout:2/918: chown d3/d16/d1d/d2b/d99/da2/l111 699 1 2024-09-20T19:06:06.481 INFO:tasks.workunit.client.0.smithi027.stdout:2/708: creat d3/d1c/d26/d2a/fde x:0 0 0 2024-09-20T19:06:06.484 INFO:tasks.workunit.client.0.smithi027.stdout:7/699: rename d3/d8/d26/d45/d56/dec/d2e/f9c to d3/d8/d1c/d80/fef 0 2024-09-20T19:06:06.484 INFO:tasks.workunit.client.0.smithi027.stdout:3/787: rmdir d0/dc5 39 2024-09-20T19:06:06.485 INFO:tasks.workunit.client.0.smithi027.stdout:5/782: dwrite d4/d1f/d7f/f67 [0,4194304] 0 2024-09-20T19:06:06.485 INFO:tasks.workunit.client.1.smithi098.stdout:2/919: truncate d3/fe4 1521377 0 2024-09-20T19:06:06.487 INFO:tasks.workunit.client.0.smithi027.stdout:9/853: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f11c x:0 0 0 2024-09-20T19:06:06.490 INFO:tasks.workunit.client.0.smithi027.stdout:5/783: write d4/da/de/feb [524334,69666] 0 2024-09-20T19:06:06.492 INFO:tasks.workunit.client.1.smithi098.stdout:2/920: dwrite d3/db0/d69/d88/d8a/f11f [0,4194304] 0 2024-09-20T19:06:06.495 INFO:tasks.workunit.client.0.smithi027.stdout:1/767: rename d2/d8/d3b/d82/d90/d9f to d2/d8/d74/d9a/da3/dad/df9 0 2024-09-20T19:06:06.495 INFO:tasks.workunit.client.1.smithi098.stdout:4/732: dread d3/f7 [0,4194304] 0 2024-09-20T19:06:06.497 INFO:tasks.workunit.client.0.smithi027.stdout:7/700: dwrite d3/d5e/dc7/fdb [0,4194304] 0 2024-09-20T19:06:06.499 INFO:tasks.workunit.client.1.smithi098.stdout:2/921: dread d3/df/d13/f3a [0,4194304] 0 2024-09-20T19:06:06.499 INFO:tasks.workunit.client.0.smithi027.stdout:9/854: truncate d0/d9/df/d1c/d6a/d9a/f113 690197 0 2024-09-20T19:06:06.499 INFO:tasks.workunit.client.0.smithi027.stdout:2/709: symlink d3/d13/d3c/ldf 0 2024-09-20T19:06:06.503 INFO:tasks.workunit.client.0.smithi027.stdout:1/768: write d2/d8/d74/d9a/da3/fc1 [34542,111198] 0 2024-09-20T19:06:06.505 INFO:tasks.workunit.client.0.smithi027.stdout:0/775: dwrite d2/f19 [0,4194304] 0 2024-09-20T19:06:06.507 INFO:tasks.workunit.client.0.smithi027.stdout:1/769: write d2/d8/d74/f60 [5154784,114736] 0 2024-09-20T19:06:06.508 INFO:tasks.workunit.client.1.smithi098.stdout:2/922: mkdir d3/db0/d69/d127 0 2024-09-20T19:06:06.509 INFO:tasks.workunit.client.0.smithi027.stdout:1/770: dread - d2/d8/d74/d9a/da3/fd9 zero size 2024-09-20T19:06:06.510 INFO:tasks.workunit.client.1.smithi098.stdout:2/923: dread d3/d16/d1a/fae [0,4194304] 0 2024-09-20T19:06:06.511 INFO:tasks.workunit.client.0.smithi027.stdout:9/855: rmdir d0/d9/df/d1b/d64 39 2024-09-20T19:06:06.515 INFO:tasks.workunit.client.0.smithi027.stdout:2/710: creat d3/d13/d3c/dce/fe0 x:0 0 0 2024-09-20T19:06:06.517 INFO:tasks.workunit.client.1.smithi098.stdout:2/924: truncate d3/db0/f102 707266 0 2024-09-20T19:06:06.518 INFO:tasks.workunit.client.0.smithi027.stdout:1/771: dwrite d2/d8/d41/fe8 [0,4194304] 0 2024-09-20T19:06:06.521 INFO:tasks.workunit.client.0.smithi027.stdout:7/701: creat d3/d8/de5/ff0 x:0 0 0 2024-09-20T19:06:06.521 INFO:tasks.workunit.client.1.smithi098.stdout:2/925: fdatasync d3/dd9/f119 0 2024-09-20T19:06:06.522 INFO:tasks.workunit.client.0.smithi027.stdout:7/702: chown d3/d8/d26/d45/d56/dec/dc/da9/dbc/ded 9541 1 2024-09-20T19:06:06.523 INFO:tasks.workunit.client.0.smithi027.stdout:3/788: creat d0/d1/d65/dbb/f10b x:0 0 0 2024-09-20T19:06:06.523 INFO:tasks.workunit.client.0.smithi027.stdout:7/703: chown d3/d8/d26/d45/d56/dec/dc/dd9 40 1 2024-09-20T19:06:06.525 INFO:tasks.workunit.client.1.smithi098.stdout:2/926: truncate d3/d16/d1d/d2b/d46/d74/f126 820118 0 2024-09-20T19:06:06.525 INFO:tasks.workunit.client.0.smithi027.stdout:3/789: read - d0/d1/d5e/d1d/da7/db0/fee zero size 2024-09-20T19:06:06.526 INFO:tasks.workunit.client.0.smithi027.stdout:0/776: write d2/d20/fd3 [355055,11015] 0 2024-09-20T19:06:06.528 INFO:tasks.workunit.client.1.smithi098.stdout:2/927: mkdir d3/d16/d1a/d128 0 2024-09-20T19:06:06.529 INFO:tasks.workunit.client.0.smithi027.stdout:0/777: stat d2/d48/d6b/d79/d84/d1b/f5f 0 2024-09-20T19:06:06.529 INFO:tasks.workunit.client.0.smithi027.stdout:5/784: rename d4/da/de/d3e/d69/d75/f20 to d4/d1f/d28/ffa 0 2024-09-20T19:06:06.531 INFO:tasks.workunit.client.0.smithi027.stdout:1/772: rmdir d2/d8/d2b/d2d/d73 39 2024-09-20T19:06:06.532 INFO:tasks.workunit.client.1.smithi098.stdout:2/928: creat d3/d16/d1a/d128/f129 x:0 0 0 2024-09-20T19:06:06.535 INFO:tasks.workunit.client.0.smithi027.stdout:2/711: dread d3/d1c/d26/fb5 [0,4194304] 0 2024-09-20T19:06:06.535 INFO:tasks.workunit.client.0.smithi027.stdout:3/790: creat d0/d1/d13/d98/dab/f10c x:0 0 0 2024-09-20T19:06:06.538 INFO:tasks.workunit.client.1.smithi098.stdout:4/733: dread d3/d7d/f85 [0,4194304] 0 2024-09-20T19:06:06.538 INFO:tasks.workunit.client.0.smithi027.stdout:0/778: readlink d2/l98 0 2024-09-20T19:06:06.538 INFO:tasks.workunit.client.0.smithi027.stdout:2/712: chown d3/de/l58 197984 1 2024-09-20T19:06:06.539 INFO:tasks.workunit.client.0.smithi027.stdout:3/791: write d0/d1/d13/d98/dab/f10c [437698,28836] 0 2024-09-20T19:06:06.540 INFO:tasks.workunit.client.1.smithi098.stdout:2/929: dwrite d3/f12 [4194304,4194304] 0 2024-09-20T19:06:06.542 INFO:tasks.workunit.client.0.smithi027.stdout:1/773: dwrite d2/d8/d74/d84/fdd [0,4194304] 0 2024-09-20T19:06:06.543 INFO:tasks.workunit.client.0.smithi027.stdout:0/779: write d2/d49/ded/f10e [810578,130192] 0 2024-09-20T19:06:06.543 INFO:tasks.workunit.client.1.smithi098.stdout:4/734: creat d3/d6/d8c/de7/df4/d1e/d2a/d45/d91/f101 x:0 0 0 2024-09-20T19:06:06.544 INFO:tasks.workunit.client.0.smithi027.stdout:5/785: creat d4/da/de/d3e/db7/dc2/d87/df0/ffb x:0 0 0 2024-09-20T19:06:06.545 INFO:tasks.workunit.client.1.smithi098.stdout:2/930: stat d3/d16/d1d/d2b/l3f 0 2024-09-20T19:06:06.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/735: write d3/d6/d8c/de7/df4/f62 [325262,7752] 0 2024-09-20T19:06:06.550 INFO:tasks.workunit.client.0.smithi027.stdout:7/704: dread d3/d24/fc5 [0,4194304] 0 2024-09-20T19:06:06.551 INFO:tasks.workunit.client.0.smithi027.stdout:7/705: stat d3/d8/d1c/d61/fa1 0 2024-09-20T19:06:06.551 INFO:tasks.workunit.client.0.smithi027.stdout:7/706: read d3/d8/d26/f71 [1039016,29438] 0 2024-09-20T19:06:06.553 INFO:tasks.workunit.client.0.smithi027.stdout:9/856: getdents d0/d9/df/d1b/d9c/d4f/dd5 0 2024-09-20T19:06:06.553 INFO:tasks.workunit.client.0.smithi027.stdout:7/707: fdatasync d3/d8/d26/d45/f52 0 2024-09-20T19:06:06.556 INFO:tasks.workunit.client.1.smithi098.stdout:2/931: creat d3/d16/d1d/d2b/d46/dc0/de3/f12a x:0 0 0 2024-09-20T19:06:06.557 INFO:tasks.workunit.client.0.smithi027.stdout:1/774: creat d2/d8/d74/d9a/ffa x:0 0 0 2024-09-20T19:06:06.558 INFO:tasks.workunit.client.0.smithi027.stdout:7/708: dread d3/d8/d26/d45/d56/dec/dc/f87 [0,4194304] 0 2024-09-20T19:06:06.558 INFO:tasks.workunit.client.0.smithi027.stdout:5/786: creat d4/da/de/d3e/dd5/ffc x:0 0 0 2024-09-20T19:06:06.560 INFO:tasks.workunit.client.1.smithi098.stdout:4/736: link d3/d5e/d9f/da7/ff3 d3/d7d/da3/d3c/d6b/d73/d98/de0/f102 0 2024-09-20T19:06:06.563 INFO:tasks.workunit.client.0.smithi027.stdout:3/792: creat d0/d19/d54/d7a/f10d x:0 0 0 2024-09-20T19:06:06.565 INFO:tasks.workunit.client.0.smithi027.stdout:4/688: sync 2024-09-20T19:06:06.566 INFO:tasks.workunit.client.0.smithi027.stdout:5/787: symlink d4/da/de/d3e/d69/d75/db4/lfd 0 2024-09-20T19:06:06.568 INFO:tasks.workunit.client.0.smithi027.stdout:5/788: truncate d4/d6c/d6f/fe2 957056 0 2024-09-20T19:06:06.568 INFO:tasks.workunit.client.0.smithi027.stdout:2/713: creat d3/d1c/fe1 x:0 0 0 2024-09-20T19:06:06.570 INFO:tasks.workunit.client.0.smithi027.stdout:9/857: truncate d0/d9/df/d1c/d6a/d6d/dd/d58/fd1 978907 0 2024-09-20T19:06:06.571 INFO:tasks.workunit.client.1.smithi098.stdout:2/932: dread d3/df/f7a [0,4194304] 0 2024-09-20T19:06:06.571 INFO:tasks.workunit.client.0.smithi027.stdout:1/775: symlink d2/d8/d3b/d44/d93/df3/lfb 0 2024-09-20T19:06:06.573 INFO:tasks.workunit.client.0.smithi027.stdout:3/793: creat d0/d1/d13/d15/d6f/d7f/f10e x:0 0 0 2024-09-20T19:06:06.574 INFO:tasks.workunit.client.0.smithi027.stdout:7/709: mknod d3/d8/d26/d45/d56/dec/dc/da9/ddd/cf1 0 2024-09-20T19:06:06.575 INFO:tasks.workunit.client.0.smithi027.stdout:7/710: write d3/d8/d26/d45/d56/dec/d51/fcd [248129,80749] 0 2024-09-20T19:06:06.576 INFO:tasks.workunit.client.0.smithi027.stdout:4/689: mkdir d5/d13/d7c/dd5 0 2024-09-20T19:06:06.576 INFO:tasks.workunit.client.0.smithi027.stdout:7/711: write d3/d8/d26/f73 [705616,86005] 0 2024-09-20T19:06:06.579 INFO:tasks.workunit.client.0.smithi027.stdout:5/789: symlink d4/da/de/d3e/db7/dc2/lfe 0 2024-09-20T19:06:06.580 INFO:tasks.workunit.client.0.smithi027.stdout:9/858: fdatasync d0/d9/df/d1c/fb2 0 2024-09-20T19:06:06.580 INFO:tasks.workunit.client.1.smithi098.stdout:4/737: write d3/d7d/da3/d3c/d6b/d73/d98/db3/f4c [2366179,70788] 0 2024-09-20T19:06:06.581 INFO:tasks.workunit.client.0.smithi027.stdout:4/690: dread d5/d9b/f62 [8388608,4194304] 0 2024-09-20T19:06:06.582 INFO:tasks.workunit.client.0.smithi027.stdout:0/780: truncate d2/d48/d6b/d79/d84/d1b/dc5/f6c 1841667 0 2024-09-20T19:06:06.583 INFO:tasks.workunit.client.0.smithi027.stdout:4/691: fsync d5/d11/d17/d1b/d8d/d26/f47 0 2024-09-20T19:06:06.584 INFO:tasks.workunit.client.1.smithi098.stdout:2/933: getdents d3/d16/d1d/d2b 0 2024-09-20T19:06:06.586 INFO:tasks.workunit.client.1.smithi098.stdout:4/738: creat d3/d6/d8c/de7/df4/d57/d7f/d84/f103 x:0 0 0 2024-09-20T19:06:06.593 INFO:tasks.workunit.client.0.smithi027.stdout:1/776: write d2/f13 [9776043,17181] 0 2024-09-20T19:06:06.594 INFO:tasks.workunit.client.0.smithi027.stdout:5/790: truncate d4/da/fac 1292910 0 2024-09-20T19:06:06.597 INFO:tasks.workunit.client.0.smithi027.stdout:3/794: write d0/d1/d13/d15/d55/f9d [650104,113815] 0 2024-09-20T19:06:06.599 INFO:tasks.workunit.client.1.smithi098.stdout:4/739: getdents d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58 0 2024-09-20T19:06:06.602 INFO:tasks.workunit.client.0.smithi027.stdout:2/714: creat d3/d13/d3c/fe2 x:0 0 0 2024-09-20T19:06:06.603 INFO:tasks.workunit.client.1.smithi098.stdout:4/740: read d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/fdf [3593604,90622] 0 2024-09-20T19:06:06.604 INFO:tasks.workunit.client.1.smithi098.stdout:2/934: dwrite d3/d16/d1d/d2b/d99/ff5 [0,4194304] 0 2024-09-20T19:06:06.607 INFO:tasks.workunit.client.0.smithi027.stdout:7/712: dread d3/f9 [0,4194304] 0 2024-09-20T19:06:06.608 INFO:tasks.workunit.client.0.smithi027.stdout:9/859: write d0/d9/df/d1c/f72 [3944583,14333] 0 2024-09-20T19:06:06.608 INFO:tasks.workunit.client.1.smithi098.stdout:4/741: symlink d3/d6/d8c/de7/l104 0 2024-09-20T19:06:06.609 INFO:tasks.workunit.client.0.smithi027.stdout:7/713: stat d3/d8/d26/d45/d56/dec/l99 0 2024-09-20T19:06:06.610 INFO:tasks.workunit.client.1.smithi098.stdout:4/742: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/db2/lb8 14295872 1 2024-09-20T19:06:06.611 INFO:tasks.workunit.client.0.smithi027.stdout:5/791: mknod d4/d6c/d6f/d92/dc8/cff 0 2024-09-20T19:06:06.615 INFO:tasks.workunit.client.0.smithi027.stdout:6/729: sync 2024-09-20T19:06:06.615 INFO:tasks.workunit.client.0.smithi027.stdout:4/692: creat d5/d13/d7c/dd5/fd6 x:0 0 0 2024-09-20T19:06:06.616 INFO:tasks.workunit.client.1.smithi098.stdout:2/935: fdatasync d3/d16/d1d/f107 0 2024-09-20T19:06:06.616 INFO:tasks.workunit.client.1.smithi098.stdout:4/743: dread d3/d6/faf [0,4194304] 0 2024-09-20T19:06:06.618 INFO:tasks.workunit.client.0.smithi027.stdout:6/730: chown d4/d15/d37/d39 7 1 2024-09-20T19:06:06.619 INFO:tasks.workunit.client.0.smithi027.stdout:4/693: stat d5/d13/d36/d48/d3f/fbf 0 2024-09-20T19:06:06.619 INFO:tasks.workunit.client.1.smithi098.stdout:4/744: fsync d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/f80 0 2024-09-20T19:06:06.620 INFO:tasks.workunit.client.0.smithi027.stdout:0/781: dread d2/d49/ded/df2/fa3 [0,4194304] 0 2024-09-20T19:06:06.621 INFO:tasks.workunit.client.0.smithi027.stdout:5/792: dwrite d4/da/de/d3e/db7/fb9 [0,4194304] 0 2024-09-20T19:06:06.621 INFO:tasks.workunit.client.0.smithi027.stdout:9/860: creat d0/d9/dfb/f11d x:0 0 0 2024-09-20T19:06:06.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/936: unlink d3/d16/d1a/f4b 0 2024-09-20T19:06:06.623 INFO:tasks.workunit.client.0.smithi027.stdout:5/793: readlink d4/da/de/le6 0 2024-09-20T19:06:06.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/745: creat d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab/f105 x:0 0 0 2024-09-20T19:06:06.626 INFO:tasks.workunit.client.1.smithi098.stdout:4/746: dread d3/d6/faf [0,4194304] 0 2024-09-20T19:06:06.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/715: unlink d3/d13/d3c/dce/ddc/cab 0 2024-09-20T19:06:06.628 INFO:tasks.workunit.client.1.smithi098.stdout:2/937: mkdir d3/db0/d69/d127/d12b 0 2024-09-20T19:06:06.635 INFO:tasks.workunit.client.0.smithi027.stdout:2/716: dwrite d3/d1c/d26/d2a/dc2/fd8 [0,4194304] 0 2024-09-20T19:06:06.636 INFO:tasks.workunit.client.0.smithi027.stdout:4/694: rename d5/d9b/f62 to d5/d9b/db0/fd7 0 2024-09-20T19:06:06.637 INFO:tasks.workunit.client.0.smithi027.stdout:5/794: rename d4 to d4/da/de/d3e/dd5/d100 22 2024-09-20T19:06:06.638 INFO:tasks.workunit.client.0.smithi027.stdout:7/714: mkdir d3/d8/d26/d45/d56/dec/d2e/d50/db8/df2 0 2024-09-20T19:06:06.638 INFO:tasks.workunit.client.0.smithi027.stdout:2/717: write d3/d13/f87 [5638966,118607] 0 2024-09-20T19:06:06.639 INFO:tasks.workunit.client.0.smithi027.stdout:4/695: dread - d5/d11/d3d/db4/fd0 zero size 2024-09-20T19:06:06.640 INFO:tasks.workunit.client.0.smithi027.stdout:1/777: dwrite d2/d8/d2b/d2d/d73/f85 [0,4194304] 0 2024-09-20T19:06:06.648 INFO:tasks.workunit.client.0.smithi027.stdout:7/715: creat d3/d5e/ff3 x:0 0 0 2024-09-20T19:06:06.648 INFO:tasks.workunit.client.0.smithi027.stdout:9/861: creat d0/d9/df/d1c/d6a/d6d/f11e x:0 0 0 2024-09-20T19:06:06.648 INFO:tasks.workunit.client.0.smithi027.stdout:2/718: fsync d3/d1c/d31/f4c 0 2024-09-20T19:06:06.651 INFO:tasks.workunit.client.0.smithi027.stdout:1/778: write d2/d61/df8/f49 [1535643,76540] 0 2024-09-20T19:06:06.651 INFO:tasks.workunit.client.0.smithi027.stdout:7/716: chown d3/f6d 29929644 1 2024-09-20T19:06:06.652 INFO:tasks.workunit.client.0.smithi027.stdout:6/731: dread d4/d6/d4b/dca/fd6 [0,4194304] 0 2024-09-20T19:06:06.652 INFO:tasks.workunit.client.1.smithi098.stdout:4/747: write d3/d6/d8c/de7/df4/d1e/f26 [8795027,91480] 0 2024-09-20T19:06:06.654 INFO:tasks.workunit.client.1.smithi098.stdout:4/748: chown d3/d6/d8c/de7/df4/d1e/l9e 1038475473 1 2024-09-20T19:06:06.654 INFO:tasks.workunit.client.0.smithi027.stdout:4/696: write d5/d13/d36/d48/d3f/d4c/f55 [8918358,77298] 0 2024-09-20T19:06:06.655 INFO:tasks.workunit.client.0.smithi027.stdout:7/717: chown d3/d24/c98 14495 1 2024-09-20T19:06:06.656 INFO:tasks.workunit.client.0.smithi027.stdout:3/795: dwrite d0/d1/d5e/d1d/f10a [0,4194304] 0 2024-09-20T19:06:06.657 INFO:tasks.workunit.client.1.smithi098.stdout:3/590: sync 2024-09-20T19:06:06.660 INFO:tasks.workunit.client.0.smithi027.stdout:1/779: creat d2/d8/d3b/de3/ffc x:0 0 0 2024-09-20T19:06:06.660 INFO:tasks.workunit.client.1.smithi098.stdout:3/591: dread - d4/d25/d40/d80/d94/fac zero size 2024-09-20T19:06:06.660 INFO:tasks.workunit.client.1.smithi098.stdout:2/938: dwrite d3/d16/d1d/d2b/d46/d74/d82/fac [0,4194304] 0 2024-09-20T19:06:06.661 INFO:tasks.workunit.client.0.smithi027.stdout:1/780: fsync d2/d8/d41/f72 0 2024-09-20T19:06:06.663 INFO:tasks.workunit.client.0.smithi027.stdout:9/862: symlink d0/d9/df/d1c/d6a/d6d/dd/d66/l11f 0 2024-09-20T19:06:06.668 INFO:tasks.workunit.client.0.smithi027.stdout:2/719: rename d3/d1c/d26/cc0 to d3/d1c/d26/d2a/dc2/ce3 0 2024-09-20T19:06:06.671 INFO:tasks.workunit.client.1.smithi098.stdout:4/749: write d3/d7d/fc0 [3121955,90807] 0 2024-09-20T19:06:06.672 INFO:tasks.workunit.client.0.smithi027.stdout:5/795: truncate d4/da/de/d3e/d69/d6a/fcb 3472810 0 2024-09-20T19:06:06.673 INFO:tasks.workunit.client.1.smithi098.stdout:4/750: write d3/d6/d8c/de7/df4/d1e/d2a/d45/fe8 [413568,130959] 0 2024-09-20T19:06:06.674 INFO:tasks.workunit.client.0.smithi027.stdout:3/796: creat d0/d1/d5e/d1d/d7d/db4/f10f x:0 0 0 2024-09-20T19:06:06.675 INFO:tasks.workunit.client.0.smithi027.stdout:0/782: dread d2/d48/d6b/d79/d84/d1b/f2b [0,4194304] 0 2024-09-20T19:06:06.677 INFO:tasks.workunit.client.0.smithi027.stdout:1/781: mknod d2/d8/d3b/d82/d87/dcf/cfd 0 2024-09-20T19:06:06.677 INFO:tasks.workunit.client.0.smithi027.stdout:3/797: write d0/d1/d5e/d1d/da7/db0/dc7/fe8 [3333054,105582] 0 2024-09-20T19:06:06.678 INFO:tasks.workunit.client.0.smithi027.stdout:9/863: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/f120 x:0 0 0 2024-09-20T19:06:06.678 INFO:tasks.workunit.client.1.smithi098.stdout:2/939: link d3/d16/d1d/f107 d3/d16/d1d/d4f/f12c 0 2024-09-20T19:06:06.679 INFO:tasks.workunit.client.0.smithi027.stdout:9/864: dread - d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/fdd zero size 2024-09-20T19:06:06.681 INFO:tasks.workunit.client.0.smithi027.stdout:6/732: rename d4/f42 to d4/d15/d37/d5a/fee 0 2024-09-20T19:06:06.681 INFO:tasks.workunit.client.0.smithi027.stdout:8/760: sync 2024-09-20T19:06:06.682 INFO:tasks.workunit.client.1.smithi098.stdout:4/751: mkdir d3/d6/d8c/de7/df4/d64/dce/d106 0 2024-09-20T19:06:06.683 INFO:tasks.workunit.client.0.smithi027.stdout:2/720: mkdir d3/d13/d3c/d48/dba/de4 0 2024-09-20T19:06:06.684 INFO:tasks.workunit.client.0.smithi027.stdout:8/761: dread - d2/d2a/df8/dda/ff9 zero size 2024-09-20T19:06:06.685 INFO:tasks.workunit.client.0.smithi027.stdout:3/798: dwrite d0/d1/d5e/d1d/f84 [0,4194304] 0 2024-09-20T19:06:06.689 INFO:tasks.workunit.client.1.smithi098.stdout:3/592: dwrite d4/da/f14 [8388608,4194304] 0 2024-09-20T19:06:06.690 INFO:tasks.workunit.client.0.smithi027.stdout:1/782: symlink d2/d8/d3b/d82/d90/lfe 0 2024-09-20T19:06:06.690 INFO:tasks.workunit.client.0.smithi027.stdout:0/783: dread d2/d48/d6b/d79/fb4 [0,4194304] 0 2024-09-20T19:06:06.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/752: dread d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f63 [0,4194304] 0 2024-09-20T19:06:06.692 INFO:tasks.workunit.client.0.smithi027.stdout:1/783: fsync d2/d61/df8/f1e 0 2024-09-20T19:06:06.692 INFO:tasks.workunit.client.0.smithi027.stdout:7/718: dwrite d3/d8/d26/d45/d56/dec/f13 [0,4194304] 0 2024-09-20T19:06:06.695 INFO:tasks.workunit.client.0.smithi027.stdout:5/796: dwrite d4/da/de/d3e/d69/d75/fad [4194304,4194304] 0 2024-09-20T19:06:06.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/593: mkdir d4/d38/d39/dba 0 2024-09-20T19:06:06.698 INFO:tasks.workunit.client.0.smithi027.stdout:9/865: read d0/d9/df/d1c/d6a/f83 [3149843,41722] 0 2024-09-20T19:06:06.702 INFO:tasks.workunit.client.1.smithi098.stdout:3/594: chown d4/d19/c57 7876926 1 2024-09-20T19:06:06.709 INFO:tasks.workunit.client.1.smithi098.stdout:2/940: write d3/d16/d1d/d2b/d46/d74/f7d [4934833,14062] 0 2024-09-20T19:06:06.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/941: fsync d3/f4c 0 2024-09-20T19:06:06.728 INFO:tasks.workunit.client.1.smithi098.stdout:4/753: truncate d3/d7d/fc0 3740602 0 2024-09-20T19:06:06.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/754: dread d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/fed [0,4194304] 0 2024-09-20T19:06:06.743 INFO:tasks.workunit.client.0.smithi027.stdout:4/697: rename d5/d11/d1a/d2a/l88 to d5/d11/d17/d1b/dd4/ld8 0 2024-09-20T19:06:06.743 INFO:tasks.workunit.client.0.smithi027.stdout:6/733: mknod d4/d15/d37/d5a/cef 0 2024-09-20T19:06:06.745 INFO:tasks.workunit.client.0.smithi027.stdout:9/866: write d0/d9/df/da2/f103 [298331,35076] 0 2024-09-20T19:06:06.745 INFO:tasks.workunit.client.0.smithi027.stdout:3/799: mkdir d0/d1/d13/d15/d6f/d110 0 2024-09-20T19:06:06.749 INFO:tasks.workunit.client.0.smithi027.stdout:3/800: stat d0/d19/d54/d7a/f10d 0 2024-09-20T19:06:06.749 INFO:tasks.workunit.client.0.smithi027.stdout:5/797: rename d4/da/de/d3e/d44/ca0 to d4/d1f/d91/d9b/de8/c101 0 2024-09-20T19:06:06.751 INFO:tasks.workunit.client.0.smithi027.stdout:8/762: creat d2/d2a/df8/d35/ffd x:0 0 0 2024-09-20T19:06:06.751 INFO:tasks.workunit.client.0.smithi027.stdout:4/698: creat d5/d13/d36/d48/d3f/d7e/fd9 x:0 0 0 2024-09-20T19:06:06.754 INFO:tasks.workunit.client.0.smithi027.stdout:9/867: dread - d0/d9/df/d1b/d9c/da4/fac zero size 2024-09-20T19:06:06.756 INFO:tasks.workunit.client.0.smithi027.stdout:2/721: getdents d3/d24 0 2024-09-20T19:06:06.757 INFO:tasks.workunit.client.0.smithi027.stdout:5/798: fsync d4/da/de/d3e/d69/d6a/f8c 0 2024-09-20T19:06:06.758 INFO:tasks.workunit.client.0.smithi027.stdout:1/784: getdents d2/d8/d3b/d44/d93/df3 0 2024-09-20T19:06:06.759 INFO:tasks.workunit.client.0.smithi027.stdout:6/734: dwrite d4/d15/d37/d7a/d8e/fbe [0,4194304] 0 2024-09-20T19:06:06.762 INFO:tasks.workunit.client.0.smithi027.stdout:8/763: write d2/d14/d13/d43/f7f [700311,941] 0 2024-09-20T19:06:06.762 INFO:tasks.workunit.client.0.smithi027.stdout:2/722: dread - d3/d13/d3c/d48/f8f zero size 2024-09-20T19:06:06.763 INFO:tasks.workunit.client.0.smithi027.stdout:7/719: dread d3/d24/f37 [0,4194304] 0 2024-09-20T19:06:06.767 INFO:tasks.workunit.client.0.smithi027.stdout:2/723: stat d3/d24/f38 0 2024-09-20T19:06:06.769 INFO:tasks.workunit.client.0.smithi027.stdout:3/801: dwrite d0/d1/d65/dbb/f10b [0,4194304] 0 2024-09-20T19:06:06.769 INFO:tasks.workunit.client.0.smithi027.stdout:6/735: chown d4/d15/d37/d7a/d46/d53/l6e 12570674 1 2024-09-20T19:06:06.770 INFO:tasks.workunit.client.0.smithi027.stdout:4/699: dwrite d5/d9b/db0/fd7 [8388608,4194304] 0 2024-09-20T19:06:06.771 INFO:tasks.workunit.client.0.smithi027.stdout:1/785: creat d2/d8/d3b/d4b/fff x:0 0 0 2024-09-20T19:06:06.775 INFO:tasks.workunit.client.0.smithi027.stdout:3/802: stat d0/d1/lc 0 2024-09-20T19:06:06.777 INFO:tasks.workunit.client.0.smithi027.stdout:7/720: mknod d3/d8/d26/d45/d56/dec/d2e/d39/cf4 0 2024-09-20T19:06:06.779 INFO:tasks.workunit.client.0.smithi027.stdout:4/700: rmdir d5 39 2024-09-20T19:06:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:3/595: dread d4/d19/f3f [0,4194304] 0 2024-09-20T19:06:06.782 INFO:tasks.workunit.client.1.smithi098.stdout:2/942: dwrite d3/d16/d1d/d2b/d46/f8d [4194304,4194304] 0 2024-09-20T19:06:06.783 INFO:tasks.workunit.client.1.smithi098.stdout:3/596: readlink d4/d38/d39/l82 0 2024-09-20T19:06:06.784 INFO:tasks.workunit.client.0.smithi027.stdout:1/786: read d2/d8/d41/f43 [405966,43465] 0 2024-09-20T19:06:06.786 INFO:tasks.workunit.client.0.smithi027.stdout:3/803: mkdir d0/d1/d65/d100/d111 0 2024-09-20T19:06:06.786 INFO:tasks.workunit.client.1.smithi098.stdout:2/943: symlink d3/d16/d1d/d2b/d99/def/l12d 0 2024-09-20T19:06:06.787 INFO:tasks.workunit.client.1.smithi098.stdout:3/597: mkdir d4/d19/d1d/d2f/d3e/dbb 0 2024-09-20T19:06:06.788 INFO:tasks.workunit.client.1.smithi098.stdout:4/755: rename d3/d6/d8c/de7/df4/d64/dce/d106 to d3/d7d/da3/d3c/d107 0 2024-09-20T19:06:06.789 INFO:tasks.workunit.client.1.smithi098.stdout:2/944: fsync d3/d16/d1d/d2b/d46/f50 0 2024-09-20T19:06:06.791 INFO:tasks.workunit.client.1.smithi098.stdout:2/945: chown d3/d16/d1a/l30 15595 1 2024-09-20T19:06:06.791 INFO:tasks.workunit.client.0.smithi027.stdout:5/799: dwrite d4/d6c/d6f/d92/fc0 [4194304,4194304] 0 2024-09-20T19:06:06.793 INFO:tasks.workunit.client.0.smithi027.stdout:6/736: creat d4/d15/d37/d7a/ff0 x:0 0 0 2024-09-20T19:06:06.794 INFO:tasks.workunit.client.1.smithi098.stdout:4/756: unlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f76 0 2024-09-20T19:06:06.795 INFO:tasks.workunit.client.0.smithi027.stdout:8/764: dwrite d2/d2a/df8/f6f [4194304,4194304] 0 2024-09-20T19:06:06.795 INFO:tasks.workunit.client.0.smithi027.stdout:4/701: truncate d5/d11/d3d/d6e/fae 327349 0 2024-09-20T19:06:06.796 INFO:tasks.workunit.client.0.smithi027.stdout:2/724: dwrite d3/d13/f15 [0,4194304] 0 2024-09-20T19:06:06.797 INFO:tasks.workunit.client.1.smithi098.stdout:3/598: link d4/d19/d1d/d2f/d4e/f90 d4/d19/d1d/d2f/d3e/dbb/fbc 0 2024-09-20T19:06:06.799 INFO:tasks.workunit.client.0.smithi027.stdout:1/787: symlink d2/d8/d3b/de3/l100 0 2024-09-20T19:06:06.800 INFO:tasks.workunit.client.0.smithi027.stdout:2/725: fsync d3/d1c/d26/d2a/dc2/fd8 0 2024-09-20T19:06:06.800 INFO:tasks.workunit.client.1.smithi098.stdout:2/946: read d3/d16/d1d/d2b/fb4 [340179,108696] 0 2024-09-20T19:06:06.805 INFO:tasks.workunit.client.0.smithi027.stdout:2/726: chown d3/d1c/d26/d2a/f85 25287668 1 2024-09-20T19:06:06.806 INFO:tasks.workunit.client.0.smithi027.stdout:1/788: readlink d2/d8/d3b/de3/l100 0 2024-09-20T19:06:06.808 INFO:tasks.workunit.client.0.smithi027.stdout:8/765: mkdir d2/d14/d13/d43/dfe 0 2024-09-20T19:06:06.808 INFO:tasks.workunit.client.0.smithi027.stdout:4/702: rename d5/d11/d3d/l7f to d5/d13/d36/d48/d3f/d7e/lda 0 2024-09-20T19:06:06.810 INFO:tasks.workunit.client.0.smithi027.stdout:9/868: dread d0/d9/df/f2a [0,4194304] 0 2024-09-20T19:06:06.810 INFO:tasks.workunit.client.1.smithi098.stdout:3/599: dread d4/d19/d1d/d2f/f53 [0,4194304] 0 2024-09-20T19:06:06.811 INFO:tasks.workunit.client.0.smithi027.stdout:4/703: fdatasync d5/d11/d17/d1b/d8d/fa7 0 2024-09-20T19:06:06.811 INFO:tasks.workunit.client.1.smithi098.stdout:3/600: chown d4/da/f6c 816843 1 2024-09-20T19:06:06.812 INFO:tasks.workunit.client.0.smithi027.stdout:4/704: dread - d5/d13/d36/d48/d3f/d4c/d52/faa zero size 2024-09-20T19:06:06.812 INFO:tasks.workunit.client.0.smithi027.stdout:2/727: fdatasync d3/de/f46 0 2024-09-20T19:06:06.815 INFO:tasks.workunit.client.1.smithi098.stdout:4/757: link d3/d2e/f67 d3/d7d/da3/d3c/f108 0 2024-09-20T19:06:06.816 INFO:tasks.workunit.client.0.smithi027.stdout:3/804: creat d0/d1/d13/d98/dc3/d104/de3/f112 x:0 0 0 2024-09-20T19:06:06.819 INFO:tasks.workunit.client.1.smithi098.stdout:2/947: fsync d3/d16/d1d/d4f/f12c 0 2024-09-20T19:06:06.822 INFO:tasks.workunit.client.0.smithi027.stdout:8/766: symlink d2/d3/d6/d6d/d75/lff 0 2024-09-20T19:06:06.822 INFO:tasks.workunit.client.1.smithi098.stdout:3/601: truncate d4/d19/d1d/d2f/f66 4832187 0 2024-09-20T19:06:06.822 INFO:tasks.workunit.client.0.smithi027.stdout:9/869: fdatasync d0/f7d 0 2024-09-20T19:06:06.824 INFO:tasks.workunit.client.1.smithi098.stdout:2/948: creat d3/d51/d68/dd7/f12e x:0 0 0 2024-09-20T19:06:06.825 INFO:tasks.workunit.client.0.smithi027.stdout:4/705: mkdir d5/d11/d17/d1b/d8d/ddb 0 2024-09-20T19:06:06.826 INFO:tasks.workunit.client.1.smithi098.stdout:2/949: chown d3/d16/d1d/d2b/c85 25 1 2024-09-20T19:06:06.827 INFO:tasks.workunit.client.1.smithi098.stdout:3/602: unlink d4/d19/l2e 0 2024-09-20T19:06:06.828 INFO:tasks.workunit.client.1.smithi098.stdout:3/603: dread - d4/d38/d48/fb2 zero size 2024-09-20T19:06:06.829 INFO:tasks.workunit.client.1.smithi098.stdout:3/604: dread - d4/d19/fb9 zero size 2024-09-20T19:06:06.829 INFO:tasks.workunit.client.0.smithi027.stdout:5/800: creat d4/da/de/d3e/d69/d75/f102 x:0 0 0 2024-09-20T19:06:06.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/950: mknod d3/d16/d1d/d2b/d101/c12f 0 2024-09-20T19:06:06.831 INFO:tasks.workunit.client.0.smithi027.stdout:7/721: dread d3/f29 [0,4194304] 0 2024-09-20T19:06:06.831 INFO:tasks.workunit.client.0.smithi027.stdout:7/722: fdatasync d3/d5e/fd2 0 2024-09-20T19:06:06.832 INFO:tasks.workunit.client.0.smithi027.stdout:7/723: chown d3/d8/d26/cbd 2 1 2024-09-20T19:06:06.834 INFO:tasks.workunit.client.0.smithi027.stdout:6/737: getdents d4 0 2024-09-20T19:06:06.836 INFO:tasks.workunit.client.0.smithi027.stdout:6/738: write d4/d15/d2c/dcb/fcf [623925,41922] 0 2024-09-20T19:06:06.837 INFO:tasks.workunit.client.0.smithi027.stdout:6/739: fsync d4/d15/d37/d7a/d46/d53/f96 0 2024-09-20T19:06:06.839 INFO:tasks.workunit.client.0.smithi027.stdout:8/767: symlink d2/d3/d6/d21/d33/d79/dcf/l100 0 2024-09-20T19:06:06.841 INFO:tasks.workunit.client.0.smithi027.stdout:3/805: dread d0/d1/f30 [0,4194304] 0 2024-09-20T19:06:06.843 INFO:tasks.workunit.client.1.smithi098.stdout:4/758: write d3/d6/faf [250056,65128] 0 2024-09-20T19:06:06.844 INFO:tasks.workunit.client.0.smithi027.stdout:5/801: unlink d4/da/cbf 0 2024-09-20T19:06:06.846 INFO:tasks.workunit.client.0.smithi027.stdout:7/724: creat d3/d8/d26/d45/dcc/ff5 x:0 0 0 2024-09-20T19:06:06.846 INFO:tasks.workunit.client.0.smithi027.stdout:7/725: readlink d3/d24/l27 0 2024-09-20T19:06:06.847 INFO:tasks.workunit.client.1.smithi098.stdout:4/759: chown d3/d7d/da3/d3c/f108 7229 1 2024-09-20T19:06:06.850 INFO:tasks.workunit.client.0.smithi027.stdout:6/740: symlink d4/d15/d37/d7a/d46/d53/lf1 0 2024-09-20T19:06:06.851 INFO:tasks.workunit.client.0.smithi027.stdout:9/870: mkdir d0/d9/df/d1b/d9c/d121 0 2024-09-20T19:06:06.852 INFO:tasks.workunit.client.1.smithi098.stdout:4/760: mkdir d3/d6/d8c/de7/df4/d109 0 2024-09-20T19:06:06.856 INFO:tasks.workunit.client.1.smithi098.stdout:3/605: dwrite d4/d25/d8d/f9e [0,4194304] 0 2024-09-20T19:06:06.862 INFO:tasks.workunit.client.1.smithi098.stdout:2/951: dwrite d3/db0/f4d [0,4194304] 0 2024-09-20T19:06:06.864 INFO:tasks.workunit.client.1.smithi098.stdout:3/606: symlink d4/d25/d40/d80/d94/lbd 0 2024-09-20T19:06:06.867 INFO:tasks.workunit.client.0.smithi027.stdout:1/789: rename d2/d8/d2b/d2d/d3e to d2/d8/d2b/d5e/d101 0 2024-09-20T19:06:06.868 INFO:tasks.workunit.client.1.smithi098.stdout:3/607: chown d4/d38/d48/fb2 5 1 2024-09-20T19:06:06.868 INFO:tasks.workunit.client.1.smithi098.stdout:3/608: readlink d4/da/l1a 0 2024-09-20T19:06:06.870 INFO:tasks.workunit.client.0.smithi027.stdout:7/726: fsync d3/d8/d26/d45/daa/fb0 0 2024-09-20T19:06:06.873 INFO:tasks.workunit.client.0.smithi027.stdout:6/741: creat d4/d1b/ff2 x:0 0 0 2024-09-20T19:06:06.874 INFO:tasks.workunit.client.0.smithi027.stdout:0/784: sync 2024-09-20T19:06:06.875 INFO:tasks.workunit.client.0.smithi027.stdout:9/871: write d0/d9/df/d1b/d64/f6c [495643,35576] 0 2024-09-20T19:06:06.875 INFO:tasks.workunit.client.0.smithi027.stdout:3/806: write d0/fbd [1475337,59472] 0 2024-09-20T19:06:06.876 INFO:tasks.workunit.client.0.smithi027.stdout:0/785: write d2/d48/f76 [1309186,5182] 0 2024-09-20T19:06:06.876 INFO:tasks.workunit.client.0.smithi027.stdout:4/706: rmdir d5/d11/d17/d1b/da9/dc3 0 2024-09-20T19:06:06.877 INFO:tasks.workunit.client.0.smithi027.stdout:2/728: link d3/d1c/d31/d9e/cac d3/d1c/d26/d2a/dc2/d6f/ce5 0 2024-09-20T19:06:06.879 INFO:tasks.workunit.client.0.smithi027.stdout:5/802: mknod d4/da/de/dda/dee/c103 0 2024-09-20T19:06:06.880 INFO:tasks.workunit.client.0.smithi027.stdout:8/768: rename d2/d3/f83 to d2/d3/d6/d21/d33/d79/d9f/f101 0 2024-09-20T19:06:06.880 INFO:tasks.workunit.client.1.smithi098.stdout:2/952: link d3/d16/d1d/d2b/d99/da2/f108 d3/db0/f130 0 2024-09-20T19:06:06.881 INFO:tasks.workunit.client.0.smithi027.stdout:8/769: fsync d2/d14/f3f 0 2024-09-20T19:06:06.882 INFO:tasks.workunit.client.0.smithi027.stdout:8/770: chown d2/d14/d13/d2e/d6c/d77/cdf 816538093 1 2024-09-20T19:06:06.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/761: write d3/d6/d8c/de7/df4/fe9 [106435,62553] 0 2024-09-20T19:06:06.886 INFO:tasks.workunit.client.0.smithi027.stdout:6/742: symlink d4/d15/d93/dd5/lf3 0 2024-09-20T19:06:06.887 INFO:tasks.workunit.client.1.smithi098.stdout:3/609: write d4/d38/d48/d60/f74 [864442,103482] 0 2024-09-20T19:06:06.889 INFO:tasks.workunit.client.1.smithi098.stdout:4/762: creat d3/d5e/d9f/f10a x:0 0 0 2024-09-20T19:06:06.891 INFO:tasks.workunit.client.1.smithi098.stdout:4/763: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58 2146683656 1 2024-09-20T19:06:06.892 INFO:tasks.workunit.client.1.smithi098.stdout:3/610: dread d4/d19/d1d/d2f/f53 [0,4194304] 0 2024-09-20T19:06:06.898 INFO:tasks.workunit.client.1.smithi098.stdout:4/764: mknod d3/d5e/c10b 0 2024-09-20T19:06:06.898 INFO:tasks.workunit.client.1.smithi098.stdout:2/953: write d3/db0/f6a [233797,5873] 0 2024-09-20T19:06:06.901 INFO:tasks.workunit.client.1.smithi098.stdout:3/611: mknod d4/cbe 0 2024-09-20T19:06:06.905 INFO:tasks.workunit.client.1.smithi098.stdout:2/954: write d3/d16/d1d/d2b/fb4 [1735362,35010] 0 2024-09-20T19:06:06.909 INFO:tasks.workunit.client.1.smithi098.stdout:4/765: write d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f75 [886680,40139] 0 2024-09-20T19:06:06.913 INFO:tasks.workunit.client.1.smithi098.stdout:2/955: dwrite d3/df/d104/f120 [0,4194304] 0 2024-09-20T19:06:06.916 INFO:tasks.workunit.client.1.smithi098.stdout:2/956: rmdir d3/d51/d68/dd7 39 2024-09-20T19:06:06.918 INFO:tasks.workunit.client.1.smithi098.stdout:3/612: dwrite d4/d19/f3f [0,4194304] 0 2024-09-20T19:06:06.918 INFO:tasks.workunit.client.1.smithi098.stdout:4/766: dread d3/f7 [0,4194304] 0 2024-09-20T19:06:06.923 INFO:tasks.workunit.client.1.smithi098.stdout:2/957: rename d3/d16/d1d/d2b/d99/def/l12d to d3/d51/d9f/dbc/d121/l131 0 2024-09-20T19:06:06.926 INFO:tasks.workunit.client.1.smithi098.stdout:2/958: mknod d3/df/d104/d38/c132 0 2024-09-20T19:06:06.928 INFO:tasks.workunit.client.1.smithi098.stdout:4/767: dwrite d3/f100 [0,4194304] 0 2024-09-20T19:06:06.936 INFO:tasks.workunit.client.1.smithi098.stdout:4/768: rename d3/d6/d8c/de7/df4/fd5 to d3/d7d/da3/d3c/d6b/d73/d98/db3/f10c 0 2024-09-20T19:06:06.940 INFO:tasks.workunit.client.1.smithi098.stdout:2/959: write d3/d16/d1d/d2b/d46/d74/f86 [4282347,123669] 0 2024-09-20T19:06:06.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/769: dwrite d3/d6/d8c/de7/df4/d1e/d2a/fd9 [0,4194304] 0 2024-09-20T19:06:06.943 INFO:tasks.workunit.client.1.smithi098.stdout:2/960: chown d3/d16/d1d/d4f/cec 69674 1 2024-09-20T19:06:06.944 INFO:tasks.workunit.client.1.smithi098.stdout:3/613: dread d4/da/f32 [0,4194304] 0 2024-09-20T19:06:06.946 INFO:tasks.workunit.client.1.smithi098.stdout:4/770: unlink d3/d6/d8c/de7/df4/d1e/l94 0 2024-09-20T19:06:06.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/961: symlink d3/d16/d1d/d10a/l133 0 2024-09-20T19:06:06.948 INFO:tasks.workunit.client.1.smithi098.stdout:4/771: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/f63 579335 1 2024-09-20T19:06:06.949 INFO:tasks.workunit.client.1.smithi098.stdout:4/772: chown d3/d5e/l70 393215268 1 2024-09-20T19:06:06.955 INFO:tasks.workunit.client.1.smithi098.stdout:2/962: write d3/df/d104/f7e [1490011,76951] 0 2024-09-20T19:06:06.958 INFO:tasks.workunit.client.1.smithi098.stdout:2/963: rmdir d3/d16/d1d/d2b/d99/def 39 2024-09-20T19:06:06.959 INFO:tasks.workunit.client.1.smithi098.stdout:2/964: write d3/d16/f103 [8102933,109827] 0 2024-09-20T19:06:06.960 INFO:tasks.workunit.client.1.smithi098.stdout:4/773: write d3/d6/d8c/de7/df4/d1e/d2a/d45/fbc [575696,26213] 0 2024-09-20T19:06:06.960 INFO:tasks.workunit.client.1.smithi098.stdout:3/614: dwrite d4/da/f32 [0,4194304] 0 2024-09-20T19:06:06.962 INFO:tasks.workunit.client.0.smithi027.stdout:4/707: mknod d5/d11/d17/d1b/dd4/cdc 0 2024-09-20T19:06:06.962 INFO:tasks.workunit.client.1.smithi098.stdout:3/615: fsync d4/da/fb 0 2024-09-20T19:06:06.963 INFO:tasks.workunit.client.0.smithi027.stdout:7/727: rename d3/d8/d26/d45/d56/dec/d51/f53 to d3/d8/de5/ff6 0 2024-09-20T19:06:06.963 INFO:tasks.workunit.client.0.smithi027.stdout:9/872: chown d0/d9/df/d1b/d9c/l9d 6594 1 2024-09-20T19:06:06.964 INFO:tasks.workunit.client.1.smithi098.stdout:3/616: chown d4/d25/d8d/f9e 0 1 2024-09-20T19:06:06.965 INFO:tasks.workunit.client.0.smithi027.stdout:1/790: creat d2/d8/d74/d84/dca/deb/f102 x:0 0 0 2024-09-20T19:06:06.965 INFO:tasks.workunit.client.0.smithi027.stdout:8/771: creat d2/d3/d6/d6d/d75/f102 x:0 0 0 2024-09-20T19:06:06.966 INFO:tasks.workunit.client.1.smithi098.stdout:2/965: unlink d3/d51/d9f/fc6 0 2024-09-20T19:06:06.969 INFO:tasks.workunit.client.0.smithi027.stdout:4/708: creat d5/d13/d16/fdd x:0 0 0 2024-09-20T19:06:06.971 INFO:tasks.workunit.client.1.smithi098.stdout:2/966: symlink d3/d51/d9f/l134 0 2024-09-20T19:06:06.972 INFO:tasks.workunit.client.0.smithi027.stdout:6/743: dwrite d4/d9c/fd1 [0,4194304] 0 2024-09-20T19:06:06.973 INFO:tasks.workunit.client.0.smithi027.stdout:9/873: write d0/d9/df/d1b/f8 [860517,86138] 0 2024-09-20T19:06:06.974 INFO:tasks.workunit.client.0.smithi027.stdout:5/803: truncate d4/d1f/d28/ff4 3414708 0 2024-09-20T19:06:06.976 INFO:tasks.workunit.client.0.smithi027.stdout:0/786: dread d2/d20/f47 [0,4194304] 0 2024-09-20T19:06:06.976 INFO:tasks.workunit.client.1.smithi098.stdout:2/967: chown d3/d16/d1d/d2b/d46/dc0/c10c 7740294 1 2024-09-20T19:06:06.977 INFO:tasks.workunit.client.0.smithi027.stdout:3/807: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:06:06.977 INFO:tasks.workunit.client.0.smithi027.stdout:1/791: creat d2/d8/d3b/d44/d93/f103 x:0 0 0 2024-09-20T19:06:06.979 INFO:tasks.workunit.client.0.smithi027.stdout:1/792: fsync d2/d8/d3b/d82/fda 0 2024-09-20T19:06:06.979 INFO:tasks.workunit.client.0.smithi027.stdout:3/808: write d0/d1/d5e/f1e [9020168,91122] 0 2024-09-20T19:06:06.980 INFO:tasks.workunit.client.1.smithi098.stdout:3/617: rename d4/d38/f56 to d4/da/fbf 0 2024-09-20T19:06:06.981 INFO:tasks.workunit.client.0.smithi027.stdout:1/793: fdatasync d2/d8/d74/fed 0 2024-09-20T19:06:06.983 INFO:tasks.workunit.client.0.smithi027.stdout:1/794: write d2/d8/f8c [5903212,43243] 0 2024-09-20T19:06:06.989 INFO:tasks.workunit.client.1.smithi098.stdout:4/774: dwrite d3/d6/d8c/de7/df4/f15 [4194304,4194304] 0 2024-09-20T19:06:06.991 INFO:tasks.workunit.client.0.smithi027.stdout:1/795: dwrite d2/d8/d74/d84/dca/deb/f102 [0,4194304] 0 2024-09-20T19:06:06.994 INFO:tasks.workunit.client.1.smithi098.stdout:3/618: truncate d4/d25/f3c 1205768 0 2024-09-20T19:06:06.996 INFO:tasks.workunit.client.1.smithi098.stdout:3/619: chown d4/d19/d1d/d22/la2 4 1 2024-09-20T19:06:06.997 INFO:tasks.workunit.client.1.smithi098.stdout:3/620: chown d4/d19/d1d/cb7 92046 1 2024-09-20T19:06:06.997 INFO:tasks.workunit.client.0.smithi027.stdout:6/744: unlink d4/d15/d37/d5a/d78/dbc/fce 0 2024-09-20T19:06:06.999 INFO:tasks.workunit.client.1.smithi098.stdout:4/775: rename d3/d6/f32 to d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/f10d 0 2024-09-20T19:06:06.999 INFO:tasks.workunit.client.1.smithi098.stdout:4/776: chown d3/d7d/dc4 12 1 2024-09-20T19:06:07.000 INFO:tasks.workunit.client.1.smithi098.stdout:3/621: rmdir d4/d19 39 2024-09-20T19:06:07.002 INFO:tasks.workunit.client.0.smithi027.stdout:7/728: creat d3/ff7 x:0 0 0 2024-09-20T19:06:07.002 INFO:tasks.workunit.client.0.smithi027.stdout:8/772: write d2/d2a/df8/f70 [3902927,92845] 0 2024-09-20T19:06:07.010 INFO:tasks.workunit.client.0.smithi027.stdout:6/745: fdatasync d4/d15/f4f 0 2024-09-20T19:06:07.011 INFO:tasks.workunit.client.0.smithi027.stdout:7/729: mknod d3/d8/de5/cf8 0 2024-09-20T19:06:07.012 INFO:tasks.workunit.client.0.smithi027.stdout:8/773: creat d2/d14/d13/f103 x:0 0 0 2024-09-20T19:06:07.013 INFO:tasks.workunit.client.0.smithi027.stdout:3/809: dwrite d0/d1/d13/d3c/f66 [4194304,4194304] 0 2024-09-20T19:06:07.013 INFO:tasks.workunit.client.0.smithi027.stdout:6/746: symlink d4/d15/d93/dd5/lf4 0 2024-09-20T19:06:07.014 INFO:tasks.workunit.client.0.smithi027.stdout:4/709: getdents d5/d80 0 2024-09-20T19:06:07.015 INFO:tasks.workunit.client.0.smithi027.stdout:7/730: symlink d3/d5e/lf9 0 2024-09-20T19:06:07.016 INFO:tasks.workunit.client.0.smithi027.stdout:8/774: symlink d2/d14/d13/l104 0 2024-09-20T19:06:07.016 INFO:tasks.workunit.client.0.smithi027.stdout:3/810: fsync d0/d1/d13/d64/f7c 0 2024-09-20T19:06:07.019 INFO:tasks.workunit.client.0.smithi027.stdout:6/747: rename d4/d6/f88 to d4/d9c/ff5 0 2024-09-20T19:06:07.019 INFO:tasks.workunit.client.1.smithi098.stdout:2/968: dread d3/fa [0,4194304] 0 2024-09-20T19:06:07.020 INFO:tasks.workunit.client.0.smithi027.stdout:8/775: truncate d2/d3/d6/d6d/d75/feb 781760 0 2024-09-20T19:06:07.021 INFO:tasks.workunit.client.0.smithi027.stdout:4/710: creat d5/d11/d1a/d2a/da3/fde x:0 0 0 2024-09-20T19:06:07.027 INFO:tasks.workunit.client.1.smithi098.stdout:2/969: creat d3/d16/d1a/f135 x:0 0 0 2024-09-20T19:06:07.027 INFO:tasks.workunit.client.0.smithi027.stdout:5/804: dread d4/da/de/d3e/d44/f76 [0,4194304] 0 2024-09-20T19:06:07.027 INFO:tasks.workunit.client.0.smithi027.stdout:7/731: fdatasync d3/d8/d26/d45/daa/fb0 0 2024-09-20T19:06:07.027 INFO:tasks.workunit.client.0.smithi027.stdout:6/748: symlink d4/lf6 0 2024-09-20T19:06:07.028 INFO:tasks.workunit.client.0.smithi027.stdout:5/805: write d4/da/de/d3e/d69/d75/fd9 [179585,109908] 0 2024-09-20T19:06:07.028 INFO:tasks.workunit.client.0.smithi027.stdout:6/749: fdatasync d4/f7 0 2024-09-20T19:06:07.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/970: creat d3/d16/d1a/ded/f136 x:0 0 0 2024-09-20T19:06:07.030 INFO:tasks.workunit.client.0.smithi027.stdout:5/806: truncate d4/da/de/d3e/dd5/ffc 236443 0 2024-09-20T19:06:07.030 INFO:tasks.workunit.client.0.smithi027.stdout:3/811: truncate d0/d1/d13/d15/d55/f96 788678 0 2024-09-20T19:06:07.034 INFO:tasks.workunit.client.1.smithi098.stdout:3/622: write d4/d19/d1d/d2f/f66 [3163898,72997] 0 2024-09-20T19:06:07.036 INFO:tasks.workunit.client.0.smithi027.stdout:8/776: mkdir d2/d14/d13/d105 0 2024-09-20T19:06:07.041 INFO:tasks.workunit.client.0.smithi027.stdout:4/711: mknod d5/d11/d17/d1b/da9/cdf 0 2024-09-20T19:06:07.044 INFO:tasks.workunit.client.0.smithi027.stdout:3/812: dread d0/d1/d13/d15/d55/f6a [0,4194304] 0 2024-09-20T19:06:07.045 INFO:tasks.workunit.client.0.smithi027.stdout:7/732: creat d3/d8/d26/d45/dcc/ffa x:0 0 0 2024-09-20T19:06:07.048 INFO:tasks.workunit.client.1.smithi098.stdout:2/971: mknod d3/d16/d1d/d2b/d101/c137 0 2024-09-20T19:06:07.048 INFO:tasks.workunit.client.1.smithi098.stdout:3/623: dwrite d4/d25/d8d/fab [0,4194304] 0 2024-09-20T19:06:07.048 INFO:tasks.workunit.client.1.smithi098.stdout:2/972: stat d3/db0/l52 0 2024-09-20T19:06:07.050 INFO:tasks.workunit.client.0.smithi027.stdout:5/807: read d4/da/fa5 [499046,62226] 0 2024-09-20T19:06:07.051 INFO:tasks.workunit.client.0.smithi027.stdout:5/808: fsync d4/d1f/d28/f85 0 2024-09-20T19:06:07.051 INFO:tasks.workunit.client.0.smithi027.stdout:4/712: creat d5/d11/d51/fe0 x:0 0 0 2024-09-20T19:06:07.052 INFO:tasks.workunit.client.1.smithi098.stdout:9/715: sync 2024-09-20T19:06:07.052 INFO:tasks.workunit.client.1.smithi098.stdout:4/777: dread d3/d6/d8c/de7/df4/d57/d7f/f8b [0,4194304] 0 2024-09-20T19:06:07.052 INFO:tasks.workunit.client.0.smithi027.stdout:6/750: symlink d4/d15/d37/d7a/lf7 0 2024-09-20T19:06:07.053 INFO:tasks.workunit.client.0.smithi027.stdout:4/713: chown d5/d13/d36/d48/d9f/dc9/d8f/dc5 418328 1 2024-09-20T19:06:07.055 INFO:tasks.workunit.client.0.smithi027.stdout:8/777: creat d2/d14/d13/d105/f106 x:0 0 0 2024-09-20T19:06:07.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/716: rename d4/de/d24/d35/c5e to d4/de/ce7 0 2024-09-20T19:06:07.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/778: truncate d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/fdf 4173452 0 2024-09-20T19:06:07.059 INFO:tasks.workunit.client.1.smithi098.stdout:3/624: rename d4/d38/d48/c76 to d4/d38/d48/cc0 0 2024-09-20T19:06:07.061 INFO:tasks.workunit.client.1.smithi098.stdout:9/717: mkdir d4/de/d48/de8 0 2024-09-20T19:06:07.062 INFO:tasks.workunit.client.0.smithi027.stdout:8/778: unlink d2/d14/d13/db5/fcb 0 2024-09-20T19:06:07.063 INFO:tasks.workunit.client.1.smithi098.stdout:2/973: link d3/df/d104/c40 d3/d16/d96/c138 0 2024-09-20T19:06:07.065 INFO:tasks.workunit.client.1.smithi098.stdout:3/625: creat d4/d19/d1d/d2f/d4e/fc1 x:0 0 0 2024-09-20T19:06:07.066 INFO:tasks.workunit.client.1.smithi098.stdout:2/974: symlink d3/d16/d1a/l139 0 2024-09-20T19:06:07.068 INFO:tasks.workunit.client.0.smithi027.stdout:3/813: rename d0/l3d to d0/d1/l113 0 2024-09-20T19:06:07.068 INFO:tasks.workunit.client.0.smithi027.stdout:3/814: read - d0/d1/d65/dc9/fef zero size 2024-09-20T19:06:07.072 INFO:tasks.workunit.client.0.smithi027.stdout:3/815: unlink d0/d1/d5e/d1d/l31 0 2024-09-20T19:06:07.073 INFO:tasks.workunit.client.1.smithi098.stdout:4/779: link d3/d6/d8c/de7/df4/d1e/l9e d3/d7d/da3/d3c/d6b/d73/d98/l10e 0 2024-09-20T19:06:07.073 INFO:tasks.workunit.client.0.smithi027.stdout:6/751: dread d4/d15/d37/d6a/f8f [0,4194304] 0 2024-09-20T19:06:07.073 INFO:tasks.workunit.client.0.smithi027.stdout:3/816: write d0/d1/f35 [6929635,32258] 0 2024-09-20T19:06:07.074 INFO:tasks.workunit.client.1.smithi098.stdout:4/780: read d3/d4f/f72 [3041096,13111] 0 2024-09-20T19:06:07.079 INFO:tasks.workunit.client.1.smithi098.stdout:3/626: creat d4/d19/d1d/fc2 x:0 0 0 2024-09-20T19:06:07.080 INFO:tasks.workunit.client.0.smithi027.stdout:6/752: dwrite d4/d1b/fd7 [0,4194304] 0 2024-09-20T19:06:07.084 INFO:tasks.workunit.client.1.smithi098.stdout:3/627: symlink d4/da/d7a/lc3 0 2024-09-20T19:06:07.085 INFO:tasks.workunit.client.0.smithi027.stdout:6/753: creat d4/d15/d37/d6a/d7f/ff8 x:0 0 0 2024-09-20T19:06:07.090 INFO:tasks.workunit.client.0.smithi027.stdout:6/754: mknod d4/cf9 0 2024-09-20T19:06:07.093 INFO:tasks.workunit.client.1.smithi098.stdout:3/628: dread d4/d25/f3c [0,4194304] 0 2024-09-20T19:06:07.094 INFO:tasks.workunit.client.1.smithi098.stdout:9/718: write d4/de/f3d [679697,94234] 0 2024-09-20T19:06:07.094 INFO:tasks.workunit.client.0.smithi027.stdout:6/755: truncate d4/d15/d37/d6a/d7f/fac 4543214 0 2024-09-20T19:06:07.095 INFO:tasks.workunit.client.1.smithi098.stdout:3/629: unlink d4/cbe 0 2024-09-20T19:06:07.096 INFO:tasks.workunit.client.0.smithi027.stdout:7/733: dwrite d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f3a [0,4194304] 0 2024-09-20T19:06:07.097 INFO:tasks.workunit.client.0.smithi027.stdout:6/756: dread - d4/d15/d37/d7a/d8e/fc4 zero size 2024-09-20T19:06:07.097 INFO:tasks.workunit.client.1.smithi098.stdout:3/630: symlink d4/d92/lc4 0 2024-09-20T19:06:07.097 INFO:tasks.workunit.client.1.smithi098.stdout:2/975: write d3/fa [4010991,55379] 0 2024-09-20T19:06:07.100 INFO:tasks.workunit.client.0.smithi027.stdout:5/809: dwrite d4/d1f/f74 [4194304,4194304] 0 2024-09-20T19:06:07.105 INFO:tasks.workunit.client.0.smithi027.stdout:8/779: dwrite d2/d3/d6/d21/d33/f5a [4194304,4194304] 0 2024-09-20T19:06:07.113 INFO:tasks.workunit.client.0.smithi027.stdout:8/780: dwrite d2/d2a/df8/d35/fc5 [4194304,4194304] 0 2024-09-20T19:06:07.114 INFO:tasks.workunit.client.0.smithi027.stdout:8/781: truncate d2/d2a/df8/d35/ffd 19731 0 2024-09-20T19:06:07.115 INFO:tasks.workunit.client.0.smithi027.stdout:8/782: chown d2/d14/d13/db5 1684500 1 2024-09-20T19:06:07.116 INFO:tasks.workunit.client.0.smithi027.stdout:8/783: stat d2/d3/d6/d9e 0 2024-09-20T19:06:07.187 INFO:tasks.workunit.client.1.smithi098.stdout:1/623: sync 2024-09-20T19:06:07.188 INFO:tasks.workunit.client.1.smithi098.stdout:7/744: sync 2024-09-20T19:06:07.188 INFO:tasks.workunit.client.1.smithi098.stdout:5/524: sync 2024-09-20T19:06:07.188 INFO:tasks.workunit.client.1.smithi098.stdout:8/752: sync 2024-09-20T19:06:07.188 INFO:tasks.workunit.client.1.smithi098.stdout:6/470: sync 2024-09-20T19:06:07.188 INFO:tasks.workunit.client.1.smithi098.stdout:0/448: sync 2024-09-20T19:06:07.189 INFO:tasks.workunit.client.1.smithi098.stdout:8/753: chown d7/l32 121949 1 2024-09-20T19:06:07.189 INFO:tasks.workunit.client.1.smithi098.stdout:0/449: chown d0/db/d1d/c59 7932 1 2024-09-20T19:06:07.190 INFO:tasks.workunit.client.1.smithi098.stdout:5/525: stat d1/d17/l21 0 2024-09-20T19:06:07.190 INFO:tasks.workunit.client.1.smithi098.stdout:7/745: truncate d3/d76/d7a/dce/fde 339440 0 2024-09-20T19:06:07.191 INFO:tasks.workunit.client.1.smithi098.stdout:3/631: mkdir d4/d19/d1d/d22/dc5 0 2024-09-20T19:06:07.193 INFO:tasks.workunit.client.1.smithi098.stdout:3/632: write d4/da/f14 [736362,90568] 0 2024-09-20T19:06:07.195 INFO:tasks.workunit.client.0.smithi027.stdout:3/817: dwrite d0/d1/d13/f89 [0,4194304] 0 2024-09-20T19:06:07.195 INFO:tasks.workunit.client.1.smithi098.stdout:1/624: fsync d1/f37 0 2024-09-20T19:06:07.197 INFO:tasks.workunit.client.0.smithi027.stdout:7/734: truncate d3/d24/f2c 3007950 0 2024-09-20T19:06:07.200 INFO:tasks.workunit.client.0.smithi027.stdout:5/810: mknod d4/da/de/d3e/d44/c104 0 2024-09-20T19:06:07.200 INFO:tasks.workunit.client.0.smithi027.stdout:5/811: chown d4/fd 9719924 1 2024-09-20T19:06:07.202 INFO:tasks.workunit.client.0.smithi027.stdout:7/735: dread d3/d5e/dc7/fdb [0,4194304] 0 2024-09-20T19:06:07.204 INFO:tasks.workunit.client.1.smithi098.stdout:4/781: dwrite d3/d7d/da3/d3c/fa6 [0,4194304] 0 2024-09-20T19:06:07.206 INFO:tasks.workunit.client.1.smithi098.stdout:4/782: dread - d3/d6/d8c/fec zero size 2024-09-20T19:06:07.208 INFO:tasks.workunit.client.1.smithi098.stdout:2/976: symlink d3/d16/d1d/l13a 0 2024-09-20T19:06:07.210 INFO:tasks.workunit.client.1.smithi098.stdout:0/450: dwrite d0/f57 [0,4194304] 0 2024-09-20T19:06:07.210 INFO:tasks.workunit.client.0.smithi027.stdout:5/812: mkdir d4/da/de/d3e/db7/dc2/d105 0 2024-09-20T19:06:07.211 INFO:tasks.workunit.client.0.smithi027.stdout:3/818: dread d0/d1/d13/d15/db3/ff5 [0,4194304] 0 2024-09-20T19:06:07.218 INFO:tasks.workunit.client.0.smithi027.stdout:6/757: dread d4/d15/d2c/f49 [0,4194304] 0 2024-09-20T19:06:07.222 INFO:tasks.workunit.client.1.smithi098.stdout:3/633: creat d4/d19/d1d/d22/dc5/fc6 x:0 0 0 2024-09-20T19:06:07.222 INFO:tasks.workunit.client.0.smithi027.stdout:8/784: link d2/d14/d13/d43/f5b d2/d2a/df8/d35/f107 0 2024-09-20T19:06:07.222 INFO:tasks.workunit.client.1.smithi098.stdout:3/634: stat d4/da/d50/ca9 0 2024-09-20T19:06:07.224 INFO:tasks.workunit.client.1.smithi098.stdout:3/635: read d4/d25/d8d/f9e [372024,113933] 0 2024-09-20T19:06:07.225 INFO:tasks.workunit.client.0.smithi027.stdout:6/758: dwrite d4/d6/f11 [0,4194304] 0 2024-09-20T19:06:07.225 INFO:tasks.workunit.client.0.smithi027.stdout:5/813: mknod d4/d1f/c106 0 2024-09-20T19:06:07.227 INFO:tasks.workunit.client.1.smithi098.stdout:1/625: dread - d1/d3/d2e/d61/fc8 zero size 2024-09-20T19:06:07.234 INFO:tasks.workunit.client.1.smithi098.stdout:6/471: dread d0/de/d1b/f1f [0,4194304] 0 2024-09-20T19:06:07.235 INFO:tasks.workunit.client.0.smithi027.stdout:6/759: symlink d4/d15/d37/d5a/d78/dbc/lfa 0 2024-09-20T19:06:07.236 INFO:tasks.workunit.client.0.smithi027.stdout:6/760: readlink d4/d6/d4b/l87 0 2024-09-20T19:06:07.236 INFO:tasks.workunit.client.1.smithi098.stdout:2/977: mknod d3/d16/d1d/d2b/d46/d74/d7b/dcb/dd3/c13b 0 2024-09-20T19:06:07.238 INFO:tasks.workunit.client.0.smithi027.stdout:8/785: dwrite d2/d2a/df8/f26 [4194304,4194304] 0 2024-09-20T19:06:07.238 INFO:tasks.workunit.client.0.smithi027.stdout:5/814: mknod d4/da/de/d3e/d44/c107 0 2024-09-20T19:06:07.240 INFO:tasks.workunit.client.1.smithi098.stdout:3/636: symlink d4/da/d7a/lc7 0 2024-09-20T19:06:07.241 INFO:tasks.workunit.client.0.smithi027.stdout:6/761: mknod d4/d15/d37/d7a/d8e/cfb 0 2024-09-20T19:06:07.245 INFO:tasks.workunit.client.0.smithi027.stdout:5/815: creat d4/da/d1a/f108 x:0 0 0 2024-09-20T19:06:07.246 INFO:tasks.workunit.client.0.smithi027.stdout:5/816: chown d4/cb5 478 1 2024-09-20T19:06:07.247 INFO:tasks.workunit.client.0.smithi027.stdout:8/786: mknod d2/d14/d13/db5/c108 0 2024-09-20T19:06:07.249 INFO:tasks.workunit.client.0.smithi027.stdout:6/762: fsync d4/d15/f4f 0 2024-09-20T19:06:07.250 INFO:tasks.workunit.client.0.smithi027.stdout:7/736: write d3/d8/d26/d45/d56/dec/d2e/d39/fe3 [878723,80781] 0 2024-09-20T19:06:07.251 INFO:tasks.workunit.client.0.smithi027.stdout:6/763: chown d4/d15/d37/d6a/fb6 4 1 2024-09-20T19:06:07.253 INFO:tasks.workunit.client.1.smithi098.stdout:7/746: dwrite d3/d10/d16/f79 [4194304,4194304] 0 2024-09-20T19:06:07.263 INFO:tasks.workunit.client.0.smithi027.stdout:3/819: dread d0/d1/d13/d64/f94 [0,4194304] 0 2024-09-20T19:06:07.267 INFO:tasks.workunit.client.0.smithi027.stdout:2/729: sync 2024-09-20T19:06:07.278 INFO:tasks.workunit.client.0.smithi027.stdout:5/817: dread d4/fd [0,4194304] 0 2024-09-20T19:06:07.279 INFO:tasks.workunit.client.0.smithi027.stdout:5/818: chown d4/d6c/d6f/d92/dc8 18594 1 2024-09-20T19:06:07.305 INFO:tasks.workunit.client.1.smithi098.stdout:0/451: dwrite d0/d55/d38/f6c [0,4194304] 0 2024-09-20T19:06:07.306 INFO:tasks.workunit.client.0.smithi027.stdout:7/737: mkdir d3/d8/d26/d45/d56/d8d/dfb 0 2024-09-20T19:06:07.306 INFO:tasks.workunit.client.0.smithi027.stdout:7/738: chown d3/cab 879680 1 2024-09-20T19:06:07.319 INFO:tasks.workunit.client.0.smithi027.stdout:5/819: mkdir d4/d1f/d91/d9b/d109 0 2024-09-20T19:06:07.319 INFO:tasks.workunit.client.0.smithi027.stdout:4/714: sync 2024-09-20T19:06:07.319 INFO:tasks.workunit.client.0.smithi027.stdout:9/874: sync 2024-09-20T19:06:07.319 INFO:tasks.workunit.client.0.smithi027.stdout:0/787: sync 2024-09-20T19:06:07.320 INFO:tasks.workunit.client.0.smithi027.stdout:1/796: sync 2024-09-20T19:06:07.320 INFO:tasks.workunit.client.0.smithi027.stdout:2/730: dread d3/d1c/d26/f57 [0,4194304] 0 2024-09-20T19:06:07.321 INFO:tasks.workunit.client.0.smithi027.stdout:2/731: chown d3/d1c/d31/fb6 0 1 2024-09-20T19:06:07.322 INFO:tasks.workunit.client.0.smithi027.stdout:2/732: chown d3/d1c/d26/cd1 12092585 1 2024-09-20T19:06:07.328 INFO:tasks.workunit.client.0.smithi027.stdout:5/820: unlink d4/da/d1a/f4f 0 2024-09-20T19:06:07.331 INFO:tasks.workunit.client.0.smithi027.stdout:9/875: unlink d0/d9/df/f112 0 2024-09-20T19:06:07.332 INFO:tasks.workunit.client.0.smithi027.stdout:9/876: write d0/d2e/f76 [2574907,30092] 0 2024-09-20T19:06:07.334 INFO:tasks.workunit.client.0.smithi027.stdout:0/788: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7d 1029312 0 2024-09-20T19:06:07.341 INFO:tasks.workunit.client.0.smithi027.stdout:6/764: link d4/d15/d37/d5a/d78/dbc/lfa d4/d15/d37/d7a/d46/d53/lfc 0 2024-09-20T19:06:07.343 INFO:tasks.workunit.client.0.smithi027.stdout:4/715: dread d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:07.344 INFO:tasks.workunit.client.0.smithi027.stdout:4/716: write d5/d13/fa4 [311477,129600] 0 2024-09-20T19:06:07.345 INFO:tasks.workunit.client.1.smithi098.stdout:6/472: write d0/de/d1b/d37/d44/d24/d29/f8d [117611,60633] 0 2024-09-20T19:06:07.346 INFO:tasks.workunit.client.0.smithi027.stdout:4/717: readlink d5/d13/d36/d48/d3f/d4c/d52/d87/d99/l57 0 2024-09-20T19:06:07.347 INFO:tasks.workunit.client.0.smithi027.stdout:4/718: fsync d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fac 0 2024-09-20T19:06:07.348 INFO:tasks.workunit.client.0.smithi027.stdout:4/719: chown d5/lf 31 1 2024-09-20T19:06:07.351 INFO:tasks.workunit.client.1.smithi098.stdout:2/978: dread d3/d16/d1d/fa7 [0,4194304] 0 2024-09-20T19:06:07.355 INFO:tasks.workunit.client.0.smithi027.stdout:0/789: creat d2/d48/d6b/d79/d9f/da4/de6/f11a x:0 0 0 2024-09-20T19:06:07.361 INFO:tasks.workunit.client.1.smithi098.stdout:1/626: dread - d1/d3/df/d4a/d6d/f99 zero size 2024-09-20T19:06:07.363 INFO:tasks.workunit.client.0.smithi027.stdout:0/790: dwrite d2/d20/fd3 [0,4194304] 0 2024-09-20T19:06:07.365 INFO:tasks.workunit.client.0.smithi027.stdout:6/765: unlink d4/d15/d37/f90 0 2024-09-20T19:06:07.369 INFO:tasks.workunit.client.1.smithi098.stdout:4/783: getdents d3/d6/d8c/de7/df4/d1e/d2a/d45/d91 0 2024-09-20T19:06:07.370 INFO:tasks.workunit.client.0.smithi027.stdout:4/720: dread d5/d13/f8a [0,4194304] 0 2024-09-20T19:06:07.371 INFO:tasks.workunit.client.0.smithi027.stdout:9/877: getdents d0/d9/df/d1b/d9c/d4f/dd5 0 2024-09-20T19:06:07.372 INFO:tasks.workunit.client.0.smithi027.stdout:4/721: read d5/f34 [2764201,4411] 0 2024-09-20T19:06:07.373 INFO:tasks.workunit.client.1.smithi098.stdout:2/979: mkdir d3/d16/d1d/d2b/d46/d13c 0 2024-09-20T19:06:07.373 INFO:tasks.workunit.client.1.smithi098.stdout:2/980: chown d3/dd9/fde 20910 1 2024-09-20T19:06:07.379 INFO:tasks.workunit.client.0.smithi027.stdout:6/766: unlink d4/d6/f2a 0 2024-09-20T19:06:07.379 INFO:tasks.workunit.client.0.smithi027.stdout:4/722: dwrite d5/d11/d17/d1b/f91 [0,4194304] 0 2024-09-20T19:06:07.381 INFO:tasks.workunit.client.0.smithi027.stdout:4/723: chown d5/d13/d7c/ld3 140068322 1 2024-09-20T19:06:07.382 INFO:tasks.workunit.client.0.smithi027.stdout:4/724: fsync d5/f37 0 2024-09-20T19:06:07.384 INFO:tasks.workunit.client.1.smithi098.stdout:1/627: dread d1/d3/f1b [4194304,4194304] 0 2024-09-20T19:06:07.385 INFO:tasks.workunit.client.0.smithi027.stdout:4/725: read d5/d13/fa4 [47858,46281] 0 2024-09-20T19:06:07.387 INFO:tasks.workunit.client.1.smithi098.stdout:4/784: symlink d3/d6/d8c/de7/df4/d64/dce/l10f 0 2024-09-20T19:06:07.388 INFO:tasks.workunit.client.1.smithi098.stdout:4/785: chown d3/d6/d8c/de7/df4/d1e 58 1 2024-09-20T19:06:07.389 INFO:tasks.workunit.client.0.smithi027.stdout:0/791: mknod d2/db7/c11b 0 2024-09-20T19:06:07.395 INFO:tasks.workunit.client.1.smithi098.stdout:4/786: dwrite d3/d7d/fc1 [0,4194304] 0 2024-09-20T19:06:07.399 INFO:tasks.workunit.client.0.smithi027.stdout:6/767: mknod d4/d15/d37/d6a/d7f/cfd 0 2024-09-20T19:06:07.400 INFO:tasks.workunit.client.0.smithi027.stdout:4/726: mknod d5/d11/d17/ce1 0 2024-09-20T19:06:07.401 INFO:tasks.workunit.client.0.smithi027.stdout:0/792: readlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/l68 0 2024-09-20T19:06:07.402 INFO:tasks.workunit.client.0.smithi027.stdout:0/793: fdatasync d2/d48/ffe 0 2024-09-20T19:06:07.403 INFO:tasks.workunit.client.1.smithi098.stdout:4/787: mkdir d3/d5e/d110 0 2024-09-20T19:06:07.404 INFO:tasks.workunit.client.0.smithi027.stdout:0/794: read d2/d48/d6b/d79/fd9 [495162,70663] 0 2024-09-20T19:06:07.412 INFO:tasks.workunit.client.1.smithi098.stdout:4/788: symlink d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/dcc/l111 0 2024-09-20T19:06:07.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/789: creat d3/d7d/dc4/dc7/f112 x:0 0 0 2024-09-20T19:06:07.424 INFO:tasks.workunit.client.0.smithi027.stdout:3/820: creat d0/d1/d13/d15/d55/f114 x:0 0 0 2024-09-20T19:06:07.425 INFO:tasks.workunit.client.1.smithi098.stdout:4/790: symlink d3/d7d/da3/d3c/l113 0 2024-09-20T19:06:07.428 INFO:tasks.workunit.client.1.smithi098.stdout:4/791: creat d3/d6/d8c/de7/df4/d57/d7f/d84/f114 x:0 0 0 2024-09-20T19:06:07.430 INFO:tasks.workunit.client.0.smithi027.stdout:3/821: dwrite d0/d1/d13/f37 [0,4194304] 0 2024-09-20T19:06:07.432 INFO:tasks.workunit.client.1.smithi098.stdout:4/792: truncate d3/d7d/fd3 710083 0 2024-09-20T19:06:07.450 INFO:tasks.workunit.client.1.smithi098.stdout:4/793: dread d3/d7d/da3/f56 [0,4194304] 0 2024-09-20T19:06:07.450 INFO:tasks.workunit.client.0.smithi027.stdout:9/878: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f122 x:0 0 0 2024-09-20T19:06:07.451 INFO:tasks.workunit.client.0.smithi027.stdout:4/727: mkdir d5/d11/d1a/d2a/da3/de2 0 2024-09-20T19:06:07.451 INFO:tasks.workunit.client.0.smithi027.stdout:6/768: read d4/d15/f2f [6326082,18851] 0 2024-09-20T19:06:07.452 INFO:tasks.workunit.client.0.smithi027.stdout:6/769: fdatasync d4/d15/d37/d6a/d91/fdd 0 2024-09-20T19:06:07.453 INFO:tasks.workunit.client.0.smithi027.stdout:0/795: mkdir d2/d48/d6b/d79/d84/d1b/d39/d11c 0 2024-09-20T19:06:07.455 INFO:tasks.workunit.client.1.smithi098.stdout:4/794: symlink d3/d6/de3/def/l115 0 2024-09-20T19:06:07.458 INFO:tasks.workunit.client.1.smithi098.stdout:4/795: symlink d3/d6/d8c/de7/l116 0 2024-09-20T19:06:07.460 INFO:tasks.workunit.client.0.smithi027.stdout:1/797: sync 2024-09-20T19:06:07.460 INFO:tasks.workunit.client.1.smithi098.stdout:4/796: chown d3/d6/d8c/de7/df4/d57/d7f/d84/la5 20257904 1 2024-09-20T19:06:07.461 INFO:tasks.workunit.client.0.smithi027.stdout:9/879: creat d0/d9/df/d1b/d9c/d4f/d8d/da0/f123 x:0 0 0 2024-09-20T19:06:07.461 INFO:tasks.workunit.client.0.smithi027.stdout:6/770: mkdir d4/d6/d4b/dca/dfe 0 2024-09-20T19:06:07.461 INFO:tasks.workunit.client.0.smithi027.stdout:4/728: dread d5/d13/d36/d48/d9f/dc9/f8c [0,4194304] 0 2024-09-20T19:06:07.463 INFO:tasks.workunit.client.0.smithi027.stdout:3/822: fdatasync d0/d1/d13/d15/d55/f5f 0 2024-09-20T19:06:07.465 INFO:tasks.workunit.client.0.smithi027.stdout:1/798: rename d2/d8/d3b/d4b/f8f to d2/d8/d2b/d5e/d101/f104 0 2024-09-20T19:06:07.466 INFO:tasks.workunit.client.0.smithi027.stdout:4/729: fsync d5/d9b/db0/fba 0 2024-09-20T19:06:07.467 INFO:tasks.workunit.client.0.smithi027.stdout:6/771: creat d4/d15/d37/d6a/d91/fff x:0 0 0 2024-09-20T19:06:07.468 INFO:tasks.workunit.client.0.smithi027.stdout:3/823: mkdir d0/d1/d65/dc9/d115 0 2024-09-20T19:06:07.469 INFO:tasks.workunit.client.0.smithi027.stdout:3/824: dread - d0/d1/d13/d98/dc3/d104/f101 zero size 2024-09-20T19:06:07.471 INFO:tasks.workunit.client.0.smithi027.stdout:4/730: mkdir d5/d11/d17/d1b/dd4/de3 0 2024-09-20T19:06:07.471 INFO:tasks.workunit.client.0.smithi027.stdout:3/825: write d0/d1/d13/d98/dc3/da2/f103 [840170,34737] 0 2024-09-20T19:06:07.473 INFO:tasks.workunit.client.0.smithi027.stdout:9/880: link d0/d9/df/d1b/d9c/d5a/f82 d0/d9/df/da2/de9/f124 0 2024-09-20T19:06:07.474 INFO:tasks.workunit.client.0.smithi027.stdout:1/799: unlink d2/d8/d3b/d44/ld7 0 2024-09-20T19:06:07.478 INFO:tasks.workunit.client.0.smithi027.stdout:6/772: dwrite d4/d9c/ff5 [0,4194304] 0 2024-09-20T19:06:07.479 INFO:tasks.workunit.client.0.smithi027.stdout:1/800: fdatasync d2/d8/d2b/f9d 0 2024-09-20T19:06:07.483 INFO:tasks.workunit.client.0.smithi027.stdout:4/731: link d5/d13/d7c/f9c d5/d11/d1a/d2a/fe4 0 2024-09-20T19:06:07.483 INFO:tasks.workunit.client.0.smithi027.stdout:9/881: truncate d0/d9/df/d1c/d6a/d9a/fb7 1685646 0 2024-09-20T19:06:07.484 INFO:tasks.workunit.client.0.smithi027.stdout:8/787: dwrite d2/d2a/df8/d35/f107 [4194304,4194304] 0 2024-09-20T19:06:07.484 INFO:tasks.workunit.client.0.smithi027.stdout:7/739: write d3/d8/d26/d45/d56/dec/f44 [3336590,119877] 0 2024-09-20T19:06:07.486 INFO:tasks.workunit.client.0.smithi027.stdout:6/773: creat d4/d6/d4b/d7c/f100 x:0 0 0 2024-09-20T19:06:07.488 INFO:tasks.workunit.client.0.smithi027.stdout:3/826: dread d0/f47 [0,4194304] 0 2024-09-20T19:06:07.494 INFO:tasks.workunit.client.0.smithi027.stdout:6/774: creat d4/d15/d37/d7a/d46/d53/f101 x:0 0 0 2024-09-20T19:06:07.497 INFO:tasks.workunit.client.0.smithi027.stdout:9/882: dwrite d0/d9/ff1 [0,4194304] 0 2024-09-20T19:06:07.497 INFO:tasks.workunit.client.0.smithi027.stdout:6/775: chown d4/d15/d37/d7a/d46/d53/l6e 1180167580 1 2024-09-20T19:06:07.498 INFO:tasks.workunit.client.0.smithi027.stdout:9/883: dread - d0/d9/df/d1b/fe4 zero size 2024-09-20T19:06:07.500 INFO:tasks.workunit.client.0.smithi027.stdout:4/732: dread d5/d13/d36/d48/d3f/d4c/d52/fa2 [0,4194304] 0 2024-09-20T19:06:07.500 INFO:tasks.workunit.client.0.smithi027.stdout:1/801: getdents d2/d8 0 2024-09-20T19:06:07.505 INFO:tasks.workunit.client.0.smithi027.stdout:6/776: unlink d4/d15/d37/d7a/d33/f4d 0 2024-09-20T19:06:07.505 INFO:tasks.workunit.client.1.smithi098.stdout:3/637: unlink d4/d19/c57 0 2024-09-20T19:06:07.508 INFO:tasks.workunit.client.0.smithi027.stdout:4/733: creat d5/d11/d17/d1b/d8d/fe5 x:0 0 0 2024-09-20T19:06:07.509 INFO:tasks.workunit.client.0.smithi027.stdout:9/884: rename d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/cdf to d0/d9/df/d1b/d9c/d4f/d8d/da0/dfa/c125 0 2024-09-20T19:06:07.510 INFO:tasks.workunit.client.0.smithi027.stdout:4/734: stat d5/d13/d36/d48/d3f/f86 0 2024-09-20T19:06:07.511 INFO:tasks.workunit.client.1.smithi098.stdout:3/638: truncate d4/da/f51 4542708 0 2024-09-20T19:06:07.511 INFO:tasks.workunit.client.0.smithi027.stdout:1/802: dwrite d2/d8/d3b/d4b/f2c [0,4194304] 0 2024-09-20T19:06:07.511 INFO:tasks.workunit.client.0.smithi027.stdout:4/735: chown d5/d11/d1a/f81 88781159 1 2024-09-20T19:06:07.513 INFO:tasks.workunit.client.0.smithi027.stdout:1/803: chown d2/d8/d2b/d2d/l94 0 1 2024-09-20T19:06:07.514 INFO:tasks.workunit.client.1.smithi098.stdout:3/639: creat d4/d19/d1d/d2f/fc8 x:0 0 0 2024-09-20T19:06:07.519 INFO:tasks.workunit.client.0.smithi027.stdout:9/885: mknod d0/c126 0 2024-09-20T19:06:07.521 INFO:tasks.workunit.client.0.smithi027.stdout:8/788: dread d2/d3/d6/f3e [0,4194304] 0 2024-09-20T19:06:07.521 INFO:tasks.workunit.client.0.smithi027.stdout:6/777: link d4/d15/d37/d7a/lf7 d4/d15/d37/d6a/d7f/l102 0 2024-09-20T19:06:07.523 INFO:tasks.workunit.client.0.smithi027.stdout:4/736: dwrite d5/d11/d1a/d2a/fc2 [0,4194304] 0 2024-09-20T19:06:07.524 INFO:tasks.workunit.client.0.smithi027.stdout:2/733: truncate d3/d13/f25 3589166 0 2024-09-20T19:06:07.527 INFO:tasks.workunit.client.0.smithi027.stdout:6/778: chown d4/d15/d37/d7a/d46/d53/l6e 1203461694 1 2024-09-20T19:06:07.527 INFO:tasks.workunit.client.0.smithi027.stdout:1/804: dwrite d2/d8/d3b/d4b/fff [0,4194304] 0 2024-09-20T19:06:07.528 INFO:tasks.workunit.client.0.smithi027.stdout:8/789: creat d2/def/f109 x:0 0 0 2024-09-20T19:06:07.529 INFO:tasks.workunit.client.0.smithi027.stdout:6/779: write d4/d6/d4b/fc2 [499171,46731] 0 2024-09-20T19:06:07.530 INFO:tasks.workunit.client.0.smithi027.stdout:9/886: mknod d0/d9/df/d1b/d9c/d4f/c127 0 2024-09-20T19:06:07.531 INFO:tasks.workunit.client.1.smithi098.stdout:0/452: dwrite d0/d55/d38/f39 [4194304,4194304] 0 2024-09-20T19:06:07.533 INFO:tasks.workunit.client.0.smithi027.stdout:1/805: rmdir d2/d8/d3b/d44/d96 39 2024-09-20T19:06:07.535 INFO:tasks.workunit.client.0.smithi027.stdout:8/790: rmdir d2/d2a/df8/d36 39 2024-09-20T19:06:07.540 INFO:tasks.workunit.client.1.smithi098.stdout:6/473: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:06:07.541 INFO:tasks.workunit.client.0.smithi027.stdout:5/821: truncate d4/da/de/d3e/fec 2307632 0 2024-09-20T19:06:07.542 INFO:tasks.workunit.client.0.smithi027.stdout:6/780: creat d4/d1b/f103 x:0 0 0 2024-09-20T19:06:07.543 INFO:tasks.workunit.client.0.smithi027.stdout:6/781: fsync d4/d15/d37/d7a/f58 0 2024-09-20T19:06:07.544 INFO:tasks.workunit.client.1.smithi098.stdout:0/453: creat d0/d55/f88 x:0 0 0 2024-09-20T19:06:07.547 INFO:tasks.workunit.client.0.smithi027.stdout:9/887: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f128 x:0 0 0 2024-09-20T19:06:07.549 INFO:tasks.workunit.client.0.smithi027.stdout:9/888: stat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb 0 2024-09-20T19:06:07.550 INFO:tasks.workunit.client.1.smithi098.stdout:0/454: creat d0/d6/f89 x:0 0 0 2024-09-20T19:06:07.550 INFO:tasks.workunit.client.1.smithi098.stdout:6/474: dwrite d0/de/d1b/d37/d44/dc/fd [0,4194304] 0 2024-09-20T19:06:07.551 INFO:tasks.workunit.client.1.smithi098.stdout:7/747: truncate d3/d10/d16/f84 4150078 0 2024-09-20T19:06:07.552 INFO:tasks.workunit.client.1.smithi098.stdout:0/455: write d0/db/f5d [1571535,112003] 0 2024-09-20T19:06:07.554 INFO:tasks.workunit.client.1.smithi098.stdout:0/456: readlink d0/d6/d19/d4f/l85 0 2024-09-20T19:06:07.558 INFO:tasks.workunit.client.1.smithi098.stdout:6/475: dread d0/de/d1b/d37/d44/dc/fd [0,4194304] 0 2024-09-20T19:06:07.560 INFO:tasks.workunit.client.0.smithi027.stdout:5/822: symlink d4/d1f/d91/d9b/l10a 0 2024-09-20T19:06:07.561 INFO:tasks.workunit.client.1.smithi098.stdout:7/748: dread d3/d10/d16/d17/d33/d37/da0/f46 [0,4194304] 0 2024-09-20T19:06:07.562 INFO:tasks.workunit.client.1.smithi098.stdout:0/457: fdatasync d0/d6/f12 0 2024-09-20T19:06:07.564 INFO:tasks.workunit.client.0.smithi027.stdout:6/782: creat d4/dc7/f104 x:0 0 0 2024-09-20T19:06:07.565 INFO:tasks.workunit.client.0.smithi027.stdout:2/734: link d3/d1c/d26/d2a/f7d d3/d13/d3c/dce/fe6 0 2024-09-20T19:06:07.567 INFO:tasks.workunit.client.0.smithi027.stdout:2/735: dread - d3/d13/d3c/d48/dba/fcb zero size 2024-09-20T19:06:07.567 INFO:tasks.workunit.client.0.smithi027.stdout:9/889: mknod d0/d9/dfb/c129 0 2024-09-20T19:06:07.569 INFO:tasks.workunit.client.0.smithi027.stdout:8/791: creat d2/d14/d13/d43/dfe/f10a x:0 0 0 2024-09-20T19:06:07.571 INFO:tasks.workunit.client.1.smithi098.stdout:7/749: rename d3/d10/d16/d17/d33/d1f/d28/d66/f8e to d3/d76/d7a/fee 0 2024-09-20T19:06:07.571 INFO:tasks.workunit.client.0.smithi027.stdout:6/783: dwrite d4/d9c/ff5 [0,4194304] 0 2024-09-20T19:06:07.572 INFO:tasks.workunit.client.1.smithi098.stdout:7/750: chown d3/d10/d16/d17/d33/d1f/c30 447 1 2024-09-20T19:06:07.574 INFO:tasks.workunit.client.0.smithi027.stdout:6/784: read d4/d15/f9e [886216,78568] 0 2024-09-20T19:06:07.577 INFO:tasks.workunit.client.1.smithi098.stdout:2/981: dwrite d3/d16/d1d/d2b/d46/dc0/de3/fea [0,4194304] 0 2024-09-20T19:06:07.579 INFO:tasks.workunit.client.0.smithi027.stdout:2/736: mkdir d3/d13/d3c/de7 0 2024-09-20T19:06:07.580 INFO:tasks.workunit.client.0.smithi027.stdout:2/737: stat d3/d13/d3c/fe2 0 2024-09-20T19:06:07.581 INFO:tasks.workunit.client.1.smithi098.stdout:0/458: symlink d0/d7d/d83/l8a 0 2024-09-20T19:06:07.582 INFO:tasks.workunit.client.0.smithi027.stdout:2/738: write d3/d1c/d26/d2a/dc2/fd8 [424468,55421] 0 2024-09-20T19:06:07.583 INFO:tasks.workunit.client.0.smithi027.stdout:2/739: read d3/d13/f15 [1390454,74548] 0 2024-09-20T19:06:07.584 INFO:tasks.workunit.client.0.smithi027.stdout:2/740: fdatasync d3/d1c/fe1 0 2024-09-20T19:06:07.584 INFO:tasks.workunit.client.0.smithi027.stdout:5/823: rename d4/da/de/dda to d4/da/de/d3e/d10b 0 2024-09-20T19:06:07.585 INFO:tasks.workunit.client.0.smithi027.stdout:8/792: rename d2/d3/d6/de0 to d2/d3/d6/de0/d10b 22 2024-09-20T19:06:07.586 INFO:tasks.workunit.client.0.smithi027.stdout:2/741: fsync d3/d13/f2b 0 2024-09-20T19:06:07.587 INFO:tasks.workunit.client.0.smithi027.stdout:2/742: fsync d3/f78 0 2024-09-20T19:06:07.588 INFO:tasks.workunit.client.0.smithi027.stdout:5/824: write d4/da/de/d3e/d44/fa6 [5247082,79631] 0 2024-09-20T19:06:07.588 INFO:tasks.workunit.client.0.smithi027.stdout:6/785: write d4/d15/d37/d7a/f77 [176762,29917] 0 2024-09-20T19:06:07.590 INFO:tasks.workunit.client.0.smithi027.stdout:6/786: read d4/d9c/ff5 [669764,23682] 0 2024-09-20T19:06:07.592 INFO:tasks.workunit.client.1.smithi098.stdout:2/982: creat d3/d16/d1d/d2b/d46/dc0/de3/f13d x:0 0 0 2024-09-20T19:06:07.595 INFO:tasks.workunit.client.0.smithi027.stdout:8/793: creat d2/d3/d9a/f10c x:0 0 0 2024-09-20T19:06:07.595 INFO:tasks.workunit.client.0.smithi027.stdout:8/794: chown d2/def 6 1 2024-09-20T19:06:07.597 INFO:tasks.workunit.client.0.smithi027.stdout:5/825: creat d4/d1f/d7f/da4/dcf/f10c x:0 0 0 2024-09-20T19:06:07.599 INFO:tasks.workunit.client.0.smithi027.stdout:2/743: write d3/d1c/d26/d2a/f5d [317432,26554] 0 2024-09-20T19:06:07.599 INFO:tasks.workunit.client.1.smithi098.stdout:2/983: symlink d3/d16/d1d/d2b/l13e 0 2024-09-20T19:06:07.600 INFO:tasks.workunit.client.0.smithi027.stdout:2/744: readlink d3/d24/d89/l9b 0 2024-09-20T19:06:07.602 INFO:tasks.workunit.client.0.smithi027.stdout:6/787: mkdir d4/d15/d37/d6a/dbf/d105 0 2024-09-20T19:06:07.606 INFO:tasks.workunit.client.0.smithi027.stdout:2/745: creat d3/d13/d3c/dce/ddc/fe8 x:0 0 0 2024-09-20T19:06:07.609 INFO:tasks.workunit.client.1.smithi098.stdout:2/984: getdents d3/d16/d1d/d2b/d46/d74 0 2024-09-20T19:06:07.611 INFO:tasks.workunit.client.0.smithi027.stdout:5/826: mknod d4/da/de/d3e/db7/dc2/d105/c10d 0 2024-09-20T19:06:07.612 INFO:tasks.workunit.client.0.smithi027.stdout:2/746: symlink d3/d96/le9 0 2024-09-20T19:06:07.612 INFO:tasks.workunit.client.0.smithi027.stdout:2/747: dread - d3/d1c/d26/d2a/dc2/fd7 zero size 2024-09-20T19:06:07.614 INFO:tasks.workunit.client.0.smithi027.stdout:2/748: truncate d3/d1c/d26/d2a/dc2/d6f/fa0 4627687 0 2024-09-20T19:06:07.615 INFO:tasks.workunit.client.0.smithi027.stdout:5/827: creat d4/da/de/d3e/db7/dc2/f10e x:0 0 0 2024-09-20T19:06:07.616 INFO:tasks.workunit.client.0.smithi027.stdout:2/749: dread - d3/d1c/d26/d2a/fde zero size 2024-09-20T19:06:07.616 INFO:tasks.workunit.client.0.smithi027.stdout:8/795: getdents d2/d14/d13/d105 0 2024-09-20T19:06:07.620 INFO:tasks.workunit.client.0.smithi027.stdout:2/750: mkdir d3/d1c/dea 0 2024-09-20T19:06:07.621 INFO:tasks.workunit.client.1.smithi098.stdout:2/985: dread d3/df/d104/d38/f44 [0,4194304] 0 2024-09-20T19:06:07.622 INFO:tasks.workunit.client.1.smithi098.stdout:2/986: chown d3/db0/d69/lf0 350805441 1 2024-09-20T19:06:07.623 INFO:tasks.workunit.client.0.smithi027.stdout:8/796: link d2/d3/d6/d21/f28 d2/d3/d6/d21/d33/d79/dcf/dd1/f10d 0 2024-09-20T19:06:07.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/751: rename d3/d13/d3c/dce/fca to d3/feb 0 2024-09-20T19:06:07.630 INFO:tasks.workunit.client.0.smithi027.stdout:2/752: creat d3/d1c/d31/d9e/fec x:0 0 0 2024-09-20T19:06:07.631 INFO:tasks.workunit.client.0.smithi027.stdout:8/797: link d2/d2a/df8/d36/f61 d2/d14/d13/d2e/f10e 0 2024-09-20T19:06:07.632 INFO:tasks.workunit.client.0.smithi027.stdout:2/753: creat d3/de/d34/fed x:0 0 0 2024-09-20T19:06:07.634 INFO:tasks.workunit.client.0.smithi027.stdout:8/798: mkdir d2/d3/d6/d21/d80/d10f 0 2024-09-20T19:06:07.636 INFO:tasks.workunit.client.0.smithi027.stdout:8/799: symlink d2/l110 0 2024-09-20T19:06:07.638 INFO:tasks.workunit.client.0.smithi027.stdout:1/806: mknod d2/d8/d74/d9a/c105 0 2024-09-20T19:06:07.640 INFO:tasks.workunit.client.0.smithi027.stdout:1/807: symlink d2/d8/d3b/d82/d87/l106 0 2024-09-20T19:06:07.641 INFO:tasks.workunit.client.0.smithi027.stdout:1/808: dread - d2/d8/d2b/f9d zero size 2024-09-20T19:06:07.642 INFO:tasks.workunit.client.0.smithi027.stdout:8/800: link d2/d3/d6/d6d/d75/fad d2/d14/d13/f111 0 2024-09-20T19:06:07.643 INFO:tasks.workunit.client.0.smithi027.stdout:8/801: read - d2/d14/d13/d2e/d6c/fc1 zero size 2024-09-20T19:06:07.645 INFO:tasks.workunit.client.0.smithi027.stdout:1/809: symlink d2/d8/d74/d9a/da3/dad/l107 0 2024-09-20T19:06:07.647 INFO:tasks.workunit.client.0.smithi027.stdout:2/754: dread d3/feb [0,4194304] 0 2024-09-20T19:06:07.649 INFO:tasks.workunit.client.0.smithi027.stdout:8/802: symlink d2/d14/d13/d72/l112 0 2024-09-20T19:06:07.651 INFO:tasks.workunit.client.0.smithi027.stdout:0/796: rmdir d2/d48/d6b/d79/d84/d1b/d39/d11c 0 2024-09-20T19:06:07.652 INFO:tasks.workunit.client.0.smithi027.stdout:0/797: readlink d2/d48/d6b/d79/d84/l21 0 2024-09-20T19:06:07.660 INFO:tasks.workunit.client.0.smithi027.stdout:7/740: write d3/d8/f96 [282015,59072] 0 2024-09-20T19:06:07.663 INFO:tasks.workunit.client.0.smithi027.stdout:2/755: dread d3/de/d34/f76 [0,4194304] 0 2024-09-20T19:06:07.664 INFO:tasks.workunit.client.0.smithi027.stdout:8/803: dread d2/d3/d6/d21/d33/f74 [0,4194304] 0 2024-09-20T19:06:07.664 INFO:tasks.workunit.client.0.smithi027.stdout:7/741: symlink d3/d8/d26/d45/d56/dec/dc/da9/ddd/lfc 0 2024-09-20T19:06:07.665 INFO:tasks.workunit.client.0.smithi027.stdout:8/804: chown d2/d14/d13/d2e/d6c/d77 92441014 1 2024-09-20T19:06:07.666 INFO:tasks.workunit.client.0.smithi027.stdout:7/742: stat d3/d8/d26/d45/d56/dec/d2e/d49/d8b/cda 0 2024-09-20T19:06:07.666 INFO:tasks.workunit.client.0.smithi027.stdout:2/756: mkdir d3/d13/d3c/d48/dba/de4/dee 0 2024-09-20T19:06:07.669 INFO:tasks.workunit.client.0.smithi027.stdout:2/757: mkdir d3/d2f/def 0 2024-09-20T19:06:07.670 INFO:tasks.workunit.client.1.smithi098.stdout:3/640: truncate d4/f1c 2847157 0 2024-09-20T19:06:07.672 INFO:tasks.workunit.client.0.smithi027.stdout:8/805: dwrite d2/d14/d13/d105/f106 [0,4194304] 0 2024-09-20T19:06:07.672 INFO:tasks.workunit.client.0.smithi027.stdout:2/758: creat d3/d96/ff0 x:0 0 0 2024-09-20T19:06:07.673 INFO:tasks.workunit.client.0.smithi027.stdout:2/759: chown d3/d13/d3c/d48/dba 299 1 2024-09-20T19:06:07.674 INFO:tasks.workunit.client.1.smithi098.stdout:3/641: creat d4/da/d7a/fc9 x:0 0 0 2024-09-20T19:06:07.675 INFO:tasks.workunit.client.0.smithi027.stdout:2/760: write d3/d13/d3c/fe2 [750304,96550] 0 2024-09-20T19:06:07.675 INFO:tasks.workunit.client.0.smithi027.stdout:7/743: getdents d3/d8/d1c/d80/db2 0 2024-09-20T19:06:07.677 INFO:tasks.workunit.client.1.smithi098.stdout:3/642: mknod d4/d19/cca 0 2024-09-20T19:06:07.677 INFO:tasks.workunit.client.0.smithi027.stdout:2/761: read d3/de/f18 [1256171,70041] 0 2024-09-20T19:06:07.678 INFO:tasks.workunit.client.1.smithi098.stdout:3/643: stat d4/d38/d48/f75 0 2024-09-20T19:06:07.682 INFO:tasks.workunit.client.1.smithi098.stdout:3/644: mkdir d4/d38/d97/dcb 0 2024-09-20T19:06:07.683 INFO:tasks.workunit.client.1.smithi098.stdout:3/645: stat d4/d25/d8d/lb3 0 2024-09-20T19:06:07.684 INFO:tasks.workunit.client.1.smithi098.stdout:3/646: write d4/d19/d1d/d2f/f66 [5244483,36860] 0 2024-09-20T19:06:07.692 INFO:tasks.workunit.client.0.smithi027.stdout:7/744: rmdir d3/d8/d1c/d80/db2/dd0 0 2024-09-20T19:06:07.692 INFO:tasks.workunit.client.0.smithi027.stdout:7/745: write d3/f5 [4730989,52488] 0 2024-09-20T19:06:07.694 INFO:tasks.workunit.client.0.smithi027.stdout:2/762: link d3/d13/d3c/cbd d3/d1c/d26/d2a/cf1 0 2024-09-20T19:06:07.695 INFO:tasks.workunit.client.0.smithi027.stdout:2/763: chown d3/d13/d3c/d48/d6a/f72 43876 1 2024-09-20T19:06:07.696 INFO:tasks.workunit.client.1.smithi098.stdout:4/797: link d3/d4f/f72 d3/d7d/da3/d3c/d6b/d73/f117 0 2024-09-20T19:06:07.697 INFO:tasks.workunit.client.1.smithi098.stdout:4/798: chown d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/laa 2 1 2024-09-20T19:06:07.697 INFO:tasks.workunit.client.0.smithi027.stdout:7/746: creat d3/d8/d1c/d80/ffd x:0 0 0 2024-09-20T19:06:07.698 INFO:tasks.workunit.client.1.smithi098.stdout:0/459: unlink d0/d55/c63 0 2024-09-20T19:06:07.699 INFO:tasks.workunit.client.0.smithi027.stdout:2/764: mkdir d3/d1c/d26/df2 0 2024-09-20T19:06:07.701 INFO:tasks.workunit.client.1.smithi098.stdout:4/799: rmdir d3/d4f 39 2024-09-20T19:06:07.701 INFO:tasks.workunit.client.0.smithi027.stdout:3/827: rmdir d0/d1/d5e/d1d 39 2024-09-20T19:06:07.702 INFO:tasks.workunit.client.1.smithi098.stdout:0/460: write d0/d6/f12 [1822140,28685] 0 2024-09-20T19:06:07.703 INFO:tasks.workunit.client.0.smithi027.stdout:7/747: dread d3/d5e/dc7/fdb [0,4194304] 0 2024-09-20T19:06:07.704 INFO:tasks.workunit.client.0.smithi027.stdout:2/765: mkdir d3/d13/d3c/d48/dba/de4/df3 0 2024-09-20T19:06:07.705 INFO:tasks.workunit.client.0.smithi027.stdout:7/748: stat d3/d8/d1c/cdc 0 2024-09-20T19:06:07.705 INFO:tasks.workunit.client.1.smithi098.stdout:3/647: creat d4/d38/d48/fcc x:0 0 0 2024-09-20T19:06:07.708 INFO:tasks.workunit.client.1.smithi098.stdout:0/461: dwrite d0/db/d1d/f4d [0,4194304] 0 2024-09-20T19:06:07.709 INFO:tasks.workunit.client.1.smithi098.stdout:6/476: truncate d0/de/d1b/f1c 2034076 0 2024-09-20T19:06:07.709 INFO:tasks.workunit.client.0.smithi027.stdout:3/828: dread d0/d1/d5e/d1d/f84 [0,4194304] 0 2024-09-20T19:06:07.710 INFO:tasks.workunit.client.0.smithi027.stdout:7/749: mkdir d3/d8/d26/d45/d56/dec/d2e/d49/dfe 0 2024-09-20T19:06:07.713 INFO:tasks.workunit.client.0.smithi027.stdout:2/766: mknod d3/de/d34/dc9/cf4 0 2024-09-20T19:06:07.714 INFO:tasks.workunit.client.0.smithi027.stdout:2/767: stat d3/d13/f87 0 2024-09-20T19:06:07.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/648: dwrite d4/d19/d1d/d2f/d4e/fc1 [0,4194304] 0 2024-09-20T19:06:07.718 INFO:tasks.workunit.client.0.smithi027.stdout:7/750: dwrite d3/d8/d26/d65/dc4/fca [0,4194304] 0 2024-09-20T19:06:07.718 INFO:tasks.workunit.client.1.smithi098.stdout:7/751: write d3/d10/d16/d90/fb3 [876683,92880] 0 2024-09-20T19:06:07.718 INFO:tasks.workunit.client.1.smithi098.stdout:0/462: dwrite d0/f57 [0,4194304] 0 2024-09-20T19:06:07.722 INFO:tasks.workunit.client.1.smithi098.stdout:3/649: symlink d4/d19/d1d/d2f/d3e/lcd 0 2024-09-20T19:06:07.726 INFO:tasks.workunit.client.1.smithi098.stdout:6/477: symlink d0/de/d1b/l91 0 2024-09-20T19:06:07.729 INFO:tasks.workunit.client.0.smithi027.stdout:7/751: unlink d3/d5e/ff3 0 2024-09-20T19:06:07.731 INFO:tasks.workunit.client.1.smithi098.stdout:7/752: mknod d3/d4c/cef 0 2024-09-20T19:06:07.732 INFO:tasks.workunit.client.1.smithi098.stdout:7/753: dread - d3/d10/dcf/fe2 zero size 2024-09-20T19:06:07.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/754: write d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/fd7 [788289,94964] 0 2024-09-20T19:06:07.735 INFO:tasks.workunit.client.0.smithi027.stdout:7/752: creat d3/d8/fff x:0 0 0 2024-09-20T19:06:07.738 INFO:tasks.workunit.client.1.smithi098.stdout:6/478: creat d0/de/d1b/d37/d43/d6d/f92 x:0 0 0 2024-09-20T19:06:07.740 INFO:tasks.workunit.client.0.smithi027.stdout:7/753: read d3/d8/d26/d45/d56/d8d/fad [176192,33312] 0 2024-09-20T19:06:07.741 INFO:tasks.workunit.client.1.smithi098.stdout:3/650: truncate d4/d19/d1d/d2f/d4e/f90 914921 0 2024-09-20T19:06:07.742 INFO:tasks.workunit.client.1.smithi098.stdout:7/755: symlink d3/d10/d16/d17/d33/d1f/d28/d7d/dcd/lf0 0 2024-09-20T19:06:07.744 INFO:tasks.workunit.client.0.smithi027.stdout:7/754: chown d3/d8/d26/d45/d56/dec/dc/l90 9890 1 2024-09-20T19:06:07.744 INFO:tasks.workunit.client.1.smithi098.stdout:9/719: sync 2024-09-20T19:06:07.747 INFO:tasks.workunit.client.1.smithi098.stdout:6/479: mknod d0/de/d1b/d37/d44/d24/d29/d2b/d66/c93 0 2024-09-20T19:06:07.749 INFO:tasks.workunit.client.1.smithi098.stdout:3/651: dwrite d4/d38/d48/fb2 [0,4194304] 0 2024-09-20T19:06:07.750 INFO:tasks.workunit.client.1.smithi098.stdout:7/756: rename d3/daa/le5 to d3/d76/d7a/lf1 0 2024-09-20T19:06:07.750 INFO:tasks.workunit.client.1.smithi098.stdout:6/480: write d0/de/d1b/d37/d44/d24/f3e [367556,97628] 0 2024-09-20T19:06:07.752 INFO:tasks.workunit.client.0.smithi027.stdout:7/755: creat d3/d8/d26/d65/f100 x:0 0 0 2024-09-20T19:06:07.753 INFO:tasks.workunit.client.1.smithi098.stdout:2/987: truncate d3/f12 4297694 0 2024-09-20T19:06:07.753 INFO:tasks.workunit.client.0.smithi027.stdout:5/828: dwrite d4/da/de/d3e/d69/d6a/f8c [0,4194304] 0 2024-09-20T19:06:07.754 INFO:tasks.workunit.client.1.smithi098.stdout:2/988: chown d3/d51/d68/l116 4 1 2024-09-20T19:06:07.754 INFO:tasks.workunit.client.1.smithi098.stdout:2/989: readlink d3/df/d104/d38/l81 0 2024-09-20T19:06:07.759 INFO:tasks.workunit.client.0.smithi027.stdout:7/756: creat d3/d8/d1c/d61/f101 x:0 0 0 2024-09-20T19:06:07.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/652: mknod d4/d25/d40/d80/cce 0 2024-09-20T19:06:07.763 INFO:tasks.workunit.client.0.smithi027.stdout:5/829: unlink d4/d6c/d6f/fe2 0 2024-09-20T19:06:07.767 INFO:tasks.workunit.client.1.smithi098.stdout:2/990: creat d3/d16/d1d/d2b/d46/f13f x:0 0 0 2024-09-20T19:06:07.768 INFO:tasks.workunit.client.1.smithi098.stdout:2/991: stat d3/d16/f83 0 2024-09-20T19:06:07.769 INFO:tasks.workunit.client.1.smithi098.stdout:3/653: mknod d4/d19/d1d/d2f/d3e/ccf 0 2024-09-20T19:06:07.770 INFO:tasks.workunit.client.1.smithi098.stdout:3/654: readlink d4/d25/d40/d4b/l61 0 2024-09-20T19:06:07.770 INFO:tasks.workunit.client.1.smithi098.stdout:3/655: chown d4/da 23940 1 2024-09-20T19:06:07.771 INFO:tasks.workunit.client.1.smithi098.stdout:3/656: write d4/da/f6c [1361616,103028] 0 2024-09-20T19:06:07.771 INFO:tasks.workunit.client.0.smithi027.stdout:1/810: rename d2/d8/d74/d9a to d2/d8/d3b/d82/d90/d108 0 2024-09-20T19:06:07.773 INFO:tasks.workunit.client.1.smithi098.stdout:6/481: symlink d0/de/d1b/l94 0 2024-09-20T19:06:07.773 INFO:tasks.workunit.client.1.smithi098.stdout:6/482: chown d0/de/d1b/d37/d8c 3 1 2024-09-20T19:06:07.775 INFO:tasks.workunit.client.0.smithi027.stdout:5/830: creat d4/da/de/d3e/f10f x:0 0 0 2024-09-20T19:06:07.777 INFO:tasks.workunit.client.0.smithi027.stdout:8/806: rename d2/d14/d13/d43/dfe to d2/d3/d113 0 2024-09-20T19:06:07.780 INFO:tasks.workunit.client.0.smithi027.stdout:5/831: creat d4/da/de/d3e/db7/dc2/d105/f110 x:0 0 0 2024-09-20T19:06:07.782 INFO:tasks.workunit.client.0.smithi027.stdout:2/768: rename d3/d1c/d26/d2a/dc2/fa8 to d3/d13/d3c/dce/ddc/ff5 0 2024-09-20T19:06:07.784 INFO:tasks.workunit.client.1.smithi098.stdout:2/992: creat d3/db0/d69/dca/f140 x:0 0 0 2024-09-20T19:06:07.785 INFO:tasks.workunit.client.1.smithi098.stdout:6/483: dwrite d0/de/d1b/d37/d44/f3d [0,4194304] 0 2024-09-20T19:06:07.787 INFO:tasks.workunit.client.1.smithi098.stdout:2/993: dread - d3/ff7 zero size 2024-09-20T19:06:07.788 INFO:tasks.workunit.client.1.smithi098.stdout:2/994: read - d3/db0/dcc/f122 zero size 2024-09-20T19:06:07.794 INFO:tasks.workunit.client.1.smithi098.stdout:2/995: creat d3/d16/d1d/d2b/d46/d74/d7b/dcb/f141 x:0 0 0 2024-09-20T19:06:07.795 INFO:tasks.workunit.client.0.smithi027.stdout:8/807: symlink d2/d3/d6/d21/d33/l114 0 2024-09-20T19:06:07.797 INFO:tasks.workunit.client.1.smithi098.stdout:2/996: creat d3/d51/d9f/dbc/f142 x:0 0 0 2024-09-20T19:06:07.801 INFO:tasks.workunit.client.1.smithi098.stdout:2/997: creat d3/d16/d1a/d128/f143 x:0 0 0 2024-09-20T19:06:07.802 INFO:tasks.workunit.client.0.smithi027.stdout:8/808: mkdir d2/d2a/df8/d36/d115 0 2024-09-20T19:06:07.803 INFO:tasks.workunit.client.0.smithi027.stdout:8/809: dread - d2/d14/d13/d43/d5d/d90/fc9 zero size 2024-09-20T19:06:07.804 INFO:tasks.workunit.client.0.smithi027.stdout:5/832: rmdir d4/da/de/d3e/d69/d75/d3d/de7 0 2024-09-20T19:06:07.804 INFO:tasks.workunit.client.1.smithi098.stdout:1/628: sync 2024-09-20T19:06:07.804 INFO:tasks.workunit.client.1.smithi098.stdout:8/754: sync 2024-09-20T19:06:07.804 INFO:tasks.workunit.client.1.smithi098.stdout:5/526: sync 2024-09-20T19:06:07.807 INFO:tasks.workunit.client.0.smithi027.stdout:7/757: rename d3/d8/d1c/d80 to d3/d8/d26/d45/d56/dec/d2e/d39/d102 0 2024-09-20T19:06:07.810 INFO:tasks.workunit.client.0.smithi027.stdout:5/833: readlink d4/d1f/d7f/l71 0 2024-09-20T19:06:07.810 INFO:tasks.workunit.client.0.smithi027.stdout:8/810: dwrite d2/d14/d13/f1d [0,4194304] 0 2024-09-20T19:06:07.811 INFO:tasks.workunit.client.0.smithi027.stdout:7/758: write d3/d8/d26/d45/d56/dec/dc/da9/dbc/fc1 [793670,46221] 0 2024-09-20T19:06:07.814 INFO:tasks.workunit.client.0.smithi027.stdout:8/811: write d2/d3/d6/d6d/f8b [1143650,23298] 0 2024-09-20T19:06:07.817 INFO:tasks.workunit.client.1.smithi098.stdout:5/527: rmdir d1/d17/d25 39 2024-09-20T19:06:07.818 INFO:tasks.workunit.client.0.smithi027.stdout:8/812: truncate d2/d14/d13/d43/d5d/ffa 981049 0 2024-09-20T19:06:07.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/755: mknod d7/de/d11/d1f/d57/db6/c109 0 2024-09-20T19:06:07.821 INFO:tasks.workunit.client.1.smithi098.stdout:4/800: write d3/d4f/f72 [3020702,99559] 0 2024-09-20T19:06:07.822 INFO:tasks.workunit.client.0.smithi027.stdout:7/759: creat d3/d8/d26/d45/d56/d8d/f103 x:0 0 0 2024-09-20T19:06:07.823 INFO:tasks.workunit.client.0.smithi027.stdout:8/813: dread d2/d3/d6/d6d/fcc [0,4194304] 0 2024-09-20T19:06:07.829 INFO:tasks.workunit.client.0.smithi027.stdout:5/834: link d4/da/de/d3e/db7/dc2/d87/df0/ffb d4/da/de/d3e/d69/d75/db4/de4/f111 0 2024-09-20T19:06:07.830 INFO:tasks.workunit.client.1.smithi098.stdout:0/463: write d0/db/d1d/f3f [54571,50380] 0 2024-09-20T19:06:07.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/801: fsync d3/f7 0 2024-09-20T19:06:07.835 INFO:tasks.workunit.client.0.smithi027.stdout:5/835: dwrite d4/da/de/fdb [0,4194304] 0 2024-09-20T19:06:07.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/464: mknod d0/db/d32/c8b 0 2024-09-20T19:06:07.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/802: truncate d3/d2e/fb9 1135230 0 2024-09-20T19:06:07.848 INFO:tasks.workunit.client.0.smithi027.stdout:6/788: dread d4/d6/d4b/dca/fd6 [0,4194304] 0 2024-09-20T19:06:07.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/720: dwrite d4/de/d24/d35/d2d/da6/dae/d86/f6f [0,4194304] 0 2024-09-20T19:06:07.849 INFO:tasks.workunit.client.1.smithi098.stdout:4/803: dread d3/d6/d8c/de7/df4/d1e/d2a/d45/fe8 [0,4194304] 0 2024-09-20T19:06:07.850 INFO:tasks.workunit.client.1.smithi098.stdout:9/721: fsync d4/de/d27/d4a/d21/f36 0 2024-09-20T19:06:07.850 INFO:tasks.workunit.client.1.smithi098.stdout:0/465: creat d0/d7d/f8c x:0 0 0 2024-09-20T19:06:07.852 INFO:tasks.workunit.client.0.smithi027.stdout:5/836: getdents d4/d1f/d91/d9b/d109 0 2024-09-20T19:06:07.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/722: chown d4/de/d27/d4a/fd4 0 1 2024-09-20T19:06:07.854 INFO:tasks.workunit.client.0.smithi027.stdout:5/837: write d4/da/de/d3e/d10b/fea [485030,118968] 0 2024-09-20T19:06:07.857 INFO:tasks.workunit.client.1.smithi098.stdout:4/804: rename d3/d6/de3/def/l115 to d3/d7d/da3/d3c/d6b/d73/l118 0 2024-09-20T19:06:07.858 INFO:tasks.workunit.client.0.smithi027.stdout:8/814: dread d2/d3/d6/d21/d33/f8f [0,4194304] 0 2024-09-20T19:06:07.858 INFO:tasks.workunit.client.0.smithi027.stdout:6/789: mkdir d4/d6/d4b/d106 0 2024-09-20T19:06:07.860 INFO:tasks.workunit.client.1.smithi098.stdout:0/466: symlink d0/d6/d28/d31/d69/l8d 0 2024-09-20T19:06:07.863 INFO:tasks.workunit.client.0.smithi027.stdout:8/815: mknod d2/d2a/df8/d35/c116 0 2024-09-20T19:06:07.865 INFO:tasks.workunit.client.1.smithi098.stdout:3/657: write d4/d19/d1d/d2f/f53 [5063358,84797] 0 2024-09-20T19:06:07.866 INFO:tasks.workunit.client.1.smithi098.stdout:3/658: fsync d4/da/d7a/fb0 0 2024-09-20T19:06:07.870 INFO:tasks.workunit.client.0.smithi027.stdout:2/769: rename d3/d13/d3c/dce/ddc to d3/d1c/d26/df2/df6 0 2024-09-20T19:06:07.870 INFO:tasks.workunit.client.1.smithi098.stdout:0/467: fdatasync d0/f3 0 2024-09-20T19:06:07.871 INFO:tasks.workunit.client.0.smithi027.stdout:2/770: read d3/de/f1a [3908234,12660] 0 2024-09-20T19:06:07.872 INFO:tasks.workunit.client.0.smithi027.stdout:6/790: creat d4/d6/de3/f107 x:0 0 0 2024-09-20T19:06:07.874 INFO:tasks.workunit.client.0.smithi027.stdout:5/838: link d4/da/c41 d4/da/de/d3e/d44/c112 0 2024-09-20T19:06:07.874 INFO:tasks.workunit.client.0.smithi027.stdout:6/791: chown d4/d9c/ff5 658 1 2024-09-20T19:06:07.875 INFO:tasks.workunit.client.0.smithi027.stdout:8/816: dwrite d2/d3/d6/d6d/fcc [0,4194304] 0 2024-09-20T19:06:07.877 INFO:tasks.workunit.client.1.smithi098.stdout:6/484: dwrite d0/de/d1b/d37/f45 [0,4194304] 0 2024-09-20T19:06:07.878 INFO:tasks.workunit.client.1.smithi098.stdout:9/723: dread d4/de/d24/f8b [0,4194304] 0 2024-09-20T19:06:07.880 INFO:tasks.workunit.client.0.smithi027.stdout:5/839: mknod d4/da/de/d3e/db7/dc2/c113 0 2024-09-20T19:06:07.883 INFO:tasks.workunit.client.0.smithi027.stdout:2/771: dwrite d3/d13/d3c/d48/d6a/f72 [0,4194304] 0 2024-09-20T19:06:07.883 INFO:tasks.workunit.client.1.smithi098.stdout:9/724: write d4/de/fe5 [963626,7239] 0 2024-09-20T19:06:07.885 INFO:tasks.workunit.client.1.smithi098.stdout:0/468: dwrite d0/d55/f1e [0,4194304] 0 2024-09-20T19:06:07.885 INFO:tasks.workunit.client.1.smithi098.stdout:6/485: dread d0/de/d1b/f28 [0,4194304] 0 2024-09-20T19:06:07.885 INFO:tasks.workunit.client.1.smithi098.stdout:2/998: write d3/d16/d1d/d2b/d46/f50 [2483601,12112] 0 2024-09-20T19:06:07.887 INFO:tasks.workunit.client.0.smithi027.stdout:6/792: rename d4/d15/d37/d7a/d8e/ld8 to d4/d15/d37/d6a/dbf/d105/l108 0 2024-09-20T19:06:07.888 INFO:tasks.workunit.client.1.smithi098.stdout:0/469: fdatasync d0/d7d/f80 0 2024-09-20T19:06:07.893 INFO:tasks.workunit.client.1.smithi098.stdout:7/757: read d3/d10/d16/f84 [2181394,21046] 0 2024-09-20T19:06:07.893 INFO:tasks.workunit.client.0.smithi027.stdout:5/840: creat d4/da/de/d3e/db7/dc2/d87/f114 x:0 0 0 2024-09-20T19:06:07.894 INFO:tasks.workunit.client.0.smithi027.stdout:5/841: dread - d4/da/de/d3e/db7/fce zero size 2024-09-20T19:06:07.896 INFO:tasks.workunit.client.0.smithi027.stdout:4/737: sync 2024-09-20T19:06:07.897 INFO:tasks.workunit.client.0.smithi027.stdout:4/738: write d5/f37 [4365658,52610] 0 2024-09-20T19:06:07.897 INFO:tasks.workunit.client.1.smithi098.stdout:1/629: dwrite d1/f50 [4194304,4194304] 0 2024-09-20T19:06:07.904 INFO:tasks.workunit.client.1.smithi098.stdout:9/725: getdents d4/d74/dc8 0 2024-09-20T19:06:07.904 INFO:tasks.workunit.client.1.smithi098.stdout:8/756: write d7/de/d11/d1d/f81 [3042997,50092] 0 2024-09-20T19:06:07.906 INFO:tasks.workunit.client.0.smithi027.stdout:5/842: readlink d4/d1f/ld3 0 2024-09-20T19:06:07.906 INFO:tasks.workunit.client.0.smithi027.stdout:4/739: dwrite d5/d11/d1a/d2a/fc2 [0,4194304] 0 2024-09-20T19:06:07.908 INFO:tasks.workunit.client.0.smithi027.stdout:7/760: write d3/d8/d26/d45/d56/dec/d2e/d39/d102/fef [22317,19228] 0 2024-09-20T19:06:07.909 INFO:tasks.workunit.client.1.smithi098.stdout:7/758: creat d3/d4c/ff2 x:0 0 0 2024-09-20T19:06:07.909 INFO:tasks.workunit.client.1.smithi098.stdout:5/528: dwrite d1/d17/d35/f41 [0,4194304] 0 2024-09-20T19:06:07.917 INFO:tasks.workunit.client.0.smithi027.stdout:8/817: link d2/d65/f4b d2/d2a/df8/f117 0 2024-09-20T19:06:07.921 INFO:tasks.workunit.client.0.smithi027.stdout:4/740: mkdir d5/d80/de6 0 2024-09-20T19:06:07.923 INFO:tasks.workunit.client.1.smithi098.stdout:6/486: dread d0/de/d1b/d37/d44/d24/d29/d2b/d65/f6a [0,4194304] 0 2024-09-20T19:06:07.924 INFO:tasks.workunit.client.0.smithi027.stdout:6/793: dread d4/d15/d37/d6a/d7f/fac [0,4194304] 0 2024-09-20T19:06:07.925 INFO:tasks.workunit.client.0.smithi027.stdout:6/794: chown d4/d15/d2c/f4c 11020313 1 2024-09-20T19:06:07.926 INFO:tasks.workunit.client.0.smithi027.stdout:5/843: chown d4/da/c41 14 1 2024-09-20T19:06:07.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/726: rmdir d4/de/d27/d4a/d21/d25 39 2024-09-20T19:06:07.927 INFO:tasks.workunit.client.1.smithi098.stdout:1/630: dread d1/f25 [0,4194304] 0 2024-09-20T19:06:07.932 INFO:tasks.workunit.client.0.smithi027.stdout:6/795: fdatasync d4/d15/d2c/f5b 0 2024-09-20T19:06:07.934 INFO:tasks.workunit.client.0.smithi027.stdout:5/844: mkdir d4/da/de/d3e/db7/dc2/d115 0 2024-09-20T19:06:07.935 INFO:tasks.workunit.client.1.smithi098.stdout:4/805: dwrite d3/d7d/da3/d3c/d6b/f74 [0,4194304] 0 2024-09-20T19:06:07.936 INFO:tasks.workunit.client.0.smithi027.stdout:8/818: mknod d2/d3/d6/d21/c118 0 2024-09-20T19:06:07.937 INFO:tasks.workunit.client.1.smithi098.stdout:7/759: dwrite d3/d76/d7a/fee [0,4194304] 0 2024-09-20T19:06:07.940 INFO:tasks.workunit.client.0.smithi027.stdout:4/741: rename d5/d11/d3d/la6 to d5/d11/d3d/le7 0 2024-09-20T19:06:07.944 INFO:tasks.workunit.client.1.smithi098.stdout:3/659: dwrite d4/d19/f8f [0,4194304] 0 2024-09-20T19:06:07.944 INFO:tasks.workunit.client.0.smithi027.stdout:6/796: mknod d4/d9c/c109 0 2024-09-20T19:06:07.947 INFO:tasks.workunit.client.1.smithi098.stdout:8/757: fdatasync d7/de/f54 0 2024-09-20T19:06:07.949 INFO:tasks.workunit.client.0.smithi027.stdout:2/772: write d3/d1c/d26/f67 [2091053,27172] 0 2024-09-20T19:06:07.953 INFO:tasks.workunit.client.1.smithi098.stdout:1/631: unlink d1/f90 0 2024-09-20T19:06:07.957 INFO:tasks.workunit.client.0.smithi027.stdout:4/742: symlink d5/d11/d17/d1b/d8d/le8 0 2024-09-20T19:06:07.959 INFO:tasks.workunit.client.1.smithi098.stdout:5/529: creat d1/d17/d35/d93/f9e x:0 0 0 2024-09-20T19:06:07.960 INFO:tasks.workunit.client.0.smithi027.stdout:7/761: dread d3/d8/d26/d45/d56/f64 [0,4194304] 0 2024-09-20T19:06:07.961 INFO:tasks.workunit.client.1.smithi098.stdout:0/470: write d0/db/d1d/f26 [1490819,92094] 0 2024-09-20T19:06:07.964 INFO:tasks.workunit.client.1.smithi098.stdout:2/999: creat d3/d16/d1d/d2b/d99/f144 x:0 0 0 2024-09-20T19:06:07.966 INFO:tasks.workunit.client.0.smithi027.stdout:9/890: sync 2024-09-20T19:06:07.968 INFO:tasks.workunit.client.1.smithi098.stdout:3/660: unlink d4/d38/d48/fb2 0 2024-09-20T19:06:07.969 INFO:tasks.workunit.client.0.smithi027.stdout:5/845: rmdir d4/da/de/d3e/db7/dc2/d115 0 2024-09-20T19:06:07.973 INFO:tasks.workunit.client.0.smithi027.stdout:9/891: mkdir d0/d9/dfb/d12a 0 2024-09-20T19:06:07.974 INFO:tasks.workunit.client.0.smithi027.stdout:6/797: link d4/la9 d4/d15/d37/d5a/d78/dbc/l10a 0 2024-09-20T19:06:07.976 INFO:tasks.workunit.client.0.smithi027.stdout:8/819: dread d2/d2a/df8/f26 [0,4194304] 0 2024-09-20T19:06:07.976 INFO:tasks.workunit.client.0.smithi027.stdout:6/798: chown d4/d15/d37/d6a/dbf/lec 995 1 2024-09-20T19:06:07.977 INFO:tasks.workunit.client.0.smithi027.stdout:7/762: symlink d3/d8/d26/d45/d56/l104 0 2024-09-20T19:06:07.979 INFO:tasks.workunit.client.0.smithi027.stdout:5/846: stat d4/d1f/d7f/ced 0 2024-09-20T19:06:07.981 INFO:tasks.workunit.client.0.smithi027.stdout:4/743: link d5/d13/d36/d48/d3f/d7e/fd9 d5/d13/d36/d48/d3f/fe9 0 2024-09-20T19:06:07.982 INFO:tasks.workunit.client.0.smithi027.stdout:9/892: rmdir d0/d9/df/d1c/d6a/d6d/de5 39 2024-09-20T19:06:07.985 INFO:tasks.workunit.client.0.smithi027.stdout:8/820: unlink d2/d14/d13/d43/d7a/c7b 0 2024-09-20T19:06:07.987 INFO:tasks.workunit.client.0.smithi027.stdout:6/799: write d4/d15/d37/d5a/fee [2107563,24799] 0 2024-09-20T19:06:07.988 INFO:tasks.workunit.client.1.smithi098.stdout:3/661: mkdir d4/d38/d48/d60/dd0 0 2024-09-20T19:06:07.989 INFO:tasks.workunit.client.1.smithi098.stdout:7/760: write d3/f2e [2013906,85318] 0 2024-09-20T19:06:07.991 INFO:tasks.workunit.client.0.smithi027.stdout:5/847: mkdir d4/d1f/d7f/da4/d116 0 2024-09-20T19:06:07.991 INFO:tasks.workunit.client.1.smithi098.stdout:6/487: link d0/de/d1b/d37/d43/f5e d0/d55/d82/f95 0 2024-09-20T19:06:07.992 INFO:tasks.workunit.client.1.smithi098.stdout:4/806: dwrite d3/d7d/da3/d3c/fd1 [0,4194304] 0 2024-09-20T19:06:07.994 INFO:tasks.workunit.client.0.smithi027.stdout:4/744: mkdir d5/d11/d1a/dea 0 2024-09-20T19:06:07.994 INFO:tasks.workunit.client.0.smithi027.stdout:6/800: dwrite d4/d15/d37/d7a/d46/d53/f101 [0,4194304] 0 2024-09-20T19:06:08.001 INFO:tasks.workunit.client.1.smithi098.stdout:8/758: write d7/de/d11/d19/d30/f70 [2085240,53741] 0 2024-09-20T19:06:08.003 INFO:tasks.workunit.client.0.smithi027.stdout:4/745: dwrite d5/d11/d1a/d2a/fc2 [0,4194304] 0 2024-09-20T19:06:08.004 INFO:tasks.workunit.client.1.smithi098.stdout:8/759: truncate d7/de/d11/d19/d30/d55/fe4 4880103 0 2024-09-20T19:06:08.005 INFO:tasks.workunit.client.1.smithi098.stdout:0/471: mkdir d0/d8e 0 2024-09-20T19:06:08.005 INFO:tasks.workunit.client.1.smithi098.stdout:8/760: chown d7/de/d11/d1f/dcd/db3/cc1 737906 1 2024-09-20T19:06:08.006 INFO:tasks.workunit.client.0.smithi027.stdout:5/848: mkdir d4/da/d117 0 2024-09-20T19:06:08.007 INFO:tasks.workunit.client.0.smithi027.stdout:5/849: fdatasync d4/da/d1a/f108 0 2024-09-20T19:06:08.007 INFO:tasks.workunit.client.1.smithi098.stdout:3/662: chown d4/d38/d48/cc0 7 1 2024-09-20T19:06:08.011 INFO:tasks.workunit.client.0.smithi027.stdout:6/801: chown d4/d6/d4b/lab 17845172 1 2024-09-20T19:06:08.016 INFO:tasks.workunit.client.1.smithi098.stdout:1/632: rmdir d1/d3/df/d34/d43/d65/dbc/dbf 0 2024-09-20T19:06:08.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/727: link d4/de/d27/d4a/d21/d25/c96 d4/de/d24/d35/d2d/da6/dae/d86/daa/ce9 0 2024-09-20T19:06:08.019 INFO:tasks.workunit.client.0.smithi027.stdout:7/763: link d3/d8/d26/d45/d56/dec/d2e/d39/cf4 d3/d8/de5/c105 0 2024-09-20T19:06:08.020 INFO:tasks.workunit.client.1.smithi098.stdout:0/472: dread - d0/d55/f76 zero size 2024-09-20T19:06:08.021 INFO:tasks.workunit.client.0.smithi027.stdout:5/850: creat d4/da/d1a/f118 x:0 0 0 2024-09-20T19:06:08.026 INFO:tasks.workunit.client.0.smithi027.stdout:9/893: unlink d0/d9/df/d1c/d6a/d6d/de5/f116 0 2024-09-20T19:06:08.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/761: fsync d3/f64 0 2024-09-20T19:06:08.031 INFO:tasks.workunit.client.0.smithi027.stdout:8/821: link d2/d3/d6/d6d/d75/lf3 d2/def/l119 0 2024-09-20T19:06:08.032 INFO:tasks.workunit.client.1.smithi098.stdout:6/488: mknod d0/de/c96 0 2024-09-20T19:06:08.036 INFO:tasks.workunit.client.0.smithi027.stdout:7/764: mkdir d3/d8/d26/d65/dc4/d106 0 2024-09-20T19:06:08.041 INFO:tasks.workunit.client.1.smithi098.stdout:9/728: creat d4/de/d27/d88/fea x:0 0 0 2024-09-20T19:06:08.042 INFO:tasks.workunit.client.1.smithi098.stdout:0/473: chown d0/d55/c66 0 1 2024-09-20T19:06:08.044 INFO:tasks.workunit.client.0.smithi027.stdout:9/894: chown d0/d9/df/d1b/c2c 8621 1 2024-09-20T19:06:08.044 INFO:tasks.workunit.client.0.smithi027.stdout:8/822: symlink d2/d65/l11a 0 2024-09-20T19:06:08.045 INFO:tasks.workunit.client.1.smithi098.stdout:8/761: dread d7/de/d11/d19/d30/d59/d80/f8a [0,4194304] 0 2024-09-20T19:06:08.046 INFO:tasks.workunit.client.0.smithi027.stdout:8/823: write d2/d3/d9a/f10c [932109,95427] 0 2024-09-20T19:06:08.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/762: chown d7/de/d11/d1f/d57/db0/l106 433 1 2024-09-20T19:06:08.050 INFO:tasks.workunit.client.0.smithi027.stdout:6/802: symlink d4/d15/d37/d7a/d33/l10b 0 2024-09-20T19:06:08.050 INFO:tasks.workunit.client.1.smithi098.stdout:9/729: truncate d4/de/d27/d6c/fbc 1014441 0 2024-09-20T19:06:08.052 INFO:tasks.workunit.client.0.smithi027.stdout:4/746: creat d5/d13/d36/d59/feb x:0 0 0 2024-09-20T19:06:08.054 INFO:tasks.workunit.client.1.smithi098.stdout:7/762: unlink d3/d76/db8/da6/cc8 0 2024-09-20T19:06:08.054 INFO:tasks.workunit.client.0.smithi027.stdout:7/765: mkdir d3/d8/d26/d45/d56/dec/dc/dd9/d107 0 2024-09-20T19:06:08.055 INFO:tasks.workunit.client.1.smithi098.stdout:4/807: write d3/d7d/f85 [3335915,11033] 0 2024-09-20T19:06:08.055 INFO:tasks.workunit.client.1.smithi098.stdout:7/763: write d3/d10/d16/d17/f3d [4483004,86103] 0 2024-09-20T19:06:08.056 INFO:tasks.workunit.client.1.smithi098.stdout:8/763: rename d7/de/d35 to d7/de/d11/d1f/d10a 0 2024-09-20T19:06:08.057 INFO:tasks.workunit.client.0.smithi027.stdout:8/824: rmdir d2/d14/d13/d2e/d6c 39 2024-09-20T19:06:08.057 INFO:tasks.workunit.client.1.smithi098.stdout:7/764: dread - d3/d10/d16/d17/d33/d1f/dba/fdd zero size 2024-09-20T19:06:08.058 INFO:tasks.workunit.client.1.smithi098.stdout:1/633: link d1/d3/c6a d1/d3/df/d34/d43/d65/ccc 0 2024-09-20T19:06:08.059 INFO:tasks.workunit.client.1.smithi098.stdout:6/489: dread d0/de/d1b/d37/d43/f48 [0,4194304] 0 2024-09-20T19:06:08.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/474: readlink d0/d55/d38/l62 0 2024-09-20T19:06:08.061 INFO:tasks.workunit.client.1.smithi098.stdout:0/475: write d0/db/d1d/f26 [3147587,99106] 0 2024-09-20T19:06:08.061 INFO:tasks.workunit.client.0.smithi027.stdout:4/747: rename d5/d13/d36/d48/d3f/d7e/l9a to d5/d11/d3d/lec 0 2024-09-20T19:06:08.062 INFO:tasks.workunit.client.1.smithi098.stdout:9/730: symlink d4/de/d27/d4a/d58/d5b/leb 0 2024-09-20T19:06:08.064 INFO:tasks.workunit.client.0.smithi027.stdout:8/825: truncate d2/d3/f25 2399392 0 2024-09-20T19:06:08.066 INFO:tasks.workunit.client.0.smithi027.stdout:8/826: write d2/d14/d13/d43/fb0 [246876,38638] 0 2024-09-20T19:06:08.067 INFO:tasks.workunit.client.1.smithi098.stdout:3/663: write d4/d25/d40/d4b/f8e [650130,17775] 0 2024-09-20T19:06:08.070 INFO:tasks.workunit.client.1.smithi098.stdout:3/664: read d4/d19/d1d/d2f/f66 [4682060,26527] 0 2024-09-20T19:06:08.070 INFO:tasks.workunit.client.1.smithi098.stdout:3/665: readlink d4/d19/d1d/d2f/d3e/lcd 0 2024-09-20T19:06:08.071 INFO:tasks.workunit.client.1.smithi098.stdout:7/765: unlink d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/ce9 0 2024-09-20T19:06:08.073 INFO:tasks.workunit.client.0.smithi027.stdout:4/748: symlink d5/d13/d36/d48/d3f/d4c/d52/d96/led 0 2024-09-20T19:06:08.074 INFO:tasks.workunit.client.0.smithi027.stdout:8/827: rmdir d2/d3/d6/d21/d33/d79/d9f 39 2024-09-20T19:06:08.075 INFO:tasks.workunit.client.0.smithi027.stdout:5/851: write d4/d1f/d91/fbc [3948687,87866] 0 2024-09-20T19:06:08.078 INFO:tasks.workunit.client.1.smithi098.stdout:0/476: rename d0/d55/d38 to d0/db/d1d/d8f 0 2024-09-20T19:06:08.080 INFO:tasks.workunit.client.0.smithi027.stdout:4/749: symlink d5/d11/d17/d1b/da9/lee 0 2024-09-20T19:06:08.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/731: mkdir d4/de/d48/dec 0 2024-09-20T19:06:08.081 INFO:tasks.workunit.client.1.smithi098.stdout:1/634: dread d1/d3/d2e/f47 [0,4194304] 0 2024-09-20T19:06:08.085 INFO:tasks.workunit.client.0.smithi027.stdout:7/766: truncate d3/d8/d26/d45/d56/dec/d2e/d49/d8b/fdf 1478357 0 2024-09-20T19:06:08.087 INFO:tasks.workunit.client.1.smithi098.stdout:3/666: unlink d4/d19/d1d/d2f/d4e/c63 0 2024-09-20T19:06:08.089 INFO:tasks.workunit.client.0.smithi027.stdout:6/803: write f0 [2345584,111950] 0 2024-09-20T19:06:08.090 INFO:tasks.workunit.client.0.smithi027.stdout:6/804: readlink d4/d6/l51 0 2024-09-20T19:06:08.092 INFO:tasks.workunit.client.0.smithi027.stdout:5/852: mkdir d4/da/de/d3e/d69/d75/d119 0 2024-09-20T19:06:08.093 INFO:tasks.workunit.client.1.smithi098.stdout:0/477: symlink d0/d6/d28/d31/d45/l90 0 2024-09-20T19:06:08.094 INFO:tasks.workunit.client.1.smithi098.stdout:4/808: write d3/d6/d8c/de7/df4/fb5 [60603,64605] 0 2024-09-20T19:06:08.095 INFO:tasks.workunit.client.1.smithi098.stdout:1/635: read - d1/f81 zero size 2024-09-20T19:06:08.096 INFO:tasks.workunit.client.0.smithi027.stdout:4/750: dread d5/d13/d36/d48/d3f/d4c/d52/d87/d99/f61 [0,4194304] 0 2024-09-20T19:06:08.096 INFO:tasks.workunit.client.1.smithi098.stdout:1/636: read - d1/d3/d2e/d61/fc8 zero size 2024-09-20T19:06:08.097 INFO:tasks.workunit.client.1.smithi098.stdout:6/490: write d0/f7b [496582,113026] 0 2024-09-20T19:06:08.098 INFO:tasks.workunit.client.1.smithi098.stdout:9/732: symlink d4/de/d27/d4a/d58/d5b/d8f/d9e/led 0 2024-09-20T19:06:08.101 INFO:tasks.workunit.client.0.smithi027.stdout:5/853: symlink d4/da/de/d3e/db7/dc2/d105/l11a 0 2024-09-20T19:06:08.103 INFO:tasks.workunit.client.0.smithi027.stdout:4/751: mkdir d5/d11/d17/d1b/dd4/def 0 2024-09-20T19:06:08.103 INFO:tasks.workunit.client.0.smithi027.stdout:5/854: truncate d4/da/de/d3e/d44/f52 4964758 0 2024-09-20T19:06:08.104 INFO:tasks.workunit.client.0.smithi027.stdout:4/752: readlink d5/d11/d3d/l63 0 2024-09-20T19:06:08.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/667: readlink d4/d19/d1d/d2f/l85 0 2024-09-20T19:06:08.108 INFO:tasks.workunit.client.0.smithi027.stdout:8/828: link d2/d3/d6/d21/d33/d79/d9f/ce3 d2/d14/d13/db5/c11b 0 2024-09-20T19:06:08.110 INFO:tasks.workunit.client.0.smithi027.stdout:5/855: dwrite d4/da/de/d3e/d69/d75/fa8 [0,4194304] 0 2024-09-20T19:06:08.111 INFO:tasks.workunit.client.1.smithi098.stdout:0/478: creat d0/d6/d28/d31/d45/d60/f91 x:0 0 0 2024-09-20T19:06:08.114 INFO:tasks.workunit.client.1.smithi098.stdout:4/809: rename d3/d6/d8c/de7/df4/f15 to d3/d5e/d110/f119 0 2024-09-20T19:06:08.118 INFO:tasks.workunit.client.1.smithi098.stdout:6/491: symlink d0/l97 0 2024-09-20T19:06:08.119 INFO:tasks.workunit.client.0.smithi027.stdout:6/805: truncate d4/d6/d4b/d7c/d64/f68 465977 0 2024-09-20T19:06:08.120 INFO:tasks.workunit.client.1.smithi098.stdout:9/733: chown d4/de/d27/d4a/d21/c28 21900586 1 2024-09-20T19:06:08.121 INFO:tasks.workunit.client.0.smithi027.stdout:8/829: symlink d2/d14/d13/d43/d7a/l11c 0 2024-09-20T19:06:08.124 INFO:tasks.workunit.client.1.smithi098.stdout:3/668: rmdir d4/d19/d1d/d2f/d4e/d59/d7c 39 2024-09-20T19:06:08.124 INFO:tasks.workunit.client.1.smithi098.stdout:3/669: readlink d4/d19/d1d/l83 0 2024-09-20T19:06:08.126 INFO:tasks.workunit.client.0.smithi027.stdout:5/856: rename d4/da/de/d3e/d44/f4c to d4/d1f/d91/f11b 0 2024-09-20T19:06:08.126 INFO:tasks.workunit.client.1.smithi098.stdout:7/766: link d3/d10/d16/f84 d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/ff3 0 2024-09-20T19:06:08.127 INFO:tasks.workunit.client.0.smithi027.stdout:5/857: fdatasync d4/da/d1a/fe5 0 2024-09-20T19:06:08.127 INFO:tasks.workunit.client.0.smithi027.stdout:5/858: chown d4/da/de/f40 3095 1 2024-09-20T19:06:08.128 INFO:tasks.workunit.client.0.smithi027.stdout:4/753: getdents d5/d9b/db0/dcd 0 2024-09-20T19:06:08.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/479: symlink d0/d6/d28/d31/d69/l92 0 2024-09-20T19:06:08.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/480: stat d0/db/d32/l6e 0 2024-09-20T19:06:08.132 INFO:tasks.workunit.client.1.smithi098.stdout:0/481: chown d0/d6/d28/d31/d45/l58 7668 1 2024-09-20T19:06:08.132 INFO:tasks.workunit.client.1.smithi098.stdout:8/764: write d7/de/d11/d1f/d57/d72/f79 [1972793,64811] 0 2024-09-20T19:06:08.133 INFO:tasks.workunit.client.1.smithi098.stdout:0/482: stat d0/d6/d28/d31/d45 0 2024-09-20T19:06:08.134 INFO:tasks.workunit.client.0.smithi027.stdout:6/806: rename d4/d15/d37/d5a/d78/c95 to d4/d15/d37/d7a/d8e/c10c 0 2024-09-20T19:06:08.136 INFO:tasks.workunit.client.0.smithi027.stdout:5/859: symlink d4/d1f/d91/d9b/de8/l11c 0 2024-09-20T19:06:08.138 INFO:tasks.workunit.client.1.smithi098.stdout:0/483: dread d0/d6/d28/f5c [0,4194304] 0 2024-09-20T19:06:08.139 INFO:tasks.workunit.client.1.smithi098.stdout:4/810: write d3/d5e/d110/f119 [8832280,36925] 0 2024-09-20T19:06:08.140 INFO:tasks.workunit.client.0.smithi027.stdout:0/798: sync 2024-09-20T19:06:08.140 INFO:tasks.workunit.client.0.smithi027.stdout:1/811: sync 2024-09-20T19:06:08.140 INFO:tasks.workunit.client.0.smithi027.stdout:3/829: sync 2024-09-20T19:06:08.141 INFO:tasks.workunit.client.0.smithi027.stdout:3/830: stat d0/d1/l48 0 2024-09-20T19:06:08.142 INFO:tasks.workunit.client.0.smithi027.stdout:8/830: rename d2/d65 to d2/d3/d11d 0 2024-09-20T19:06:08.143 INFO:tasks.workunit.client.0.smithi027.stdout:3/831: read d0/d1/d5e/f1e [9432658,39025] 0 2024-09-20T19:06:08.143 INFO:tasks.workunit.client.0.smithi027.stdout:6/807: mknod d4/d15/d37/d7a/d46/d53/c10d 0 2024-09-20T19:06:08.144 INFO:tasks.workunit.client.0.smithi027.stdout:6/808: stat d4/d15/d37/d6a/d7f/fdc 0 2024-09-20T19:06:08.145 INFO:tasks.workunit.client.0.smithi027.stdout:5/860: fdatasync d4/da/de/d3e/fc5 0 2024-09-20T19:06:08.145 INFO:tasks.workunit.client.0.smithi027.stdout:3/832: truncate d0/d1/d13/d15/d6f/dcc/fdc 116635 0 2024-09-20T19:06:08.146 INFO:tasks.workunit.client.1.smithi098.stdout:7/767: write d3/f12 [312659,124576] 0 2024-09-20T19:06:08.147 INFO:tasks.workunit.client.1.smithi098.stdout:9/734: write d4/de/d27/d4a/d58/f9a [687711,49205] 0 2024-09-20T19:06:08.148 INFO:tasks.workunit.client.1.smithi098.stdout:7/768: chown d3/d10/d16/d17/d33/f52 2140011 1 2024-09-20T19:06:08.150 INFO:tasks.workunit.client.1.smithi098.stdout:7/769: fdatasync d3/d10/d16/d17/d33/d1f/d28/d7d/f94 0 2024-09-20T19:06:08.152 INFO:tasks.workunit.client.1.smithi098.stdout:7/770: write d3/d10/d16/d17/d33/d1f/f43 [803938,74558] 0 2024-09-20T19:06:08.153 INFO:tasks.workunit.client.1.smithi098.stdout:1/637: rename d1/d3/df/d34/d43/f9c to d1/d3/d2e/d61/fcd 0 2024-09-20T19:06:08.154 INFO:tasks.workunit.client.1.smithi098.stdout:8/765: write d7/de/d11/d19/d30/d68/f7b [469420,39160] 0 2024-09-20T19:06:08.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/766: fsync d7/de/d11/d19/f4a 0 2024-09-20T19:06:08.156 INFO:tasks.workunit.client.1.smithi098.stdout:4/811: rmdir d3/d7d 39 2024-09-20T19:06:08.158 INFO:tasks.workunit.client.0.smithi027.stdout:8/831: creat d2/d3/f11e x:0 0 0 2024-09-20T19:06:08.158 INFO:tasks.workunit.client.1.smithi098.stdout:3/670: symlink d4/d38/d97/dcb/ld1 0 2024-09-20T19:06:08.159 INFO:tasks.workunit.client.1.smithi098.stdout:8/767: write d7/de/d11/d19/d30/d55/da9/ff4 [948523,16164] 0 2024-09-20T19:06:08.159 INFO:tasks.workunit.client.0.smithi027.stdout:6/809: creat d4/d15/d37/d6a/dbf/f10e x:0 0 0 2024-09-20T19:06:08.160 INFO:tasks.workunit.client.1.smithi098.stdout:9/735: symlink d4/d74/lee 0 2024-09-20T19:06:08.163 INFO:tasks.workunit.client.1.smithi098.stdout:0/484: dwrite d0/d55/d67/f68 [0,4194304] 0 2024-09-20T19:06:08.163 INFO:tasks.workunit.client.0.smithi027.stdout:0/799: mkdir d2/d11d 0 2024-09-20T19:06:08.165 INFO:tasks.workunit.client.1.smithi098.stdout:7/771: symlink d3/daa/dd4/lf4 0 2024-09-20T19:06:08.169 INFO:tasks.workunit.client.0.smithi027.stdout:4/754: rename d5/d11/c44 to d5/d13/d36/d60/cf0 0 2024-09-20T19:06:08.175 INFO:tasks.workunit.client.0.smithi027.stdout:8/832: symlink d2/d2a/df8/dda/l11f 0 2024-09-20T19:06:08.177 INFO:tasks.workunit.client.1.smithi098.stdout:8/768: mkdir d7/de/d11/d1f/d57/d72/d10b 0 2024-09-20T19:06:08.179 INFO:tasks.workunit.client.0.smithi027.stdout:3/833: getdents d0/d1/d13/d98/de1 0 2024-09-20T19:06:08.181 INFO:tasks.workunit.client.1.smithi098.stdout:9/736: dread d4/de/d27/d4a/d58/fab [0,4194304] 0 2024-09-20T19:06:08.182 INFO:tasks.workunit.client.1.smithi098.stdout:7/772: symlink d3/daa/dd4/lf5 0 2024-09-20T19:06:08.184 INFO:tasks.workunit.client.0.smithi027.stdout:1/812: creat d2/d8/d3b/d44/f109 x:0 0 0 2024-09-20T19:06:08.186 INFO:tasks.workunit.client.0.smithi027.stdout:8/833: unlink d2/d14/d13/d43/d5d/ffa 0 2024-09-20T19:06:08.187 INFO:tasks.workunit.client.1.smithi098.stdout:4/812: mkdir d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/d71/d11a 0 2024-09-20T19:06:08.188 INFO:tasks.workunit.client.1.smithi098.stdout:4/813: chown d3/d5e/d97 342 1 2024-09-20T19:06:08.188 INFO:tasks.workunit.client.0.smithi027.stdout:6/810: write d4/d15/d37/d6a/d7f/fdc [1067087,108936] 0 2024-09-20T19:06:08.188 INFO:tasks.workunit.client.1.smithi098.stdout:8/769: rmdir d7/de/d11/d19/d30 39 2024-09-20T19:06:08.191 INFO:tasks.workunit.client.1.smithi098.stdout:0/485: mkdir d0/db/d7f/d93 0 2024-09-20T19:06:08.191 INFO:tasks.workunit.client.1.smithi098.stdout:7/773: rmdir d3/d76/d86 39 2024-09-20T19:06:08.193 INFO:tasks.workunit.client.0.smithi027.stdout:4/755: unlink d5/d11/d3d/le7 0 2024-09-20T19:06:08.193 INFO:tasks.workunit.client.0.smithi027.stdout:3/834: dread d0/d19/d54/d7a/f9e [0,4194304] 0 2024-09-20T19:06:08.194 INFO:tasks.workunit.client.0.smithi027.stdout:5/861: dwrite d4/da/de/d3e/d69/d6a/fcb [0,4194304] 0 2024-09-20T19:06:08.194 INFO:tasks.workunit.client.1.smithi098.stdout:9/737: mknod d4/de/d27/d6c/cef 0 2024-09-20T19:06:08.196 INFO:tasks.workunit.client.0.smithi027.stdout:2/773: sync 2024-09-20T19:06:08.196 INFO:tasks.workunit.client.0.smithi027.stdout:9/895: sync 2024-09-20T19:06:08.197 INFO:tasks.workunit.client.1.smithi098.stdout:6/492: rename d0/de/d1b/d37/d44/d24/d29/d2b/d65/f6a to d0/de/d1b/d37/d43/f98 0 2024-09-20T19:06:08.197 INFO:tasks.workunit.client.1.smithi098.stdout:0/486: dwrite d0/db/f14 [0,4194304] 0 2024-09-20T19:06:08.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/738: write d4/de/d27/d4a/d21/d25/d51/fdd [780548,13631] 0 2024-09-20T19:06:08.199 INFO:tasks.workunit.client.0.smithi027.stdout:0/800: mkdir d2/d48/d6b/d79/d84/d11e 0 2024-09-20T19:06:08.204 INFO:tasks.workunit.client.1.smithi098.stdout:8/770: read d7/de/d11/d1f/d57/d72/f75 [300764,97383] 0 2024-09-20T19:06:08.205 INFO:tasks.workunit.client.1.smithi098.stdout:6/493: read d0/de/d1b/d37/d44/f13 [6758283,53577] 0 2024-09-20T19:06:08.207 INFO:tasks.workunit.client.1.smithi098.stdout:6/494: fdatasync d0/de/d1b/d37/d44/d24/f3e 0 2024-09-20T19:06:08.210 INFO:tasks.workunit.client.0.smithi027.stdout:3/835: symlink d0/d1/d13/d15/d6f/d7f/l116 0 2024-09-20T19:06:08.211 INFO:tasks.workunit.client.1.smithi098.stdout:1/638: getdents d1/d3/df/d34/d43/d65/dbc 0 2024-09-20T19:06:08.212 INFO:tasks.workunit.client.0.smithi027.stdout:4/756: dread d5/d13/d7c/f9c [0,4194304] 0 2024-09-20T19:06:08.213 INFO:tasks.workunit.client.0.smithi027.stdout:4/757: read - d5/d11/d1a/d2a/da3/fc8 zero size 2024-09-20T19:06:08.215 INFO:tasks.workunit.client.0.smithi027.stdout:2/774: creat d3/d24/d89/ff7 x:0 0 0 2024-09-20T19:06:08.215 INFO:tasks.workunit.client.1.smithi098.stdout:0/487: mknod d0/d6/c94 0 2024-09-20T19:06:08.217 INFO:tasks.workunit.client.1.smithi098.stdout:4/814: dwrite d3/d7d/da3/f56 [0,4194304] 0 2024-09-20T19:06:08.218 INFO:tasks.workunit.client.0.smithi027.stdout:6/811: symlink d4/d6/d4b/l10f 0 2024-09-20T19:06:08.220 INFO:tasks.workunit.client.0.smithi027.stdout:0/801: fsync d2/d48/d6b/d79/fd9 0 2024-09-20T19:06:08.222 INFO:tasks.workunit.client.0.smithi027.stdout:4/758: dwrite d5/d13/d36/d48/d3f/d4c/f55 [0,4194304] 0 2024-09-20T19:06:08.222 INFO:tasks.workunit.client.0.smithi027.stdout:1/813: creat d2/d8/d3b/f10a x:0 0 0 2024-09-20T19:06:08.225 INFO:tasks.workunit.client.0.smithi027.stdout:3/836: creat d0/d1/d5e/d1d/d7d/db4/f117 x:0 0 0 2024-09-20T19:06:08.225 INFO:tasks.workunit.client.0.smithi027.stdout:1/814: fdatasync d2/d8/d3b/d44/d93/f103 0 2024-09-20T19:06:08.225 INFO:tasks.workunit.client.0.smithi027.stdout:8/834: dread d2/d14/d13/f3b [4194304,4194304] 0 2024-09-20T19:06:08.227 INFO:tasks.workunit.client.0.smithi027.stdout:4/759: read d5/d13/d36/d48/d9f/dc9/f76 [9271959,83806] 0 2024-09-20T19:06:08.230 INFO:tasks.workunit.client.0.smithi027.stdout:5/862: creat d4/da/d1a/df8/f11d x:0 0 0 2024-09-20T19:06:08.234 INFO:tasks.workunit.client.0.smithi027.stdout:6/812: dread d4/d15/d2c/f5b [0,4194304] 0 2024-09-20T19:06:08.234 INFO:tasks.workunit.client.0.smithi027.stdout:2/775: mknod d3/de/d34/dc9/cf8 0 2024-09-20T19:06:08.237 INFO:tasks.workunit.client.0.smithi027.stdout:6/813: fdatasync d4/d1b/fd7 0 2024-09-20T19:06:08.238 INFO:tasks.workunit.client.0.smithi027.stdout:3/837: dwrite d0/d1/d13/d15/d6f/dcc/ff8 [0,4194304] 0 2024-09-20T19:06:08.239 INFO:tasks.workunit.client.0.smithi027.stdout:9/896: dwrite d0/d9/df/f49 [0,4194304] 0 2024-09-20T19:06:08.239 INFO:tasks.workunit.client.0.smithi027.stdout:8/835: symlink d2/d3/d113/l120 0 2024-09-20T19:06:08.241 INFO:tasks.workunit.client.0.smithi027.stdout:9/897: readlink d0/d9/df/d57/l7e 0 2024-09-20T19:06:08.242 INFO:tasks.workunit.client.0.smithi027.stdout:1/815: rename d2/d8/d74/f5a to d2/d8/d41/f10b 0 2024-09-20T19:06:08.245 INFO:tasks.workunit.client.0.smithi027.stdout:9/898: dread - d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/fdd zero size 2024-09-20T19:06:08.249 INFO:tasks.workunit.client.0.smithi027.stdout:0/802: fdatasync d2/fc 0 2024-09-20T19:06:08.253 INFO:tasks.workunit.client.0.smithi027.stdout:4/760: dwrite d5/d13/d36/d48/d3f/d4c/d52/d87/d99/f61 [0,4194304] 0 2024-09-20T19:06:08.254 INFO:tasks.workunit.client.0.smithi027.stdout:6/814: mknod d4/d15/d93/dd5/c110 0 2024-09-20T19:06:08.257 INFO:tasks.workunit.client.1.smithi098.stdout:9/739: truncate d4/de/d27/d6c/d73/f99 638621 0 2024-09-20T19:06:08.263 INFO:tasks.workunit.client.0.smithi027.stdout:1/816: rmdir d2/d8/d3b/d82/d87/dcf 39 2024-09-20T19:06:08.265 INFO:tasks.workunit.client.0.smithi027.stdout:9/899: rmdir d0/d9/dfb 39 2024-09-20T19:06:08.267 INFO:tasks.workunit.client.0.smithi027.stdout:9/900: fdatasync d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f11c 0 2024-09-20T19:06:08.271 INFO:tasks.workunit.client.0.smithi027.stdout:6/815: symlink d4/d6/d4b/d7c/l111 0 2024-09-20T19:06:08.272 INFO:tasks.workunit.client.0.smithi027.stdout:7/767: sync 2024-09-20T19:06:08.278 INFO:tasks.workunit.client.0.smithi027.stdout:9/901: write d0/d9/fec [1551605,52355] 0 2024-09-20T19:06:08.281 INFO:tasks.workunit.client.0.smithi027.stdout:4/761: creat d5/d11/d17/d1b/dd4/de3/ff1 x:0 0 0 2024-09-20T19:06:08.281 INFO:tasks.workunit.client.0.smithi027.stdout:3/838: dwrite d0/d1/d5e/f77 [0,4194304] 0 2024-09-20T19:06:08.282 INFO:tasks.workunit.client.0.smithi027.stdout:4/762: readlink d5/d11/lb2 0 2024-09-20T19:06:08.283 INFO:tasks.workunit.client.0.smithi027.stdout:4/763: dread - d5/d13/d16/f8e zero size 2024-09-20T19:06:08.286 INFO:tasks.workunit.client.0.smithi027.stdout:7/768: symlink d3/d8/d26/d65/dc4/l108 0 2024-09-20T19:06:08.287 INFO:tasks.workunit.client.0.smithi027.stdout:0/803: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [0,4194304] 0 2024-09-20T19:06:08.288 INFO:tasks.workunit.client.0.smithi027.stdout:8/836: link d2/d3/d11d/f4f d2/d3/d6/d21/d33/d79/d9f/f121 0 2024-09-20T19:06:08.291 INFO:tasks.workunit.client.0.smithi027.stdout:5/863: getdents d4/da/de/d3e/db7/dc2 0 2024-09-20T19:06:08.293 INFO:tasks.workunit.client.0.smithi027.stdout:5/864: dread - d4/d1f/fe9 zero size 2024-09-20T19:06:08.293 INFO:tasks.workunit.client.0.smithi027.stdout:2/776: getdents d3/d1c/d26/d2a/dc2/d6f 0 2024-09-20T19:06:08.295 INFO:tasks.workunit.client.0.smithi027.stdout:9/902: rename d0/fea to d0/d9/df/da2/f12b 0 2024-09-20T19:06:08.296 INFO:tasks.workunit.client.0.smithi027.stdout:6/816: mknod d4/d6/d4b/dca/c112 0 2024-09-20T19:06:08.297 INFO:tasks.workunit.client.0.smithi027.stdout:8/837: dwrite d2/d14/d13/d43/d5d/d90/fe5 [0,4194304] 0 2024-09-20T19:06:08.297 INFO:tasks.workunit.client.0.smithi027.stdout:7/769: mknod d3/d8/d26/d45/d56/dec/d51/c109 0 2024-09-20T19:06:08.300 INFO:tasks.workunit.client.0.smithi027.stdout:1/817: creat d2/d8/d2b/d2d/f10c x:0 0 0 2024-09-20T19:06:08.306 INFO:tasks.workunit.client.0.smithi027.stdout:9/903: dwrite d0/d97/fcc [0,4194304] 0 2024-09-20T19:06:08.306 INFO:tasks.workunit.client.0.smithi027.stdout:4/764: rename d5/d13/d7c/dd5 to d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2 0 2024-09-20T19:06:08.307 INFO:tasks.workunit.client.0.smithi027.stdout:6/817: dwrite d4/d15/d37/d7a/d46/d53/f101 [0,4194304] 0 2024-09-20T19:06:08.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/671: rename d4/d19/d1d/d2f/l85 to d4/d19/ld2 0 2024-09-20T19:06:08.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/672: chown d4/d25/d40/d80 7142989 1 2024-09-20T19:06:08.309 INFO:tasks.workunit.client.0.smithi027.stdout:4/765: read - d5/d13/d16/fdd zero size 2024-09-20T19:06:08.309 INFO:tasks.workunit.client.0.smithi027.stdout:3/839: mknod d0/d1/d65/d100/d111/c118 0 2024-09-20T19:06:08.311 INFO:tasks.workunit.client.0.smithi027.stdout:8/838: rmdir d2/d2a/df8 39 2024-09-20T19:06:08.314 INFO:tasks.workunit.client.0.smithi027.stdout:8/839: write d2/d3/d6/d6d/d75/feb [893447,127093] 0 2024-09-20T19:06:08.314 INFO:tasks.workunit.client.0.smithi027.stdout:6/818: write d4/d15/d37/d7a/d46/f71 [1440289,113060] 0 2024-09-20T19:06:08.314 INFO:tasks.workunit.client.0.smithi027.stdout:0/804: mknod d2/d20/c11f 0 2024-09-20T19:06:08.318 INFO:tasks.workunit.client.1.smithi098.stdout:1/639: dwrite d1/d3/d2e/d71/f8f [0,4194304] 0 2024-09-20T19:06:08.319 INFO:tasks.workunit.client.1.smithi098.stdout:6/495: creat d0/de/d1b/d37/d44/d24/d29/f99 x:0 0 0 2024-09-20T19:06:08.319 INFO:tasks.workunit.client.1.smithi098.stdout:1/640: dread - d1/d3/d2e/d61/fc8 zero size 2024-09-20T19:06:08.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:08 smithi027 ceph-mon[28196]: pgmap v12: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 92 MiB/s rd, 251 MiB/s wr, 499 op/s 2024-09-20T19:06:08.330 INFO:tasks.workunit.client.1.smithi098.stdout:7/774: creat d3/d76/ff6 x:0 0 0 2024-09-20T19:06:08.331 INFO:tasks.workunit.client.1.smithi098.stdout:8/771: getdents d7/de/d11/d19/d47 0 2024-09-20T19:06:08.338 INFO:tasks.workunit.client.0.smithi027.stdout:3/840: mkdir d0/d1/d65/d119 0 2024-09-20T19:06:08.339 INFO:tasks.workunit.client.0.smithi027.stdout:4/766: dwrite d5/d9b/db0/fd7 [4194304,4194304] 0 2024-09-20T19:06:08.340 INFO:tasks.workunit.client.1.smithi098.stdout:0/488: rename d0/d55/l36 to d0/db/d1d/d8f/l95 0 2024-09-20T19:06:08.342 INFO:tasks.workunit.client.0.smithi027.stdout:4/767: chown d5/d13/d36/d48/d3f/d4c/d52/lad 143 1 2024-09-20T19:06:08.343 INFO:tasks.workunit.client.1.smithi098.stdout:7/775: truncate d3/d10/d16/f6c 853075 0 2024-09-20T19:06:08.344 INFO:tasks.workunit.client.0.smithi027.stdout:8/840: rmdir d2/d14/d13/d43/d5d/d86 39 2024-09-20T19:06:08.346 INFO:tasks.workunit.client.0.smithi027.stdout:2/777: dwrite d3/d1c/d26/fb5 [0,4194304] 0 2024-09-20T19:06:08.347 INFO:tasks.workunit.client.1.smithi098.stdout:9/740: write d4/f16 [2448439,127094] 0 2024-09-20T19:06:08.348 INFO:tasks.workunit.client.0.smithi027.stdout:7/770: creat d3/d8/d26/d45/d56/dec/dc/dd9/d107/f10a x:0 0 0 2024-09-20T19:06:08.351 INFO:tasks.workunit.client.0.smithi027.stdout:1/818: mknod d2/d8/d74/c10d 0 2024-09-20T19:06:08.351 INFO:tasks.workunit.client.1.smithi098.stdout:0/489: read d0/f47 [1322919,109304] 0 2024-09-20T19:06:08.352 INFO:tasks.workunit.client.0.smithi027.stdout:5/865: link d4/f45 d4/da/de/d3e/db7/f11e 0 2024-09-20T19:06:08.352 INFO:tasks.workunit.client.0.smithi027.stdout:1/819: chown d2/d8/f20 237 1 2024-09-20T19:06:08.352 INFO:tasks.workunit.client.1.smithi098.stdout:0/490: chown d0/db/d1d/d8f/f39 267255477 1 2024-09-20T19:06:08.353 INFO:tasks.workunit.client.0.smithi027.stdout:3/841: dwrite d0/d1/d13/d64/fb6 [4194304,4194304] 0 2024-09-20T19:06:08.353 INFO:tasks.workunit.client.0.smithi027.stdout:1/820: fsync d2/f13 0 2024-09-20T19:06:08.355 INFO:tasks.workunit.client.1.smithi098.stdout:4/815: rename d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/dcc/l111 to d3/d6/d8c/de7/df4/dfe/l11b 0 2024-09-20T19:06:08.355 INFO:tasks.workunit.client.0.smithi027.stdout:3/842: chown d0/d1/d5e/d1d/d7d/db4/f10f 24290 1 2024-09-20T19:06:08.356 INFO:tasks.workunit.client.0.smithi027.stdout:9/904: write d0/d9/df/da2/de9/f124 [3922077,8631] 0 2024-09-20T19:06:08.357 INFO:tasks.workunit.client.1.smithi098.stdout:7/776: creat d3/d10/d16/d17/d33/d4b/ff7 x:0 0 0 2024-09-20T19:06:08.358 INFO:tasks.workunit.client.1.smithi098.stdout:6/496: write d0/de/d1b/d37/d43/d6d/f75 [1012961,7959] 0 2024-09-20T19:06:08.361 INFO:tasks.workunit.client.1.smithi098.stdout:9/741: creat d4/de/d27/ff0 x:0 0 0 2024-09-20T19:06:08.362 INFO:tasks.workunit.client.1.smithi098.stdout:1/641: dwrite d1/f96 [0,4194304] 0 2024-09-20T19:06:08.364 INFO:tasks.workunit.client.1.smithi098.stdout:1/642: chown d1/d3/d2e/fca 915446 1 2024-09-20T19:06:08.364 INFO:tasks.workunit.client.0.smithi027.stdout:4/768: rename d5/d11/d3d/lcc to d5/d11/d17/d1b/dd4/def/lf3 0 2024-09-20T19:06:08.366 INFO:tasks.workunit.client.0.smithi027.stdout:5/866: rmdir d4/d6c/d6f 39 2024-09-20T19:06:08.366 INFO:tasks.workunit.client.0.smithi027.stdout:4/769: write d5/d13/d16/f79 [985503,123794] 0 2024-09-20T19:06:08.366 INFO:tasks.workunit.client.0.smithi027.stdout:5/867: readlink d4/d1f/d7f/l5d 0 2024-09-20T19:06:08.369 INFO:tasks.workunit.client.0.smithi027.stdout:7/771: unlink d3/d8/d26/d45/d56/dec/d2e/l33 0 2024-09-20T19:06:08.371 INFO:tasks.workunit.client.0.smithi027.stdout:1/821: stat d2/d8/d3b/d44/d96/fa4 0 2024-09-20T19:06:08.371 INFO:tasks.workunit.client.0.smithi027.stdout:7/772: dread - d3/d8/d26/d45/d56/dec/dc/dd9/d107/f10a zero size 2024-09-20T19:06:08.372 INFO:tasks.workunit.client.1.smithi098.stdout:8/772: symlink d7/de/d11/d19/d30/d59/d80/df1/l10c 0 2024-09-20T19:06:08.372 INFO:tasks.workunit.client.0.smithi027.stdout:7/773: chown d3/d8/d26/f73 75 1 2024-09-20T19:06:08.373 INFO:tasks.workunit.client.0.smithi027.stdout:1/822: truncate d2/d8/d74/f91 1707668 0 2024-09-20T19:06:08.373 INFO:tasks.workunit.client.1.smithi098.stdout:8/773: fsync d7/de/d11/d19/d30/d55/da9/ff4 0 2024-09-20T19:06:08.373 INFO:tasks.workunit.client.1.smithi098.stdout:6/497: dread - d0/de/f56 zero size 2024-09-20T19:06:08.374 INFO:tasks.workunit.client.0.smithi027.stdout:7/774: write d3/d8/d1c/d61/f97 [344570,107123] 0 2024-09-20T19:06:08.379 INFO:tasks.workunit.client.0.smithi027.stdout:6/819: truncate d4/d15/d37/d7a/d8e/fa4 3984956 0 2024-09-20T19:06:08.380 INFO:tasks.workunit.client.0.smithi027.stdout:6/820: chown d4/lcd 46908 1 2024-09-20T19:06:08.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/491: creat d0/d8e/f96 x:0 0 0 2024-09-20T19:06:08.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/492: chown d0/d7d/d83 70536109 1 2024-09-20T19:06:08.387 INFO:tasks.workunit.client.1.smithi098.stdout:4/816: symlink d3/d6/de3/def/df5/l11c 0 2024-09-20T19:06:08.388 INFO:tasks.workunit.client.0.smithi027.stdout:3/843: mkdir d0/d19/d54/d11a 0 2024-09-20T19:06:08.393 INFO:tasks.workunit.client.1.smithi098.stdout:6/498: unlink d0/de/c96 0 2024-09-20T19:06:08.393 INFO:tasks.workunit.client.1.smithi098.stdout:1/643: write d1/d3/df/d34/d43/d65/f75 [567306,116823] 0 2024-09-20T19:06:08.398 INFO:tasks.workunit.client.1.smithi098.stdout:9/742: creat d4/de/d24/d35/d6d/d78/ff1 x:0 0 0 2024-09-20T19:06:08.400 INFO:tasks.workunit.client.1.smithi098.stdout:0/493: symlink d0/d6/d28/d31/d45/d60/l97 0 2024-09-20T19:06:08.400 INFO:tasks.workunit.client.1.smithi098.stdout:0/494: fsync d0/d6/d19/d4f/f72 0 2024-09-20T19:06:08.401 INFO:tasks.workunit.client.1.smithi098.stdout:0/495: write d0/d6/f89 [344471,46722] 0 2024-09-20T19:06:08.404 INFO:tasks.workunit.client.1.smithi098.stdout:3/673: rename d4/d25/d40/c62 to d4/d19/cd3 0 2024-09-20T19:06:08.406 INFO:tasks.workunit.client.0.smithi027.stdout:2/778: creat d3/de/ff9 x:0 0 0 2024-09-20T19:06:08.407 INFO:tasks.workunit.client.0.smithi027.stdout:9/905: link d0/d9/df/c7c d0/d9/df/d1b/d9c/d4f/d8d/c12c 0 2024-09-20T19:06:08.408 INFO:tasks.workunit.client.1.smithi098.stdout:1/644: mknod d1/d3/df/d34/d43/dad/dc1/cce 0 2024-09-20T19:06:08.409 INFO:tasks.workunit.client.0.smithi027.stdout:5/868: dwrite d4/da/de/d3e/fc5 [0,4194304] 0 2024-09-20T19:06:08.410 INFO:tasks.workunit.client.0.smithi027.stdout:4/770: dwrite d5/d13/d36/d48/d9f/dc9/d8f/fcb [0,4194304] 0 2024-09-20T19:06:08.410 INFO:tasks.workunit.client.0.smithi027.stdout:5/869: chown d4/da 68816 1 2024-09-20T19:06:08.410 INFO:tasks.workunit.client.1.smithi098.stdout:7/777: creat d3/d10/d16/d17/d33/d1f/ff8 x:0 0 0 2024-09-20T19:06:08.411 INFO:tasks.workunit.client.0.smithi027.stdout:9/906: write d0/d9/df/d1b/d9c/f54 [3260457,60729] 0 2024-09-20T19:06:08.411 INFO:tasks.workunit.client.1.smithi098.stdout:6/499: dwrite d0/de/d1b/f1f [0,4194304] 0 2024-09-20T19:06:08.413 INFO:tasks.workunit.client.1.smithi098.stdout:6/500: chown d0/de/d1b/d37/d43/l47 87514 1 2024-09-20T19:06:08.413 INFO:tasks.workunit.client.1.smithi098.stdout:9/743: mkdir d4/de/d27/d4a/d21/d25/df2 0 2024-09-20T19:06:08.416 INFO:tasks.workunit.client.1.smithi098.stdout:7/778: dread d3/d10/d16/d17/d33/d37/da0/f4d [0,4194304] 0 2024-09-20T19:06:08.416 INFO:tasks.workunit.client.1.smithi098.stdout:6/501: write d0/de/d1b/d37/d44/d24/d29/d50/f8e [337017,96938] 0 2024-09-20T19:06:08.419 INFO:tasks.workunit.client.1.smithi098.stdout:4/817: symlink d3/d6/l11d 0 2024-09-20T19:06:08.420 INFO:tasks.workunit.client.1.smithi098.stdout:7/779: stat d3/d10/d16/d17/d33/l56 0 2024-09-20T19:06:08.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/780: dread - d3/d10/d16/d17/d33/d1f/dba/fdd zero size 2024-09-20T19:06:08.426 INFO:tasks.workunit.client.1.smithi098.stdout:8/774: creat d7/de/d11/d19/d30/d59/d80/f10d x:0 0 0 2024-09-20T19:06:08.429 INFO:tasks.workunit.client.1.smithi098.stdout:1/645: fsync d1/d3/d2e/d68/d7a/da1/fbd 0 2024-09-20T19:06:08.435 INFO:tasks.workunit.client.1.smithi098.stdout:4/818: readlink d3/d6/d8c/de7/df4/d57/d7f/d84/lb0 0 2024-09-20T19:06:08.435 INFO:tasks.workunit.client.1.smithi098.stdout:4/819: stat d3/f16 0 2024-09-20T19:06:08.437 INFO:tasks.workunit.client.1.smithi098.stdout:8/775: creat d7/de/d11/dca/f10e x:0 0 0 2024-09-20T19:06:08.437 INFO:tasks.workunit.client.1.smithi098.stdout:4/820: stat d3/d6/d8c/de7/df4/d1e/d2a/d45/d91 0 2024-09-20T19:06:08.439 INFO:tasks.workunit.client.1.smithi098.stdout:0/496: link d0/db/c2b d0/d55/d67/c98 0 2024-09-20T19:06:08.444 INFO:tasks.workunit.client.1.smithi098.stdout:3/674: dread d4/d19/d1d/d2f/f8c [0,4194304] 0 2024-09-20T19:06:08.445 INFO:tasks.workunit.client.1.smithi098.stdout:6/502: dread d0/de/f5f [0,4194304] 0 2024-09-20T19:06:08.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/503: write d0/de/f8b [377476,112648] 0 2024-09-20T19:06:08.447 INFO:tasks.workunit.client.1.smithi098.stdout:8/776: creat d7/de/d11/d1f/d57/daa/f10f x:0 0 0 2024-09-20T19:06:08.452 INFO:tasks.workunit.client.1.smithi098.stdout:8/777: dread d7/dd2/fe3 [0,4194304] 0 2024-09-20T19:06:08.452 INFO:tasks.workunit.client.1.smithi098.stdout:8/778: write d7/f1c [137725,20133] 0 2024-09-20T19:06:08.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/497: unlink d0/d55/c5f 0 2024-09-20T19:06:08.465 INFO:tasks.workunit.client.0.smithi027.stdout:7/775: creat d3/d8/d26/d45/d56/dec/f10b x:0 0 0 2024-09-20T19:06:08.466 INFO:tasks.workunit.client.0.smithi027.stdout:7/776: stat d3/d8/d26/d45/daa 0 2024-09-20T19:06:08.466 INFO:tasks.workunit.client.1.smithi098.stdout:9/744: write d4/de/d27/d4a/d8e/f95 [474204,43658] 0 2024-09-20T19:06:08.466 INFO:tasks.workunit.client.1.smithi098.stdout:8/779: truncate d7/de/d11/d19/d30/d59/d80/f10d 767033 0 2024-09-20T19:06:08.466 INFO:tasks.workunit.client.0.smithi027.stdout:2/779: creat d3/d24/d89/ffa x:0 0 0 2024-09-20T19:06:08.467 INFO:tasks.workunit.client.1.smithi098.stdout:1/646: write d1/d3/df/d34/f5f [1806871,27168] 0 2024-09-20T19:06:08.469 INFO:tasks.workunit.client.0.smithi027.stdout:8/841: rename d2/d3/c4 to d2/d3/d6/d6d/c122 0 2024-09-20T19:06:08.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/781: dwrite d3/d10/d16/d17/d33/d4b/f55 [0,4194304] 0 2024-09-20T19:06:08.474 INFO:tasks.workunit.client.0.smithi027.stdout:2/780: dwrite d3/d1c/d26/fa2 [0,4194304] 0 2024-09-20T19:06:08.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:08 smithi098 ceph-mon[35737]: pgmap v12: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 92 MiB/s rd, 251 MiB/s wr, 499 op/s 2024-09-20T19:06:08.489 INFO:tasks.workunit.client.0.smithi027.stdout:7/777: dread d3/d8/d26/d45/f52 [0,4194304] 0 2024-09-20T19:06:08.493 INFO:tasks.workunit.client.0.smithi027.stdout:8/842: dread d2/d14/d13/d2e/fe2 [0,4194304] 0 2024-09-20T19:06:08.502 INFO:tasks.workunit.client.1.smithi098.stdout:4/821: getdents d3/d7d/da3 0 2024-09-20T19:06:08.502 INFO:tasks.workunit.client.1.smithi098.stdout:4/822: stat d3/dfb 0 2024-09-20T19:06:08.503 INFO:tasks.workunit.client.1.smithi098.stdout:4/823: write d3/d6/d8c/de7/df4/d57/d7f/d84/fbe [423824,8594] 0 2024-09-20T19:06:08.504 INFO:tasks.workunit.client.1.smithi098.stdout:0/498: creat d0/db/d1d/f99 x:0 0 0 2024-09-20T19:06:08.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/780: mkdir d7/de/d11/d1d/d110 0 2024-09-20T19:06:08.508 INFO:tasks.workunit.client.1.smithi098.stdout:6/504: write d0/de/f6b [115921,26326] 0 2024-09-20T19:06:08.509 INFO:tasks.workunit.client.1.smithi098.stdout:0/499: dread d0/db/d1d/f4d [0,4194304] 0 2024-09-20T19:06:08.515 INFO:tasks.workunit.client.0.smithi027.stdout:1/823: getdents d2/d8/d3b/d82/d87 0 2024-09-20T19:06:08.515 INFO:tasks.workunit.client.0.smithi027.stdout:1/824: chown d2/d8/d3b/d82/d90/d108/da3 5005896 1 2024-09-20T19:06:08.516 INFO:tasks.workunit.client.1.smithi098.stdout:6/505: dwrite d0/de/f8b [0,4194304] 0 2024-09-20T19:06:08.518 INFO:tasks.workunit.client.0.smithi027.stdout:3/844: rename d0/d1/d13/d98/dab/dba to d0/d1/d13/d3c/d93/d11b 0 2024-09-20T19:06:08.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/506: chown d0/de/d1b/d37/d44/d24/d29/d2b/d66 76 1 2024-09-20T19:06:08.523 INFO:tasks.workunit.client.0.smithi027.stdout:0/805: sync 2024-09-20T19:06:08.525 INFO:tasks.workunit.client.0.smithi027.stdout:7/778: rmdir d3/d8 39 2024-09-20T19:06:08.526 INFO:tasks.workunit.client.0.smithi027.stdout:0/806: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/c62 3706478 1 2024-09-20T19:06:08.528 INFO:tasks.workunit.client.0.smithi027.stdout:0/807: write d2/d48/d6b/d79/d9f/da4/ff4 [979122,19842] 0 2024-09-20T19:06:08.528 INFO:tasks.workunit.client.0.smithi027.stdout:9/907: mknod d0/c12d 0 2024-09-20T19:06:08.529 INFO:tasks.workunit.client.0.smithi027.stdout:0/808: fsync d2/d48/d6b/d79/d84/d1b/dc5/f88 0 2024-09-20T19:06:08.529 INFO:tasks.workunit.client.1.smithi098.stdout:9/745: dwrite d4/de/d27/d4a/d21/d25/d51/f55 [4194304,4194304] 0 2024-09-20T19:06:08.530 INFO:tasks.workunit.client.1.smithi098.stdout:4/824: unlink d3/d7d/da3/d3c/d6b/d73/d98/l10e 0 2024-09-20T19:06:08.530 INFO:tasks.workunit.client.0.smithi027.stdout:5/870: symlink d4/da/de/d3e/d69/d6a/d9e/l11f 0 2024-09-20T19:06:08.531 INFO:tasks.workunit.client.0.smithi027.stdout:5/871: stat d4/d1f/d28 0 2024-09-20T19:06:08.532 INFO:tasks.workunit.client.1.smithi098.stdout:6/507: mkdir d0/de/d1b/d37/d8c/d9a 0 2024-09-20T19:06:08.535 INFO:tasks.workunit.client.1.smithi098.stdout:6/508: write d0/de/d1b/d37/d44/f3d [628082,73604] 0 2024-09-20T19:06:08.535 INFO:tasks.workunit.client.1.smithi098.stdout:7/782: dread d3/d76/db8/fa4 [0,4194304] 0 2024-09-20T19:06:08.535 INFO:tasks.workunit.client.0.smithi027.stdout:3/845: write d0/d1/d5e/d1d/f84 [2775324,19754] 0 2024-09-20T19:06:08.536 INFO:tasks.workunit.client.1.smithi098.stdout:1/647: dread d1/d3/df/f58 [4194304,4194304] 0 2024-09-20T19:06:08.536 INFO:tasks.workunit.client.0.smithi027.stdout:3/846: fsync d0/d19/d54/f67 0 2024-09-20T19:06:08.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/500: link d0/db/d1d/f2a d0/d6/d28/d31/d45/d60/f9a 0 2024-09-20T19:06:08.541 INFO:tasks.workunit.client.1.smithi098.stdout:4/825: rmdir d3/d7d/da3/d3c/d6b/d73/d98 39 2024-09-20T19:06:08.542 INFO:tasks.workunit.client.0.smithi027.stdout:4/771: creat d5/d13/ff4 x:0 0 0 2024-09-20T19:06:08.549 INFO:tasks.workunit.client.1.smithi098.stdout:7/783: dread d3/d76/db8/fa9 [0,4194304] 0 2024-09-20T19:06:08.549 INFO:tasks.workunit.client.0.smithi027.stdout:3/847: unlink d0/d19/d54/d7a/fb8 0 2024-09-20T19:06:08.549 INFO:tasks.workunit.client.1.smithi098.stdout:9/746: dread d4/de/d27/d4a/d8e/f95 [0,4194304] 0 2024-09-20T19:06:08.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/826: rmdir d3/d4f 39 2024-09-20T19:06:08.550 INFO:tasks.workunit.client.1.smithi098.stdout:7/784: readlink d3/d10/d16/d17/d33/d37/da0/l25 0 2024-09-20T19:06:08.551 INFO:tasks.workunit.client.1.smithi098.stdout:8/781: getdents d7/de/d11/d19/d30/db5 0 2024-09-20T19:06:08.552 INFO:tasks.workunit.client.0.smithi027.stdout:8/843: creat d2/d2a/df8/d36/d115/f123 x:0 0 0 2024-09-20T19:06:08.556 INFO:tasks.workunit.client.0.smithi027.stdout:4/772: mkdir d5/d13/d36/d48/df5 0 2024-09-20T19:06:08.556 INFO:tasks.workunit.client.0.smithi027.stdout:3/848: dwrite d0/d1/d13/d15/d6f/dcc/ff8 [0,4194304] 0 2024-09-20T19:06:08.559 INFO:tasks.workunit.client.1.smithi098.stdout:9/747: readlink d4/de/d24/d35/d2d/da6/dae/d86/le6 0 2024-09-20T19:06:08.559 INFO:tasks.workunit.client.0.smithi027.stdout:1/825: write d2/d8/d2b/d2d/d73/fa8 [707540,93869] 0 2024-09-20T19:06:08.560 INFO:tasks.workunit.client.1.smithi098.stdout:7/785: symlink d3/d76/db8/lf9 0 2024-09-20T19:06:08.564 INFO:tasks.workunit.client.0.smithi027.stdout:2/781: dwrite d3/ff [0,4194304] 0 2024-09-20T19:06:08.564 INFO:tasks.workunit.client.0.smithi027.stdout:1/826: chown d2/f5c 22 1 2024-09-20T19:06:08.566 INFO:tasks.workunit.client.1.smithi098.stdout:1/648: write d1/f9f [4354892,56682] 0 2024-09-20T19:06:08.566 INFO:tasks.workunit.client.0.smithi027.stdout:6/821: dwrite d4/d15/d37/d7a/d8e/fa4 [4194304,4194304] 0 2024-09-20T19:06:08.568 INFO:tasks.workunit.client.1.smithi098.stdout:6/509: write d0/de/d1b/d37/d44/d24/d29/f35 [2202610,122371] 0 2024-09-20T19:06:08.568 INFO:tasks.workunit.client.1.smithi098.stdout:8/782: mknod d7/de/d11/d1f/d57/d72/de8/c111 0 2024-09-20T19:06:08.571 INFO:tasks.workunit.client.0.smithi027.stdout:2/782: chown d3/de/d34/f4e 345040 1 2024-09-20T19:06:08.574 INFO:tasks.workunit.client.0.smithi027.stdout:0/809: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7d [680971,15692] 0 2024-09-20T19:06:08.575 INFO:tasks.workunit.client.0.smithi027.stdout:7/779: getdents d3/d8/d26/d65/dc4 0 2024-09-20T19:06:08.576 INFO:tasks.workunit.client.1.smithi098.stdout:0/501: dwrite d0/db/fd [0,4194304] 0 2024-09-20T19:06:08.576 INFO:tasks.workunit.client.0.smithi027.stdout:5/872: dwrite d4/d1f/d91/f9d [0,4194304] 0 2024-09-20T19:06:08.577 INFO:tasks.workunit.client.1.smithi098.stdout:1/649: rmdir d1/d3/df/d34/d52 39 2024-09-20T19:06:08.581 INFO:tasks.workunit.client.0.smithi027.stdout:6/822: creat d4/dc7/f113 x:0 0 0 2024-09-20T19:06:08.582 INFO:tasks.workunit.client.1.smithi098.stdout:6/510: creat d0/de/d1b/d37/f9b x:0 0 0 2024-09-20T19:06:08.582 INFO:tasks.workunit.client.1.smithi098.stdout:6/511: chown d0/de/f18 12148444 1 2024-09-20T19:06:08.584 INFO:tasks.workunit.client.1.smithi098.stdout:7/786: rename d3/d10/d16/d17/d7c/f92 to d3/d10/d16/d17/d33/d37/ffa 0 2024-09-20T19:06:08.586 INFO:tasks.workunit.client.0.smithi027.stdout:2/783: symlink d3/d2f/lfb 0 2024-09-20T19:06:08.587 INFO:tasks.workunit.client.1.smithi098.stdout:8/783: symlink d7/de/d11/d1f/d57/d72/l112 0 2024-09-20T19:06:08.590 INFO:tasks.workunit.client.1.smithi098.stdout:8/784: dread - d7/de/d11/d19/d30/d55/da9/dbe/feb zero size 2024-09-20T19:06:08.590 INFO:tasks.workunit.client.1.smithi098.stdout:1/650: mknod d1/d3/d62/d9e/ccf 0 2024-09-20T19:06:08.592 INFO:tasks.workunit.client.1.smithi098.stdout:9/748: dwrite d4/f8 [0,4194304] 0 2024-09-20T19:06:08.592 INFO:tasks.workunit.client.0.smithi027.stdout:0/810: fdatasync d2/d48/d6b/d79/fb4 0 2024-09-20T19:06:08.594 INFO:tasks.workunit.client.0.smithi027.stdout:2/784: dwrite d3/d1c/d26/d2a/dc2/fd8 [0,4194304] 0 2024-09-20T19:06:08.594 INFO:tasks.workunit.client.0.smithi027.stdout:4/773: dread d5/f37 [0,4194304] 0 2024-09-20T19:06:08.595 INFO:tasks.workunit.client.0.smithi027.stdout:0/811: chown d2/d48/d6b/d79/d84 2006541 1 2024-09-20T19:06:08.598 INFO:tasks.workunit.client.1.smithi098.stdout:0/502: rename d0/d8e to d0/d6/d28/d31/d69/d9b 0 2024-09-20T19:06:08.600 INFO:tasks.workunit.client.1.smithi098.stdout:7/787: mkdir d3/d10/d16/d17/d33/d1f/d28/d66/dfb 0 2024-09-20T19:06:08.600 INFO:tasks.workunit.client.0.smithi027.stdout:0/812: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f9e [2692886,76492] 0 2024-09-20T19:06:08.601 INFO:tasks.workunit.client.0.smithi027.stdout:5/873: mkdir d4/da/de/d3e/db7/dc2/d87/df0/d120 0 2024-09-20T19:06:08.602 INFO:tasks.workunit.client.1.smithi098.stdout:4/827: getdents d3/d6/de3/def 0 2024-09-20T19:06:08.602 INFO:tasks.workunit.client.0.smithi027.stdout:5/874: chown d4/da/d1a/c3b 1399 1 2024-09-20T19:06:08.604 INFO:tasks.workunit.client.1.smithi098.stdout:4/828: write d3/d6/d8c/fec [590455,75864] 0 2024-09-20T19:06:08.605 INFO:tasks.workunit.client.0.smithi027.stdout:3/849: rmdir d0/d1/d13/d15/d6f/d110 0 2024-09-20T19:06:08.606 INFO:tasks.workunit.client.1.smithi098.stdout:6/512: dread d0/de/d1b/d37/d44/dc/f1a [0,4194304] 0 2024-09-20T19:06:08.608 INFO:tasks.workunit.client.0.smithi027.stdout:1/827: write d2/d8/d3b/d82/d90/d108/da3/dad/df9/fb4 [536554,13323] 0 2024-09-20T19:06:08.608 INFO:tasks.workunit.client.0.smithi027.stdout:5/875: read d4/da/de/d3e/d44/f77 [934550,44686] 0 2024-09-20T19:06:08.609 INFO:tasks.workunit.client.0.smithi027.stdout:4/774: unlink d5/d11/d1a/d2a/fe4 0 2024-09-20T19:06:08.611 INFO:tasks.workunit.client.1.smithi098.stdout:9/749: read d4/de/d48/f4d [6544997,109093] 0 2024-09-20T19:06:08.611 INFO:tasks.workunit.client.1.smithi098.stdout:6/513: dread d0/de/d1b/d37/d44/d24/d29/f8d [0,4194304] 0 2024-09-20T19:06:08.612 INFO:tasks.workunit.client.1.smithi098.stdout:0/503: symlink d0/db/d1d/l9c 0 2024-09-20T19:06:08.613 INFO:tasks.workunit.client.1.smithi098.stdout:9/750: truncate d4/de/d27/d4a/d8e/f95 1218478 0 2024-09-20T19:06:08.615 INFO:tasks.workunit.client.1.smithi098.stdout:7/788: truncate d3/d10/d16/d17/d33/d1f/f72 1507387 0 2024-09-20T19:06:08.619 INFO:tasks.workunit.client.0.smithi027.stdout:6/823: mknod d4/d15/d37/d6a/c114 0 2024-09-20T19:06:08.620 INFO:tasks.workunit.client.0.smithi027.stdout:6/824: write d4/f7 [16266589,129962] 0 2024-09-20T19:06:08.621 INFO:tasks.workunit.client.1.smithi098.stdout:1/651: rename d1/d3/df/d34/d52/d77/fa9 to d1/d3/df/d34/d43/d65/fd0 0 2024-09-20T19:06:08.622 INFO:tasks.workunit.client.0.smithi027.stdout:0/813: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f120 x:0 0 0 2024-09-20T19:06:08.627 INFO:tasks.workunit.client.1.smithi098.stdout:1/652: dwrite d1/d3/d2e/d71/f8f [4194304,4194304] 0 2024-09-20T19:06:08.628 INFO:tasks.workunit.client.1.smithi098.stdout:0/504: fsync d0/d6/d19/d4f/f50 0 2024-09-20T19:06:08.630 INFO:tasks.workunit.client.1.smithi098.stdout:0/505: chown d0/d6/d19/f33 5 1 2024-09-20T19:06:08.631 INFO:tasks.workunit.client.0.smithi027.stdout:1/828: rename d2/d8/d2b/f9e to d2/d8/d3b/d82/d87/f10e 0 2024-09-20T19:06:08.633 INFO:tasks.workunit.client.1.smithi098.stdout:9/751: truncate d4/de/d27/d4a/d21/d25/f30 339693 0 2024-09-20T19:06:08.634 INFO:tasks.workunit.client.0.smithi027.stdout:4/775: creat d5/d13/d36/d48/d9f/dc9/d8f/dc5/ff6 x:0 0 0 2024-09-20T19:06:08.634 INFO:tasks.workunit.client.1.smithi098.stdout:8/785: dwrite d7/de/d11/d19/d30/d59/d80/f8a [0,4194304] 0 2024-09-20T19:06:08.637 INFO:tasks.workunit.client.1.smithi098.stdout:7/789: unlink d3/lc 0 2024-09-20T19:06:08.641 INFO:tasks.workunit.client.1.smithi098.stdout:4/829: write d3/d6/d8c/de7/df4/d1e/d2a/d45/fe8 [125265,122665] 0 2024-09-20T19:06:08.642 INFO:tasks.workunit.client.1.smithi098.stdout:8/786: dwrite d7/de/d11/d19/f4a [0,4194304] 0 2024-09-20T19:06:08.643 INFO:tasks.workunit.client.0.smithi027.stdout:6/825: creat d4/d15/d2c/dcb/f115 x:0 0 0 2024-09-20T19:06:08.645 INFO:tasks.workunit.client.0.smithi027.stdout:7/780: dwrite d3/d8/d26/f3d [0,4194304] 0 2024-09-20T19:06:08.647 INFO:tasks.workunit.client.1.smithi098.stdout:7/790: dwrite d3/f12 [4194304,4194304] 0 2024-09-20T19:06:08.650 INFO:tasks.workunit.client.0.smithi027.stdout:3/850: mknod d0/d1/d65/dc9/d115/c11c 0 2024-09-20T19:06:08.652 INFO:tasks.workunit.client.1.smithi098.stdout:0/506: read d0/f47 [2312539,71916] 0 2024-09-20T19:06:08.654 INFO:tasks.workunit.client.0.smithi027.stdout:4/776: dread d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:08.654 INFO:tasks.workunit.client.0.smithi027.stdout:5/876: write d4/da/f2c [252048,99807] 0 2024-09-20T19:06:08.654 INFO:tasks.workunit.client.0.smithi027.stdout:4/777: chown d5/d13/d7c/ld3 0 1 2024-09-20T19:06:08.660 INFO:tasks.workunit.client.0.smithi027.stdout:1/829: symlink d2/d8/d3b/d82/d90/d108/da3/dad/l10f 0 2024-09-20T19:06:08.662 INFO:tasks.workunit.client.1.smithi098.stdout:0/507: dwrite d0/db/d1d/f87 [0,4194304] 0 2024-09-20T19:06:08.662 INFO:tasks.workunit.client.0.smithi027.stdout:2/785: link d3/d13/lae d3/d13/d3c/d48/dba/lfc 0 2024-09-20T19:06:08.663 INFO:tasks.workunit.client.0.smithi027.stdout:2/786: fdatasync d3/d24/d89/ff7 0 2024-09-20T19:06:08.666 INFO:tasks.workunit.client.1.smithi098.stdout:4/830: chown d3/l1b 56342177 1 2024-09-20T19:06:08.666 INFO:tasks.workunit.client.1.smithi098.stdout:8/787: rename d7/de/d11/d19/d30/lfa to d7/de/d11/d1f/dcd/db3/dcb/l113 0 2024-09-20T19:06:08.668 INFO:tasks.workunit.client.1.smithi098.stdout:1/653: getdents d1/d3/df/d34/d43/dad/dc1/dc7 0 2024-09-20T19:06:08.668 INFO:tasks.workunit.client.0.smithi027.stdout:7/781: creat d3/d8/d26/d45/d56/dec/d2e/d39/f10c x:0 0 0 2024-09-20T19:06:08.669 INFO:tasks.workunit.client.0.smithi027.stdout:0/814: unlink d2/d48/d6b/d79/d84/lea 0 2024-09-20T19:06:08.671 INFO:tasks.workunit.client.1.smithi098.stdout:0/508: fdatasync d0/d6/d28/f6f 0 2024-09-20T19:06:08.673 INFO:tasks.workunit.client.1.smithi098.stdout:0/509: read - d0/d6/d28/d31/d45/d60/f91 zero size 2024-09-20T19:06:08.674 INFO:tasks.workunit.client.1.smithi098.stdout:0/510: fdatasync d0/d55/f88 0 2024-09-20T19:06:08.675 INFO:tasks.workunit.client.0.smithi027.stdout:2/787: unlink d3/d1c/d26/d2a/dc2/d6f/fa0 0 2024-09-20T19:06:08.677 INFO:tasks.workunit.client.0.smithi027.stdout:6/826: mkdir d4/d6/d4b/d116 0 2024-09-20T19:06:08.679 INFO:tasks.workunit.client.1.smithi098.stdout:4/831: truncate d3/d7d/fd3 1144081 0 2024-09-20T19:06:08.679 INFO:tasks.workunit.client.0.smithi027.stdout:0/815: chown d2/fe 2478429 1 2024-09-20T19:06:08.680 INFO:tasks.workunit.client.1.smithi098.stdout:0/511: dwrite d0/db/f5d [0,4194304] 0 2024-09-20T19:06:08.680 INFO:tasks.workunit.client.0.smithi027.stdout:3/851: creat d0/d19/d54/d11a/f11d x:0 0 0 2024-09-20T19:06:08.681 INFO:tasks.workunit.client.1.smithi098.stdout:0/512: chown d0/db/d1d/l9c 34 1 2024-09-20T19:06:08.682 INFO:tasks.workunit.client.0.smithi027.stdout:7/782: truncate d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f7a 3259795 0 2024-09-20T19:06:08.684 INFO:tasks.workunit.client.1.smithi098.stdout:1/654: mkdir d1/d3/df/d34/d43/daa/dd1 0 2024-09-20T19:06:08.684 INFO:tasks.workunit.client.1.smithi098.stdout:0/513: readlink d0/d55/l49 0 2024-09-20T19:06:08.687 INFO:tasks.workunit.client.0.smithi027.stdout:6/827: symlink d4/d15/d93/l117 0 2024-09-20T19:06:08.688 INFO:tasks.workunit.client.1.smithi098.stdout:1/655: fdatasync d1/d3/d2e/d68/d7a/da1/fb9 0 2024-09-20T19:06:08.689 INFO:tasks.workunit.client.1.smithi098.stdout:0/514: rmdir d0/db/d1d/d8f 39 2024-09-20T19:06:08.690 INFO:tasks.workunit.client.1.smithi098.stdout:0/515: read - d0/d6/d28/d31/f53 zero size 2024-09-20T19:06:08.692 INFO:tasks.workunit.client.1.smithi098.stdout:9/752: write d4/de/d24/d35/d2d/da6/dae/d86/fcb [1111558,68751] 0 2024-09-20T19:06:08.692 INFO:tasks.workunit.client.0.smithi027.stdout:3/852: unlink d0/d1/d13/d15/d6f/d7f/lca 0 2024-09-20T19:06:08.693 INFO:tasks.workunit.client.1.smithi098.stdout:7/791: dread d3/d10/d16/d17/d33/d1f/d28/d7d/f94 [0,4194304] 0 2024-09-20T19:06:08.694 INFO:tasks.workunit.client.1.smithi098.stdout:9/753: fdatasync d4/de/d27/d4a/d21/f50 0 2024-09-20T19:06:08.694 INFO:tasks.workunit.client.0.smithi027.stdout:5/877: link d4/da/de/d3e/db7/fc9 d4/d6c/d6f/f121 0 2024-09-20T19:06:08.694 INFO:tasks.workunit.client.1.smithi098.stdout:7/792: stat d3/fda 0 2024-09-20T19:06:08.696 INFO:tasks.workunit.client.1.smithi098.stdout:7/793: chown d3/d10/d16/d17/d33/c20 12 1 2024-09-20T19:06:08.697 INFO:tasks.workunit.client.0.smithi027.stdout:7/783: dread d3/d8/fa5 [0,4194304] 0 2024-09-20T19:06:08.697 INFO:tasks.workunit.client.0.smithi027.stdout:1/830: creat d2/d8/d3b/f110 x:0 0 0 2024-09-20T19:06:08.698 INFO:tasks.workunit.client.1.smithi098.stdout:0/516: creat d0/d7d/f9d x:0 0 0 2024-09-20T19:06:08.700 INFO:tasks.workunit.client.0.smithi027.stdout:1/831: dread - d2/d8/d3b/d82/d90/d108/da3/fd9 zero size 2024-09-20T19:06:08.701 INFO:tasks.workunit.client.1.smithi098.stdout:9/754: creat d4/de/d27/d4a/d21/d25/ff3 x:0 0 0 2024-09-20T19:06:08.701 INFO:tasks.workunit.client.0.smithi027.stdout:4/778: dread d5/d9b/f4e [0,4194304] 0 2024-09-20T19:06:08.702 INFO:tasks.workunit.client.0.smithi027.stdout:6/828: mknod d4/d15/d37/d5a/c118 0 2024-09-20T19:06:08.704 INFO:tasks.workunit.client.1.smithi098.stdout:9/755: chown d4/de/d24/d35/dc4/fe1 11787 1 2024-09-20T19:06:08.704 INFO:tasks.workunit.client.0.smithi027.stdout:4/779: chown d5/d13/d36/d48/d9f/dc9/d8f/dc5 16776 1 2024-09-20T19:06:08.705 INFO:tasks.workunit.client.1.smithi098.stdout:7/794: dwrite d3/d10/d16/d17/d33/d1f/d28/d7d/fc4 [0,4194304] 0 2024-09-20T19:06:08.705 INFO:tasks.workunit.client.0.smithi027.stdout:4/780: fsync d5/d11/d3d/db4/fd0 0 2024-09-20T19:06:08.706 INFO:tasks.workunit.client.0.smithi027.stdout:3/853: creat d0/d19/d54/d11a/f11e x:0 0 0 2024-09-20T19:06:08.710 INFO:tasks.workunit.client.0.smithi027.stdout:5/878: rename d4/da/d117 to d4/da/de/d3e/d10b/d122 0 2024-09-20T19:06:08.711 INFO:tasks.workunit.client.1.smithi098.stdout:0/517: symlink d0/db/d7f/d93/l9e 0 2024-09-20T19:06:08.712 INFO:tasks.workunit.client.1.smithi098.stdout:0/518: chown d0/db/d32 15851595 1 2024-09-20T19:06:08.713 INFO:tasks.workunit.client.0.smithi027.stdout:2/788: link d3/de/d34/dc9/cf8 d3/d2f/def/cfd 0 2024-09-20T19:06:08.715 INFO:tasks.workunit.client.1.smithi098.stdout:7/795: truncate d3/d10/d16/d17/d33/f52 877615 0 2024-09-20T19:06:08.716 INFO:tasks.workunit.client.0.smithi027.stdout:6/829: mkdir d4/d15/d2c/d119 0 2024-09-20T19:06:08.718 INFO:tasks.workunit.client.0.smithi027.stdout:4/781: mkdir d5/d13/d7c/df7 0 2024-09-20T19:06:08.721 INFO:tasks.workunit.client.1.smithi098.stdout:0/519: truncate d0/d6/d28/d31/d45/d60/f9a 3327964 0 2024-09-20T19:06:08.723 INFO:tasks.workunit.client.1.smithi098.stdout:9/756: dread d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:06:08.724 INFO:tasks.workunit.client.0.smithi027.stdout:5/879: creat d4/da/de/d3e/db7/dc2/d105/f123 x:0 0 0 2024-09-20T19:06:08.726 INFO:tasks.workunit.client.1.smithi098.stdout:0/520: creat d0/d6/d28/d31/d45/f9f x:0 0 0 2024-09-20T19:06:08.728 INFO:tasks.workunit.client.1.smithi098.stdout:9/757: creat d4/d74/d8a/ff4 x:0 0 0 2024-09-20T19:06:08.728 INFO:tasks.workunit.client.0.smithi027.stdout:5/880: truncate d4/da/de/d3e/d61/fe3 485869 0 2024-09-20T19:06:08.729 INFO:tasks.workunit.client.0.smithi027.stdout:0/816: write d2/d20/fd6 [476073,115027] 0 2024-09-20T19:06:08.729 INFO:tasks.workunit.client.0.smithi027.stdout:1/832: dread d2/d8/f70 [0,4194304] 0 2024-09-20T19:06:08.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/832: dwrite d3/d6/f18 [0,4194304] 0 2024-09-20T19:06:08.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/833: readlink d3/ld6 0 2024-09-20T19:06:08.732 INFO:tasks.workunit.client.0.smithi027.stdout:4/782: unlink d5/d11/d17/d1b/d8d/fe5 0 2024-09-20T19:06:08.733 INFO:tasks.workunit.client.1.smithi098.stdout:0/521: rmdir d0/d6/d19 39 2024-09-20T19:06:08.733 INFO:tasks.workunit.client.0.smithi027.stdout:1/833: read d2/d8/d41/f88 [1170883,5116] 0 2024-09-20T19:06:08.735 INFO:tasks.workunit.client.0.smithi027.stdout:3/854: mknod d0/d38/c11f 0 2024-09-20T19:06:08.735 INFO:tasks.workunit.client.0.smithi027.stdout:4/783: dread d5/d11/d3d/d6e/fae [0,4194304] 0 2024-09-20T19:06:08.735 INFO:tasks.workunit.client.1.smithi098.stdout:4/834: dwrite d3/d6/d8c/de7/df4/f62 [0,4194304] 0 2024-09-20T19:06:08.736 INFO:tasks.workunit.client.1.smithi098.stdout:9/758: write f3 [1165887,27254] 0 2024-09-20T19:06:08.739 INFO:tasks.workunit.client.1.smithi098.stdout:7/796: getdents d3/d10/d16/d17/d33/d1f/dba 0 2024-09-20T19:06:08.741 INFO:tasks.workunit.client.0.smithi027.stdout:7/784: creat d3/d8/d26/d45/d56/f10d x:0 0 0 2024-09-20T19:06:08.747 INFO:tasks.workunit.client.1.smithi098.stdout:1/656: dwrite d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:06:08.747 INFO:tasks.workunit.client.0.smithi027.stdout:6/830: mknod d4/d6/d4b/d116/c11a 0 2024-09-20T19:06:08.750 INFO:tasks.workunit.client.1.smithi098.stdout:7/797: dread d3/d10/d16/d17/d33/d1f/d28/d7d/f3f [0,4194304] 0 2024-09-20T19:06:08.753 INFO:tasks.workunit.client.0.smithi027.stdout:5/881: mknod d4/d1f/d91/d9b/c124 0 2024-09-20T19:06:08.758 INFO:tasks.workunit.client.1.smithi098.stdout:1/657: fsync d1/d3/d2e/f47 0 2024-09-20T19:06:08.762 INFO:tasks.workunit.client.0.smithi027.stdout:7/785: dread d3/d8/d26/d45/d56/f7d [0,4194304] 0 2024-09-20T19:06:08.765 INFO:tasks.workunit.client.0.smithi027.stdout:2/789: dwrite d3/d13/d3c/f8c [0,4194304] 0 2024-09-20T19:06:08.765 INFO:tasks.workunit.client.0.smithi027.stdout:6/831: write d4/d6/d4b/dca/fd6 [4819605,116253] 0 2024-09-20T19:06:08.767 INFO:tasks.workunit.client.1.smithi098.stdout:9/759: rename d4/de/d27/d4a/d8e/fd2 to d4/de/d27/d4a/d21/ff5 0 2024-09-20T19:06:08.769 INFO:tasks.workunit.client.1.smithi098.stdout:9/760: fdatasync d4/de/d27/d4a/d21/d25/d51/d7b/fc5 0 2024-09-20T19:06:08.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/835: write d3/d5e/d9f/fc5 [3958859,28717] 0 2024-09-20T19:06:08.771 INFO:tasks.workunit.client.0.smithi027.stdout:1/834: chown d2/d8/d3b/d82/d87/fa5 116386 1 2024-09-20T19:06:08.776 INFO:tasks.workunit.client.0.smithi027.stdout:4/784: write d5/d13/d36/d48/d3f/d7e/fd9 [5093,15114] 0 2024-09-20T19:06:08.777 INFO:tasks.workunit.client.0.smithi027.stdout:7/786: unlink d3/d8/d26/f73 0 2024-09-20T19:06:08.778 INFO:tasks.workunit.client.1.smithi098.stdout:4/836: chown d3/d6/d8c/de7/df4/d57/d7f/lf0 15 1 2024-09-20T19:06:08.779 INFO:tasks.workunit.client.0.smithi027.stdout:2/790: symlink d3/d13/d3c/d48/lfe 0 2024-09-20T19:06:08.780 INFO:tasks.workunit.client.0.smithi027.stdout:1/835: stat d2/d61/cec 0 2024-09-20T19:06:08.780 INFO:tasks.workunit.client.0.smithi027.stdout:9/908: sync 2024-09-20T19:06:08.782 INFO:tasks.workunit.client.1.smithi098.stdout:9/761: mknod d4/de/d24/cf6 0 2024-09-20T19:06:08.782 INFO:tasks.workunit.client.0.smithi027.stdout:6/832: unlink d4/d15/d37/d39/f83 0 2024-09-20T19:06:08.784 INFO:tasks.workunit.client.1.smithi098.stdout:7/798: getdents d3/d10/dcf 0 2024-09-20T19:06:08.784 INFO:tasks.workunit.client.1.smithi098.stdout:9/762: chown d4/de/d27/d4a/d58/d5b/d9c/fdb 0 1 2024-09-20T19:06:08.784 INFO:tasks.workunit.client.0.smithi027.stdout:0/817: getdents d2 0 2024-09-20T19:06:08.787 INFO:tasks.workunit.client.0.smithi027.stdout:3/855: creat d0/dc5/deb/dfc/f120 x:0 0 0 2024-09-20T19:06:08.787 INFO:tasks.workunit.client.0.smithi027.stdout:6/833: chown d4/d6/d4b/dca/fd6 8382642 1 2024-09-20T19:06:08.787 INFO:tasks.workunit.client.0.smithi027.stdout:7/787: write d3/d8/d26/d45/d56/dec/d2e/d39/d102/fef [807204,72634] 0 2024-09-20T19:06:08.790 INFO:tasks.workunit.client.1.smithi098.stdout:9/763: creat d4/de/d27/d4a/d58/d5b/d9c/ff7 x:0 0 0 2024-09-20T19:06:08.790 INFO:tasks.workunit.client.0.smithi027.stdout:6/834: chown d4/dc7/f104 988498 1 2024-09-20T19:06:08.791 INFO:tasks.workunit.client.1.smithi098.stdout:4/837: getdents d3/dfb 0 2024-09-20T19:06:08.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/658: truncate d1/d3/df/d34/d52/fb8 1994153 0 2024-09-20T19:06:08.793 INFO:tasks.workunit.client.0.smithi027.stdout:1/836: rmdir d2/d8/d3b/d82/d87 39 2024-09-20T19:06:08.796 INFO:tasks.workunit.client.0.smithi027.stdout:5/882: dread d4/d1f/d28/f85 [0,4194304] 0 2024-09-20T19:06:08.797 INFO:tasks.workunit.client.0.smithi027.stdout:9/909: dwrite d0/d9/df/d1b/d9c/d5a/f63 [0,4194304] 0 2024-09-20T19:06:08.799 INFO:tasks.workunit.client.1.smithi098.stdout:4/838: fsync d3/d6/d8c/de7/df4/d1e/f54 0 2024-09-20T19:06:08.803 INFO:tasks.workunit.client.1.smithi098.stdout:1/659: creat d1/d3/df/d4a/d6d/fd2 x:0 0 0 2024-09-20T19:06:08.804 INFO:tasks.workunit.client.1.smithi098.stdout:1/660: readlink d1/d3/l11 0 2024-09-20T19:06:08.805 INFO:tasks.workunit.client.0.smithi027.stdout:3/856: stat d0/d1/d13/d15/d6f/cac 0 2024-09-20T19:06:08.807 INFO:tasks.workunit.client.1.smithi098.stdout:7/799: creat d3/d76/ffc x:0 0 0 2024-09-20T19:06:08.810 INFO:tasks.workunit.client.0.smithi027.stdout:2/791: dread d3/d24/f80 [0,4194304] 0 2024-09-20T19:06:08.811 INFO:tasks.workunit.client.0.smithi027.stdout:4/785: write d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fbb [740627,106501] 0 2024-09-20T19:06:08.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/661: dwrite d1/d3/df/d4a/d6d/f70 [0,4194304] 0 2024-09-20T19:06:08.813 INFO:tasks.workunit.client.0.smithi027.stdout:5/883: dwrite d4/d6c/d6f/d92/dc8/fd7 [4194304,4194304] 0 2024-09-20T19:06:08.813 INFO:tasks.workunit.client.0.smithi027.stdout:0/818: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f3b [0,4194304] 0 2024-09-20T19:06:08.814 INFO:tasks.workunit.client.0.smithi027.stdout:6/835: mknod d4/d15/d37/d6a/d91/c11b 0 2024-09-20T19:06:08.814 INFO:tasks.workunit.client.1.smithi098.stdout:1/662: write d1/d3/df/d34/d43/d53/f7f [4256980,123838] 0 2024-09-20T19:06:08.815 INFO:tasks.workunit.client.1.smithi098.stdout:1/663: fdatasync d1/d3/d62/fc9 0 2024-09-20T19:06:08.818 INFO:tasks.workunit.client.1.smithi098.stdout:9/764: rename d4/l41 to d4/lf8 0 2024-09-20T19:06:08.819 INFO:tasks.workunit.client.0.smithi027.stdout:4/786: readlink d5/d11/d17/d1b/d8d/le8 0 2024-09-20T19:06:08.819 INFO:tasks.workunit.client.0.smithi027.stdout:6/836: write d4/d1b/fd7 [2707898,127242] 0 2024-09-20T19:06:08.820 INFO:tasks.workunit.client.0.smithi027.stdout:3/857: dwrite d0/fbd [4194304,4194304] 0 2024-09-20T19:06:08.821 INFO:tasks.workunit.client.1.smithi098.stdout:9/765: read d4/d74/d8a/d94/fc0 [860547,46826] 0 2024-09-20T19:06:08.822 INFO:tasks.workunit.client.0.smithi027.stdout:6/837: chown d4/d1b 35 1 2024-09-20T19:06:08.822 INFO:tasks.workunit.client.0.smithi027.stdout:3/858: chown d0/d19 1524013645 1 2024-09-20T19:06:08.824 INFO:tasks.workunit.client.0.smithi027.stdout:5/884: symlink d4/da/d98/l125 0 2024-09-20T19:06:08.824 INFO:tasks.workunit.client.0.smithi027.stdout:4/787: fdatasync d5/d11/d51/fe0 0 2024-09-20T19:06:08.825 INFO:tasks.workunit.client.1.smithi098.stdout:1/664: link d1/d3/lb3 d1/d3/df/d34/d52/ld3 0 2024-09-20T19:06:08.825 INFO:tasks.workunit.client.0.smithi027.stdout:3/859: read d0/d1/d13/d3c/f42 [570280,76201] 0 2024-09-20T19:06:08.827 INFO:tasks.workunit.client.1.smithi098.stdout:9/766: creat d4/de/d24/d35/d6d/ff9 x:0 0 0 2024-09-20T19:06:08.828 INFO:tasks.workunit.client.0.smithi027.stdout:2/792: write d3/d13/d3c/d48/f62 [793867,88803] 0 2024-09-20T19:06:08.828 INFO:tasks.workunit.client.1.smithi098.stdout:1/665: symlink d1/d3/df/d34/d43/d65/ld4 0 2024-09-20T19:06:08.828 INFO:tasks.workunit.client.1.smithi098.stdout:4/839: dread d3/d6/d8c/de7/df4/d1e/d2a/d45/d91/fbf [8388608,4194304] 0 2024-09-20T19:06:08.829 INFO:tasks.workunit.client.0.smithi027.stdout:6/838: rmdir d4/d6/d4b 39 2024-09-20T19:06:08.829 INFO:tasks.workunit.client.1.smithi098.stdout:1/666: chown d1/d3/d2e/d68/lc5 41248 1 2024-09-20T19:06:08.830 INFO:tasks.workunit.client.0.smithi027.stdout:4/788: readlink d5/d11/d3d/lec 0 2024-09-20T19:06:08.830 INFO:tasks.workunit.client.0.smithi027.stdout:3/860: mknod d0/d1/d5e/d1d/da7/c121 0 2024-09-20T19:06:08.831 INFO:tasks.workunit.client.1.smithi098.stdout:9/767: symlink d4/de/d27/d4a/d8e/lfa 0 2024-09-20T19:06:08.832 INFO:tasks.workunit.client.0.smithi027.stdout:0/819: truncate d2/d48/d6b/d79/d84/d1b/d39/f6f 720095 0 2024-09-20T19:06:08.835 INFO:tasks.workunit.client.0.smithi027.stdout:0/820: read - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fb3 zero size 2024-09-20T19:06:08.836 INFO:tasks.workunit.client.0.smithi027.stdout:3/861: creat d0/d1/d13/d3c/d93/f122 x:0 0 0 2024-09-20T19:06:08.837 INFO:tasks.workunit.client.1.smithi098.stdout:4/840: creat d3/dfb/f11e x:0 0 0 2024-09-20T19:06:08.837 INFO:tasks.workunit.client.0.smithi027.stdout:8/844: sync 2024-09-20T19:06:08.838 INFO:tasks.workunit.client.1.smithi098.stdout:1/667: mkdir d1/d3/dd5 0 2024-09-20T19:06:08.839 INFO:tasks.workunit.client.0.smithi027.stdout:5/885: creat d4/da/de/d3e/d69/d75/d119/f126 x:0 0 0 2024-09-20T19:06:08.841 INFO:tasks.workunit.client.1.smithi098.stdout:9/768: symlink d4/de/d48/dec/lfb 0 2024-09-20T19:06:08.842 INFO:tasks.workunit.client.0.smithi027.stdout:4/789: unlink d5/d13/d36/d48/d3f/d4c/d52/d96/led 0 2024-09-20T19:06:08.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/841: symlink d3/d6/de3/l11f 0 2024-09-20T19:06:08.845 INFO:tasks.workunit.client.1.smithi098.stdout:1/668: dwrite d1/d3/d2e/d68/d7a/da1/fbd [0,4194304] 0 2024-09-20T19:06:08.846 INFO:tasks.workunit.client.0.smithi027.stdout:4/790: write d5/d13/d36/d48/d3f/d4c/d52/d87/d99/fbb [57351,100544] 0 2024-09-20T19:06:08.847 INFO:tasks.workunit.client.0.smithi027.stdout:9/910: write d0/d9/df/d1c/d6a/d6d/dd/d66/f8e [1196760,30836] 0 2024-09-20T19:06:08.850 INFO:tasks.workunit.client.0.smithi027.stdout:1/837: dwrite d2/d8/d2b/f9d [0,4194304] 0 2024-09-20T19:06:08.874 INFO:tasks.workunit.client.1.smithi098.stdout:5/530: sync 2024-09-20T19:06:08.876 INFO:tasks.workunit.client.0.smithi027.stdout:6/839: link d4/d15/d37/d5a/fee d4/d15/d37/d6a/dbf/f11c 0 2024-09-20T19:06:08.877 INFO:tasks.workunit.client.0.smithi027.stdout:6/840: fdatasync d4/d15/d37/d7a/f58 0 2024-09-20T19:06:08.878 INFO:tasks.workunit.client.0.smithi027.stdout:8/845: creat d2/d14/d13/d43/d5d/d90/f124 x:0 0 0 2024-09-20T19:06:08.879 INFO:tasks.workunit.client.1.smithi098.stdout:1/669: fdatasync d1/d3/df/f58 0 2024-09-20T19:06:08.880 INFO:tasks.workunit.client.1.smithi098.stdout:1/670: readlink d1/d3/df/d34/d52/lb1 0 2024-09-20T19:06:08.883 INFO:tasks.workunit.client.1.smithi098.stdout:9/769: dread d4/de/d27/d4a/d21/d25/d51/f55 [0,4194304] 0 2024-09-20T19:06:08.884 INFO:tasks.workunit.client.1.smithi098.stdout:5/531: chown d1/d1b/l30 1 1 2024-09-20T19:06:08.885 INFO:tasks.workunit.client.1.smithi098.stdout:5/532: chown d1/d46/d69/c6c 0 1 2024-09-20T19:06:08.886 INFO:tasks.workunit.client.1.smithi098.stdout:5/533: dread - d1/d71/d98/f9c zero size 2024-09-20T19:06:08.886 INFO:tasks.workunit.client.1.smithi098.stdout:5/534: chown d1/d1b/d40/f4c 29568 1 2024-09-20T19:06:08.888 INFO:tasks.workunit.client.0.smithi027.stdout:2/793: dwrite d3/d13/f4d [0,4194304] 0 2024-09-20T19:06:08.890 INFO:tasks.workunit.client.0.smithi027.stdout:2/794: chown d3/d13/d3c/dce/l81 3980 1 2024-09-20T19:06:08.890 INFO:tasks.workunit.client.0.smithi027.stdout:2/795: readlink d3/d13/d3c/l7f 0 2024-09-20T19:06:08.892 INFO:tasks.workunit.client.0.smithi027.stdout:0/821: write d2/d48/d6b/d79/fd4 [961398,39903] 0 2024-09-20T19:06:08.893 INFO:tasks.workunit.client.0.smithi027.stdout:1/838: mknod d2/d8/d3b/d44/d93/df3/c111 0 2024-09-20T19:06:08.898 INFO:tasks.workunit.client.0.smithi027.stdout:6/841: chown d4/d6/d4b/d7c/f6c 940988 1 2024-09-20T19:06:08.899 INFO:tasks.workunit.client.0.smithi027.stdout:0/822: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 0 1 2024-09-20T19:06:08.899 INFO:tasks.workunit.client.1.smithi098.stdout:9/770: mkdir d4/d74/dc8/dfc 0 2024-09-20T19:06:08.901 INFO:tasks.workunit.client.1.smithi098.stdout:4/842: getdents d3/d7d 0 2024-09-20T19:06:08.901 INFO:tasks.workunit.client.0.smithi027.stdout:9/911: dwrite d0/d9/df/d1c/fbc [0,4194304] 0 2024-09-20T19:06:08.902 INFO:tasks.workunit.client.0.smithi027.stdout:3/862: dwrite d0/d1/d13/d98/dc3/d104/faa [0,4194304] 0 2024-09-20T19:06:08.903 INFO:tasks.workunit.client.0.smithi027.stdout:9/912: fdatasync d0/d2e/f76 0 2024-09-20T19:06:08.904 INFO:tasks.workunit.client.1.smithi098.stdout:9/771: symlink d4/de/d48/lfd 0 2024-09-20T19:06:08.904 INFO:tasks.workunit.client.0.smithi027.stdout:4/791: getdents d5/d80/de6 0 2024-09-20T19:06:08.904 INFO:tasks.workunit.client.0.smithi027.stdout:3/863: stat d0/d1/d5e/c1b 0 2024-09-20T19:06:08.905 INFO:tasks.workunit.client.1.smithi098.stdout:1/671: write d1/d3/df/f23 [3319249,37624] 0 2024-09-20T19:06:08.909 INFO:tasks.workunit.client.1.smithi098.stdout:5/535: dread d1/fc [4194304,4194304] 0 2024-09-20T19:06:08.909 INFO:tasks.workunit.client.0.smithi027.stdout:2/796: rename d3/d1c/d26/d2a/f5d to d3/d24/d89/fff 0 2024-09-20T19:06:08.910 INFO:tasks.workunit.client.0.smithi027.stdout:0/823: rename d2/d48/d6b/d79/d9f/da4 to d2/d48/d6b/d79/d9f/da4/de6/d121 22 2024-09-20T19:06:08.910 INFO:tasks.workunit.client.1.smithi098.stdout:9/772: mkdir d4/d74/dc8/dfe 0 2024-09-20T19:06:08.913 INFO:tasks.workunit.client.0.smithi027.stdout:4/792: dwrite d5/d11/f68 [0,4194304] 0 2024-09-20T19:06:08.914 INFO:tasks.workunit.client.1.smithi098.stdout:1/672: creat d1/d3/df/d34/d43/daa/fd6 x:0 0 0 2024-09-20T19:06:08.915 INFO:tasks.workunit.client.0.smithi027.stdout:4/793: stat d5/d13/d36/d48 0 2024-09-20T19:06:08.915 INFO:tasks.workunit.client.0.smithi027.stdout:0/824: fsync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 0 2024-09-20T19:06:08.915 INFO:tasks.workunit.client.1.smithi098.stdout:1/673: chown d1/d3/d62 11095 1 2024-09-20T19:06:08.919 INFO:tasks.workunit.client.0.smithi027.stdout:6/842: chown d4/d15/d37/d6a/l98 6 1 2024-09-20T19:06:08.920 INFO:tasks.workunit.client.0.smithi027.stdout:5/886: link d4/d1f/d28/f8f d4/da/de/d3e/db7/dc2/d105/f127 0 2024-09-20T19:06:08.921 INFO:tasks.workunit.client.0.smithi027.stdout:5/887: readlink d4/d1f/d91/d9b/de8/l11c 0 2024-09-20T19:06:08.923 INFO:tasks.workunit.client.0.smithi027.stdout:6/843: read d4/d15/d37/d7a/d8e/fbe [18601,64171] 0 2024-09-20T19:06:08.924 INFO:tasks.workunit.client.1.smithi098.stdout:1/674: rename d1/d3/df/d34/d43/d53/f60 to d1/d3/df/d34/d43/daa/fd7 0 2024-09-20T19:06:08.924 INFO:tasks.workunit.client.1.smithi098.stdout:1/675: chown d1/d3/d62/fc9 179 1 2024-09-20T19:06:08.926 INFO:tasks.workunit.client.0.smithi027.stdout:5/888: read d4/d6c/d6f/d92/fc0 [821131,126798] 0 2024-09-20T19:06:08.927 INFO:tasks.workunit.client.0.smithi027.stdout:5/889: truncate d4/da/d1a/f108 766883 0 2024-09-20T19:06:08.928 INFO:tasks.workunit.client.1.smithi098.stdout:9/773: symlink d4/de/d27/d4a/lff 0 2024-09-20T19:06:08.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/536: rmdir d1/d17/d25/d56 39 2024-09-20T19:06:08.930 INFO:tasks.workunit.client.1.smithi098.stdout:4/843: getdents d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab 0 2024-09-20T19:06:08.931 INFO:tasks.workunit.client.0.smithi027.stdout:7/788: sync 2024-09-20T19:06:08.932 INFO:tasks.workunit.client.0.smithi027.stdout:8/846: dwrite d2/d3/d6/d21/d33/d79/d9f/f121 [0,4194304] 0 2024-09-20T19:06:08.932 INFO:tasks.workunit.client.0.smithi027.stdout:0/825: readlink d2/d48/d6b/d79/d9f/da4/ld7 0 2024-09-20T19:06:08.933 INFO:tasks.workunit.client.1.smithi098.stdout:5/537: read d1/d1b/f7e [655141,101558] 0 2024-09-20T19:06:08.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/774: creat d4/de/d24/d35/d2d/da6/dae/d86/f100 x:0 0 0 2024-09-20T19:06:08.934 INFO:tasks.workunit.client.1.smithi098.stdout:4/844: mkdir d3/d5e/de4/d120 0 2024-09-20T19:06:08.939 INFO:tasks.workunit.client.1.smithi098.stdout:9/775: creat d4/d74/d8a/f101 x:0 0 0 2024-09-20T19:06:08.941 INFO:tasks.workunit.client.1.smithi098.stdout:1/676: getdents d1/d3/df/d4a/d6d 0 2024-09-20T19:06:08.943 INFO:tasks.workunit.client.0.smithi027.stdout:9/913: mkdir d0/d9/df/d1c/d12e 0 2024-09-20T19:06:08.943 INFO:tasks.workunit.client.1.smithi098.stdout:1/677: write d1/d3/d62/fc9 [910935,74603] 0 2024-09-20T19:06:08.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/845: dwrite d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab/f105 [0,4194304] 0 2024-09-20T19:06:08.945 INFO:tasks.workunit.client.0.smithi027.stdout:3/864: symlink d0/d1/d13/d15/l123 0 2024-09-20T19:06:08.947 INFO:tasks.workunit.client.1.smithi098.stdout:9/776: symlink d4/d74/l102 0 2024-09-20T19:06:08.947 INFO:tasks.workunit.client.1.smithi098.stdout:4/846: dread d3/d6/d8c/de7/df4/d1e/d2a/d45/fe8 [0,4194304] 0 2024-09-20T19:06:08.954 INFO:tasks.workunit.client.1.smithi098.stdout:9/777: write d4/de/d27/d4a/d21/d25/d51/fdd [337695,77320] 0 2024-09-20T19:06:08.955 INFO:tasks.workunit.client.1.smithi098.stdout:5/538: write d1/d17/f97 [2310506,34277] 0 2024-09-20T19:06:08.955 INFO:tasks.workunit.client.0.smithi027.stdout:8/847: fsync d2/d3/d6/d6d/d75/fad 0 2024-09-20T19:06:08.955 INFO:tasks.workunit.client.0.smithi027.stdout:2/797: creat d3/d1c/dea/f100 x:0 0 0 2024-09-20T19:06:08.955 INFO:tasks.workunit.client.0.smithi027.stdout:1/839: mkdir d2/d8/d3b/d82/d87/dcf/d112 0 2024-09-20T19:06:08.956 INFO:tasks.workunit.client.1.smithi098.stdout:5/539: dread - d1/d46/d69/d84/d87/f8e zero size 2024-09-20T19:06:08.956 INFO:tasks.workunit.client.0.smithi027.stdout:3/865: dread d0/d19/f1a [0,4194304] 0 2024-09-20T19:06:08.957 INFO:tasks.workunit.client.0.smithi027.stdout:7/789: creat d3/d8/d1c/d61/f10e x:0 0 0 2024-09-20T19:06:08.957 INFO:tasks.workunit.client.1.smithi098.stdout:4/847: rmdir d3/d6/d8c/de7/df4/d1e 39 2024-09-20T19:06:08.957 INFO:tasks.workunit.client.0.smithi027.stdout:1/840: dread - d2/d8/d41/fe0 zero size 2024-09-20T19:06:08.959 INFO:tasks.workunit.client.0.smithi027.stdout:3/866: chown d0/d1/d13/d98/ca4 26 1 2024-09-20T19:06:08.961 INFO:tasks.workunit.client.0.smithi027.stdout:8/848: dwrite d2/d14/d13/d2e/f53 [0,4194304] 0 2024-09-20T19:06:08.962 INFO:tasks.workunit.client.0.smithi027.stdout:5/890: write d4/da/d98/faa [4565175,117609] 0 2024-09-20T19:06:08.962 INFO:tasks.workunit.client.1.smithi098.stdout:9/778: unlink d4/de/d27/d4a/f69 0 2024-09-20T19:06:08.970 INFO:tasks.workunit.client.1.smithi098.stdout:9/779: dwrite d4/de/d27/d4a/d21/d25/d51/d7b/fc5 [0,4194304] 0 2024-09-20T19:06:08.970 INFO:tasks.workunit.client.1.smithi098.stdout:4/848: creat d3/d6/d8c/f121 x:0 0 0 2024-09-20T19:06:08.975 INFO:tasks.workunit.client.0.smithi027.stdout:9/914: rename d0/d9/df/d57/fe8 to d0/d2e/d110/f12f 0 2024-09-20T19:06:08.976 INFO:tasks.workunit.client.0.smithi027.stdout:8/849: read d2/d14/d13/d43/f5b [5626955,95925] 0 2024-09-20T19:06:08.977 INFO:tasks.workunit.client.1.smithi098.stdout:1/678: dread d1/d3/d62/f8e [0,4194304] 0 2024-09-20T19:06:08.978 INFO:tasks.workunit.client.1.smithi098.stdout:4/849: rename d3/f100 to d3/dfb/f122 0 2024-09-20T19:06:08.980 INFO:tasks.workunit.client.0.smithi027.stdout:2/798: symlink d3/d1c/d26/df2/l101 0 2024-09-20T19:06:08.980 INFO:tasks.workunit.client.0.smithi027.stdout:4/794: dwrite d5/d11/d17/d1b/d8d/d26/f29 [0,4194304] 0 2024-09-20T19:06:08.983 INFO:tasks.workunit.client.0.smithi027.stdout:1/841: symlink d2/d61/df8/d56/l113 0 2024-09-20T19:06:08.986 INFO:tasks.workunit.client.0.smithi027.stdout:0/826: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/d108/l122 0 2024-09-20T19:06:08.987 INFO:tasks.workunit.client.1.smithi098.stdout:1/679: dwrite d1/d3/df/d34/d43/daa/fd6 [0,4194304] 0 2024-09-20T19:06:08.987 INFO:tasks.workunit.client.0.smithi027.stdout:6/844: symlink d4/d15/d37/d7a/d33/l11d 0 2024-09-20T19:06:08.990 INFO:tasks.workunit.client.0.smithi027.stdout:2/799: symlink d3/d1c/d31/d9e/l102 0 2024-09-20T19:06:08.991 INFO:tasks.workunit.client.0.smithi027.stdout:7/790: dread d3/d8/d1c/d61/f97 [0,4194304] 0 2024-09-20T19:06:08.991 INFO:tasks.workunit.client.1.smithi098.stdout:1/680: fdatasync d1/f81 0 2024-09-20T19:06:08.992 INFO:tasks.workunit.client.0.smithi027.stdout:9/915: dwrite d0/d9/df/d1c/d6a/d9a/f113 [0,4194304] 0 2024-09-20T19:06:08.993 INFO:tasks.workunit.client.1.smithi098.stdout:4/850: dwrite d3/d6/d8c/de7/df4/d1e/d2a/d45/ffa [0,4194304] 0 2024-09-20T19:06:08.994 INFO:tasks.workunit.client.0.smithi027.stdout:3/867: dread d0/d1/d13/f22 [0,4194304] 0 2024-09-20T19:06:08.996 INFO:tasks.workunit.client.0.smithi027.stdout:3/868: write d0/d1/d13/d15/d6f/d7f/f86 [1930980,49680] 0 2024-09-20T19:06:09.000 INFO:tasks.workunit.client.0.smithi027.stdout:1/842: creat d2/d8/f114 x:0 0 0 2024-09-20T19:06:09.006 INFO:tasks.workunit.client.1.smithi098.stdout:4/851: dwrite d3/d6/d8c/de7/df4/fe9 [0,4194304] 0 2024-09-20T19:06:09.008 INFO:tasks.workunit.client.1.smithi098.stdout:5/540: dwrite d1/d17/d2e/f51 [0,4194304] 0 2024-09-20T19:06:09.009 INFO:tasks.workunit.client.0.smithi027.stdout:2/800: mknod d3/de/d34/dc9/c103 0 2024-09-20T19:06:09.011 INFO:tasks.workunit.client.1.smithi098.stdout:9/780: dread d4/de/f7f [0,4194304] 0 2024-09-20T19:06:09.013 INFO:tasks.workunit.client.1.smithi098.stdout:9/781: write d4/de/d24/d35/d2d/da6/dae/d86/f100 [933659,39739] 0 2024-09-20T19:06:09.015 INFO:tasks.workunit.client.0.smithi027.stdout:6/845: creat d4/d15/d37/d7a/d46/d53/f11e x:0 0 0 2024-09-20T19:06:09.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/782: chown d4/de/d27/d4a/d58/d5b/lb6 182975687 1 2024-09-20T19:06:09.018 INFO:tasks.workunit.client.1.smithi098.stdout:5/541: creat d1/d17/d25/d79/f9f x:0 0 0 2024-09-20T19:06:09.021 INFO:tasks.workunit.client.1.smithi098.stdout:1/681: link d1/d3/d62/lae d1/d3/d2e/ld8 0 2024-09-20T19:06:09.023 INFO:tasks.workunit.client.0.smithi027.stdout:4/795: link d5/d13/d16/f8e d5/d13/d36/d48/ff8 0 2024-09-20T19:06:09.025 INFO:tasks.workunit.client.0.smithi027.stdout:3/869: creat d0/d1/d65/f124 x:0 0 0 2024-09-20T19:06:09.027 INFO:tasks.workunit.client.1.smithi098.stdout:4/852: rename d3/d5e/c60 to d3/d7d/da3/d3c/d6b/d73/d98/db3/d50/d58/dab/c123 0 2024-09-20T19:06:09.027 INFO:tasks.workunit.client.1.smithi098.stdout:9/783: rename d4/d74/d8a to d4/d74/d8a/d94/d103 22 2024-09-20T19:06:09.028 INFO:tasks.workunit.client.1.smithi098.stdout:4/853: fdatasync d3/d6/d8c/fec 0 2024-09-20T19:06:09.030 INFO:tasks.workunit.client.0.smithi027.stdout:5/891: rename d4/da/de/d3e/d69/d75/d3d/f68 to d4/d1f/d7f/f128 0 2024-09-20T19:06:09.032 INFO:tasks.workunit.client.1.smithi098.stdout:1/682: rename d1/d3/df/d4a/d6d/f70 to d1/d3/d2e/d61/fd9 0 2024-09-20T19:06:09.032 INFO:tasks.workunit.client.0.smithi027.stdout:2/801: dread d3/d13/f2b [0,4194304] 0 2024-09-20T19:06:09.035 INFO:tasks.workunit.client.0.smithi027.stdout:0/827: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/d118/f123 x:0 0 0 2024-09-20T19:06:09.036 INFO:tasks.workunit.client.1.smithi098.stdout:9/784: creat d4/de/d24/d35/d2d/da6/dae/d86/f104 x:0 0 0 2024-09-20T19:06:09.041 INFO:tasks.workunit.client.0.smithi027.stdout:6/846: dread d4/d15/d37/d6a/f73 [0,4194304] 0 2024-09-20T19:06:09.042 INFO:tasks.workunit.client.1.smithi098.stdout:5/542: rename d1/d17/d25/d56/c8a to d1/d46/d69/ca0 0 2024-09-20T19:06:09.042 INFO:tasks.workunit.client.1.smithi098.stdout:5/543: chown d1/d17/f97 632994532 1 2024-09-20T19:06:09.043 INFO:tasks.workunit.client.0.smithi027.stdout:5/892: creat d4/d1f/d91/d9b/de8/f129 x:0 0 0 2024-09-20T19:06:09.046 INFO:tasks.workunit.client.1.smithi098.stdout:1/683: mkdir d1/dda 0 2024-09-20T19:06:09.048 INFO:tasks.workunit.client.0.smithi027.stdout:2/802: symlink d3/d24/l104 0 2024-09-20T19:06:09.050 INFO:tasks.workunit.client.0.smithi027.stdout:4/796: link d5/d9b/db0/fba d5/d11/d17/d1b/d8d/ddb/ff9 0 2024-09-20T19:06:09.050 INFO:tasks.workunit.client.1.smithi098.stdout:1/684: truncate d1/d3/f1b 4364417 0 2024-09-20T19:06:09.055 INFO:tasks.workunit.client.0.smithi027.stdout:8/850: rename d2/d14/d13/d43/d5d/d86 to d2/d14/d13/db5/d125 0 2024-09-20T19:06:09.056 INFO:tasks.workunit.client.1.smithi098.stdout:1/685: symlink d1/d3/d2e/d61/ldb 0 2024-09-20T19:06:09.057 INFO:tasks.workunit.client.1.smithi098.stdout:5/544: link d1/d17/d25/f90 d1/d46/fa1 0 2024-09-20T19:06:09.058 INFO:tasks.workunit.client.1.smithi098.stdout:9/785: getdents d4/d74/d8a 0 2024-09-20T19:06:09.060 INFO:tasks.workunit.client.0.smithi027.stdout:9/916: getdents d0/d9/df 0 2024-09-20T19:06:09.061 INFO:tasks.workunit.client.0.smithi027.stdout:2/803: dread d3/d1c/d26/f67 [0,4194304] 0 2024-09-20T19:06:09.064 INFO:tasks.workunit.client.0.smithi027.stdout:1/843: mknod d2/d8/c115 0 2024-09-20T19:06:09.065 INFO:tasks.workunit.client.1.smithi098.stdout:5/545: creat d1/fa2 x:0 0 0 2024-09-20T19:06:09.067 INFO:tasks.workunit.client.0.smithi027.stdout:6/847: rename d4/d15/d93/dd5/feb to d4/d6/d4b/dca/dfe/f11f 0 2024-09-20T19:06:09.068 INFO:tasks.workunit.client.0.smithi027.stdout:8/851: unlink d2/d14/d13/d2e/fe2 0 2024-09-20T19:06:09.068 INFO:tasks.workunit.client.0.smithi027.stdout:8/852: readlink d2/d3/d9a/l8c 0 2024-09-20T19:06:09.070 INFO:tasks.workunit.client.0.smithi027.stdout:5/893: mkdir d4/d1f/d7f/d12a 0 2024-09-20T19:06:09.071 INFO:tasks.workunit.client.0.smithi027.stdout:5/894: truncate d4/da/de/d3e/db7/dc2/d105/f110 973643 0 2024-09-20T19:06:09.075 INFO:tasks.workunit.client.1.smithi098.stdout:5/546: creat d1/fa3 x:0 0 0 2024-09-20T19:06:09.076 INFO:tasks.workunit.client.0.smithi027.stdout:4/797: truncate d5/d11/d17/d1b/d8d/d26/f47 2239328 0 2024-09-20T19:06:09.078 INFO:tasks.workunit.client.0.smithi027.stdout:2/804: mkdir d3/d13/d3c/d48/d6a/d105 0 2024-09-20T19:06:09.078 INFO:tasks.workunit.client.0.smithi027.stdout:0/828: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [4194304,4194304] 0 2024-09-20T19:06:09.079 INFO:tasks.workunit.client.1.smithi098.stdout:9/786: write d4/de/d27/d4a/fd4 [50705,83124] 0 2024-09-20T19:06:09.081 INFO:tasks.workunit.client.0.smithi027.stdout:1/844: write d2/d8/d3b/d82/d90/d108/da3/fd9 [729224,129852] 0 2024-09-20T19:06:09.081 INFO:tasks.workunit.client.0.smithi027.stdout:6/848: truncate d4/d6/f56 1531940 0 2024-09-20T19:06:09.082 INFO:tasks.workunit.client.1.smithi098.stdout:5/547: dwrite d1/d17/d5e/f7d [0,4194304] 0 2024-09-20T19:06:09.087 INFO:tasks.workunit.client.0.smithi027.stdout:2/805: dwrite d3/d13/d3c/dce/fe0 [0,4194304] 0 2024-09-20T19:06:09.090 INFO:tasks.workunit.client.0.smithi027.stdout:2/806: write d3/d1c/d26/d2a/f85 [423433,100053] 0 2024-09-20T19:06:09.091 INFO:tasks.workunit.client.1.smithi098.stdout:9/787: read d4/de/d27/d4a/d21/d25/f30 [66188,41996] 0 2024-09-20T19:06:09.094 INFO:tasks.workunit.client.0.smithi027.stdout:4/798: creat d5/d11/d3d/d6e/ffa x:0 0 0 2024-09-20T19:06:09.095 INFO:tasks.workunit.client.1.smithi098.stdout:9/788: mknod d4/d74/d8a/d94/c105 0 2024-09-20T19:06:09.095 INFO:tasks.workunit.client.1.smithi098.stdout:5/548: mknod d1/d17/d25/d56/ca4 0 2024-09-20T19:06:09.096 INFO:tasks.workunit.client.0.smithi027.stdout:9/917: dwrite d0/d9/df/d1c/d6a/d6d/f36 [0,4194304] 0 2024-09-20T19:06:09.097 INFO:tasks.workunit.client.0.smithi027.stdout:0/829: symlink d2/d48/d6b/d79/d84/d1b/l124 0 2024-09-20T19:06:09.099 INFO:tasks.workunit.client.0.smithi027.stdout:6/849: creat d4/d15/d37/d5a/d78/dbc/f120 x:0 0 0 2024-09-20T19:06:09.100 INFO:tasks.workunit.client.0.smithi027.stdout:5/895: mknod d4/da/de/d3e/d69/d75/db4/de4/c12b 0 2024-09-20T19:06:09.101 INFO:tasks.workunit.client.0.smithi027.stdout:4/799: read d5/d13/d36/d48/d3f/d4c/d52/fc1 [776676,84057] 0 2024-09-20T19:06:09.102 INFO:tasks.workunit.client.0.smithi027.stdout:5/896: write d4/d1f/fe9 [563896,76908] 0 2024-09-20T19:06:09.103 INFO:tasks.workunit.client.0.smithi027.stdout:4/800: write d5/d11/d17/d1b/d8d/fa7 [527431,39062] 0 2024-09-20T19:06:09.111 INFO:tasks.workunit.client.1.smithi098.stdout:9/789: mkdir d4/de/d27/d6c/d73/d106 0 2024-09-20T19:06:09.112 INFO:tasks.workunit.client.1.smithi098.stdout:5/549: symlink d1/d17/d25/d79/la5 0 2024-09-20T19:06:09.114 INFO:tasks.workunit.client.1.smithi098.stdout:9/790: mknod d4/de/d24/d35/d2d/da6/c107 0 2024-09-20T19:06:09.115 INFO:tasks.workunit.client.1.smithi098.stdout:5/550: unlink d1/d71/c86 0 2024-09-20T19:06:09.116 INFO:tasks.workunit.client.0.smithi027.stdout:9/918: mknod d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/c130 0 2024-09-20T19:06:09.117 INFO:tasks.workunit.client.1.smithi098.stdout:9/791: mknod d4/d74/c108 0 2024-09-20T19:06:09.118 INFO:tasks.workunit.client.1.smithi098.stdout:5/551: mkdir d1/d46/da6 0 2024-09-20T19:06:09.122 INFO:tasks.workunit.client.0.smithi027.stdout:8/853: dread d2/d2a/df8/f2c [0,4194304] 0 2024-09-20T19:06:09.123 INFO:tasks.workunit.client.0.smithi027.stdout:8/854: chown d2/d3/d6/d6d/fb3 171496681 1 2024-09-20T19:06:09.124 INFO:tasks.workunit.client.0.smithi027.stdout:1/845: creat d2/d8/d3b/d82/d87/f116 x:0 0 0 2024-09-20T19:06:09.125 INFO:tasks.workunit.client.0.smithi027.stdout:2/807: link d3/d96/le9 d3/d13/d3c/d48/dba/de4/l106 0 2024-09-20T19:06:09.126 INFO:tasks.workunit.client.0.smithi027.stdout:4/801: rename d5/d13/d70 to d5/d13/dfb 0 2024-09-20T19:06:09.126 INFO:tasks.workunit.client.0.smithi027.stdout:8/855: truncate d2/d3/d11d/f3c 5901370 0 2024-09-20T19:06:09.130 INFO:tasks.workunit.client.0.smithi027.stdout:9/919: link d0/d9/df/d1b/d9c/d4f/d8d/cf9 d0/d9/df/d1c/d6a/d6d/c131 0 2024-09-20T19:06:09.132 INFO:tasks.workunit.client.0.smithi027.stdout:2/808: dread d3/d13/d3c/d48/f62 [0,4194304] 0 2024-09-20T19:06:09.134 INFO:tasks.workunit.client.0.smithi027.stdout:1/846: read d2/d8/d74/f79 [1643205,80958] 0 2024-09-20T19:06:09.134 INFO:tasks.workunit.client.0.smithi027.stdout:4/802: creat d5/d13/ffc x:0 0 0 2024-09-20T19:06:09.135 INFO:tasks.workunit.client.0.smithi027.stdout:9/920: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/d132 0 2024-09-20T19:06:09.137 INFO:tasks.workunit.client.0.smithi027.stdout:4/803: write d5/d13/d36/d48/d3f/d4c/d52/faa [608001,52642] 0 2024-09-20T19:06:09.138 INFO:tasks.workunit.client.0.smithi027.stdout:1/847: symlink d2/d8/d3b/d44/d93/l117 0 2024-09-20T19:06:09.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/792: dread d4/f16 [0,4194304] 0 2024-09-20T19:06:09.141 INFO:tasks.workunit.client.0.smithi027.stdout:2/809: truncate d3/d1c/f90 602226 0 2024-09-20T19:06:09.143 INFO:tasks.workunit.client.0.smithi027.stdout:4/804: creat d5/d13/d36/d48/d3f/d4c/ffd x:0 0 0 2024-09-20T19:06:09.144 INFO:tasks.workunit.client.0.smithi027.stdout:1/848: chown d2/d8/d41/l48 265 1 2024-09-20T19:06:09.144 INFO:tasks.workunit.client.0.smithi027.stdout:4/805: chown d5/d11/d1a/d2a/da3/de2 46708 1 2024-09-20T19:06:09.144 INFO:tasks.workunit.client.1.smithi098.stdout:9/793: mknod d4/de/d24/d35/dc4/c109 0 2024-09-20T19:06:09.145 INFO:tasks.workunit.client.0.smithi027.stdout:1/849: write d2/d8/d3b/d44/d93/fcd [611294,83687] 0 2024-09-20T19:06:09.145 INFO:tasks.workunit.client.0.smithi027.stdout:9/921: symlink d0/d9/df/d1b/d9c/l133 0 2024-09-20T19:06:09.146 INFO:tasks.workunit.client.1.smithi098.stdout:9/794: creat d4/de/d27/d6c/f10a x:0 0 0 2024-09-20T19:06:09.149 INFO:tasks.workunit.client.0.smithi027.stdout:4/806: rmdir d5/d11/d3d/db4 39 2024-09-20T19:06:09.151 INFO:tasks.workunit.client.0.smithi027.stdout:6/850: write d4/d15/d37/d7a/d8e/fbe [3128891,19393] 0 2024-09-20T19:06:09.152 INFO:tasks.workunit.client.0.smithi027.stdout:0/830: dwrite d2/d48/d6b/fbf [0,4194304] 0 2024-09-20T19:06:09.152 INFO:tasks.workunit.client.0.smithi027.stdout:4/807: dread - d5/d13/d36/d48/d9f/dc9/d8f/dc5/ff6 zero size 2024-09-20T19:06:09.154 INFO:tasks.workunit.client.1.smithi098.stdout:9/795: dwrite d4/de/d24/d35/dc4/fe1 [0,4194304] 0 2024-09-20T19:06:09.154 INFO:tasks.workunit.client.1.smithi098.stdout:5/552: write d1/d1b/f26 [1670967,65148] 0 2024-09-20T19:06:09.155 INFO:tasks.workunit.client.0.smithi027.stdout:4/808: write d5/d11/d17/d1b/dd4/de3/ff1 [484747,70357] 0 2024-09-20T19:06:09.157 INFO:tasks.workunit.client.0.smithi027.stdout:4/809: write d5/d13/d16/f8b [4736174,71826] 0 2024-09-20T19:06:09.158 INFO:tasks.workunit.client.1.smithi098.stdout:9/796: truncate d4/de/d24/d35/d6d/d78/ff1 100593 0 2024-09-20T19:06:09.160 INFO:tasks.workunit.client.1.smithi098.stdout:5/553: dread - d1/d17/d35/f80 zero size 2024-09-20T19:06:09.161 INFO:tasks.workunit.client.1.smithi098.stdout:5/554: stat d1/d17/d2e/f2f 0 2024-09-20T19:06:09.161 INFO:tasks.workunit.client.0.smithi027.stdout:5/897: truncate d4/d6c/d6f/d92/fd6 847951 0 2024-09-20T19:06:09.163 INFO:tasks.workunit.client.0.smithi027.stdout:9/922: creat d0/d9/df/d1b/d9c/f134 x:0 0 0 2024-09-20T19:06:09.163 INFO:tasks.workunit.client.1.smithi098.stdout:9/797: creat d4/de/f10b x:0 0 0 2024-09-20T19:06:09.166 INFO:tasks.workunit.client.1.smithi098.stdout:5/555: creat d1/d46/fa7 x:0 0 0 2024-09-20T19:06:09.166 INFO:tasks.workunit.client.0.smithi027.stdout:8/856: write d2/d3/d6/d21/f28 [3590464,61445] 0 2024-09-20T19:06:09.168 INFO:tasks.workunit.client.0.smithi027.stdout:0/831: creat d2/d119/f125 x:0 0 0 2024-09-20T19:06:09.168 INFO:tasks.workunit.client.0.smithi027.stdout:8/857: chown d2/d14/fa9 0 1 2024-09-20T19:06:09.170 INFO:tasks.workunit.client.1.smithi098.stdout:9/798: mkdir d4/de/d27/d4a/d58/d5b/d9c/d10c 0 2024-09-20T19:06:09.172 INFO:tasks.workunit.client.1.smithi098.stdout:5/556: rmdir d1/d17 39 2024-09-20T19:06:09.173 INFO:tasks.workunit.client.0.smithi027.stdout:6/851: chown d4/d15/d37/d7a/d33/lbb 3 1 2024-09-20T19:06:09.177 INFO:tasks.workunit.client.1.smithi098.stdout:5/557: chown d1/d1b/f1c 448 1 2024-09-20T19:06:09.180 INFO:tasks.workunit.client.0.smithi027.stdout:9/923: rename d0/d9/df/d1c/f72 to d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/f135 0 2024-09-20T19:06:09.180 INFO:tasks.workunit.client.0.smithi027.stdout:5/898: dread d4/da/f48 [0,4194304] 0 2024-09-20T19:06:09.181 INFO:tasks.workunit.client.0.smithi027.stdout:2/810: write d3/d13/d3c/d48/f88 [3508271,82661] 0 2024-09-20T19:06:09.182 INFO:tasks.workunit.client.0.smithi027.stdout:8/858: chown d2/d14/d13/d43/c87 463630467 1 2024-09-20T19:06:09.184 INFO:tasks.workunit.client.1.smithi098.stdout:5/558: rmdir d1/d17/d2e 39 2024-09-20T19:06:09.184 INFO:tasks.workunit.client.0.smithi027.stdout:5/899: write d4/da/de/d3e/d69/d75/d119/f126 [867264,12492] 0 2024-09-20T19:06:09.185 INFO:tasks.workunit.client.1.smithi098.stdout:5/559: truncate d1/d1b/f7e 8873160 0 2024-09-20T19:06:09.185 INFO:tasks.workunit.client.0.smithi027.stdout:6/852: symlink d4/d15/d2c/l121 0 2024-09-20T19:06:09.188 INFO:tasks.workunit.client.0.smithi027.stdout:5/900: chown d4/d1f/d7f/da4/dcf/fd4 858 1 2024-09-20T19:06:09.190 INFO:tasks.workunit.client.0.smithi027.stdout:1/850: dwrite d2/d61/df8/f4f [4194304,4194304] 0 2024-09-20T19:06:09.190 INFO:tasks.workunit.client.0.smithi027.stdout:9/924: creat d0/d9/df/da2/de9/df8/f136 x:0 0 0 2024-09-20T19:06:09.191 INFO:tasks.workunit.client.0.smithi027.stdout:5/901: dread - d4/da/de/d3e/db7/fc6 zero size 2024-09-20T19:06:09.193 INFO:tasks.workunit.client.0.smithi027.stdout:0/832: fsync d2/d48/d6b/d79/d84/d1b/d39/f6f 0 2024-09-20T19:06:09.194 INFO:tasks.workunit.client.0.smithi027.stdout:8/859: creat d2/d3/d113/f126 x:0 0 0 2024-09-20T19:06:09.196 INFO:tasks.workunit.client.0.smithi027.stdout:4/810: mkdir d5/d13/d36/d59/dfe 0 2024-09-20T19:06:09.197 INFO:tasks.workunit.client.0.smithi027.stdout:1/851: dread d2/d8/f70 [0,4194304] 0 2024-09-20T19:06:09.198 INFO:tasks.workunit.client.0.smithi027.stdout:1/852: stat d2/d8/d3b/d82/d87/dcf 0 2024-09-20T19:06:09.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/799: dwrite d4/de/d24/d35/f42 [0,4194304] 0 2024-09-20T19:06:09.200 INFO:tasks.workunit.client.0.smithi027.stdout:6/853: mknod d4/dc7/c122 0 2024-09-20T19:06:09.202 INFO:tasks.workunit.client.0.smithi027.stdout:5/902: readlink d4/da/de/lf 0 2024-09-20T19:06:09.203 INFO:tasks.workunit.client.0.smithi027.stdout:5/903: stat d4/d1f/d7f/da4/dcf/fd4 0 2024-09-20T19:06:09.205 INFO:tasks.workunit.client.0.smithi027.stdout:2/811: write d3/d1c/d26/f57 [570014,68177] 0 2024-09-20T19:06:09.206 INFO:tasks.workunit.client.0.smithi027.stdout:0/833: write d2/d20/f47 [365307,77246] 0 2024-09-20T19:06:09.208 INFO:tasks.workunit.client.0.smithi027.stdout:8/860: fdatasync d2/d3/d6/d21/f4e 0 2024-09-20T19:06:09.208 INFO:tasks.workunit.client.1.smithi098.stdout:5/560: dwrite d1/d17/f55 [0,4194304] 0 2024-09-20T19:06:09.214 INFO:tasks.workunit.client.0.smithi027.stdout:5/904: mknod d4/da/d1a/df8/c12c 0 2024-09-20T19:06:09.214 INFO:tasks.workunit.client.1.smithi098.stdout:5/561: mknod d1/d46/da6/ca8 0 2024-09-20T19:06:09.216 INFO:tasks.workunit.client.0.smithi027.stdout:5/905: write d4/d1f/d7f/da4/ff1 [945923,96464] 0 2024-09-20T19:06:09.216 INFO:tasks.workunit.client.0.smithi027.stdout:2/812: unlink d3/d1c/d26/df2/df6/f92 0 2024-09-20T19:06:09.217 INFO:tasks.workunit.client.0.smithi027.stdout:0/834: mkdir d2/d48/d6b/d79/ddc/d126 0 2024-09-20T19:06:09.218 INFO:tasks.workunit.client.1.smithi098.stdout:5/562: mkdir d1/d17/d35/da9 0 2024-09-20T19:06:09.219 INFO:tasks.workunit.client.0.smithi027.stdout:4/811: mkdir d5/d13/dff 0 2024-09-20T19:06:09.219 INFO:tasks.workunit.client.0.smithi027.stdout:8/861: read - d2/d14/fa9 zero size 2024-09-20T19:06:09.221 INFO:tasks.workunit.client.0.smithi027.stdout:6/854: fdatasync d4/d6/d4b/d7c/d64/f68 0 2024-09-20T19:06:09.222 INFO:tasks.workunit.client.1.smithi098.stdout:5/563: read d1/d1b/d40/f4c [3870104,10276] 0 2024-09-20T19:06:09.223 INFO:tasks.workunit.client.0.smithi027.stdout:9/925: rename d0/d9/df/d1c/d6a/d6d/dd/d66/ff3 to d0/d9/df/d1c/d6a/d6d/dd/f137 0 2024-09-20T19:06:09.224 INFO:tasks.workunit.client.0.smithi027.stdout:2/813: creat d3/d1c/d26/d2a/f107 x:0 0 0 2024-09-20T19:06:09.225 INFO:tasks.workunit.client.0.smithi027.stdout:0/835: rmdir d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106 39 2024-09-20T19:06:09.225 INFO:tasks.workunit.client.1.smithi098.stdout:5/564: rmdir d1/d17/d25/d56 39 2024-09-20T19:06:09.226 INFO:tasks.workunit.client.0.smithi027.stdout:4/812: dread - d5/d11/d3d/db4/fd2 zero size 2024-09-20T19:06:09.227 INFO:tasks.workunit.client.0.smithi027.stdout:1/853: link d2/d8/d3b/d82/d90/d108/da3/dad/l107 d2/d8/d74/d84/l118 0 2024-09-20T19:06:09.228 INFO:tasks.workunit.client.1.smithi098.stdout:5/565: mkdir d1/d46/daa 0 2024-09-20T19:06:09.228 INFO:tasks.workunit.client.1.smithi098.stdout:5/566: dread - d1/fa2 zero size 2024-09-20T19:06:09.231 INFO:tasks.workunit.client.0.smithi027.stdout:6/855: symlink d4/d15/d37/d6a/d7f/l123 0 2024-09-20T19:06:09.232 INFO:tasks.workunit.client.1.smithi098.stdout:5/567: mkdir d1/d17/d35/d54/dab 0 2024-09-20T19:06:09.235 INFO:tasks.workunit.client.0.smithi027.stdout:2/814: creat d3/d13/f108 x:0 0 0 2024-09-20T19:06:09.241 INFO:tasks.workunit.client.0.smithi027.stdout:6/856: symlink d4/d15/d37/d5a/d78/dbc/l124 0 2024-09-20T19:06:09.242 INFO:tasks.workunit.client.0.smithi027.stdout:4/813: dread d5/d11/d1a/d2a/fc2 [0,4194304] 0 2024-09-20T19:06:09.242 INFO:tasks.workunit.client.1.smithi098.stdout:5/568: dwrite d1/d17/d5e/f7d [0,4194304] 0 2024-09-20T19:06:09.242 INFO:tasks.workunit.client.0.smithi027.stdout:4/814: fdatasync d5/d13/d36/d48/d3f/fe9 0 2024-09-20T19:06:09.243 INFO:tasks.workunit.client.1.smithi098.stdout:5/569: dread - d1/d46/fa7 zero size 2024-09-20T19:06:09.244 INFO:tasks.workunit.client.0.smithi027.stdout:5/906: rename d4/d1f/d28/cc4 to d4/da/de/d3e/d69/d75/db4/c12d 0 2024-09-20T19:06:09.249 INFO:tasks.workunit.client.0.smithi027.stdout:0/836: write f1 [4311419,81805] 0 2024-09-20T19:06:09.251 INFO:tasks.workunit.client.1.smithi098.stdout:5/570: mkdir d1/d17/d2e/dac 0 2024-09-20T19:06:09.252 INFO:tasks.workunit.client.1.smithi098.stdout:5/571: stat d1/d17/d2e/dac 0 2024-09-20T19:06:09.252 INFO:tasks.workunit.client.0.smithi027.stdout:5/907: mkdir d4/da/de/d3e/db7/d12e 0 2024-09-20T19:06:09.253 INFO:tasks.workunit.client.0.smithi027.stdout:1/854: creat d2/d8/d74/f119 x:0 0 0 2024-09-20T19:06:09.254 INFO:tasks.workunit.client.0.smithi027.stdout:8/862: getdents d2/d14/d13/d43 0 2024-09-20T19:06:09.256 INFO:tasks.workunit.client.0.smithi027.stdout:0/837: creat d2/d48/d6b/d79/d9f/da4/de6/f127 x:0 0 0 2024-09-20T19:06:09.256 INFO:tasks.workunit.client.0.smithi027.stdout:4/815: mknod d5/d13/d7c/df7/c100 0 2024-09-20T19:06:09.258 INFO:tasks.workunit.client.0.smithi027.stdout:5/908: rename d4/da/de/d3e/d69/cbd to d4/da/de/d3e/d69/d75/db4/c12f 0 2024-09-20T19:06:09.258 INFO:tasks.workunit.client.0.smithi027.stdout:4/816: fdatasync d5/d13/d36/d48/d3f/f77 0 2024-09-20T19:06:09.259 INFO:tasks.workunit.client.1.smithi098.stdout:5/572: getdents d1/d71 0 2024-09-20T19:06:09.259 INFO:tasks.workunit.client.0.smithi027.stdout:1/855: truncate d2/d8/d41/f88 3086198 0 2024-09-20T19:06:09.260 INFO:tasks.workunit.client.0.smithi027.stdout:0/838: dread - d2/d48/d6b/d79/fac zero size 2024-09-20T19:06:09.261 INFO:tasks.workunit.client.0.smithi027.stdout:2/815: getdents d3/d1c/d26/d2a 0 2024-09-20T19:06:09.262 INFO:tasks.workunit.client.0.smithi027.stdout:8/863: dwrite d2/d3/d6/d21/d33/f74 [0,4194304] 0 2024-09-20T19:06:09.263 INFO:tasks.workunit.client.0.smithi027.stdout:4/817: read - d5/d13/d36/d48/d9f/dc9/d8f/fce zero size 2024-09-20T19:06:09.263 INFO:tasks.workunit.client.0.smithi027.stdout:6/857: getdents d4/d15 0 2024-09-20T19:06:09.266 INFO:tasks.workunit.client.1.smithi098.stdout:5/573: truncate d1/f9 445853 0 2024-09-20T19:06:09.269 INFO:tasks.workunit.client.0.smithi027.stdout:0/839: dread - d2/d48/d6b/d79/d9f/da4/de6/f11a zero size 2024-09-20T19:06:09.269 INFO:tasks.workunit.client.0.smithi027.stdout:2/816: write d3/d1c/d26/d2a/f85 [4103854,16769] 0 2024-09-20T19:06:09.271 INFO:tasks.workunit.client.0.smithi027.stdout:4/818: creat d5/d11/d17/d1b/f101 x:0 0 0 2024-09-20T19:06:09.272 INFO:tasks.workunit.client.0.smithi027.stdout:0/840: fdatasync d2/d48/fb1 0 2024-09-20T19:06:09.273 INFO:tasks.workunit.client.0.smithi027.stdout:2/817: chown d3/d13/d3c/d48/l56 41091 1 2024-09-20T19:06:09.273 INFO:tasks.workunit.client.0.smithi027.stdout:5/909: dwrite d4/da/de/d3e/fc5 [4194304,4194304] 0 2024-09-20T19:06:09.275 INFO:tasks.workunit.client.0.smithi027.stdout:1/856: creat d2/d8/d2b/d5e/f11a x:0 0 0 2024-09-20T19:06:09.276 INFO:tasks.workunit.client.0.smithi027.stdout:8/864: symlink d2/d3/d6/d21/d33/d79/dcf/l127 0 2024-09-20T19:06:09.280 INFO:tasks.workunit.client.0.smithi027.stdout:2/818: rmdir d3/d13/d3c 39 2024-09-20T19:06:09.286 INFO:tasks.workunit.client.0.smithi027.stdout:0/841: creat d2/d48/d6b/d79/ddc/d126/f128 x:0 0 0 2024-09-20T19:06:09.286 INFO:tasks.workunit.client.1.smithi098.stdout:5/574: write d1/d1b/f1c [2568876,79319] 0 2024-09-20T19:06:09.287 INFO:tasks.workunit.client.0.smithi027.stdout:1/857: symlink d2/d8/d2b/d5e/l11b 0 2024-09-20T19:06:09.288 INFO:tasks.workunit.client.0.smithi027.stdout:6/858: dread d4/d15/d37/d6a/d7f/f92 [0,4194304] 0 2024-09-20T19:06:09.290 INFO:tasks.workunit.client.0.smithi027.stdout:4/819: dread d5/d13/d36/d48/d3f/f86 [0,4194304] 0 2024-09-20T19:06:09.291 INFO:tasks.workunit.client.0.smithi027.stdout:6/859: stat d4/d15/d37/d6a/c114 0 2024-09-20T19:06:09.292 INFO:tasks.workunit.client.0.smithi027.stdout:0/842: mkdir d2/d48/d6b/d79/d84/d1b/d39/d129 0 2024-09-20T19:06:09.294 INFO:tasks.workunit.client.0.smithi027.stdout:2/819: dwrite d3/d13/d3c/d48/d6a/f72 [0,4194304] 0 2024-09-20T19:06:09.295 INFO:tasks.workunit.client.0.smithi027.stdout:0/843: dread - d2/d48/d6b/d79/ddc/d126/f128 zero size 2024-09-20T19:06:09.296 INFO:tasks.workunit.client.0.smithi027.stdout:2/820: write d3/ff [678459,41086] 0 2024-09-20T19:06:09.296 INFO:tasks.workunit.client.0.smithi027.stdout:4/820: dread d5/d13/d36/d48/d3f/d7e/fd9 [0,4194304] 0 2024-09-20T19:06:09.297 INFO:tasks.workunit.client.0.smithi027.stdout:1/858: getdents d2/d8/d3b/d82/d90 0 2024-09-20T19:06:09.300 INFO:tasks.workunit.client.0.smithi027.stdout:6/860: unlink d4/d15/d37/d7a/d33/c9f 0 2024-09-20T19:06:09.301 INFO:tasks.workunit.client.0.smithi027.stdout:0/844: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/c62 21 1 2024-09-20T19:06:09.302 INFO:tasks.workunit.client.0.smithi027.stdout:1/859: write d2/d8/d3b/fb9 [2522323,71917] 0 2024-09-20T19:06:09.302 INFO:tasks.workunit.client.1.smithi098.stdout:5/575: dwrite d1/d17/d2e/f5f [0,4194304] 0 2024-09-20T19:06:09.303 INFO:tasks.workunit.client.0.smithi027.stdout:2/821: mkdir d3/de/d109 0 2024-09-20T19:06:09.304 INFO:tasks.workunit.client.0.smithi027.stdout:0/845: mknod d2/c12a 0 2024-09-20T19:06:09.306 INFO:tasks.workunit.client.0.smithi027.stdout:4/821: dread d5/d13/d36/d48/d3f/d4c/d52/faa [0,4194304] 0 2024-09-20T19:06:09.306 INFO:tasks.workunit.client.0.smithi027.stdout:2/822: dread - d3/d1c/d26/d2a/fde zero size 2024-09-20T19:06:09.308 INFO:tasks.workunit.client.0.smithi027.stdout:1/860: truncate d2/d8/d3b/d44/d96/fa4 4551259 0 2024-09-20T19:06:09.308 INFO:tasks.workunit.client.0.smithi027.stdout:4/822: readlink d5/d11/d3d/lec 0 2024-09-20T19:06:09.310 INFO:tasks.workunit.client.0.smithi027.stdout:6/861: dread d4/d15/d2c/dcb/fcf [0,4194304] 0 2024-09-20T19:06:09.313 INFO:tasks.workunit.client.0.smithi027.stdout:8/865: dread d2/d2a/fd0 [0,4194304] 0 2024-09-20T19:06:09.315 INFO:tasks.workunit.client.0.smithi027.stdout:5/910: dread d4/d1f/d91/f94 [0,4194304] 0 2024-09-20T19:06:09.315 INFO:tasks.workunit.client.0.smithi027.stdout:2/823: dread d3/d24/f80 [0,4194304] 0 2024-09-20T19:06:09.315 INFO:tasks.workunit.client.0.smithi027.stdout:4/823: read d5/d13/d36/fb8 [436606,17218] 0 2024-09-20T19:06:09.319 INFO:tasks.workunit.client.0.smithi027.stdout:4/824: dwrite d5/d13/ffc [0,4194304] 0 2024-09-20T19:06:09.366 INFO:tasks.workunit.client.1.smithi098.stdout:5/576: mknod d1/d46/d69/d84/d87/cad 0 2024-09-20T19:06:09.369 INFO:tasks.workunit.client.0.smithi027.stdout:1/861: creat d2/d8/d3b/de3/f11c x:0 0 0 2024-09-20T19:06:09.372 INFO:tasks.workunit.client.1.smithi098.stdout:5/577: dwrite d1/fa2 [0,4194304] 0 2024-09-20T19:06:09.374 INFO:tasks.workunit.client.0.smithi027.stdout:8/866: symlink d2/d2a/df8/d36/d115/l128 0 2024-09-20T19:06:09.380 INFO:tasks.workunit.client.0.smithi027.stdout:1/862: unlink d2/d8/d3b/d44/c89 0 2024-09-20T19:06:09.382 INFO:tasks.workunit.client.1.smithi098.stdout:5/578: creat d1/d17/fae x:0 0 0 2024-09-20T19:06:09.383 INFO:tasks.workunit.client.1.smithi098.stdout:5/579: readlink d1/d17/d25/d79/la5 0 2024-09-20T19:06:09.383 INFO:tasks.workunit.client.0.smithi027.stdout:8/867: symlink d2/d14/d13/d43/d5d/d90/l129 0 2024-09-20T19:06:09.384 INFO:tasks.workunit.client.0.smithi027.stdout:5/911: symlink d4/d6c/l130 0 2024-09-20T19:06:09.386 INFO:tasks.workunit.client.0.smithi027.stdout:4/825: mkdir d5/d13/d102 0 2024-09-20T19:06:09.387 INFO:tasks.workunit.client.1.smithi098.stdout:5/580: mkdir d1/d1b/d40/daf 0 2024-09-20T19:06:09.388 INFO:tasks.workunit.client.0.smithi027.stdout:6/862: write d4/d15/d37/d6a/d91/fa2 [640757,6556] 0 2024-09-20T19:06:09.390 INFO:tasks.workunit.client.0.smithi027.stdout:8/868: symlink d2/d2a/df8/d36/d115/l12a 0 2024-09-20T19:06:09.390 INFO:tasks.workunit.client.0.smithi027.stdout:0/846: fsync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 0 2024-09-20T19:06:09.391 INFO:tasks.workunit.client.1.smithi098.stdout:5/581: mkdir d1/d17/d35/db0 0 2024-09-20T19:06:09.396 INFO:tasks.workunit.client.0.smithi027.stdout:0/847: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/c62 to d2/d48/c12b 0 2024-09-20T19:06:09.397 INFO:tasks.workunit.client.0.smithi027.stdout:0/848: readlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/lf 0 2024-09-20T19:06:09.398 INFO:tasks.workunit.client.0.smithi027.stdout:1/863: getdents d2/d8/d41 0 2024-09-20T19:06:09.399 INFO:tasks.workunit.client.0.smithi027.stdout:8/869: rename d2/d14/d13/d2e/d6c/d77 to d2/d14/d13/d2e/d6c/d77/d12b 22 2024-09-20T19:06:09.401 INFO:tasks.workunit.client.0.smithi027.stdout:6/863: creat d4/d6/d4b/f125 x:0 0 0 2024-09-20T19:06:09.401 INFO:tasks.workunit.client.0.smithi027.stdout:4/826: getdents d5/d11/d3d/d6e 0 2024-09-20T19:06:09.402 INFO:tasks.workunit.client.0.smithi027.stdout:4/827: stat d5/d11/d17/d1b/f101 0 2024-09-20T19:06:09.404 INFO:tasks.workunit.client.0.smithi027.stdout:8/870: chown d2/d2a/df8/ca6 59991444 1 2024-09-20T19:06:09.405 INFO:tasks.workunit.client.0.smithi027.stdout:6/864: mknod d4/d15/d37/d5a/d78/dbc/c126 0 2024-09-20T19:06:09.405 INFO:tasks.workunit.client.0.smithi027.stdout:8/871: readlink d2/d14/d13/d51/l7e 0 2024-09-20T19:06:09.405 INFO:tasks.workunit.client.1.smithi098.stdout:5/582: write d1/d17/d35/f80 [964784,20254] 0 2024-09-20T19:06:09.406 INFO:tasks.workunit.client.0.smithi027.stdout:7/791: sync 2024-09-20T19:06:09.419 INFO:tasks.workunit.client.0.smithi027.stdout:0/849: dwrite d2/d48/d6b/d79/d84/d1b/d39/dc7/ffd [0,4194304] 0 2024-09-20T19:06:09.420 INFO:tasks.workunit.client.0.smithi027.stdout:1/864: dread d2/d8/d74/d84/fdd [0,4194304] 0 2024-09-20T19:06:09.421 INFO:tasks.workunit.client.0.smithi027.stdout:7/792: dwrite d3/d8/d26/d45/dcc/fe0 [0,4194304] 0 2024-09-20T19:06:09.422 INFO:tasks.workunit.client.0.smithi027.stdout:1/865: read d2/d8/d41/f10b [526803,48035] 0 2024-09-20T19:06:09.427 INFO:tasks.workunit.client.0.smithi027.stdout:7/793: dwrite d3/d8/d26/d45/d56/dec/dc/dd9/d107/f10a [0,4194304] 0 2024-09-20T19:06:09.435 INFO:tasks.workunit.client.0.smithi027.stdout:6/865: creat d4/d15/d37/d7a/d46/d53/f127 x:0 0 0 2024-09-20T19:06:09.439 INFO:tasks.workunit.client.0.smithi027.stdout:0/850: mkdir d2/d12c 0 2024-09-20T19:06:09.439 INFO:tasks.workunit.client.0.smithi027.stdout:1/866: mkdir d2/d8/d3b/d82/d11d 0 2024-09-20T19:06:09.441 INFO:tasks.workunit.client.0.smithi027.stdout:7/794: creat d3/d8/d26/d65/dc4/d106/f10f x:0 0 0 2024-09-20T19:06:09.442 INFO:tasks.workunit.client.0.smithi027.stdout:8/872: getdents d2/d3/d6/d6d/d75 0 2024-09-20T19:06:09.444 INFO:tasks.workunit.client.0.smithi027.stdout:0/851: creat d2/d20/f12d x:0 0 0 2024-09-20T19:06:09.444 INFO:tasks.workunit.client.0.smithi027.stdout:7/795: readlink d3/d8/d26/d45/d56/dec/d51/l8c 0 2024-09-20T19:06:09.444 INFO:tasks.workunit.client.0.smithi027.stdout:6/866: dwrite d4/d1b/fd7 [4194304,4194304] 0 2024-09-20T19:06:09.445 INFO:tasks.workunit.client.0.smithi027.stdout:7/796: fsync d3/d8/fff 0 2024-09-20T19:06:09.446 INFO:tasks.workunit.client.0.smithi027.stdout:7/797: dread - d3/d8/d26/d45/daa/fb0 zero size 2024-09-20T19:06:09.446 INFO:tasks.workunit.client.0.smithi027.stdout:8/873: creat d2/d14/d13/d2e/d6c/f12c x:0 0 0 2024-09-20T19:06:09.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/514: sync 2024-09-20T19:06:09.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/675: sync 2024-09-20T19:06:09.450 INFO:tasks.workunit.client.1.smithi098.stdout:3/676: symlink d4/d38/d97/dcb/ld4 0 2024-09-20T19:06:09.451 INFO:tasks.workunit.client.0.smithi027.stdout:0/852: read d2/d48/d6b/d79/d84/d1b/f2b [678800,125782] 0 2024-09-20T19:06:09.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/515: creat d0/de/d1b/d37/d8c/d4c/f9c x:0 0 0 2024-09-20T19:06:09.452 INFO:tasks.workunit.client.0.smithi027.stdout:8/874: chown d2/d14/d13/d43/d5d/d90/l129 156 1 2024-09-20T19:06:09.452 INFO:tasks.workunit.client.1.smithi098.stdout:3/677: readlink d4/d38/lb6 0 2024-09-20T19:06:09.455 INFO:tasks.workunit.client.0.smithi027.stdout:6/867: dwrite d4/d15/d37/d6a/d91/fff [0,4194304] 0 2024-09-20T19:06:09.457 INFO:tasks.workunit.client.1.smithi098.stdout:6/516: symlink d0/de/d1b/d37/d44/d24/d29/d2b/d65/l9d 0 2024-09-20T19:06:09.457 INFO:tasks.workunit.client.1.smithi098.stdout:6/517: dread - d0/de/d1b/d37/f9b zero size 2024-09-20T19:06:09.458 INFO:tasks.workunit.client.0.smithi027.stdout:8/875: mkdir d2/d14/d13/d72/d12d 0 2024-09-20T19:06:09.461 INFO:tasks.workunit.client.0.smithi027.stdout:0/853: mknod d2/c12e 0 2024-09-20T19:06:09.461 INFO:tasks.workunit.client.0.smithi027.stdout:6/868: symlink d4/d15/d2c/dcb/l128 0 2024-09-20T19:06:09.468 INFO:tasks.workunit.client.0.smithi027.stdout:0/854: mkdir d2/d49/ded/d12f 0 2024-09-20T19:06:09.470 INFO:tasks.workunit.client.0.smithi027.stdout:0/855: mknod d2/db7/c130 0 2024-09-20T19:06:09.472 INFO:tasks.workunit.client.0.smithi027.stdout:0/856: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/lf9 0 2024-09-20T19:06:09.473 INFO:tasks.workunit.client.0.smithi027.stdout:0/857: fdatasync d2/d48/f76 0 2024-09-20T19:06:09.474 INFO:tasks.workunit.client.0.smithi027.stdout:0/858: rmdir d2/d48/d6b/d79/d84 39 2024-09-20T19:06:09.478 INFO:tasks.workunit.client.0.smithi027.stdout:0/859: mknod d2/d48/d6b/d79/d84/c131 0 2024-09-20T19:06:09.482 INFO:tasks.workunit.client.0.smithi027.stdout:0/860: getdents d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29 0 2024-09-20T19:06:09.484 INFO:tasks.workunit.client.0.smithi027.stdout:0/861: fsync d2/da2/f105 0 2024-09-20T19:06:09.485 INFO:tasks.workunit.client.0.smithi027.stdout:4/828: write d5/d13/d36/d59/f5b [1647113,24557] 0 2024-09-20T19:06:09.487 INFO:tasks.workunit.client.0.smithi027.stdout:0/862: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/l132 0 2024-09-20T19:06:09.490 INFO:tasks.workunit.client.0.smithi027.stdout:4/829: dwrite d5/d9b/db0/fd7 [0,4194304] 0 2024-09-20T19:06:09.491 INFO:tasks.workunit.client.1.smithi098.stdout:3/678: write d4/da/f51 [2440735,118423] 0 2024-09-20T19:06:09.491 INFO:tasks.workunit.client.1.smithi098.stdout:3/679: dread - d4/da/d7a/fb0 zero size 2024-09-20T19:06:09.492 INFO:tasks.workunit.client.1.smithi098.stdout:6/518: truncate d0/de/d1b/d37/d44/f13 15686446 0 2024-09-20T19:06:09.493 INFO:tasks.workunit.client.0.smithi027.stdout:8/876: truncate d2/d14/d13/d43/d5d/d90/fb2 403805 0 2024-09-20T19:06:09.497 INFO:tasks.workunit.client.1.smithi098.stdout:6/519: unlink d0/de/d1b/d37/f40 0 2024-09-20T19:06:09.499 INFO:tasks.workunit.client.1.smithi098.stdout:3/680: rename d4/ca6 to d4/d25/d40/d4b/cd5 0 2024-09-20T19:06:09.513 INFO:tasks.workunit.client.1.smithi098.stdout:6/520: truncate d0/de/d1b/d37/d44/f3d 660790 0 2024-09-20T19:06:09.520 INFO:tasks.workunit.client.1.smithi098.stdout:3/681: dread d4/d25/d8d/fab [0,4194304] 0 2024-09-20T19:06:09.523 INFO:tasks.workunit.client.1.smithi098.stdout:3/682: rename d4/d19/d1d/d22/l33 to d4/d19/d7b/ld6 0 2024-09-20T19:06:09.524 INFO:tasks.workunit.client.0.smithi027.stdout:3/870: sync 2024-09-20T19:06:09.524 INFO:tasks.workunit.client.0.smithi027.stdout:9/926: sync 2024-09-20T19:06:09.528 INFO:tasks.workunit.client.1.smithi098.stdout:3/683: write d4/d25/f2b [978824,64036] 0 2024-09-20T19:06:09.533 INFO:tasks.workunit.client.1.smithi098.stdout:3/684: write d4/d38/d48/d60/f99 [1050939,17829] 0 2024-09-20T19:06:09.535 INFO:tasks.workunit.client.0.smithi027.stdout:4/830: symlink d5/d13/d36/d48/d9f/l103 0 2024-09-20T19:06:09.535 INFO:tasks.workunit.client.0.smithi027.stdout:7/798: dwrite d3/d8/d26/d45/d56/dec/d2e/d49/d8b/fc3 [0,4194304] 0 2024-09-20T19:06:09.536 INFO:tasks.workunit.client.1.smithi098.stdout:3/685: dread d4/d38/d48/d60/f6b [0,4194304] 0 2024-09-20T19:06:09.539 INFO:tasks.workunit.client.0.smithi027.stdout:6/869: dwrite d4/d15/f2f [4194304,4194304] 0 2024-09-20T19:06:09.541 INFO:tasks.workunit.client.0.smithi027.stdout:9/927: dread d0/d9/df/d1b/d9c/d4f/f9b [0,4194304] 0 2024-09-20T19:06:09.541 INFO:tasks.workunit.client.0.smithi027.stdout:6/870: chown d4/d15/d37/d6a/d7f/f92 1366333 1 2024-09-20T19:06:09.543 INFO:tasks.workunit.client.1.smithi098.stdout:3/686: link d4/da/d7a/fc9 d4/d25/d40/fd7 0 2024-09-20T19:06:09.544 INFO:tasks.workunit.client.0.smithi027.stdout:6/871: dread - d4/d15/d37/d7a/d46/d53/f11e zero size 2024-09-20T19:06:09.544 INFO:tasks.workunit.client.0.smithi027.stdout:9/928: write d0/d9/df/d1c/d6a/d6d/f36 [2795093,38532] 0 2024-09-20T19:06:09.545 INFO:tasks.workunit.client.0.smithi027.stdout:8/877: creat d2/d2a/df8/f12e x:0 0 0 2024-09-20T19:06:09.546 INFO:tasks.workunit.client.0.smithi027.stdout:3/871: write d0/d1/d5e/f1e [6145613,66857] 0 2024-09-20T19:06:09.548 INFO:tasks.workunit.client.0.smithi027.stdout:4/831: creat d5/f104 x:0 0 0 2024-09-20T19:06:09.552 INFO:tasks.workunit.client.0.smithi027.stdout:6/872: fdatasync d4/d15/d37/d39/f54 0 2024-09-20T19:06:09.552 INFO:tasks.workunit.client.1.smithi098.stdout:3/687: getdents d4/d19/d1d/d2f/d4e/d59/d7c 0 2024-09-20T19:06:09.553 INFO:tasks.workunit.client.1.smithi098.stdout:3/688: readlink d4/d38/d39/l82 0 2024-09-20T19:06:09.554 INFO:tasks.workunit.client.1.smithi098.stdout:3/689: read d4/d38/d48/d60/f6b [230713,52873] 0 2024-09-20T19:06:09.554 INFO:tasks.workunit.client.0.smithi027.stdout:7/799: dwrite d3/d8/fa5 [0,4194304] 0 2024-09-20T19:06:09.555 INFO:tasks.workunit.client.0.smithi027.stdout:8/878: creat d2/d3/d6/f12f x:0 0 0 2024-09-20T19:06:09.557 INFO:tasks.workunit.client.0.smithi027.stdout:3/872: getdents d0/d1/d13/d3c/d93 0 2024-09-20T19:06:09.557 INFO:tasks.workunit.client.0.smithi027.stdout:6/873: mknod d4/d15/d37/d7a/d8e/c129 0 2024-09-20T19:06:09.558 INFO:tasks.workunit.client.1.smithi098.stdout:3/690: unlink d4/da/f14 0 2024-09-20T19:06:09.558 INFO:tasks.workunit.client.0.smithi027.stdout:7/800: write d3/d8/d26/d45/d56/dec/f10b [716318,110279] 0 2024-09-20T19:06:09.559 INFO:tasks.workunit.client.0.smithi027.stdout:8/879: chown d2/d3/d113/l120 1 1 2024-09-20T19:06:09.560 INFO:tasks.workunit.client.0.smithi027.stdout:6/874: mkdir d4/d12a 0 2024-09-20T19:06:09.560 INFO:tasks.workunit.client.0.smithi027.stdout:7/801: fsync d3/d8/d1c/d61/f10e 0 2024-09-20T19:06:09.562 INFO:tasks.workunit.client.0.smithi027.stdout:9/929: dread d0/f47 [0,4194304] 0 2024-09-20T19:06:09.563 INFO:tasks.workunit.client.1.smithi098.stdout:3/691: creat d4/d19/d1d/d2f/fd8 x:0 0 0 2024-09-20T19:06:09.565 INFO:tasks.workunit.client.0.smithi027.stdout:6/875: mknod d4/d6/d4b/d7c/c12b 0 2024-09-20T19:06:09.567 INFO:tasks.workunit.client.1.smithi098.stdout:3/692: creat d4/da/d7a/fd9 x:0 0 0 2024-09-20T19:06:09.570 INFO:tasks.workunit.client.1.smithi098.stdout:8/788: sync 2024-09-20T19:06:09.570 INFO:tasks.workunit.client.0.smithi027.stdout:9/930: dwrite d0/d9/df/d1b/f100 [0,4194304] 0 2024-09-20T19:06:09.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/693: dwrite d4/d19/fb9 [0,4194304] 0 2024-09-20T19:06:09.574 INFO:tasks.workunit.client.0.smithi027.stdout:7/802: link d3/d8/d26/d45/d56/dec/d2e/d50/c81 d3/d8/d26/d45/d56/dec/d2e/d39/d102/c110 0 2024-09-20T19:06:09.575 INFO:tasks.workunit.client.0.smithi027.stdout:6/876: dwrite d4/d15/d37/d7a/d46/f71 [0,4194304] 0 2024-09-20T19:06:09.578 INFO:tasks.workunit.client.0.smithi027.stdout:9/931: creat d0/d9/df/d1c/d6a/d6d/dd/d58/f138 x:0 0 0 2024-09-20T19:06:09.584 INFO:tasks.workunit.client.0.smithi027.stdout:6/877: creat d4/d15/d37/d5a/f12c x:0 0 0 2024-09-20T19:06:09.586 INFO:tasks.workunit.client.0.smithi027.stdout:3/873: dwrite d0/d1/d13/d64/f94 [0,4194304] 0 2024-09-20T19:06:09.587 INFO:tasks.workunit.client.1.smithi098.stdout:8/789: getdents d7/de/d11/d1f/d57 0 2024-09-20T19:06:09.588 INFO:tasks.workunit.client.0.smithi027.stdout:6/878: fsync d4/d15/d37/d6a/fb6 0 2024-09-20T19:06:09.588 INFO:tasks.workunit.client.1.smithi098.stdout:8/790: dread - d7/de/d11/d1f/d57/daa/f10f zero size 2024-09-20T19:06:09.590 INFO:tasks.workunit.client.0.smithi027.stdout:9/932: dwrite d0/d9/fec [0,4194304] 0 2024-09-20T19:06:09.590 INFO:tasks.workunit.client.0.smithi027.stdout:8/880: dread d2/d3/d11d/fd3 [0,4194304] 0 2024-09-20T19:06:09.591 INFO:tasks.workunit.client.0.smithi027.stdout:3/874: chown d0/c8f 0 1 2024-09-20T19:06:09.592 INFO:tasks.workunit.client.1.smithi098.stdout:8/791: symlink d7/de/d11/d19/d30/d55/l114 0 2024-09-20T19:06:09.595 INFO:tasks.workunit.client.0.smithi027.stdout:3/875: write d0/d1/d5e/d1d/f106 [968731,105398] 0 2024-09-20T19:06:09.595 INFO:tasks.workunit.client.0.smithi027.stdout:6/879: symlink d4/d15/d37/d6a/dbf/de0/l12d 0 2024-09-20T19:06:09.599 INFO:tasks.workunit.client.0.smithi027.stdout:6/880: creat d4/d15/d37/d7a/d46/de7/f12e x:0 0 0 2024-09-20T19:06:09.601 INFO:tasks.workunit.client.0.smithi027.stdout:3/876: rename d0/d1/d13/f37 to d0/d1/d13/d15/d6f/f125 0 2024-09-20T19:06:09.601 INFO:tasks.workunit.client.0.smithi027.stdout:8/881: link d2/d14/d13/d43/f49 d2/d3/d9a/dbf/f130 0 2024-09-20T19:06:09.602 INFO:tasks.workunit.client.0.smithi027.stdout:8/882: readlink d2/d3/d6/l3a 0 2024-09-20T19:06:09.603 INFO:tasks.workunit.client.1.smithi098.stdout:3/694: write d4/d25/f3c [1735603,67211] 0 2024-09-20T19:06:09.604 INFO:tasks.workunit.client.0.smithi027.stdout:3/877: rmdir d0/d1/d13/d15/d55 39 2024-09-20T19:06:09.604 INFO:tasks.workunit.client.1.smithi098.stdout:3/695: chown d4/d38/d39/l82 3 1 2024-09-20T19:06:09.605 INFO:tasks.workunit.client.1.smithi098.stdout:3/696: chown d4/d25/d40/d80/d94 12 1 2024-09-20T19:06:09.606 INFO:tasks.workunit.client.0.smithi027.stdout:8/883: creat d2/d3/d6/de0/f131 x:0 0 0 2024-09-20T19:06:09.606 INFO:tasks.workunit.client.0.smithi027.stdout:3/878: read d0/d1/d13/d3c/d93/d11b/fd4 [668306,37320] 0 2024-09-20T19:06:09.606 INFO:tasks.workunit.client.0.smithi027.stdout:6/881: creat d4/d15/d37/d7a/d33/f12f x:0 0 0 2024-09-20T19:06:09.607 INFO:tasks.workunit.client.0.smithi027.stdout:3/879: fsync d0/d1/d13/d3c/f62 0 2024-09-20T19:06:09.609 INFO:tasks.workunit.client.1.smithi098.stdout:3/697: unlink d4/d25/d40/c55 0 2024-09-20T19:06:09.610 INFO:tasks.workunit.client.0.smithi027.stdout:6/882: mkdir d4/d15/d37/d39/d130 0 2024-09-20T19:06:09.611 INFO:tasks.workunit.client.1.smithi098.stdout:3/698: rename d4/d19/d1d/d2f/d3e/ccf to d4/d38/d39/db4/cda 0 2024-09-20T19:06:09.614 INFO:tasks.workunit.client.0.smithi027.stdout:8/884: dwrite d2/d14/d13/d43/f7f [0,4194304] 0 2024-09-20T19:06:09.614 INFO:tasks.workunit.client.0.smithi027.stdout:3/880: dwrite d0/d1/d5e/f77 [0,4194304] 0 2024-09-20T19:06:09.619 INFO:tasks.workunit.client.0.smithi027.stdout:3/881: mkdir d0/d1/d65/d100/d126 0 2024-09-20T19:06:09.622 INFO:tasks.workunit.client.1.smithi098.stdout:3/699: dread d4/da/f6c [0,4194304] 0 2024-09-20T19:06:09.623 INFO:tasks.workunit.client.0.smithi027.stdout:3/882: symlink d0/d1/d5e/d1d/l127 0 2024-09-20T19:06:09.624 INFO:tasks.workunit.client.0.smithi027.stdout:7/803: dwrite d3/d8/d1c/d61/f89 [0,4194304] 0 2024-09-20T19:06:09.626 INFO:tasks.workunit.client.0.smithi027.stdout:7/804: write d3/d8/de5/ff0 [550311,92046] 0 2024-09-20T19:06:09.627 INFO:tasks.workunit.client.1.smithi098.stdout:8/792: write d7/de/d11/d1f/d9c/fc6 [916795,16816] 0 2024-09-20T19:06:09.634 INFO:tasks.workunit.client.1.smithi098.stdout:8/793: rmdir d7/de/d11/d19/d30/db5 39 2024-09-20T19:06:09.634 INFO:tasks.workunit.client.1.smithi098.stdout:3/700: dwrite d4/d38/d48/d60/f74 [0,4194304] 0 2024-09-20T19:06:09.639 INFO:tasks.workunit.client.0.smithi027.stdout:9/933: dread d0/d9/df/d1c/fb2 [4194304,4194304] 0 2024-09-20T19:06:09.640 INFO:tasks.workunit.client.1.smithi098.stdout:8/794: creat d7/dd2/f115 x:0 0 0 2024-09-20T19:06:09.640 INFO:tasks.workunit.client.0.smithi027.stdout:9/934: stat d0/d9/df/d1b/d9c/da4/cc4 0 2024-09-20T19:06:09.641 INFO:tasks.workunit.client.1.smithi098.stdout:8/795: chown d7/de/d11/d19/d30/d68/d78/lba 425 1 2024-09-20T19:06:09.642 INFO:tasks.workunit.client.0.smithi027.stdout:3/883: link d0/d1/d5e/cde d0/d1/d5e/d1d/d7d/db4/c128 0 2024-09-20T19:06:09.645 INFO:tasks.workunit.client.0.smithi027.stdout:3/884: mkdir d0/d1/d65/dbb/d129 0 2024-09-20T19:06:09.646 INFO:tasks.workunit.client.0.smithi027.stdout:9/935: mknod d0/c139 0 2024-09-20T19:06:09.649 INFO:tasks.workunit.client.1.smithi098.stdout:8/796: dwrite d7/de/d11/d19/d30/d55/da9/f103 [0,4194304] 0 2024-09-20T19:06:09.650 INFO:tasks.workunit.client.0.smithi027.stdout:9/936: read - d0/d9/df/d57/f84 zero size 2024-09-20T19:06:09.650 INFO:tasks.workunit.client.0.smithi027.stdout:8/885: write d2/d3/d11d/f4b [5123525,131050] 0 2024-09-20T19:06:09.652 INFO:tasks.workunit.client.0.smithi027.stdout:2/824: sync 2024-09-20T19:06:09.652 INFO:tasks.workunit.client.0.smithi027.stdout:5/912: sync 2024-09-20T19:06:09.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/797: symlink d7/de/d11/d19/d30/l116 0 2024-09-20T19:06:09.654 INFO:tasks.workunit.client.0.smithi027.stdout:6/883: dread d4/d15/d2c/f49 [0,4194304] 0 2024-09-20T19:06:09.654 INFO:tasks.workunit.client.0.smithi027.stdout:9/937: symlink d0/d9/df/d1c/d6a/d6d/dd/d66/l13a 0 2024-09-20T19:06:09.655 INFO:tasks.workunit.client.0.smithi027.stdout:8/886: mkdir d2/d3/d6/d21/d80/d132 0 2024-09-20T19:06:09.655 INFO:tasks.workunit.client.0.smithi027.stdout:5/913: rmdir d4/da/de/d3e/db7/dc2/d87 39 2024-09-20T19:06:09.657 INFO:tasks.workunit.client.0.smithi027.stdout:8/887: read d2/d3/d11d/f4f [2713124,8154] 0 2024-09-20T19:06:09.658 INFO:tasks.workunit.client.0.smithi027.stdout:2/825: symlink d3/d13/d3c/l10a 0 2024-09-20T19:06:09.662 INFO:tasks.workunit.client.0.smithi027.stdout:6/884: dread d4/d15/d37/f7b [0,4194304] 0 2024-09-20T19:06:09.662 INFO:tasks.workunit.client.1.smithi098.stdout:8/798: rename d7/de/d11/d19/d30/d55/da9/dbe/fd5 to d7/de/d11/d19/d30/d68/f117 0 2024-09-20T19:06:09.664 INFO:tasks.workunit.client.0.smithi027.stdout:2/826: rename d3/d13/f2b to d3/d1c/d26/df2/f10b 0 2024-09-20T19:06:09.667 INFO:tasks.workunit.client.1.smithi098.stdout:8/799: creat d7/de/d11/d19/d30/d82/f118 x:0 0 0 2024-09-20T19:06:09.668 INFO:tasks.workunit.client.0.smithi027.stdout:6/885: symlink d4/d15/d37/d5a/d78/l131 0 2024-09-20T19:06:09.669 INFO:tasks.workunit.client.0.smithi027.stdout:7/805: write d3/d8/d26/f4a [1217974,90773] 0 2024-09-20T19:06:09.669 INFO:tasks.workunit.client.0.smithi027.stdout:5/914: symlink d4/da/de/d3e/db7/dc2/d87/df0/d120/l131 0 2024-09-20T19:06:09.671 INFO:tasks.workunit.client.0.smithi027.stdout:6/886: truncate d4/d15/d37/d7a/f9b 167292 0 2024-09-20T19:06:09.672 INFO:tasks.workunit.client.1.smithi098.stdout:3/701: write d4/d25/d40/d80/f86 [1812159,112606] 0 2024-09-20T19:06:09.673 INFO:tasks.workunit.client.0.smithi027.stdout:7/806: creat d3/d8/d26/d45/daa/f111 x:0 0 0 2024-09-20T19:06:09.674 INFO:tasks.workunit.client.0.smithi027.stdout:7/807: write d3/f5 [1192520,40508] 0 2024-09-20T19:06:09.676 INFO:tasks.workunit.client.0.smithi027.stdout:1/867: sync 2024-09-20T19:06:09.676 INFO:tasks.workunit.client.0.smithi027.stdout:4/832: sync 2024-09-20T19:06:09.676 INFO:tasks.workunit.client.0.smithi027.stdout:0/863: sync 2024-09-20T19:06:09.676 INFO:tasks.workunit.client.0.smithi027.stdout:5/915: mknod d4/da/de/d3e/d69/d6a/d9e/c132 0 2024-09-20T19:06:09.677 INFO:tasks.workunit.client.0.smithi027.stdout:6/887: dread d4/d15/d37/d7a/f77 [0,4194304] 0 2024-09-20T19:06:09.678 INFO:tasks.workunit.client.0.smithi027.stdout:1/868: chown d2/d8/d3b/d82/d87/dcf/d112 160487 1 2024-09-20T19:06:09.679 INFO:tasks.workunit.client.0.smithi027.stdout:2/827: link d3/d2f/lfb d3/d13/d3c/d48/l10c 0 2024-09-20T19:06:09.680 INFO:tasks.workunit.client.0.smithi027.stdout:7/808: rmdir d3/d24/d84 39 2024-09-20T19:06:09.681 INFO:tasks.workunit.client.1.smithi098.stdout:3/702: creat d4/d25/fdb x:0 0 0 2024-09-20T19:06:09.681 INFO:tasks.workunit.client.0.smithi027.stdout:9/938: write d0/d9/df/d1c/d6a/d6d/dd/f5b [3715076,63674] 0 2024-09-20T19:06:09.682 INFO:tasks.workunit.client.0.smithi027.stdout:6/888: mknod d4/d15/d37/d39/c132 0 2024-09-20T19:06:09.683 INFO:tasks.workunit.client.1.smithi098.stdout:3/703: fdatasync d4/d19/d1d/d2f/f66 0 2024-09-20T19:06:09.683 INFO:tasks.workunit.client.1.smithi098.stdout:3/704: dread - d4/d25/d40/fd7 zero size 2024-09-20T19:06:09.684 INFO:tasks.workunit.client.0.smithi027.stdout:1/869: write d2/d8/d3b/f10a [135539,107056] 0 2024-09-20T19:06:09.685 INFO:tasks.workunit.client.0.smithi027.stdout:5/916: mknod d4/d1f/d7f/d12a/c133 0 2024-09-20T19:06:09.685 INFO:tasks.workunit.client.1.smithi098.stdout:3/705: dread - d4/d38/d48/f79 zero size 2024-09-20T19:06:09.686 INFO:tasks.workunit.client.0.smithi027.stdout:0/864: dread d2/d48/d6b/d79/d84/d1b/d39/f81 [0,4194304] 0 2024-09-20T19:06:09.687 INFO:tasks.workunit.client.0.smithi027.stdout:3/885: dwrite d0/d1/d13/d3c/d93/d11b/fd4 [0,4194304] 0 2024-09-20T19:06:09.688 INFO:tasks.workunit.client.0.smithi027.stdout:4/833: rename d5/d11/d17/d1b/fa0 to d5/d11/d17/d1b/d8d/ddb/f105 0 2024-09-20T19:06:09.690 INFO:tasks.workunit.client.0.smithi027.stdout:4/834: stat d5/d11/l19 0 2024-09-20T19:06:09.693 INFO:tasks.workunit.client.0.smithi027.stdout:8/888: dread d2/d3/f11 [0,4194304] 0 2024-09-20T19:06:09.696 INFO:tasks.workunit.client.0.smithi027.stdout:2/828: truncate d3/d13/d3c/d48/d6a/fb2 154576 0 2024-09-20T19:06:09.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/706: dread d4/d38/d48/f75 [0,4194304] 0 2024-09-20T19:06:09.699 INFO:tasks.workunit.client.0.smithi027.stdout:0/865: mknod d2/d48/d6b/d79/d84/dfa/c133 0 2024-09-20T19:06:09.702 INFO:tasks.workunit.client.0.smithi027.stdout:3/886: dwrite d0/d1/d5e/d1d/da7/db0/fee [0,4194304] 0 2024-09-20T19:06:09.702 INFO:tasks.workunit.client.0.smithi027.stdout:9/939: rename d0/d9/dfb/f109 to d0/d9/df/d1c/d6a/d6d/dd/d66/f13b 0 2024-09-20T19:06:09.703 INFO:tasks.workunit.client.0.smithi027.stdout:8/889: dwrite d2/d3/f11e [0,4194304] 0 2024-09-20T19:06:09.704 INFO:tasks.workunit.client.1.smithi098.stdout:3/707: symlink d4/d19/ldc 0 2024-09-20T19:06:09.710 INFO:tasks.workunit.client.0.smithi027.stdout:1/870: truncate d2/d8/f70 1653246 0 2024-09-20T19:06:09.714 INFO:tasks.workunit.client.0.smithi027.stdout:9/940: dwrite d0/d9/df/d1b/d9c/da4/fb0 [4194304,4194304] 0 2024-09-20T19:06:09.716 INFO:tasks.workunit.client.0.smithi027.stdout:0/866: mkdir d2/d119/d134 0 2024-09-20T19:06:09.716 INFO:tasks.workunit.client.0.smithi027.stdout:9/941: write d0/d9/df/da2/f103 [505822,93115] 0 2024-09-20T19:06:09.717 INFO:tasks.workunit.client.0.smithi027.stdout:3/887: creat d0/d1/d13/d3c/f12a x:0 0 0 2024-09-20T19:06:09.720 INFO:tasks.workunit.client.0.smithi027.stdout:8/890: rmdir d2/d2a/df8/d36 39 2024-09-20T19:06:09.722 INFO:tasks.workunit.client.1.smithi098.stdout:3/708: write d4/da/f5c [461586,35707] 0 2024-09-20T19:06:09.723 INFO:tasks.workunit.client.0.smithi027.stdout:0/867: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/c104 385 1 2024-09-20T19:06:09.723 INFO:tasks.workunit.client.0.smithi027.stdout:5/917: dwrite d4/da/de/d3e/d44/f77 [0,4194304] 0 2024-09-20T19:06:09.725 INFO:tasks.workunit.client.1.smithi098.stdout:3/709: creat d4/d25/d8d/fdd x:0 0 0 2024-09-20T19:06:09.726 INFO:tasks.workunit.client.0.smithi027.stdout:2/829: dread d3/d1c/d26/fa2 [0,4194304] 0 2024-09-20T19:06:09.728 INFO:tasks.workunit.client.0.smithi027.stdout:3/888: mknod d0/d1/d5e/d1d/da7/db0/dc7/c12b 0 2024-09-20T19:06:09.729 INFO:tasks.workunit.client.0.smithi027.stdout:2/830: fdatasync d3/d24/f95 0 2024-09-20T19:06:09.730 INFO:tasks.workunit.client.0.smithi027.stdout:5/918: creat d4/da/de/d3e/d61/f134 x:0 0 0 2024-09-20T19:06:09.731 INFO:tasks.workunit.client.0.smithi027.stdout:8/891: symlink d2/d2a/df8/d36/l133 0 2024-09-20T19:06:09.732 INFO:tasks.workunit.client.1.smithi098.stdout:3/710: read d4/d19/d1d/d2f/d3e/f52 [1151332,86417] 0 2024-09-20T19:06:09.732 INFO:tasks.workunit.client.0.smithi027.stdout:0/868: readlink d2/d48/d6b/d79/d84/d1b/dc5/lf3 0 2024-09-20T19:06:09.734 INFO:tasks.workunit.client.1.smithi098.stdout:3/711: creat d4/d19/d7b/fde x:0 0 0 2024-09-20T19:06:09.735 INFO:tasks.workunit.client.0.smithi027.stdout:9/942: dwrite d0/d9/df/d1b/d9c/f114 [0,4194304] 0 2024-09-20T19:06:09.736 INFO:tasks.workunit.client.0.smithi027.stdout:9/943: chown d0/d9/df/d1b/d9c/d121 152815457 1 2024-09-20T19:06:09.737 INFO:tasks.workunit.client.0.smithi027.stdout:2/831: symlink d3/d13/d3c/d48/dba/de4/dee/l10d 0 2024-09-20T19:06:09.740 INFO:tasks.workunit.client.0.smithi027.stdout:8/892: rename d2/d3/d11d/l11a to d2/d2a/df8/dda/l134 0 2024-09-20T19:06:09.740 INFO:tasks.workunit.client.0.smithi027.stdout:3/889: link d0/d19/d54/d7a/la9 d0/dc5/deb/dfc/l12c 0 2024-09-20T19:06:09.742 INFO:tasks.workunit.client.0.smithi027.stdout:2/832: creat d3/d1c/d26/d2a/dc2/f10e x:0 0 0 2024-09-20T19:06:09.743 INFO:tasks.workunit.client.0.smithi027.stdout:5/919: rename d4/da/de/d3e/d69/d75/d3d/c4b to d4/da/de/d3e/d69/c135 0 2024-09-20T19:06:09.743 INFO:tasks.workunit.client.0.smithi027.stdout:4/835: dread d5/d13/d36/d48/d3f/fb6 [0,4194304] 0 2024-09-20T19:06:09.744 INFO:tasks.workunit.client.0.smithi027.stdout:8/893: rmdir d2/d3/d9a 39 2024-09-20T19:06:09.744 INFO:tasks.workunit.client.0.smithi027.stdout:5/920: dread - d4/da/d1a/fe5 zero size 2024-09-20T19:06:09.746 INFO:tasks.workunit.client.0.smithi027.stdout:3/890: write d0/d1/d13/d15/d55/f114 [130173,97380] 0 2024-09-20T19:06:09.746 INFO:tasks.workunit.client.0.smithi027.stdout:1/871: truncate d2/d61/df8/f49 1915445 0 2024-09-20T19:06:09.748 INFO:tasks.workunit.client.0.smithi027.stdout:1/872: truncate d2/d61/df8/dde/ff5 1401149 0 2024-09-20T19:06:09.748 INFO:tasks.workunit.client.0.smithi027.stdout:2/833: getdents d3/d13/d3c/de7 0 2024-09-20T19:06:09.750 INFO:tasks.workunit.client.0.smithi027.stdout:4/836: mknod d5/d13/c106 0 2024-09-20T19:06:09.751 INFO:tasks.workunit.client.0.smithi027.stdout:2/834: mknod d3/d1c/d26/d2a/c10f 0 2024-09-20T19:06:09.754 INFO:tasks.workunit.client.0.smithi027.stdout:2/835: creat d3/d24/d89/f110 x:0 0 0 2024-09-20T19:06:09.757 INFO:tasks.workunit.client.0.smithi027.stdout:8/894: write d2/d14/d13/f71 [1088758,85300] 0 2024-09-20T19:06:09.757 INFO:tasks.workunit.client.0.smithi027.stdout:5/921: dwrite d4/d1f/d7f/f128 [0,4194304] 0 2024-09-20T19:06:09.763 INFO:tasks.workunit.client.0.smithi027.stdout:2/836: creat d3/d1c/d26/d2a/dc2/d6f/f111 x:0 0 0 2024-09-20T19:06:09.764 INFO:tasks.workunit.client.0.smithi027.stdout:4/837: dwrite d5/d11/d3d/db4/fd2 [0,4194304] 0 2024-09-20T19:06:09.768 INFO:tasks.workunit.client.0.smithi027.stdout:0/869: dwrite d2/d48/d6b/d79/d84/d1b/d39/f6f [0,4194304] 0 2024-09-20T19:06:09.768 INFO:tasks.workunit.client.0.smithi027.stdout:4/838: mkdir d5/d13/dfb/d107 0 2024-09-20T19:06:09.773 INFO:tasks.workunit.client.0.smithi027.stdout:5/922: truncate d4/da/de/d3e/d44/f60 1008690 0 2024-09-20T19:06:09.776 INFO:tasks.workunit.client.0.smithi027.stdout:8/895: dwrite d2/d3/f11e [0,4194304] 0 2024-09-20T19:06:09.776 INFO:tasks.workunit.client.0.smithi027.stdout:2/837: getdents d3/d96 0 2024-09-20T19:06:09.780 INFO:tasks.workunit.client.0.smithi027.stdout:4/839: dwrite d5/d13/f98 [0,4194304] 0 2024-09-20T19:06:09.788 INFO:tasks.workunit.client.0.smithi027.stdout:2/838: dwrite d3/d1c/d26/d2a/fde [0,4194304] 0 2024-09-20T19:06:09.788 INFO:tasks.workunit.client.0.smithi027.stdout:4/840: rename d5/d11/d3d/l63 to d5/d11/d3d/l108 0 2024-09-20T19:06:09.792 INFO:tasks.workunit.client.0.smithi027.stdout:4/841: symlink d5/d13/d36/d48/d9f/dc9/d8f/l109 0 2024-09-20T19:06:09.800 INFO:tasks.workunit.client.1.smithi098.stdout:7/800: sync 2024-09-20T19:06:09.803 INFO:tasks.workunit.client.1.smithi098.stdout:7/801: unlink d3/d10/d16/d17/d33/d37/f74 0 2024-09-20T19:06:09.806 INFO:tasks.workunit.client.1.smithi098.stdout:7/802: rename d3/d10/d16/d17/l2f to d3/d76/db8/da6/dec/lfd 0 2024-09-20T19:06:09.807 INFO:tasks.workunit.client.1.smithi098.stdout:7/803: fdatasync d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/fd7 0 2024-09-20T19:06:09.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/804: mkdir d3/d10/d16/d17/d33/d1f/dfe 0 2024-09-20T19:06:09.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/522: sync 2024-09-20T19:06:09.811 INFO:tasks.workunit.client.1.smithi098.stdout:7/805: creat d3/d4c/fff x:0 0 0 2024-09-20T19:06:09.812 INFO:tasks.workunit.client.1.smithi098.stdout:0/523: dread - d0/d55/f5b zero size 2024-09-20T19:06:09.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/806: readlink d3/d10/d16/d17/d33/d1f/d28/l50 0 2024-09-20T19:06:09.813 INFO:tasks.workunit.client.1.smithi098.stdout:0/524: read - d0/d6/f61 zero size 2024-09-20T19:06:09.817 INFO:tasks.workunit.client.1.smithi098.stdout:7/807: rmdir d3/daa/dd4/de8 0 2024-09-20T19:06:09.819 INFO:tasks.workunit.client.1.smithi098.stdout:0/525: dwrite d0/db/d1d/f6a [0,4194304] 0 2024-09-20T19:06:09.821 INFO:tasks.workunit.client.1.smithi098.stdout:0/526: write d0/d6/d28/d31/d45/d60/f91 [270007,93712] 0 2024-09-20T19:06:09.825 INFO:tasks.workunit.client.1.smithi098.stdout:0/527: rename d0/db/d32/l75 to d0/d7d/la0 0 2024-09-20T19:06:09.826 INFO:tasks.workunit.client.1.smithi098.stdout:0/528: rmdir d0 39 2024-09-20T19:06:09.828 INFO:tasks.workunit.client.0.smithi027.stdout:2/839: link d3/d1c/d31/d9e/fcd d3/d13/d3c/d48/dba/de4/f112 0 2024-09-20T19:06:09.830 INFO:tasks.workunit.client.0.smithi027.stdout:8/896: write d2/d14/d13/d51/f76 [663484,44941] 0 2024-09-20T19:06:09.831 INFO:tasks.workunit.client.0.smithi027.stdout:2/840: chown d3/d13/f4d 18498112 1 2024-09-20T19:06:09.833 INFO:tasks.workunit.client.1.smithi098.stdout:7/808: dread d3/f2e [0,4194304] 0 2024-09-20T19:06:09.834 INFO:tasks.workunit.client.0.smithi027.stdout:2/841: write d3/de/d34/fed [743830,14391] 0 2024-09-20T19:06:09.834 INFO:tasks.workunit.client.1.smithi098.stdout:0/529: dwrite d0/d55/f1e [0,4194304] 0 2024-09-20T19:06:09.835 INFO:tasks.workunit.client.1.smithi098.stdout:7/809: fdatasync d3/d10/d16/d17/d33/d4b/f55 0 2024-09-20T19:06:09.835 INFO:tasks.workunit.client.0.smithi027.stdout:8/897: write d2/d3/d6/d21/d33/d79/dcf/fe7 [482723,2709] 0 2024-09-20T19:06:09.837 INFO:tasks.workunit.client.0.smithi027.stdout:0/870: dwrite d2/d48/d6b/d79/d84/d1b/d39/f81 [0,4194304] 0 2024-09-20T19:06:09.839 INFO:tasks.workunit.client.0.smithi027.stdout:8/898: stat d2/d14/d13/d43/d5d/d90 0 2024-09-20T19:06:09.839 INFO:tasks.workunit.client.0.smithi027.stdout:5/923: dread d4/d6c/dc7/fde [0,4194304] 0 2024-09-20T19:06:09.840 INFO:tasks.workunit.client.1.smithi098.stdout:7/810: dread - d3/d4c/fa1 zero size 2024-09-20T19:06:09.844 INFO:tasks.workunit.client.1.smithi098.stdout:7/811: mkdir d3/d10/d16/d17/d33/d1f/d28/d66/ddf/d100 0 2024-09-20T19:06:09.846 INFO:tasks.workunit.client.0.smithi027.stdout:0/871: unlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fe3 0 2024-09-20T19:06:09.848 INFO:tasks.workunit.client.0.smithi027.stdout:8/899: dread d2/d14/d13/d51/f76 [0,4194304] 0 2024-09-20T19:06:09.849 INFO:tasks.workunit.client.1.smithi098.stdout:7/812: creat d3/d4c/f101 x:0 0 0 2024-09-20T19:06:09.855 INFO:tasks.workunit.client.0.smithi027.stdout:0/872: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/l135 0 2024-09-20T19:06:09.856 INFO:tasks.workunit.client.1.smithi098.stdout:7/813: creat d3/d76/f102 x:0 0 0 2024-09-20T19:06:09.856 INFO:tasks.workunit.client.0.smithi027.stdout:0/873: read - d2/d48/d6b/d79/d9f/da4/de6/f11a zero size 2024-09-20T19:06:09.857 INFO:tasks.workunit.client.1.smithi098.stdout:7/814: chown d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/ce1 159663 1 2024-09-20T19:06:09.859 INFO:tasks.workunit.client.1.smithi098.stdout:7/815: chown d3/d10/d16/d17/d33/d1f/d28/d7d/d8c/fe0 10045 1 2024-09-20T19:06:09.860 INFO:tasks.workunit.client.1.smithi098.stdout:7/816: fsync d3/d10/d16/d17/d33/d37/da0/f51 0 2024-09-20T19:06:09.861 INFO:tasks.workunit.client.0.smithi027.stdout:2/842: dwrite d3/d1c/d26/d2a/f86 [0,4194304] 0 2024-09-20T19:06:09.862 INFO:tasks.workunit.client.1.smithi098.stdout:7/817: rmdir d3/d10/d16/d17/d33/d1f/dba 39 2024-09-20T19:06:09.863 INFO:tasks.workunit.client.0.smithi027.stdout:0/874: dread d2/d49/ded/f10e [0,4194304] 0 2024-09-20T19:06:09.864 INFO:tasks.workunit.client.0.smithi027.stdout:5/924: truncate d4/da/de/d3e/d69/d75/d119/f126 746330 0 2024-09-20T19:06:09.865 INFO:tasks.workunit.client.0.smithi027.stdout:2/843: mknod d3/d1c/d26/c113 0 2024-09-20T19:06:09.865 INFO:tasks.workunit.client.0.smithi027.stdout:8/900: write d2/d14/d13/d43/f5b [7591377,105958] 0 2024-09-20T19:06:09.865 INFO:tasks.workunit.client.1.smithi098.stdout:0/530: dread d0/f5 [0,4194304] 0 2024-09-20T19:06:09.866 INFO:tasks.workunit.client.0.smithi027.stdout:2/844: chown d3/d1c/d26/d2a/dc2/d6f/fcf 6069 1 2024-09-20T19:06:09.868 INFO:tasks.workunit.client.1.smithi098.stdout:0/531: write d0/d55/d67/f68 [2532885,32744] 0 2024-09-20T19:06:09.868 INFO:tasks.workunit.client.0.smithi027.stdout:8/901: truncate d2/d3/d6/f12f 837109 0 2024-09-20T19:06:09.868 INFO:tasks.workunit.client.0.smithi027.stdout:2/845: readlink d3/de/l58 0 2024-09-20T19:06:09.869 INFO:tasks.workunit.client.0.smithi027.stdout:2/846: dread - d3/d1c/d26/d2a/dc2/f10e zero size 2024-09-20T19:06:09.869 INFO:tasks.workunit.client.0.smithi027.stdout:2/847: stat d3/d1c/ldd 0 2024-09-20T19:06:09.871 INFO:tasks.workunit.client.0.smithi027.stdout:5/925: mknod d4/da/c136 0 2024-09-20T19:06:09.872 INFO:tasks.workunit.client.0.smithi027.stdout:5/926: stat d4/da/l12 0 2024-09-20T19:06:09.873 INFO:tasks.workunit.client.0.smithi027.stdout:0/875: mknod d2/d48/d6b/d79/d84/c136 0 2024-09-20T19:06:09.875 INFO:tasks.workunit.client.0.smithi027.stdout:8/902: mknod d2/d14/d13/d43/d5d/d90/c135 0 2024-09-20T19:06:09.876 INFO:tasks.workunit.client.1.smithi098.stdout:7/818: write d3/d76/db8/fa9 [866955,4231] 0 2024-09-20T19:06:09.877 INFO:tasks.workunit.client.1.smithi098.stdout:0/532: mkdir d0/d6/d28/d31/d45/d60/da1 0 2024-09-20T19:06:09.879 INFO:tasks.workunit.client.1.smithi098.stdout:0/533: write d0/d6/d28/f5c [867865,53341] 0 2024-09-20T19:06:09.879 INFO:tasks.workunit.client.0.smithi027.stdout:2/848: mkdir d3/d1c/d26/d114 0 2024-09-20T19:06:09.880 INFO:tasks.workunit.client.0.smithi027.stdout:5/927: rmdir d4/d1f/d7f 39 2024-09-20T19:06:09.882 INFO:tasks.workunit.client.1.smithi098.stdout:7/819: mkdir d3/d10/d16/d17/d33/d1f/d103 0 2024-09-20T19:06:09.883 INFO:tasks.workunit.client.0.smithi027.stdout:8/903: fdatasync d2/d14/d13/d51/fc2 0 2024-09-20T19:06:09.884 INFO:tasks.workunit.client.0.smithi027.stdout:2/849: creat d3/d1c/d26/d2a/f115 x:0 0 0 2024-09-20T19:06:09.885 INFO:tasks.workunit.client.1.smithi098.stdout:0/534: dwrite d0/db/fd [0,4194304] 0 2024-09-20T19:06:09.886 INFO:tasks.workunit.client.1.smithi098.stdout:4/854: sync 2024-09-20T19:06:09.887 INFO:tasks.workunit.client.1.smithi098.stdout:0/535: write d0/db/d1d/f99 [525613,118665] 0 2024-09-20T19:06:09.887 INFO:tasks.workunit.client.0.smithi027.stdout:8/904: dread - d2/d3/d6/d6d/fb7 zero size 2024-09-20T19:06:09.888 INFO:tasks.workunit.client.1.smithi098.stdout:7/820: symlink d3/d76/d7a/dce/l104 0 2024-09-20T19:06:09.888 INFO:tasks.workunit.client.1.smithi098.stdout:0/536: write d0/db/d1d/f3f [64421,126516] 0 2024-09-20T19:06:09.892 INFO:tasks.workunit.client.1.smithi098.stdout:7/821: fdatasync d3/d76/d86/fb1 0 2024-09-20T19:06:09.893 INFO:tasks.workunit.client.1.smithi098.stdout:7/822: readlink d3/d10/d16/d17/l70 0 2024-09-20T19:06:09.896 INFO:tasks.workunit.client.1.smithi098.stdout:0/537: dwrite d0/db/d1d/f3f [0,4194304] 0 2024-09-20T19:06:09.900 INFO:tasks.workunit.client.0.smithi027.stdout:0/876: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f42 [0,4194304] 0 2024-09-20T19:06:09.904 INFO:tasks.workunit.client.0.smithi027.stdout:0/877: mkdir d2/da2/d137 0 2024-09-20T19:06:09.906 INFO:tasks.workunit.client.0.smithi027.stdout:0/878: stat d2/d48/d6b/d79/d84/d1b/dc5/d2e/cd2 0 2024-09-20T19:06:09.907 INFO:tasks.workunit.client.0.smithi027.stdout:5/928: write d4/da/d1a/f1b [188560,57184] 0 2024-09-20T19:06:09.908 INFO:tasks.workunit.client.0.smithi027.stdout:5/929: write d4/da/fba [4641572,97869] 0 2024-09-20T19:06:09.908 INFO:tasks.workunit.client.0.smithi027.stdout:0/879: symlink d2/da2/l138 0 2024-09-20T19:06:09.910 INFO:tasks.workunit.client.0.smithi027.stdout:5/930: write d4/da/de/d3e/db7/fce [58929,57390] 0 2024-09-20T19:06:09.910 INFO:tasks.workunit.client.0.smithi027.stdout:0/880: creat d2/d12c/f139 x:0 0 0 2024-09-20T19:06:09.913 INFO:tasks.workunit.client.1.smithi098.stdout:7/823: truncate d3/d10/d16/d17/d33/d4b/fb0 3293340 0 2024-09-20T19:06:09.913 INFO:tasks.workunit.client.1.smithi098.stdout:7/824: chown d3 674039 1 2024-09-20T19:06:09.915 INFO:tasks.workunit.client.0.smithi027.stdout:0/881: mkdir d2/d48/d6b/d79/d9f/da4/d13a 0 2024-09-20T19:06:09.915 INFO:tasks.workunit.client.0.smithi027.stdout:5/931: symlink d4/d1f/d91/d9b/d109/l137 0 2024-09-20T19:06:09.916 INFO:tasks.workunit.client.0.smithi027.stdout:2/850: dwrite d3/d1c/f90 [0,4194304] 0 2024-09-20T19:06:09.917 INFO:tasks.workunit.client.1.smithi098.stdout:7/825: creat d3/d76/d86/f105 x:0 0 0 2024-09-20T19:06:09.917 INFO:tasks.workunit.client.0.smithi027.stdout:0/882: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/c7e 3701965 1 2024-09-20T19:06:09.918 INFO:tasks.workunit.client.0.smithi027.stdout:0/883: readlink d2/d48/d6b/d79/d9f/da4/la9 0 2024-09-20T19:06:09.919 INFO:tasks.workunit.client.0.smithi027.stdout:5/932: creat d4/d6c/d6f/f138 x:0 0 0 2024-09-20T19:06:09.920 INFO:tasks.workunit.client.0.smithi027.stdout:2/851: dread - d3/d13/d3c/d48/d6a/f8e zero size 2024-09-20T19:06:09.920 INFO:tasks.workunit.client.1.smithi098.stdout:7/826: mknod d3/d10/d16/d17/d33/d37/da0/c106 0 2024-09-20T19:06:09.921 INFO:tasks.workunit.client.0.smithi027.stdout:0/884: fdatasync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/d118/f123 0 2024-09-20T19:06:09.921 INFO:tasks.workunit.client.0.smithi027.stdout:5/933: read d4/d6c/dc7/fde [116366,13867] 0 2024-09-20T19:06:09.921 INFO:tasks.workunit.client.0.smithi027.stdout:2/852: chown d3/de/d34/l4a 3 1 2024-09-20T19:06:09.922 INFO:tasks.workunit.client.0.smithi027.stdout:2/853: chown d3/d13/d3c/fe2 477 1 2024-09-20T19:06:09.925 INFO:tasks.workunit.client.0.smithi027.stdout:0/885: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/d118/f13b x:0 0 0 2024-09-20T19:06:09.926 INFO:tasks.workunit.client.0.smithi027.stdout:2/854: mknod d3/d13/d3c/d48/d6a/c116 0 2024-09-20T19:06:09.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/538: dread d0/d6/d19/f33 [0,4194304] 0 2024-09-20T19:06:09.928 INFO:tasks.workunit.client.0.smithi027.stdout:0/886: truncate d2/d48/d6b/d79/ddc/d126/f128 503962 0 2024-09-20T19:06:09.928 INFO:tasks.workunit.client.0.smithi027.stdout:2/855: mkdir d3/de/d117 0 2024-09-20T19:06:09.930 INFO:tasks.workunit.client.0.smithi027.stdout:0/887: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f114 [805775,104970] 0 2024-09-20T19:06:09.931 INFO:tasks.workunit.client.0.smithi027.stdout:2/856: rmdir d3/d1c/d31 39 2024-09-20T19:06:09.933 INFO:tasks.workunit.client.0.smithi027.stdout:2/857: mknod d3/d1c/d26/df2/df6/c118 0 2024-09-20T19:06:09.934 INFO:tasks.workunit.client.0.smithi027.stdout:0/888: symlink d2/d48/d6b/d79/d84/d1b/d39/l13c 0 2024-09-20T19:06:09.936 INFO:tasks.workunit.client.1.smithi098.stdout:7/827: write d3/d10/d16/f39 [2930116,78637] 0 2024-09-20T19:06:09.936 INFO:tasks.workunit.client.0.smithi027.stdout:0/889: dread d2/d49/ded/f10e [0,4194304] 0 2024-09-20T19:06:09.938 INFO:tasks.workunit.client.0.smithi027.stdout:0/890: write d2/d48/d6b/d79/d84/d1b/d39/f6f [807299,9873] 0 2024-09-20T19:06:09.939 INFO:tasks.workunit.client.1.smithi098.stdout:7/828: creat d3/d10/d16/d17/d33/d1f/d2d/f107 x:0 0 0 2024-09-20T19:06:09.939 INFO:tasks.workunit.client.1.smithi098.stdout:0/539: write d0/db/d1d/f34 [3006546,116203] 0 2024-09-20T19:06:09.943 INFO:tasks.workunit.client.0.smithi027.stdout:0/891: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/fda [0,4194304] 0 2024-09-20T19:06:09.944 INFO:tasks.workunit.client.1.smithi098.stdout:0/540: creat d0/d6/d28/d31/d45/d60/fa2 x:0 0 0 2024-09-20T19:06:09.947 INFO:tasks.workunit.client.0.smithi027.stdout:2/858: dwrite d3/de/d34/f7a [0,4194304] 0 2024-09-20T19:06:09.947 INFO:tasks.workunit.client.1.smithi098.stdout:0/541: creat d0/d6/d19/d4f/d70/fa3 x:0 0 0 2024-09-20T19:06:09.950 INFO:tasks.workunit.client.0.smithi027.stdout:0/892: dwrite d2/d20/fd6 [0,4194304] 0 2024-09-20T19:06:09.951 INFO:tasks.workunit.client.1.smithi098.stdout:0/542: truncate d0/d6/d19/d4f/f6b 129602 0 2024-09-20T19:06:09.952 INFO:tasks.workunit.client.0.smithi027.stdout:2/859: mkdir d3/d13/d3c/de7/d119 0 2024-09-20T19:06:09.954 INFO:tasks.workunit.client.1.smithi098.stdout:7/829: dread d3/d10/d16/d17/d33/d37/ffa [0,4194304] 0 2024-09-20T19:06:09.955 INFO:tasks.workunit.client.0.smithi027.stdout:2/860: mkdir d3/d1c/dea/d11a 0 2024-09-20T19:06:09.957 INFO:tasks.workunit.client.0.smithi027.stdout:2/861: write d3/d13/d3c/d48/dba/fc6 [631222,43883] 0 2024-09-20T19:06:09.959 INFO:tasks.workunit.client.1.smithi098.stdout:0/543: rename d0/db/d1d/c59 to d0/db/d7f/d93/ca4 0 2024-09-20T19:06:09.960 INFO:tasks.workunit.client.0.smithi027.stdout:2/862: rmdir d3/d1c/d26/df2/df6 39 2024-09-20T19:06:09.961 INFO:tasks.workunit.client.1.smithi098.stdout:7/830: mknod d3/daa/dd4/c108 0 2024-09-20T19:06:09.963 INFO:tasks.workunit.client.1.smithi098.stdout:7/831: rmdir d3/d76/db8/da6/dec 39 2024-09-20T19:06:09.965 INFO:tasks.workunit.client.1.smithi098.stdout:7/832: symlink d3/d10/d16/dc1/l109 0 2024-09-20T19:06:09.967 INFO:tasks.workunit.client.0.smithi027.stdout:0/893: dwrite d2/d48/d6b/d79/fac [0,4194304] 0 2024-09-20T19:06:09.968 INFO:tasks.workunit.client.1.smithi098.stdout:0/544: dwrite d0/d6/d28/d31/d45/d60/f91 [0,4194304] 0 2024-09-20T19:06:09.969 INFO:tasks.workunit.client.0.smithi027.stdout:7/809: sync 2024-09-20T19:06:09.969 INFO:tasks.workunit.client.1.smithi098.stdout:0/545: fsync d0/db/d1d/f87 0 2024-09-20T19:06:09.973 INFO:tasks.workunit.client.1.smithi098.stdout:0/546: dread - d0/d6/d28/d31/d45/f5e zero size 2024-09-20T19:06:09.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/833: dwrite d3/d76/ffc [0,4194304] 0 2024-09-20T19:06:09.976 INFO:tasks.workunit.client.1.smithi098.stdout:7/834: dread - d3/d10/d16/d17/d7c/fe3 zero size 2024-09-20T19:06:09.978 INFO:tasks.workunit.client.1.smithi098.stdout:0/547: mkdir d0/d6/d19/d4f/d70/da5 0 2024-09-20T19:06:09.979 INFO:tasks.workunit.client.1.smithi098.stdout:0/548: fsync d0/d6/fe 0 2024-09-20T19:06:09.979 INFO:tasks.workunit.client.1.smithi098.stdout:7/835: mkdir d3/d4c/d10a 0 2024-09-20T19:06:09.982 INFO:tasks.workunit.client.1.smithi098.stdout:0/549: fdatasync d0/db/f20 0 2024-09-20T19:06:09.982 INFO:tasks.workunit.client.1.smithi098.stdout:7/836: mknod d3/d10/d16/d17/c10b 0 2024-09-20T19:06:09.983 INFO:tasks.workunit.client.1.smithi098.stdout:7/837: chown d3/f64 29459 1 2024-09-20T19:06:09.984 INFO:tasks.workunit.client.1.smithi098.stdout:0/550: symlink d0/d6/la6 0 2024-09-20T19:06:09.987 INFO:tasks.workunit.client.1.smithi098.stdout:7/838: rename d3/d10/d16/d17/d33/d1f/d28/d7d to d3/d10/d16/d17/d33/d1f/d10c 0 2024-09-20T19:06:09.989 INFO:tasks.workunit.client.1.smithi098.stdout:7/839: creat d3/daa/f10d x:0 0 0 2024-09-20T19:06:09.991 INFO:tasks.workunit.client.1.smithi098.stdout:7/840: truncate d3/d10/d16/d17/d33/d1f/f44 4898733 0 2024-09-20T19:06:09.994 INFO:tasks.workunit.client.0.smithi027.stdout:2/863: dread d3/d96/fd4 [0,4194304] 0 2024-09-20T19:06:09.996 INFO:tasks.workunit.client.0.smithi027.stdout:2/864: mknod d3/d1c/d26/c11b 0 2024-09-20T19:06:09.996 INFO:tasks.workunit.client.0.smithi027.stdout:2/865: stat d3/de/c22 0 2024-09-20T19:06:09.999 INFO:tasks.workunit.client.0.smithi027.stdout:2/866: mknod d3/d13/d3c/d48/dba/de4/dee/c11c 0 2024-09-20T19:06:10.000 INFO:tasks.workunit.client.0.smithi027.stdout:2/867: readlink d3/d1c/d26/d2a/dc2/d6f/lcc 0 2024-09-20T19:06:10.001 INFO:tasks.workunit.client.0.smithi027.stdout:2/868: write d3/d1c/d26/d2a/dc2/fd8 [1136070,17228] 0 2024-09-20T19:06:10.002 INFO:tasks.workunit.client.1.smithi098.stdout:0/551: getdents d0/d6/d19/d4f/d70 0 2024-09-20T19:06:10.003 INFO:tasks.workunit.client.0.smithi027.stdout:2/869: truncate d3/d24/d89/ff7 1042965 0 2024-09-20T19:06:10.003 INFO:tasks.workunit.client.1.smithi098.stdout:0/552: fsync d0/d6/d19/d4f/d70/fa3 0 2024-09-20T19:06:10.004 INFO:tasks.workunit.client.0.smithi027.stdout:0/894: dread d2/d48/d6b/d79/d84/d1b/d39/f74 [0,4194304] 0 2024-09-20T19:06:10.007 INFO:tasks.workunit.client.1.smithi098.stdout:0/553: creat d0/db/d1d/d8f/fa7 x:0 0 0 2024-09-20T19:06:10.008 INFO:tasks.workunit.client.1.smithi098.stdout:0/554: chown d0/db/d1d/d8f/l3e 443853 1 2024-09-20T19:06:10.010 INFO:tasks.workunit.client.1.smithi098.stdout:9/800: sync 2024-09-20T19:06:10.010 INFO:tasks.workunit.client.1.smithi098.stdout:1/686: sync 2024-09-20T19:06:10.011 INFO:tasks.workunit.client.1.smithi098.stdout:0/555: mknod d0/d6/ca8 0 2024-09-20T19:06:10.013 INFO:tasks.workunit.client.1.smithi098.stdout:0/556: chown d0/c81 266554749 1 2024-09-20T19:06:10.015 INFO:tasks.workunit.client.1.smithi098.stdout:9/801: rename d4/d74/d8a/f101 to d4/de/d27/d6c/d73/f10d 0 2024-09-20T19:06:10.016 INFO:tasks.workunit.client.1.smithi098.stdout:7/841: dread d3/d10/d16/d17/d33/d1f/fe7 [0,4194304] 0 2024-09-20T19:06:10.023 INFO:tasks.workunit.client.1.smithi098.stdout:9/802: dwrite d4/f1a [0,4194304] 0 2024-09-20T19:06:10.024 INFO:tasks.workunit.client.1.smithi098.stdout:9/803: chown f0 5 1 2024-09-20T19:06:10.025 INFO:tasks.workunit.client.1.smithi098.stdout:9/804: chown d4/de/d24/d35/d2d/da6/dae/lcf 591428 1 2024-09-20T19:06:10.027 INFO:tasks.workunit.client.1.smithi098.stdout:7/842: dwrite d3/d10/d16/d90/fb3 [0,4194304] 0 2024-09-20T19:06:10.029 INFO:tasks.workunit.client.1.smithi098.stdout:7/843: chown d3/d4c/ff2 4206852 1 2024-09-20T19:06:10.029 INFO:tasks.workunit.client.1.smithi098.stdout:0/557: write d0/d6/d28/d31/d45/d60/f91 [4933871,89977] 0 2024-09-20T19:06:10.033 INFO:tasks.workunit.client.1.smithi098.stdout:7/844: mknod d3/d10/d16/dc1/c10e 0 2024-09-20T19:06:10.035 INFO:tasks.workunit.client.1.smithi098.stdout:0/558: unlink d0/db/d1d/l4c 0 2024-09-20T19:06:10.036 INFO:tasks.workunit.client.1.smithi098.stdout:1/687: dread d1/f14 [0,4194304] 0 2024-09-20T19:06:10.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/845: rename d3/daa/dd4/lf5 to d3/d10/d16/d17/d33/d1f/d28/d66/dfb/l10f 0 2024-09-20T19:06:10.040 INFO:tasks.workunit.client.1.smithi098.stdout:0/559: creat d0/db/d32/fa9 x:0 0 0 2024-09-20T19:06:10.040 INFO:tasks.workunit.client.1.smithi098.stdout:7/846: readlink d3/d10/d16/d17/d33/d37/l89 0 2024-09-20T19:06:10.041 INFO:tasks.workunit.client.1.smithi098.stdout:0/560: truncate d0/d55/f88 801687 0 2024-09-20T19:06:10.042 INFO:tasks.workunit.client.1.smithi098.stdout:7/847: dread - d3/d76/d7a/fbc zero size 2024-09-20T19:06:10.042 INFO:tasks.workunit.client.1.smithi098.stdout:1/688: symlink d1/d3/d2e/d68/d7a/da1/ldc 0 2024-09-20T19:06:10.043 INFO:tasks.workunit.client.1.smithi098.stdout:7/848: chown d3/d10/d16/d90/f9c 34119190 1 2024-09-20T19:06:10.047 INFO:tasks.workunit.client.1.smithi098.stdout:9/805: dread d4/de/f3d [0,4194304] 0 2024-09-20T19:06:10.047 INFO:tasks.workunit.client.1.smithi098.stdout:7/849: unlink d3/d76/d7a/lf1 0 2024-09-20T19:06:10.048 INFO:tasks.workunit.client.1.smithi098.stdout:9/806: write d4/fb [5297499,36858] 0 2024-09-20T19:06:10.050 INFO:tasks.workunit.client.1.smithi098.stdout:1/689: dread d1/d3/d2e/f47 [0,4194304] 0 2024-09-20T19:06:10.051 INFO:tasks.workunit.client.1.smithi098.stdout:7/850: symlink d3/d10/d16/d17/d33/d1f/d10c/d8c/l110 0 2024-09-20T19:06:10.053 INFO:tasks.workunit.client.1.smithi098.stdout:1/690: symlink d1/d3/d2e/d68/d7a/da1/ldd 0 2024-09-20T19:06:10.054 INFO:tasks.workunit.client.1.smithi098.stdout:4/855: sync 2024-09-20T19:06:10.054 INFO:tasks.workunit.client.1.smithi098.stdout:3/712: sync 2024-09-20T19:06:10.054 INFO:tasks.workunit.client.1.smithi098.stdout:5/583: sync 2024-09-20T19:06:10.054 INFO:tasks.workunit.client.1.smithi098.stdout:6/521: sync 2024-09-20T19:06:10.054 INFO:tasks.workunit.client.1.smithi098.stdout:8/800: sync 2024-09-20T19:06:10.055 INFO:tasks.workunit.client.1.smithi098.stdout:9/807: mkdir d4/de/d48/de8/d10e 0 2024-09-20T19:06:10.055 INFO:tasks.workunit.client.1.smithi098.stdout:0/561: write d0/db/d1d/f21 [3920044,46074] 0 2024-09-20T19:06:10.057 INFO:tasks.workunit.client.1.smithi098.stdout:7/851: rename d3/d10/d16/d17/d33/d1f/d28/d66/dfb to d3/d10/d16/dc1/d111 0 2024-09-20T19:06:10.059 INFO:tasks.workunit.client.1.smithi098.stdout:3/713: creat d4/d25/d8d/fdf x:0 0 0 2024-09-20T19:06:10.059 INFO:tasks.workunit.client.1.smithi098.stdout:5/584: mkdir d1/d17/d35/d93/db1 0 2024-09-20T19:06:10.060 INFO:tasks.workunit.client.1.smithi098.stdout:7/852: chown d3/d10/d16/d17/d33/d37/ldb 49328112 1 2024-09-20T19:06:10.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/522: mknod d0/de/d1b/d37/d8c/c9e 0 2024-09-20T19:06:10.062 INFO:tasks.workunit.client.1.smithi098.stdout:8/801: mknod d7/de/d11/d1f/dcd/db3/c119 0 2024-09-20T19:06:10.062 INFO:tasks.workunit.client.1.smithi098.stdout:1/691: dread d1/d3/df/d34/d43/d65/f73 [0,4194304] 0 2024-09-20T19:06:10.063 INFO:tasks.workunit.client.1.smithi098.stdout:6/523: read d0/de/d1b/d37/d44/d24/d29/d50/f8e [174422,93006] 0 2024-09-20T19:06:10.065 INFO:tasks.workunit.client.1.smithi098.stdout:9/808: creat d4/de/d27/d4a/d58/d5b/f10f x:0 0 0 2024-09-20T19:06:10.066 INFO:tasks.workunit.client.1.smithi098.stdout:9/809: fdatasync d4/de/d24/d35/d6d/ff9 0 2024-09-20T19:06:10.067 INFO:tasks.workunit.client.0.smithi027.stdout:0/895: truncate d2/da2/f105 699576 0 2024-09-20T19:06:10.067 INFO:tasks.workunit.client.1.smithi098.stdout:3/714: rmdir d4/da/d50 39 2024-09-20T19:06:10.068 INFO:tasks.workunit.client.0.smithi027.stdout:0/896: chown d2/d48/d6b/d79/d84/d1b/dc5/f3d 11943504 1 2024-09-20T19:06:10.068 INFO:tasks.workunit.client.1.smithi098.stdout:5/585: creat d1/d71/fb2 x:0 0 0 2024-09-20T19:06:10.069 INFO:tasks.workunit.client.0.smithi027.stdout:0/897: write d2/d48/d6b/d79/d84/d1b/d39/f6f [4004194,89636] 0 2024-09-20T19:06:10.069 INFO:tasks.workunit.client.0.smithi027.stdout:2/870: dwrite d3/d13/f49 [0,4194304] 0 2024-09-20T19:06:10.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/524: creat d0/de/d1b/d37/d8c/f9f x:0 0 0 2024-09-20T19:06:10.077 INFO:tasks.workunit.client.1.smithi098.stdout:6/525: write d0/de/d1b/d37/d44/d24/d29/f35 [5719619,5823] 0 2024-09-20T19:06:10.077 INFO:tasks.workunit.client.1.smithi098.stdout:1/692: fdatasync d1/d3/df/d34/d43/d65/f88 0 2024-09-20T19:06:10.079 INFO:tasks.workunit.client.1.smithi098.stdout:4/856: write d3/d6/f13 [1044461,53750] 0 2024-09-20T19:06:10.080 INFO:tasks.workunit.client.1.smithi098.stdout:1/693: truncate d1/d3/d2e/fca 722177 0 2024-09-20T19:06:10.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/715: truncate d4/d25/d40/f58 1952939 0 2024-09-20T19:06:10.082 INFO:tasks.workunit.client.1.smithi098.stdout:0/562: write d0/db/d1d/f4d [4215298,114808] 0 2024-09-20T19:06:10.083 INFO:tasks.workunit.client.1.smithi098.stdout:5/586: truncate d1/fb 1809445 0 2024-09-20T19:06:10.086 INFO:tasks.workunit.client.1.smithi098.stdout:9/810: dread d4/de/d27/d6c/d73/f99 [0,4194304] 0 2024-09-20T19:06:10.103 INFO:tasks.workunit.client.0.smithi027.stdout:6/889: sync 2024-09-20T19:06:10.134 INFO:tasks.workunit.client.1.smithi098.stdout:8/802: write d7/de/d11/d19/d30/f62 [1537716,99993] 0 2024-09-20T19:06:10.134 INFO:tasks.workunit.client.1.smithi098.stdout:3/716: mknod d4/d38/ce0 0 2024-09-20T19:06:10.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/694: truncate d1/d3/d2e/d61/fd9 2214956 0 2024-09-20T19:06:10.140 INFO:tasks.workunit.client.1.smithi098.stdout:7/853: link d3/ld d3/d10/d16/d17/d33/l112 0 2024-09-20T19:06:10.140 INFO:tasks.workunit.client.0.smithi027.stdout:6/890: dread - d4/d6/d4b/d7c/f100 zero size 2024-09-20T19:06:10.141 INFO:tasks.workunit.client.1.smithi098.stdout:0/563: link d0/d6/d28/d31/d45/l4e d0/d6/d28/d31/laa 0 2024-09-20T19:06:10.142 INFO:tasks.workunit.client.0.smithi027.stdout:6/891: write d4/d15/d37/fad [4090585,26369] 0 2024-09-20T19:06:10.142 INFO:tasks.workunit.client.0.smithi027.stdout:0/898: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/fe5 [0,4194304] 0 2024-09-20T19:06:10.143 INFO:tasks.workunit.client.1.smithi098.stdout:0/564: write d0/db/d32/fa9 [22540,56147] 0 2024-09-20T19:06:10.143 INFO:tasks.workunit.client.0.smithi027.stdout:2/871: mknod d3/d1c/d31/c11d 0 2024-09-20T19:06:10.144 INFO:tasks.workunit.client.1.smithi098.stdout:0/565: chown d0/d55/f88 146 1 2024-09-20T19:06:10.146 INFO:tasks.workunit.client.1.smithi098.stdout:6/526: dread d0/de/d1b/d37/f45 [0,4194304] 0 2024-09-20T19:06:10.146 INFO:tasks.workunit.client.1.smithi098.stdout:0/566: read d0/db/d1d/f3f [1311250,98994] 0 2024-09-20T19:06:10.146 INFO:tasks.workunit.client.1.smithi098.stdout:0/567: readlink d0/d6/la6 0 2024-09-20T19:06:10.147 INFO:tasks.workunit.client.1.smithi098.stdout:5/587: truncate d1/d17/d2e/f51 2718304 0 2024-09-20T19:06:10.150 INFO:tasks.workunit.client.0.smithi027.stdout:6/892: dwrite d4/d15/d37/d7a/fba [0,4194304] 0 2024-09-20T19:06:10.151 INFO:tasks.workunit.client.0.smithi027.stdout:6/893: write d4/d15/d37/d5a/d78/dbc/f120 [292137,64606] 0 2024-09-20T19:06:10.152 INFO:tasks.workunit.client.0.smithi027.stdout:0/899: creat d2/db7/f13d x:0 0 0 2024-09-20T19:06:10.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/811: dwrite d4/de/d24/d35/d2d/f49 [0,4194304] 0 2024-09-20T19:06:10.158 INFO:tasks.workunit.client.0.smithi027.stdout:2/872: creat d3/d13/d3c/dce/f11e x:0 0 0 2024-09-20T19:06:10.159 INFO:tasks.workunit.client.0.smithi027.stdout:2/873: fsync d3/d1c/fe1 0 2024-09-20T19:06:10.160 INFO:tasks.workunit.client.1.smithi098.stdout:1/695: write d1/f37 [1378293,52409] 0 2024-09-20T19:06:10.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/588: readlink d1/l31 0 2024-09-20T19:06:10.168 INFO:tasks.workunit.client.1.smithi098.stdout:0/568: read d0/d6/d28/d31/d45/d60/f9a [2339677,108805] 0 2024-09-20T19:06:10.168 INFO:tasks.workunit.client.0.smithi027.stdout:6/894: rename d4/d6/d4b/l87 to d4/d6/d4b/dca/l133 0 2024-09-20T19:06:10.168 INFO:tasks.workunit.client.1.smithi098.stdout:3/717: truncate d4/d25/f49 3633767 0 2024-09-20T19:06:10.169 INFO:tasks.workunit.client.0.smithi027.stdout:6/895: fsync d4/d15/d37/d7a/d46/de7/f12e 0 2024-09-20T19:06:10.170 INFO:tasks.workunit.client.0.smithi027.stdout:2/874: symlink d3/d2f/def/l11f 0 2024-09-20T19:06:10.171 INFO:tasks.workunit.client.0.smithi027.stdout:0/900: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [0,4194304] 0 2024-09-20T19:06:10.171 INFO:tasks.workunit.client.0.smithi027.stdout:6/896: rmdir d4/dc7 39 2024-09-20T19:06:10.172 INFO:tasks.workunit.client.1.smithi098.stdout:9/812: mknod d4/de/d24/d35/d6d/c110 0 2024-09-20T19:06:10.174 INFO:tasks.workunit.client.0.smithi027.stdout:0/901: dread d2/f5e [0,4194304] 0 2024-09-20T19:06:10.175 INFO:tasks.workunit.client.1.smithi098.stdout:8/803: dwrite d7/de/d11/d19/d30/db5/fd0 [0,4194304] 0 2024-09-20T19:06:10.175 INFO:tasks.workunit.client.1.smithi098.stdout:1/696: rename d1/d3/df/f58 to d1/dbb/fde 0 2024-09-20T19:06:10.176 INFO:tasks.workunit.client.1.smithi098.stdout:6/527: mknod d0/de/d1b/d37/d44/d24/d29/d2b/d66/d81/ca0 0 2024-09-20T19:06:10.178 INFO:tasks.workunit.client.0.smithi027.stdout:6/897: mknod d4/d15/d37/d5a/d78/c134 0 2024-09-20T19:06:10.178 INFO:tasks.workunit.client.0.smithi027.stdout:2/875: dwrite d3/de/d34/fed [0,4194304] 0 2024-09-20T19:06:10.178 INFO:tasks.workunit.client.1.smithi098.stdout:8/804: chown d7/de/d11/d19/l64 2 1 2024-09-20T19:06:10.178 INFO:tasks.workunit.client.0.smithi027.stdout:0/902: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f7d [1625068,125628] 0 2024-09-20T19:06:10.180 INFO:tasks.workunit.client.1.smithi098.stdout:3/718: rmdir d4/d38/d97 39 2024-09-20T19:06:10.181 INFO:tasks.workunit.client.0.smithi027.stdout:0/903: chown d2/d48/d6b/d79/d9f/da4/c100 60434699 1 2024-09-20T19:06:10.184 INFO:tasks.workunit.client.1.smithi098.stdout:9/813: creat d4/de/d27/d4a/d58/d5b/d9c/f111 x:0 0 0 2024-09-20T19:06:10.185 INFO:tasks.workunit.client.1.smithi098.stdout:5/589: mkdir d1/d46/daa/db3 0 2024-09-20T19:06:10.187 INFO:tasks.workunit.client.1.smithi098.stdout:6/528: creat d0/de/d1b/d37/d8c/d4c/fa1 x:0 0 0 2024-09-20T19:06:10.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/529: chown d0/de/d1b/l20 0 1 2024-09-20T19:06:10.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/530: write d0/de/f6b [1944425,68706] 0 2024-09-20T19:06:10.192 INFO:tasks.workunit.client.0.smithi027.stdout:0/904: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/d108/f13e x:0 0 0 2024-09-20T19:06:10.193 INFO:tasks.workunit.client.1.smithi098.stdout:0/569: symlink d0/lab 0 2024-09-20T19:06:10.197 INFO:tasks.workunit.client.0.smithi027.stdout:0/905: mkdir d2/d48/d6b/d79/ddc/d126/d13f 0 2024-09-20T19:06:10.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/814: mkdir d4/de/d27/d4a/d58/d5b/d112 0 2024-09-20T19:06:10.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/815: chown d4/d74/lee 127407121 1 2024-09-20T19:06:10.199 INFO:tasks.workunit.client.0.smithi027.stdout:0/906: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 [1029260,15106] 0 2024-09-20T19:06:10.201 INFO:tasks.workunit.client.1.smithi098.stdout:1/697: rename d1/d3/df/d34/d52/fb8 to d1/d3/df/d34/d43/dad/dc1/dc7/fdf 0 2024-09-20T19:06:10.203 INFO:tasks.workunit.client.1.smithi098.stdout:0/570: mknod d0/d7d/d83/cac 0 2024-09-20T19:06:10.204 INFO:tasks.workunit.client.0.smithi027.stdout:0/907: creat d2/d49/ded/d12f/f140 x:0 0 0 2024-09-20T19:06:10.205 INFO:tasks.workunit.client.0.smithi027.stdout:6/898: getdents d4/d15/d37/d5a/d78 0 2024-09-20T19:06:10.205 INFO:tasks.workunit.client.1.smithi098.stdout:3/719: truncate d4/d19/d1d/d2f/d3e/dbb/fbc 328052 0 2024-09-20T19:06:10.206 INFO:tasks.workunit.client.1.smithi098.stdout:5/590: truncate d1/fb 2043142 0 2024-09-20T19:06:10.207 INFO:tasks.workunit.client.1.smithi098.stdout:5/591: chown d1/d17/d35/d93/db1 9129 1 2024-09-20T19:06:10.213 INFO:tasks.workunit.client.1.smithi098.stdout:8/805: rename d7/de/d11/d1f/d57 to d7/de/d11/d1d/d110/d11a 0 2024-09-20T19:06:10.213 INFO:tasks.workunit.client.0.smithi027.stdout:2/876: dwrite d3/d13/d3c/d48/f74 [0,4194304] 0 2024-09-20T19:06:10.214 INFO:tasks.workunit.client.1.smithi098.stdout:8/806: write d7/de/d11/d1f/f4d [8693452,102737] 0 2024-09-20T19:06:10.216 INFO:tasks.workunit.client.0.smithi027.stdout:0/908: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f141 x:0 0 0 2024-09-20T19:06:10.217 INFO:tasks.workunit.client.0.smithi027.stdout:2/877: dread d3/d96/fd4 [0,4194304] 0 2024-09-20T19:06:10.223 INFO:tasks.workunit.client.0.smithi027.stdout:0/909: creat d2/d48/d6b/d79/d84/d1b/f142 x:0 0 0 2024-09-20T19:06:10.224 INFO:tasks.workunit.client.1.smithi098.stdout:9/816: dread d4/f47 [0,4194304] 0 2024-09-20T19:06:10.224 INFO:tasks.workunit.client.0.smithi027.stdout:0/910: truncate d2/db7/f13d 917594 0 2024-09-20T19:06:10.225 INFO:tasks.workunit.client.1.smithi098.stdout:0/571: dread d0/d55/d67/f68 [0,4194304] 0 2024-09-20T19:06:10.228 INFO:tasks.workunit.client.0.smithi027.stdout:0/911: creat d2/d49/ded/f143 x:0 0 0 2024-09-20T19:06:10.228 INFO:tasks.workunit.client.1.smithi098.stdout:1/698: chown d1/d3/df/dbe/fb7 182 1 2024-09-20T19:06:10.230 INFO:tasks.workunit.client.1.smithi098.stdout:9/817: mkdir d4/de/d27/d6c/d73/d113 0 2024-09-20T19:06:10.231 INFO:tasks.workunit.client.1.smithi098.stdout:0/572: read - d0/db/d1d/d8f/d51/f5a zero size 2024-09-20T19:06:10.232 INFO:tasks.workunit.client.0.smithi027.stdout:9/944: sync 2024-09-20T19:06:10.232 INFO:tasks.workunit.client.0.smithi027.stdout:6/899: dwrite d4/d6/d4b/d7c/d64/f68 [0,4194304] 0 2024-09-20T19:06:10.233 INFO:tasks.workunit.client.1.smithi098.stdout:0/573: write d0/db/f14 [1140284,88184] 0 2024-09-20T19:06:10.236 INFO:tasks.workunit.client.0.smithi027.stdout:2/878: link d3/de/d34/dc9/cf8 d3/d1c/c120 0 2024-09-20T19:06:10.239 INFO:tasks.workunit.client.0.smithi027.stdout:0/912: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f120 [0,4194304] 0 2024-09-20T19:06:10.240 INFO:tasks.workunit.client.1.smithi098.stdout:5/592: dread d1/d17/d5e/f81 [0,4194304] 0 2024-09-20T19:06:10.240 INFO:tasks.workunit.client.1.smithi098.stdout:8/807: truncate d7/de/d11/fa7 3016642 0 2024-09-20T19:06:10.243 INFO:tasks.workunit.client.0.smithi027.stdout:9/945: rename d0/d9/df/d1b/fe4 to d0/d9/df/da2/de9/df8/f13c 0 2024-09-20T19:06:10.244 INFO:tasks.workunit.client.0.smithi027.stdout:0/913: dread d2/d48/d6b/d79/d84/d1b/d39/f81 [0,4194304] 0 2024-09-20T19:06:10.245 INFO:tasks.workunit.client.0.smithi027.stdout:0/914: write d2/da2/f105 [34264,82219] 0 2024-09-20T19:06:10.246 INFO:tasks.workunit.client.1.smithi098.stdout:3/720: symlink d4/d38/d48/d60/dd0/le1 0 2024-09-20T19:06:10.248 INFO:tasks.workunit.client.1.smithi098.stdout:9/818: fsync d4/de/f3f 0 2024-09-20T19:06:10.251 INFO:tasks.workunit.client.1.smithi098.stdout:0/574: rmdir d0/d7d/d83 39 2024-09-20T19:06:10.254 INFO:tasks.workunit.client.1.smithi098.stdout:1/699: fsync d1/d3/f1b 0 2024-09-20T19:06:10.255 INFO:tasks.workunit.client.0.smithi027.stdout:9/946: readlink d0/d9/df/d1b/d9c/d4f/d8d/da0/dfa/l104 0 2024-09-20T19:06:10.255 INFO:tasks.workunit.client.1.smithi098.stdout:9/819: dwrite d4/de/d27/ff0 [0,4194304] 0 2024-09-20T19:06:10.264 INFO:tasks.workunit.client.0.smithi027.stdout:9/947: dwrite d0/d9/f98 [0,4194304] 0 2024-09-20T19:06:10.270 INFO:tasks.workunit.client.0.smithi027.stdout:9/948: mkdir d0/d9/df/d1b/d64/d13d 0 2024-09-20T19:06:10.270 INFO:tasks.workunit.client.0.smithi027.stdout:6/900: dread d4/d15/d37/d7a/d8e/fbe [0,4194304] 0 2024-09-20T19:06:10.289 INFO:tasks.workunit.client.1.smithi098.stdout:9/820: chown d4/de/d24/d35/d2d/da6/dae/d86/daa/ce9 28 1 2024-09-20T19:06:10.293 INFO:tasks.workunit.client.1.smithi098.stdout:0/575: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T19:06:10.295 INFO:tasks.workunit.client.1.smithi098.stdout:5/593: creat d1/d17/d25/fb4 x:0 0 0 2024-09-20T19:06:10.300 INFO:tasks.workunit.client.1.smithi098.stdout:9/821: mknod d4/de/d27/d4a/d8e/c114 0 2024-09-20T19:06:10.300 INFO:tasks.workunit.client.1.smithi098.stdout:0/576: readlink d0/d55/l24 0 2024-09-20T19:06:10.302 INFO:tasks.workunit.client.1.smithi098.stdout:0/577: dread - d0/db/d1d/d8f/fa7 zero size 2024-09-20T19:06:10.302 INFO:tasks.workunit.client.1.smithi098.stdout:9/822: readlink d4/de/d27/d4a/d8e/lfa 0 2024-09-20T19:06:10.310 INFO:tasks.workunit.client.1.smithi098.stdout:3/721: write d4/d38/d39/f88 [199019,106087] 0 2024-09-20T19:06:10.312 INFO:tasks.workunit.client.1.smithi098.stdout:8/808: write d7/de/d11/fa7 [974204,33762] 0 2024-09-20T19:06:10.318 INFO:tasks.workunit.client.1.smithi098.stdout:3/722: creat d4/d19/d1d/d2f/d4e/da3/fe2 x:0 0 0 2024-09-20T19:06:10.322 INFO:tasks.workunit.client.0.smithi027.stdout:6/901: fdatasync d4/d6/d4b/d7c/f8b 0 2024-09-20T19:06:10.325 INFO:tasks.workunit.client.0.smithi027.stdout:2/879: dwrite d3/d1c/d31/f4c [0,4194304] 0 2024-09-20T19:06:10.326 INFO:tasks.workunit.client.0.smithi027.stdout:2/880: chown d3/d13/d3c/d48/f8f 8093161 1 2024-09-20T19:06:10.331 INFO:tasks.workunit.client.0.smithi027.stdout:6/902: truncate d4/d15/d37/d39/f97 4664327 0 2024-09-20T19:06:10.331 INFO:tasks.workunit.client.0.smithi027.stdout:6/903: fdatasync d4/d15/d37/d7a/d8e/fdf 0 2024-09-20T19:06:10.332 INFO:tasks.workunit.client.1.smithi098.stdout:0/578: dread d0/db/d1d/f87 [0,4194304] 0 2024-09-20T19:06:10.332 INFO:tasks.workunit.client.1.smithi098.stdout:8/809: dwrite d7/fb7 [0,4194304] 0 2024-09-20T19:06:10.332 INFO:tasks.workunit.client.1.smithi098.stdout:3/723: mkdir d4/d19/d1d/d2f/d4e/d59/d7c/de3 0 2024-09-20T19:06:10.332 INFO:tasks.workunit.client.1.smithi098.stdout:1/700: dwrite d1/d3/df/f78 [0,4194304] 0 2024-09-20T19:06:10.335 INFO:tasks.workunit.client.0.smithi027.stdout:9/949: link d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/f135 d0/d9/df/d1b/d9c/da4/f13e 0 2024-09-20T19:06:10.338 INFO:tasks.workunit.client.1.smithi098.stdout:9/823: dwrite d4/de/d27/d6c/fa3 [0,4194304] 0 2024-09-20T19:06:10.338 INFO:tasks.workunit.client.1.smithi098.stdout:5/594: dwrite d1/d17/d25/f2b [0,4194304] 0 2024-09-20T19:06:10.338 INFO:tasks.workunit.client.0.smithi027.stdout:2/881: rename d3/d13/d3c/d48/lfe to d3/d13/d3c/de7/d119/l121 0 2024-09-20T19:06:10.340 INFO:tasks.workunit.client.1.smithi098.stdout:5/595: stat d1/d17/d5e/f81 0 2024-09-20T19:06:10.341 INFO:tasks.workunit.client.0.smithi027.stdout:6/904: rmdir d4/d15/d37/d5a 39 2024-09-20T19:06:10.341 INFO:tasks.workunit.client.1.smithi098.stdout:0/579: mkdir d0/d55/d67/dad 0 2024-09-20T19:06:10.342 INFO:tasks.workunit.client.0.smithi027.stdout:6/905: stat d4/d15/d37/d6a/dbf/de0/l12d 0 2024-09-20T19:06:10.343 INFO:tasks.workunit.client.1.smithi098.stdout:8/810: creat d7/de/d11/d1d/d110/d11a/f11b x:0 0 0 2024-09-20T19:06:10.343 INFO:tasks.workunit.client.0.smithi027.stdout:6/906: stat d4/d15/d2c/dcb/fcf 0 2024-09-20T19:06:10.345 INFO:tasks.workunit.client.0.smithi027.stdout:9/950: getdents d0/d9/df/d1b/d9c/d5a 0 2024-09-20T19:06:10.346 INFO:tasks.workunit.client.1.smithi098.stdout:1/701: mknod d1/d3/d2e/ce0 0 2024-09-20T19:06:10.347 INFO:tasks.workunit.client.0.smithi027.stdout:2/882: unlink d3/d13/d3c/dce/fe6 0 2024-09-20T19:06:10.349 INFO:tasks.workunit.client.1.smithi098.stdout:3/724: mknod d4/d25/d40/d80/d94/ce4 0 2024-09-20T19:06:10.353 INFO:tasks.workunit.client.1.smithi098.stdout:0/580: mkdir d0/d6/d28/d31/d69/d9b/dae 0 2024-09-20T19:06:10.354 INFO:tasks.workunit.client.1.smithi098.stdout:8/811: unlink d7/de/f105 0 2024-09-20T19:06:10.355 INFO:tasks.workunit.client.0.smithi027.stdout:2/883: dwrite d3/d1c/d26/d2a/f86 [4194304,4194304] 0 2024-09-20T19:06:10.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/596: fdatasync d1/d1b/f5a 0 2024-09-20T19:06:10.357 INFO:tasks.workunit.client.1.smithi098.stdout:3/725: dwrite d4/d38/d48/d60/f99 [0,4194304] 0 2024-09-20T19:06:10.358 INFO:tasks.workunit.client.0.smithi027.stdout:6/907: dread d4/d15/d37/d6a/f8f [0,4194304] 0 2024-09-20T19:06:10.362 INFO:tasks.workunit.client.0.smithi027.stdout:9/951: getdents d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb 0 2024-09-20T19:06:10.364 INFO:tasks.workunit.client.0.smithi027.stdout:1/873: sync 2024-09-20T19:06:10.364 INFO:tasks.workunit.client.0.smithi027.stdout:3/891: sync 2024-09-20T19:06:10.365 INFO:tasks.workunit.client.0.smithi027.stdout:2/884: creat d3/d1c/dea/d11a/f122 x:0 0 0 2024-09-20T19:06:10.365 INFO:tasks.workunit.client.0.smithi027.stdout:6/908: rmdir d4/d15/d37/d6a/da5 39 2024-09-20T19:06:10.366 INFO:tasks.workunit.client.1.smithi098.stdout:8/812: chown d7/de/d11/d19/d30/d55/d9d/cad 12873 1 2024-09-20T19:06:10.366 INFO:tasks.workunit.client.0.smithi027.stdout:6/909: chown d4/d6/d4b 161 1 2024-09-20T19:06:10.367 INFO:tasks.workunit.client.0.smithi027.stdout:1/874: write d2/d8/d3b/d4b/f2c [3025575,121438] 0 2024-09-20T19:06:10.367 INFO:tasks.workunit.client.0.smithi027.stdout:9/952: mkdir d0/d9/df/d1c/d6a/d6d/dd/d66/d79/d13f 0 2024-09-20T19:06:10.369 INFO:tasks.workunit.client.1.smithi098.stdout:3/726: dread d4/d19/d1d/f4c [0,4194304] 0 2024-09-20T19:06:10.370 INFO:tasks.workunit.client.0.smithi027.stdout:3/892: write d0/d1/d13/f22 [4745181,66141] 0 2024-09-20T19:06:10.372 INFO:tasks.workunit.client.0.smithi027.stdout:9/953: write d0/d9/df/d1b/fcb [356046,36299] 0 2024-09-20T19:06:10.372 INFO:tasks.workunit.client.0.smithi027.stdout:2/885: creat d3/d1c/d26/d2a/dc2/f123 x:0 0 0 2024-09-20T19:06:10.374 INFO:tasks.workunit.client.0.smithi027.stdout:3/893: chown d0/d38/cfb 2 1 2024-09-20T19:06:10.375 INFO:tasks.workunit.client.1.smithi098.stdout:3/727: mknod d4/d25/d40/d80/ce5 0 2024-09-20T19:06:10.377 INFO:tasks.workunit.client.1.smithi098.stdout:3/728: truncate d4/d19/d1d/fc2 474049 0 2024-09-20T19:06:10.378 INFO:tasks.workunit.client.0.smithi027.stdout:6/910: dread d4/d15/d37/d7a/d46/f71 [0,4194304] 0 2024-09-20T19:06:10.379 INFO:tasks.workunit.client.1.smithi098.stdout:8/813: creat d7/de/d11/f11c x:0 0 0 2024-09-20T19:06:10.380 INFO:tasks.workunit.client.1.smithi098.stdout:1/702: dread d1/f96 [0,4194304] 0 2024-09-20T19:06:10.382 INFO:tasks.workunit.client.1.smithi098.stdout:3/729: rmdir d4/d19/d1d/d2f/d4e 39 2024-09-20T19:06:10.383 INFO:tasks.workunit.client.0.smithi027.stdout:2/886: rmdir d3/d1c/d31/d9e 39 2024-09-20T19:06:10.384 INFO:tasks.workunit.client.0.smithi027.stdout:7/810: sync 2024-09-20T19:06:10.384 INFO:tasks.workunit.client.0.smithi027.stdout:4/842: sync 2024-09-20T19:06:10.384 INFO:tasks.workunit.client.0.smithi027.stdout:8/905: sync 2024-09-20T19:06:10.384 INFO:tasks.workunit.client.0.smithi027.stdout:5/934: sync 2024-09-20T19:06:10.385 INFO:tasks.workunit.client.1.smithi098.stdout:8/814: mkdir d7/de/d11/d1d/d110/d11a/db6/d11d 0 2024-09-20T19:06:10.386 INFO:tasks.workunit.client.0.smithi027.stdout:5/935: dread d4/f45 [0,4194304] 0 2024-09-20T19:06:10.388 INFO:tasks.workunit.client.1.smithi098.stdout:8/815: read d7/de/d11/d1f/f4d [1537494,86590] 0 2024-09-20T19:06:10.388 INFO:tasks.workunit.client.0.smithi027.stdout:8/906: write d2/d3/d6/d6d/d75/fad [2382949,27474] 0 2024-09-20T19:06:10.390 INFO:tasks.workunit.client.0.smithi027.stdout:5/936: write d4/d1f/d91/d9b/de8/f129 [88575,67263] 0 2024-09-20T19:06:10.392 INFO:tasks.workunit.client.0.smithi027.stdout:2/887: symlink d3/d24/d89/l124 0 2024-09-20T19:06:10.393 INFO:tasks.workunit.client.1.smithi098.stdout:0/581: dread d0/db/f5d [0,4194304] 0 2024-09-20T19:06:10.394 INFO:tasks.workunit.client.1.smithi098.stdout:3/730: mknod d4/d38/d97/dcb/ce6 0 2024-09-20T19:06:10.397 INFO:tasks.workunit.client.1.smithi098.stdout:9/824: truncate d4/fb 3056263 0 2024-09-20T19:06:10.398 INFO:tasks.workunit.client.0.smithi027.stdout:1/875: dread d2/d61/df8/d56/d71/f95 [0,4194304] 0 2024-09-20T19:06:10.399 INFO:tasks.workunit.client.0.smithi027.stdout:7/811: creat d3/d8/d26/d45/dcc/f112 x:0 0 0 2024-09-20T19:06:10.400 INFO:tasks.workunit.client.0.smithi027.stdout:7/812: read - d3/ff7 zero size 2024-09-20T19:06:10.400 INFO:tasks.workunit.client.0.smithi027.stdout:1/876: truncate d2/d8/d2b/d2d/d73/fa8 1321290 0 2024-09-20T19:06:10.400 INFO:tasks.workunit.client.0.smithi027.stdout:8/907: mknod d2/d14/d13/db5/d125/c136 0 2024-09-20T19:06:10.402 INFO:tasks.workunit.client.0.smithi027.stdout:5/937: truncate d4/da/f48 726151 0 2024-09-20T19:06:10.403 INFO:tasks.workunit.client.1.smithi098.stdout:3/731: symlink d4/d38/d97/le7 0 2024-09-20T19:06:10.404 INFO:tasks.workunit.client.1.smithi098.stdout:5/597: write d1/d17/d2e/f2f [3752196,13172] 0 2024-09-20T19:06:10.405 INFO:tasks.workunit.client.0.smithi027.stdout:6/911: dread d4/d6/fa [0,4194304] 0 2024-09-20T19:06:10.405 INFO:tasks.workunit.client.0.smithi027.stdout:2/888: write d3/d1c/d26/df2/df6/f99 [2048778,40862] 0 2024-09-20T19:06:10.406 INFO:tasks.workunit.client.1.smithi098.stdout:5/598: stat d1/d17/d35/f89 0 2024-09-20T19:06:10.407 INFO:tasks.workunit.client.0.smithi027.stdout:6/912: write d4/d15/d37/fad [706098,123671] 0 2024-09-20T19:06:10.407 INFO:tasks.workunit.client.1.smithi098.stdout:5/599: write d1/d17/d35/f80 [2009850,123052] 0 2024-09-20T19:06:10.408 INFO:tasks.workunit.client.0.smithi027.stdout:3/894: rename d0/d1/d13 to d0/d12d 0 2024-09-20T19:06:10.408 INFO:tasks.workunit.client.1.smithi098.stdout:5/600: readlink d1/d17/l8c 0 2024-09-20T19:06:10.408 INFO:tasks.workunit.client.1.smithi098.stdout:1/703: link d1/d3/df/d34/d52/l7e d1/d3/df/d4a/le1 0 2024-09-20T19:06:10.409 INFO:tasks.workunit.client.0.smithi027.stdout:8/908: dread d2/d3/d6/d6d/d75/feb [0,4194304] 0 2024-09-20T19:06:10.410 INFO:tasks.workunit.client.0.smithi027.stdout:8/909: stat d2/d3/d11d/f6a 0 2024-09-20T19:06:10.419 INFO:tasks.workunit.client.1.smithi098.stdout:8/816: write d7/de/d11/d19/f4c [4816940,8350] 0 2024-09-20T19:06:10.421 INFO:tasks.workunit.client.0.smithi027.stdout:7/813: read d3/f6d [153045,115583] 0 2024-09-20T19:06:10.421 INFO:tasks.workunit.client.1.smithi098.stdout:1/704: creat d1/d3/df/d4a/d6d/fe2 x:0 0 0 2024-09-20T19:06:10.422 INFO:tasks.workunit.client.1.smithi098.stdout:8/817: write d7/de/d11/d19/d30/d59/d80/f8a [3622715,98888] 0 2024-09-20T19:06:10.423 INFO:tasks.workunit.client.1.smithi098.stdout:8/818: dread - d7/dd2/f115 zero size 2024-09-20T19:06:10.423 INFO:tasks.workunit.client.1.smithi098.stdout:9/825: mknod d4/de/d27/d6c/d73/db5/c115 0 2024-09-20T19:06:10.424 INFO:tasks.workunit.client.0.smithi027.stdout:9/954: dwrite d0/d9/df/d57/f7b [0,4194304] 0 2024-09-20T19:06:10.425 INFO:tasks.workunit.client.0.smithi027.stdout:8/910: read d2/d14/d13/d105/f106 [302842,128469] 0 2024-09-20T19:06:10.428 INFO:tasks.workunit.client.0.smithi027.stdout:6/913: unlink d4/d15/d37/d6a/d7f/fac 0 2024-09-20T19:06:10.429 INFO:tasks.workunit.client.1.smithi098.stdout:3/732: creat d4/d19/d1d/d2f/d3e/dbb/fe8 x:0 0 0 2024-09-20T19:06:10.437 INFO:tasks.workunit.client.1.smithi098.stdout:5/601: write d1/f2c [533141,88167] 0 2024-09-20T19:06:10.439 INFO:tasks.workunit.client.1.smithi098.stdout:5/602: dread - d1/d46/fa7 zero size 2024-09-20T19:06:10.439 INFO:tasks.workunit.client.1.smithi098.stdout:4/857: sync 2024-09-20T19:06:10.439 INFO:tasks.workunit.client.1.smithi098.stdout:5/603: chown d1/d17/d35/f41 301 1 2024-09-20T19:06:10.439 INFO:tasks.workunit.client.1.smithi098.stdout:5/604: chown d1/d71/d98 0 1 2024-09-20T19:06:10.440 INFO:tasks.workunit.client.1.smithi098.stdout:9/826: unlink d4/de/d24/d35/d2d/l5d 0 2024-09-20T19:06:10.442 INFO:tasks.workunit.client.1.smithi098.stdout:0/582: getdents d0/d6/d28/d31/d45 0 2024-09-20T19:06:10.443 INFO:tasks.workunit.client.1.smithi098.stdout:9/827: chown d4/de/d27/d4a/d21/d25/f59 3 1 2024-09-20T19:06:10.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/733: read d4/da/fb [2881577,18081] 0 2024-09-20T19:06:10.449 INFO:tasks.workunit.client.1.smithi098.stdout:1/705: mknod d1/d3/df/d4a/ce3 0 2024-09-20T19:06:10.452 INFO:tasks.workunit.client.1.smithi098.stdout:9/828: dwrite d4/de/d24/d35/d2d/da6/dae/d86/fcb [0,4194304] 0 2024-09-20T19:06:10.457 INFO:tasks.workunit.client.1.smithi098.stdout:5/605: dread d1/d17/d2e/f67 [0,4194304] 0 2024-09-20T19:06:10.459 INFO:tasks.workunit.client.1.smithi098.stdout:5/606: dread - d1/d17/d25/fb4 zero size 2024-09-20T19:06:10.463 INFO:tasks.workunit.client.1.smithi098.stdout:3/734: symlink d4/d25/d40/d80/le9 0 2024-09-20T19:06:10.465 INFO:tasks.workunit.client.1.smithi098.stdout:1/706: creat d1/d3/df/d34/d43/dad/dc1/fe4 x:0 0 0 2024-09-20T19:06:10.469 INFO:tasks.workunit.client.1.smithi098.stdout:0/583: mknod d0/db/d1d/caf 0 2024-09-20T19:06:10.471 INFO:tasks.workunit.client.1.smithi098.stdout:4/858: dwrite d3/d6/d8c/fda [0,4194304] 0 2024-09-20T19:06:10.472 INFO:tasks.workunit.client.1.smithi098.stdout:8/819: rename d7/de/d11/d1d/d110/d11a/l5b to d7/de/d11/d19/d30/d59/d80/l11e 0 2024-09-20T19:06:10.473 INFO:tasks.workunit.client.1.smithi098.stdout:3/735: fdatasync d4/d19/d1d/d22/f9f 0 2024-09-20T19:06:10.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:10 smithi098 ceph-mon[35737]: pgmap v13: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 231 MiB/s wr, 462 op/s 2024-09-20T19:06:10.476 INFO:tasks.workunit.client.1.smithi098.stdout:9/829: dwrite d4/de/d27/d4a/d21/d25/d51/f55 [0,4194304] 0 2024-09-20T19:06:10.481 INFO:tasks.workunit.client.1.smithi098.stdout:7/854: sync 2024-09-20T19:06:10.482 INFO:tasks.workunit.client.1.smithi098.stdout:6/531: sync 2024-09-20T19:06:10.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/736: truncate d4/d19/d1d/d22/dc5/fc6 608097 0 2024-09-20T19:06:10.483 INFO:tasks.workunit.client.1.smithi098.stdout:0/584: dwrite d0/db/d1d/f87 [0,4194304] 0 2024-09-20T19:06:10.486 INFO:tasks.workunit.client.1.smithi098.stdout:5/607: rename d1/d17/d35/db0 to d1/d1b/d40/db5 0 2024-09-20T19:06:10.487 INFO:tasks.workunit.client.1.smithi098.stdout:0/585: read - d0/d6/d28/d31/d45/d60/fa2 zero size 2024-09-20T19:06:10.491 INFO:tasks.workunit.client.1.smithi098.stdout:4/859: truncate d3/d2e/f68 5103039 0 2024-09-20T19:06:10.492 INFO:tasks.workunit.client.1.smithi098.stdout:4/860: chown d3/d7d/da3/d3c/d6b/d73/d98/de0/le2 5525 1 2024-09-20T19:06:10.494 INFO:tasks.workunit.client.1.smithi098.stdout:8/820: mkdir d7/de/d11/d1d/d110/d11a/db0/d11f 0 2024-09-20T19:06:10.498 INFO:tasks.workunit.client.1.smithi098.stdout:9/830: truncate d4/de/d24/f8b 5031344 0 2024-09-20T19:06:10.499 INFO:tasks.workunit.client.1.smithi098.stdout:8/821: dread d7/de/d11/d19/d30/d55/da9/f103 [0,4194304] 0 2024-09-20T19:06:10.503 INFO:tasks.workunit.client.1.smithi098.stdout:7/855: truncate d3/f11 247747 0 2024-09-20T19:06:10.510 INFO:tasks.workunit.client.1.smithi098.stdout:0/586: unlink d0/db/d1d/d8f/d51/f5a 0 2024-09-20T19:06:10.511 INFO:tasks.workunit.client.1.smithi098.stdout:0/587: dread d0/db/f17 [0,4194304] 0 2024-09-20T19:06:10.513 INFO:tasks.workunit.client.1.smithi098.stdout:4/861: rename d3/d7d/da3/d3c to d3/d6/d8c/de7/d124 0 2024-09-20T19:06:10.515 INFO:tasks.workunit.client.1.smithi098.stdout:1/707: truncate d1/f9f 369383 0 2024-09-20T19:06:10.519 INFO:tasks.workunit.client.0.smithi027.stdout:0/915: sync 2024-09-20T19:06:10.524 INFO:tasks.workunit.client.0.smithi027.stdout:0/916: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fa0 [0,4194304] 0 2024-09-20T19:06:10.529 INFO:tasks.workunit.client.1.smithi098.stdout:5/608: unlink d1/d17/d2e/f51 0 2024-09-20T19:06:10.532 INFO:tasks.workunit.client.1.smithi098.stdout:0/588: truncate d0/d6/d19/d4f/f50 854884 0 2024-09-20T19:06:10.533 INFO:tasks.workunit.client.1.smithi098.stdout:3/737: dwrite d4/d38/f6f [0,4194304] 0 2024-09-20T19:06:10.534 INFO:tasks.workunit.client.1.smithi098.stdout:3/738: write d4/d25/fdb [357083,120981] 0 2024-09-20T19:06:10.537 INFO:tasks.workunit.client.1.smithi098.stdout:4/862: fsync d3/d6/d8c/de7/df4/d57/f9b 0 2024-09-20T19:06:10.537 INFO:tasks.workunit.client.1.smithi098.stdout:3/739: dread - d4/d19/d1d/d2f/d3e/dbb/fe8 zero size 2024-09-20T19:06:10.540 INFO:tasks.workunit.client.1.smithi098.stdout:1/708: mkdir d1/d3/d2e/d68/de5 0 2024-09-20T19:06:10.543 INFO:tasks.workunit.client.1.smithi098.stdout:1/709: dread - d1/d3/d2e/d68/d7a/fb2 zero size 2024-09-20T19:06:10.543 INFO:tasks.workunit.client.1.smithi098.stdout:6/532: write d0/d55/d82/f95 [2613009,2507] 0 2024-09-20T19:06:10.547 INFO:tasks.workunit.client.0.smithi027.stdout:4/843: getdents d5/d13/d36/d48/d3f/d4c/d52 0 2024-09-20T19:06:10.549 INFO:tasks.workunit.client.0.smithi027.stdout:7/814: truncate d3/d8/d1c/f47 4373628 0 2024-09-20T19:06:10.550 INFO:tasks.workunit.client.0.smithi027.stdout:9/955: truncate d0/d9/df/d1b/d9c/d5a/fd2 3476501 0 2024-09-20T19:06:10.551 INFO:tasks.workunit.client.0.smithi027.stdout:9/956: fsync d0/d9/df/da2/de9/df8/f136 0 2024-09-20T19:06:10.554 INFO:tasks.workunit.client.0.smithi027.stdout:3/895: rename d0/f2 to d0/d1/d5e/d1d/f12e 0 2024-09-20T19:06:10.558 INFO:tasks.workunit.client.1.smithi098.stdout:5/609: fdatasync d1/d17/d35/f89 0 2024-09-20T19:06:10.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/589: readlink d0/d6/d28/d31/d45/l4e 0 2024-09-20T19:06:10.565 INFO:tasks.workunit.client.1.smithi098.stdout:3/740: mknod d4/d92/cea 0 2024-09-20T19:06:10.566 INFO:tasks.workunit.client.1.smithi098.stdout:9/831: dwrite d4/de/d27/d6c/fbc [0,4194304] 0 2024-09-20T19:06:10.566 INFO:tasks.workunit.client.0.smithi027.stdout:0/917: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/f8e [0,4194304] 0 2024-09-20T19:06:10.568 INFO:tasks.workunit.client.1.smithi098.stdout:4/863: truncate d3/d7d/fad 5257866 0 2024-09-20T19:06:10.568 INFO:tasks.workunit.client.0.smithi027.stdout:4/844: mkdir d5/d9b/db0/d10a 0 2024-09-20T19:06:10.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:10 smithi027 ceph-mon[28196]: pgmap v13: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 231 MiB/s wr, 462 op/s 2024-09-20T19:06:10.573 INFO:tasks.workunit.client.0.smithi027.stdout:7/815: mkdir d3/d5e/d113 0 2024-09-20T19:06:10.575 INFO:tasks.workunit.client.1.smithi098.stdout:6/533: rmdir d0/de/d1b/d37/d43/d51 39 2024-09-20T19:06:10.579 INFO:tasks.workunit.client.0.smithi027.stdout:8/911: rename d2/d14/d13/d2e to d2/d3/d6/d9e/d137 0 2024-09-20T19:06:10.580 INFO:tasks.workunit.client.1.smithi098.stdout:7/856: rmdir d3/d10/d16/d17/d33/d1f/d28/d66/ddf/d100 0 2024-09-20T19:06:10.581 INFO:tasks.workunit.client.0.smithi027.stdout:1/877: getdents d2/d8/d3b/d82/d87/dcf 0 2024-09-20T19:06:10.582 INFO:tasks.workunit.client.0.smithi027.stdout:2/889: getdents d3/d13/d3c/d48/dba 0 2024-09-20T19:06:10.583 INFO:tasks.workunit.client.0.smithi027.stdout:0/918: fsync d2/d49/ded/df2/ff1 0 2024-09-20T19:06:10.584 INFO:tasks.workunit.client.0.smithi027.stdout:0/919: dread - d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/fb3 zero size 2024-09-20T19:06:10.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/590: rmdir d0/d6/d28 39 2024-09-20T19:06:10.585 INFO:tasks.workunit.client.0.smithi027.stdout:0/920: write d2/d48/d6b/d79/fac [2614350,33138] 0 2024-09-20T19:06:10.586 INFO:tasks.workunit.client.0.smithi027.stdout:7/816: creat d3/d8/d26/d45/f114 x:0 0 0 2024-09-20T19:06:10.586 INFO:tasks.workunit.client.0.smithi027.stdout:7/817: readlink d3/l4 0 2024-09-20T19:06:10.586 INFO:tasks.workunit.client.0.smithi027.stdout:7/818: chown d3/d8/d1c/l74 2721383 1 2024-09-20T19:06:10.587 INFO:tasks.workunit.client.0.smithi027.stdout:6/914: creat d4/d15/d37/d7a/f135 x:0 0 0 2024-09-20T19:06:10.587 INFO:tasks.workunit.client.0.smithi027.stdout:0/921: dread d2/d48/d6b/d79/ddc/d126/f128 [0,4194304] 0 2024-09-20T19:06:10.590 INFO:tasks.workunit.client.0.smithi027.stdout:8/912: chown d2/d3/d9a/dbf 0 1 2024-09-20T19:06:10.592 INFO:tasks.workunit.client.1.smithi098.stdout:9/832: mknod d4/de/d27/d4a/d21/d25/d51/d7b/c116 0 2024-09-20T19:06:10.593 INFO:tasks.workunit.client.0.smithi027.stdout:3/896: mkdir d0/d1/d5e/d12f 0 2024-09-20T19:06:10.594 INFO:tasks.workunit.client.1.smithi098.stdout:4/864: rmdir d3/d5e/d9f/da7 39 2024-09-20T19:06:10.599 INFO:tasks.workunit.client.1.smithi098.stdout:4/865: dread - d3/d6/d8c/de7/df4/d57/d7f/d84/f114 zero size 2024-09-20T19:06:10.599 INFO:tasks.workunit.client.1.smithi098.stdout:4/866: stat d3/d6/d8c/f8e 0 2024-09-20T19:06:10.599 INFO:tasks.workunit.client.1.smithi098.stdout:1/710: mknod d1/d3/df/d34/d43/ce6 0 2024-09-20T19:06:10.600 INFO:tasks.workunit.client.0.smithi027.stdout:1/878: mknod d2/d8/d2b/c11e 0 2024-09-20T19:06:10.600 INFO:tasks.workunit.client.1.smithi098.stdout:8/822: link d7/de/d11/d19/d47/cda d7/de/d11/c120 0 2024-09-20T19:06:10.600 INFO:tasks.workunit.client.1.smithi098.stdout:8/823: chown d7/de/d11 7 1 2024-09-20T19:06:10.601 INFO:tasks.workunit.client.0.smithi027.stdout:1/879: dwrite d2/d61/df8/f1e [0,4194304] 0 2024-09-20T19:06:10.603 INFO:tasks.workunit.client.1.smithi098.stdout:8/824: chown d7/de/d11/d1f/d10a/ff6 86612205 1 2024-09-20T19:06:10.603 INFO:tasks.workunit.client.1.smithi098.stdout:7/857: truncate d3/f6a 1263653 0 2024-09-20T19:06:10.604 INFO:tasks.workunit.client.0.smithi027.stdout:7/819: dread d3/d5e/dc7/fdb [0,4194304] 0 2024-09-20T19:06:10.604 INFO:tasks.workunit.client.0.smithi027.stdout:9/957: link d0/d9/df/d1b/d9c/d4f/d8d/da0/fa5 d0/d9/df/d1c/d6a/d9a/f140 0 2024-09-20T19:06:10.606 INFO:tasks.workunit.client.1.smithi098.stdout:5/610: fdatasync d1/d17/d35/f6a 0 2024-09-20T19:06:10.607 INFO:tasks.workunit.client.0.smithi027.stdout:8/913: creat d2/d2a/df8/d35/f138 x:0 0 0 2024-09-20T19:06:10.608 INFO:tasks.workunit.client.0.smithi027.stdout:3/897: creat d0/d12d/d98/dc3/da2/f130 x:0 0 0 2024-09-20T19:06:10.610 INFO:tasks.workunit.client.1.smithi098.stdout:7/858: dwrite d3/d10/d16/f79 [4194304,4194304] 0 2024-09-20T19:06:10.610 INFO:tasks.workunit.client.0.smithi027.stdout:3/898: truncate d0/d12d/d3c/d93/f122 1023836 0 2024-09-20T19:06:10.611 INFO:tasks.workunit.client.1.smithi098.stdout:3/741: symlink d4/leb 0 2024-09-20T19:06:10.611 INFO:tasks.workunit.client.0.smithi027.stdout:3/899: dread - d0/d1/d5e/d1d/d7d/db4/f10f zero size 2024-09-20T19:06:10.613 INFO:tasks.workunit.client.0.smithi027.stdout:2/890: link d3/d1c/fe1 d3/de/d34/f125 0 2024-09-20T19:06:10.616 INFO:tasks.workunit.client.0.smithi027.stdout:1/880: write d2/d61/df8/d56/d71/f95 [76133,91190] 0 2024-09-20T19:06:10.617 INFO:tasks.workunit.client.1.smithi098.stdout:1/711: unlink d1/f37 0 2024-09-20T19:06:10.620 INFO:tasks.workunit.client.1.smithi098.stdout:4/867: creat d3/d6/d8c/de7/df4/d1e/d2a/d45/f125 x:0 0 0 2024-09-20T19:06:10.621 INFO:tasks.workunit.client.0.smithi027.stdout:7/820: dread - d3/d8/d26/d45/d56/dec/d2e/d39/f4d zero size 2024-09-20T19:06:10.622 INFO:tasks.workunit.client.1.smithi098.stdout:4/868: fdatasync d3/d6/d8c/de7/df4/d1e/d2a/d45/ff8 0 2024-09-20T19:06:10.623 INFO:tasks.workunit.client.0.smithi027.stdout:7/821: dread - d3/ff7 zero size 2024-09-20T19:06:10.623 INFO:tasks.workunit.client.1.smithi098.stdout:6/534: mknod d0/de/d1b/ca2 0 2024-09-20T19:06:10.624 INFO:tasks.workunit.client.0.smithi027.stdout:9/958: mkdir d0/d9/df/d1c/d6a/df7/d141 0 2024-09-20T19:06:10.624 INFO:tasks.workunit.client.1.smithi098.stdout:6/535: write d0/de/d1b/d37/d8c/d4c/f6e [1263237,127713] 0 2024-09-20T19:06:10.627 INFO:tasks.workunit.client.1.smithi098.stdout:8/825: fdatasync d7/de/d11/d19/d30/d55/f66 0 2024-09-20T19:06:10.627 INFO:tasks.workunit.client.1.smithi098.stdout:9/833: dread d4/de/f1f [4194304,4194304] 0 2024-09-20T19:06:10.627 INFO:tasks.workunit.client.0.smithi027.stdout:8/914: fsync d2/d3/d6/d9e/d137/fa8 0 2024-09-20T19:06:10.628 INFO:tasks.workunit.client.0.smithi027.stdout:3/900: fsync d0/d12d/f1c 0 2024-09-20T19:06:10.628 INFO:tasks.workunit.client.0.smithi027.stdout:3/901: stat d0/d19/d54/d7a 0 2024-09-20T19:06:10.628 INFO:tasks.workunit.client.0.smithi027.stdout:2/891: mknod d3/d1c/d26/c126 0 2024-09-20T19:06:10.631 INFO:tasks.workunit.client.0.smithi027.stdout:1/881: rename d2/l7 to d2/d8/d3b/d44/d93/df3/l11f 0 2024-09-20T19:06:10.632 INFO:tasks.workunit.client.1.smithi098.stdout:5/611: mknod d1/d17/d35/d93/cb6 0 2024-09-20T19:06:10.633 INFO:tasks.workunit.client.0.smithi027.stdout:7/822: creat d3/d8/f115 x:0 0 0 2024-09-20T19:06:10.636 INFO:tasks.workunit.client.1.smithi098.stdout:3/742: creat d4/d38/d48/d60/dd0/fec x:0 0 0 2024-09-20T19:06:10.638 INFO:tasks.workunit.client.0.smithi027.stdout:1/882: dwrite d2/d8/d2b/d2d/d73/f85 [0,4194304] 0 2024-09-20T19:06:10.638 INFO:tasks.workunit.client.0.smithi027.stdout:5/938: sync 2024-09-20T19:06:10.641 INFO:tasks.workunit.client.0.smithi027.stdout:3/902: creat d0/d1/d5e/d1d/f131 x:0 0 0 2024-09-20T19:06:10.643 INFO:tasks.workunit.client.0.smithi027.stdout:3/903: fsync d0/d12d/d98/dc3/d104/faa 0 2024-09-20T19:06:10.644 INFO:tasks.workunit.client.0.smithi027.stdout:3/904: chown d0/d12d/d3c/d93/fd6 3 1 2024-09-20T19:06:10.646 INFO:tasks.workunit.client.1.smithi098.stdout:1/712: dread d1/d3/df/d34/d43/daa/fd6 [0,4194304] 0 2024-09-20T19:06:10.648 INFO:tasks.workunit.client.1.smithi098.stdout:6/536: rename d0/de/d1b/d37 to d0/d55/d82/da3 0 2024-09-20T19:06:10.649 INFO:tasks.workunit.client.1.smithi098.stdout:6/537: chown d0/d55/d82/da3/d43/l47 377441 1 2024-09-20T19:06:10.652 INFO:tasks.workunit.client.0.smithi027.stdout:9/959: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/d132/f142 x:0 0 0 2024-09-20T19:06:10.654 INFO:tasks.workunit.client.0.smithi027.stdout:7/823: rmdir d3/d8/d26/d45/d56/dec/dc/da9 39 2024-09-20T19:06:10.656 INFO:tasks.workunit.client.1.smithi098.stdout:6/538: dwrite d0/d55/d82/f95 [0,4194304] 0 2024-09-20T19:06:10.657 INFO:tasks.workunit.client.0.smithi027.stdout:1/883: read d2/d8/f20 [392551,22763] 0 2024-09-20T19:06:10.658 INFO:tasks.workunit.client.0.smithi027.stdout:1/884: dread - d2/d8/d3b/d82/d87/f116 zero size 2024-09-20T19:06:10.658 INFO:tasks.workunit.client.0.smithi027.stdout:1/885: readlink d2/d8/d3b/de3/l100 0 2024-09-20T19:06:10.659 INFO:tasks.workunit.client.1.smithi098.stdout:9/834: mknod d4/de/d27/d4a/d58/d5b/c117 0 2024-09-20T19:06:10.661 INFO:tasks.workunit.client.0.smithi027.stdout:5/939: truncate d4/f16 394682 0 2024-09-20T19:06:10.663 INFO:tasks.workunit.client.1.smithi098.stdout:0/591: creat d0/fb0 x:0 0 0 2024-09-20T19:06:10.665 INFO:tasks.workunit.client.0.smithi027.stdout:8/915: truncate d2/d3/d6/d9e/d137/fa8 262743 0 2024-09-20T19:06:10.667 INFO:tasks.workunit.client.0.smithi027.stdout:8/916: write d2/d3/d6/d6d/fcc [2761128,96036] 0 2024-09-20T19:06:10.671 INFO:tasks.workunit.client.1.smithi098.stdout:0/592: dwrite d0/d6/d19/d4f/f72 [0,4194304] 0 2024-09-20T19:06:10.672 INFO:tasks.workunit.client.1.smithi098.stdout:4/869: truncate d3/d6/d5b/f65 8581769 0 2024-09-20T19:06:10.676 INFO:tasks.workunit.client.0.smithi027.stdout:1/886: mknod d2/d61/df8/d56/c120 0 2024-09-20T19:06:10.676 INFO:tasks.workunit.client.0.smithi027.stdout:2/892: dwrite d3/de/d34/f125 [0,4194304] 0 2024-09-20T19:06:10.678 INFO:tasks.workunit.client.0.smithi027.stdout:9/960: dread d0/d9/df/d1b/d9c/d4f/fb9 [0,4194304] 0 2024-09-20T19:06:10.679 INFO:tasks.workunit.client.0.smithi027.stdout:5/940: creat d4/d1f/d91/d9b/d109/f139 x:0 0 0 2024-09-20T19:06:10.679 INFO:tasks.workunit.client.0.smithi027.stdout:3/905: dwrite d0/d12d/d3c/f42 [0,4194304] 0 2024-09-20T19:06:10.682 INFO:tasks.workunit.client.1.smithi098.stdout:8/826: dwrite d7/f3a [4194304,4194304] 0 2024-09-20T19:06:10.690 INFO:tasks.workunit.client.0.smithi027.stdout:7/824: rename d3/d8/d26/d45/d56/dec/dc/da9/dbc/ded to d3/d8/d26/d45/d56/dec/d2e/d39/d116 0 2024-09-20T19:06:10.694 INFO:tasks.workunit.client.1.smithi098.stdout:7/859: dwrite d3/f8 [0,4194304] 0 2024-09-20T19:06:10.694 INFO:tasks.workunit.client.1.smithi098.stdout:5/612: fsync d1/d17/f63 0 2024-09-20T19:06:10.695 INFO:tasks.workunit.client.0.smithi027.stdout:3/906: creat d0/d1/d65/dbb/f132 x:0 0 0 2024-09-20T19:06:10.696 INFO:tasks.workunit.client.0.smithi027.stdout:3/907: write d0/d19/d54/fcd [7152797,125025] 0 2024-09-20T19:06:10.697 INFO:tasks.workunit.client.1.smithi098.stdout:5/613: write d1/d17/d25/fb4 [651494,91717] 0 2024-09-20T19:06:10.699 INFO:tasks.workunit.client.1.smithi098.stdout:4/870: rmdir d3/d6/d5b/dd0 39 2024-09-20T19:06:10.701 INFO:tasks.workunit.client.0.smithi027.stdout:8/917: truncate d2/d2a/df8/f9c 693273 0 2024-09-20T19:06:10.703 INFO:tasks.workunit.client.1.smithi098.stdout:7/860: dread d3/d10/d16/d17/d33/d1f/fe7 [0,4194304] 0 2024-09-20T19:06:10.703 INFO:tasks.workunit.client.0.smithi027.stdout:8/918: write d2/d3/d6/d21/d33/d79/d9f/f121 [4922352,20040] 0 2024-09-20T19:06:10.704 INFO:tasks.workunit.client.0.smithi027.stdout:8/919: chown d2/d3/d9a/cf5 19 1 2024-09-20T19:06:10.705 INFO:tasks.workunit.client.1.smithi098.stdout:6/539: symlink d0/d55/d82/da3/d44/d24/la4 0 2024-09-20T19:06:10.706 INFO:tasks.workunit.client.0.smithi027.stdout:1/887: truncate d2/d8/d3b/d82/d90/d108/da3/dad/df9/fa9 192301 0 2024-09-20T19:06:10.708 INFO:tasks.workunit.client.1.smithi098.stdout:9/835: creat d4/de/d27/d6c/d73/d113/f118 x:0 0 0 2024-09-20T19:06:10.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/836: stat d4/de/d27/d4a/d58/d5b/d8f 0 2024-09-20T19:06:10.710 INFO:tasks.workunit.client.1.smithi098.stdout:8/827: dread d7/fd [0,4194304] 0 2024-09-20T19:06:10.711 INFO:tasks.workunit.client.0.smithi027.stdout:7/825: creat d3/d8/d26/d45/d56/dec/d2e/d39/f117 x:0 0 0 2024-09-20T19:06:10.712 INFO:tasks.workunit.client.0.smithi027.stdout:7/826: read - d3/d8/d26/d45/d56/dec/d2e/d39/f10c zero size 2024-09-20T19:06:10.713 INFO:tasks.workunit.client.0.smithi027.stdout:3/908: rename d0/d1/d65/dbb/f10b to d0/d1/d65/d100/d126/f133 0 2024-09-20T19:06:10.715 INFO:tasks.workunit.client.1.smithi098.stdout:3/743: rename d4/da/fb to d4/d19/d1d/fed 0 2024-09-20T19:06:10.716 INFO:tasks.workunit.client.1.smithi098.stdout:4/871: creat d3/d6/d8c/de7/d124/d6b/d73/d98/db3/f126 x:0 0 0 2024-09-20T19:06:10.717 INFO:tasks.workunit.client.1.smithi098.stdout:4/872: chown d3/f5 11197379 1 2024-09-20T19:06:10.718 INFO:tasks.workunit.client.1.smithi098.stdout:6/540: mknod d0/d55/ca5 0 2024-09-20T19:06:10.719 INFO:tasks.workunit.client.0.smithi027.stdout:1/888: symlink d2/d8/d2b/d5e/d101/l121 0 2024-09-20T19:06:10.719 INFO:tasks.workunit.client.1.smithi098.stdout:9/837: rmdir d4/de/d24 39 2024-09-20T19:06:10.720 INFO:tasks.workunit.client.0.smithi027.stdout:9/961: creat d0/d9/df/d1b/f143 x:0 0 0 2024-09-20T19:06:10.720 INFO:tasks.workunit.client.1.smithi098.stdout:9/838: write d4/de/d27/d4a/d21/f36 [9014333,82951] 0 2024-09-20T19:06:10.721 INFO:tasks.workunit.client.1.smithi098.stdout:8/828: truncate d7/de/d11/dca/fed 984621 0 2024-09-20T19:06:10.721 INFO:tasks.workunit.client.1.smithi098.stdout:9/839: stat d4/de/d27/d4a/d21/f50 0 2024-09-20T19:06:10.721 INFO:tasks.workunit.client.1.smithi098.stdout:8/829: readlink d7/de/d11/d19/d30/d55/l114 0 2024-09-20T19:06:10.723 INFO:tasks.workunit.client.1.smithi098.stdout:5/614: mkdir d1/d17/d35/d54/dab/db7 0 2024-09-20T19:06:10.726 INFO:tasks.workunit.client.1.smithi098.stdout:1/713: rename d1/d3/f2b to d1/d3/df/d34/d43/dad/dc1/fe7 0 2024-09-20T19:06:10.727 INFO:tasks.workunit.client.0.smithi027.stdout:7/827: mknod d3/d8/d26/d45/d56/dec/d2e/d39/d102/db2/c118 0 2024-09-20T19:06:10.728 INFO:tasks.workunit.client.0.smithi027.stdout:7/828: truncate d3/f29 5259788 0 2024-09-20T19:06:10.729 INFO:tasks.workunit.client.0.smithi027.stdout:7/829: readlink d3/d8/d26/d45/d56/dec/dc/l90 0 2024-09-20T19:06:10.729 INFO:tasks.workunit.client.1.smithi098.stdout:7/861: creat d3/d76/db8/da6/dec/f113 x:0 0 0 2024-09-20T19:06:10.729 INFO:tasks.workunit.client.1.smithi098.stdout:7/862: dread - d3/d4c/ff2 zero size 2024-09-20T19:06:10.730 INFO:tasks.workunit.client.0.smithi027.stdout:7/830: fdatasync d3/d8/d26/d45/d56/d8d/f103 0 2024-09-20T19:06:10.730 INFO:tasks.workunit.client.0.smithi027.stdout:3/909: creat d0/d12d/d15/db3/f134 x:0 0 0 2024-09-20T19:06:10.731 INFO:tasks.workunit.client.1.smithi098.stdout:4/873: unlink d3/d6/d8c/de7/df4/l4a 0 2024-09-20T19:06:10.733 INFO:tasks.workunit.client.1.smithi098.stdout:6/541: symlink d0/d55/d82/da3/la6 0 2024-09-20T19:06:10.733 INFO:tasks.workunit.client.0.smithi027.stdout:2/893: write d3/d13/d3c/dce/f82 [1493571,35098] 0 2024-09-20T19:06:10.734 INFO:tasks.workunit.client.0.smithi027.stdout:1/889: rmdir d2/d8/d2b 39 2024-09-20T19:06:10.734 INFO:tasks.workunit.client.1.smithi098.stdout:6/542: dread - d0/d55/d82/da3/d8c/d4c/f9c zero size 2024-09-20T19:06:10.734 INFO:tasks.workunit.client.0.smithi027.stdout:2/894: write d3/d1c/d26/d2a/f107 [224515,58111] 0 2024-09-20T19:06:10.735 INFO:tasks.workunit.client.0.smithi027.stdout:2/895: chown d3/d24/c51 245379354 1 2024-09-20T19:06:10.735 INFO:tasks.workunit.client.1.smithi098.stdout:8/830: chown d7/de/d11/d1f/cfe 61626 1 2024-09-20T19:06:10.736 INFO:tasks.workunit.client.1.smithi098.stdout:8/831: readlink d7/de/d11/d19/d30/d59/l104 0 2024-09-20T19:06:10.737 INFO:tasks.workunit.client.0.smithi027.stdout:9/962: symlink d0/d9/df/d1b/d9c/d4f/d8d/l144 0 2024-09-20T19:06:10.739 INFO:tasks.workunit.client.0.smithi027.stdout:8/920: rename d2/d3/d6/d6d/d75/lf3 to d2/d14/d13/d43/d5d/d90/l139 0 2024-09-20T19:06:10.742 INFO:tasks.workunit.client.0.smithi027.stdout:3/910: unlink d0/d1/d5e/d1d/f3a 0 2024-09-20T19:06:10.742 INFO:tasks.workunit.client.1.smithi098.stdout:1/714: stat d1/d3/c22 0 2024-09-20T19:06:10.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/593: rename d0/d6/d19/c56 to d0/d6/d19/d4f/d70/da5/cb1 0 2024-09-20T19:06:10.747 INFO:tasks.workunit.client.0.smithi027.stdout:5/941: link d4/d1f/fe9 d4/d1f/d7f/f13a 0 2024-09-20T19:06:10.750 INFO:tasks.workunit.client.1.smithi098.stdout:7/863: truncate d3/d10/d16/d17/d33/d1f/d10c/d8c/fe0 428084 0 2024-09-20T19:06:10.753 INFO:tasks.workunit.client.1.smithi098.stdout:6/543: mkdir d0/d55/d82/da3/d44/dc/da7 0 2024-09-20T19:06:10.758 INFO:tasks.workunit.client.1.smithi098.stdout:3/744: creat d4/d38/fee x:0 0 0 2024-09-20T19:06:10.759 INFO:tasks.workunit.client.0.smithi027.stdout:9/963: mknod d0/d9/df/d1b/d9c/d4f/d8d/c145 0 2024-09-20T19:06:10.761 INFO:tasks.workunit.client.1.smithi098.stdout:6/544: dwrite d0/d55/d82/da3/f9b [0,4194304] 0 2024-09-20T19:06:10.768 INFO:tasks.workunit.client.1.smithi098.stdout:9/840: rename d4/cd1 to d4/d74/dc8/dfc/c119 0 2024-09-20T19:06:10.770 INFO:tasks.workunit.client.0.smithi027.stdout:5/942: creat d4/da/de/d3e/db7/dc2/d87/f13b x:0 0 0 2024-09-20T19:06:10.773 INFO:tasks.workunit.client.1.smithi098.stdout:7/864: rmdir d3/d10/d16/dc1/d111 39 2024-09-20T19:06:10.774 INFO:tasks.workunit.client.1.smithi098.stdout:3/745: dread d4/da/f51 [0,4194304] 0 2024-09-20T19:06:10.778 INFO:tasks.workunit.client.0.smithi027.stdout:2/896: mknod d3/de/d109/c127 0 2024-09-20T19:06:10.778 INFO:tasks.workunit.client.0.smithi027.stdout:2/897: dread - d3/d13/f108 zero size 2024-09-20T19:06:10.781 INFO:tasks.workunit.client.0.smithi027.stdout:3/911: unlink d0/d1/d5e/l75 0 2024-09-20T19:06:10.782 INFO:tasks.workunit.client.1.smithi098.stdout:7/865: dwrite d3/daa/f10d [0,4194304] 0 2024-09-20T19:06:10.784 INFO:tasks.workunit.client.0.smithi027.stdout:2/898: dwrite d3/d13/d3c/d48/f88 [4194304,4194304] 0 2024-09-20T19:06:10.786 INFO:tasks.workunit.client.0.smithi027.stdout:5/943: fdatasync d4/f11 0 2024-09-20T19:06:10.786 INFO:tasks.workunit.client.0.smithi027.stdout:7/831: link d3/d8/d26/d45/d56/dec/l77 d3/d8/d26/d45/d56/dec/dc/da9/dbc/l119 0 2024-09-20T19:06:10.787 INFO:tasks.workunit.client.1.smithi098.stdout:8/832: dwrite d7/de/d11/d1d/d110/d11a/daa/fef [0,4194304] 0 2024-09-20T19:06:10.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/746: dwrite d4/d38/d48/d60/f99 [0,4194304] 0 2024-09-20T19:06:10.803 INFO:tasks.workunit.client.0.smithi027.stdout:9/964: write d0/d2e/f94 [367646,15434] 0 2024-09-20T19:06:10.806 INFO:tasks.workunit.client.1.smithi098.stdout:5/615: rename d1/d46/d69/f95 to d1/d17/d35/d54/dab/db7/fb8 0 2024-09-20T19:06:10.807 INFO:tasks.workunit.client.1.smithi098.stdout:0/594: rmdir d0/d6/d28/d31/d69 39 2024-09-20T19:06:10.811 INFO:tasks.workunit.client.0.smithi027.stdout:7/832: creat d3/d8/d26/d45/d56/dec/dc/da9/ddd/f11a x:0 0 0 2024-09-20T19:06:10.812 INFO:tasks.workunit.client.0.smithi027.stdout:1/890: getdents d2/d61/df8/dde 0 2024-09-20T19:06:10.813 INFO:tasks.workunit.client.0.smithi027.stdout:7/833: fdatasync d3/d8/d26/d45/d56/dec/d2e/d39/fe3 0 2024-09-20T19:06:10.814 INFO:tasks.workunit.client.1.smithi098.stdout:5/616: dwrite d1/d46/fa7 [0,4194304] 0 2024-09-20T19:06:10.815 INFO:tasks.workunit.client.0.smithi027.stdout:1/891: write d2/d8/d3b/d44/f109 [340302,121065] 0 2024-09-20T19:06:10.815 INFO:tasks.workunit.client.0.smithi027.stdout:2/899: mknod d3/d13/d3c/c128 0 2024-09-20T19:06:10.815 INFO:tasks.workunit.client.0.smithi027.stdout:1/892: chown d2/d8/d3b/d82/cb5 20008 1 2024-09-20T19:06:10.820 INFO:tasks.workunit.client.1.smithi098.stdout:8/833: mkdir d7/de/d11/d19/d47/d121 0 2024-09-20T19:06:10.821 INFO:tasks.workunit.client.0.smithi027.stdout:7/834: creat d3/d8/d26/d65/f11b x:0 0 0 2024-09-20T19:06:10.822 INFO:tasks.workunit.client.0.smithi027.stdout:5/944: link d4/da/de/d3e/db7/dc2/f97 d4/da/d1a/df8/f13c 0 2024-09-20T19:06:10.823 INFO:tasks.workunit.client.0.smithi027.stdout:5/945: chown d4/da/de/d3e/d69/d75/c4d 5 1 2024-09-20T19:06:10.825 INFO:tasks.workunit.client.0.smithi027.stdout:5/946: chown d4/d6c/d6f/d92/dc8/cff 6811214 1 2024-09-20T19:06:10.825 INFO:tasks.workunit.client.0.smithi027.stdout:9/965: link d0/d2e/l31 d0/d9/df/d1b/d9c/d121/l146 0 2024-09-20T19:06:10.827 INFO:tasks.workunit.client.0.smithi027.stdout:2/900: mknod d3/d1c/d26/d114/c129 0 2024-09-20T19:06:10.829 INFO:tasks.workunit.client.0.smithi027.stdout:4/845: sync 2024-09-20T19:06:10.829 INFO:tasks.workunit.client.0.smithi027.stdout:6/915: sync 2024-09-20T19:06:10.829 INFO:tasks.workunit.client.0.smithi027.stdout:0/922: sync 2024-09-20T19:06:10.830 INFO:tasks.workunit.client.0.smithi027.stdout:4/846: readlink d5/l6 0 2024-09-20T19:06:10.830 INFO:tasks.workunit.client.0.smithi027.stdout:6/916: dread - d4/d15/d37/d7a/f135 zero size 2024-09-20T19:06:10.834 INFO:tasks.workunit.client.0.smithi027.stdout:1/893: mknod d2/d8/d3b/d4b/c122 0 2024-09-20T19:06:10.836 INFO:tasks.workunit.client.0.smithi027.stdout:5/947: mkdir d4/d1f/d7f/da4/d13d 0 2024-09-20T19:06:10.838 INFO:tasks.workunit.client.0.smithi027.stdout:2/901: stat d3/d2f/def/cfd 0 2024-09-20T19:06:10.841 INFO:tasks.workunit.client.0.smithi027.stdout:6/917: truncate d4/d15/d37/d6a/fa3 364740 0 2024-09-20T19:06:10.848 INFO:tasks.workunit.client.0.smithi027.stdout:5/948: mknod d4/da/de/d3e/d44/c13e 0 2024-09-20T19:06:10.848 INFO:tasks.workunit.client.0.smithi027.stdout:1/894: dread d2/d8/d3b/d82/d90/d108/da3/fc1 [0,4194304] 0 2024-09-20T19:06:10.848 INFO:tasks.workunit.client.0.smithi027.stdout:5/949: write d4/d1f/d91/d9b/d109/f139 [320902,57981] 0 2024-09-20T19:06:10.848 INFO:tasks.workunit.client.0.smithi027.stdout:3/912: write d0/d1/d65/d100/d126/f133 [2804387,58890] 0 2024-09-20T19:06:10.853 INFO:tasks.workunit.client.0.smithi027.stdout:2/902: mkdir d3/d1c/d26/df2/d12a 0 2024-09-20T19:06:10.853 INFO:tasks.workunit.client.0.smithi027.stdout:7/835: getdents d3/d8/d26/d45/daa 0 2024-09-20T19:06:10.853 INFO:tasks.workunit.client.0.smithi027.stdout:6/918: creat d4/d6/d4b/d106/f136 x:0 0 0 2024-09-20T19:06:10.854 INFO:tasks.workunit.client.0.smithi027.stdout:6/919: chown d4/fb3 74 1 2024-09-20T19:06:10.854 INFO:tasks.workunit.client.0.smithi027.stdout:1/895: symlink d2/d8/d3b/d82/d90/l123 0 2024-09-20T19:06:10.856 INFO:tasks.workunit.client.0.smithi027.stdout:5/950: unlink d4/d1f/d91/d9b/c124 0 2024-09-20T19:06:10.859 INFO:tasks.workunit.client.0.smithi027.stdout:0/923: dread d2/d48/fb2 [0,4194304] 0 2024-09-20T19:06:10.859 INFO:tasks.workunit.client.0.smithi027.stdout:1/896: mkdir d2/d61/df8/dde/d124 0 2024-09-20T19:06:10.860 INFO:tasks.workunit.client.0.smithi027.stdout:5/951: chown d4/d6c/d6f/d92/dc8/fd7 136276749 1 2024-09-20T19:06:10.860 INFO:tasks.workunit.client.0.smithi027.stdout:4/847: dwrite d5/d11/d3d/fa8 [0,4194304] 0 2024-09-20T19:06:10.860 INFO:tasks.workunit.client.0.smithi027.stdout:1/897: chown d2/d8/d3b 103613 1 2024-09-20T19:06:10.861 INFO:tasks.workunit.client.0.smithi027.stdout:3/913: creat d0/d1/d5e/d1d/da7/db0/dc7/f135 x:0 0 0 2024-09-20T19:06:10.862 INFO:tasks.workunit.client.0.smithi027.stdout:5/952: fsync d4/da/d1a/df8/f11d 0 2024-09-20T19:06:10.862 INFO:tasks.workunit.client.0.smithi027.stdout:2/903: symlink d3/l12b 0 2024-09-20T19:06:10.863 INFO:tasks.workunit.client.0.smithi027.stdout:7/836: creat d3/d24/d84/f11c x:0 0 0 2024-09-20T19:06:10.865 INFO:tasks.workunit.client.0.smithi027.stdout:0/924: mkdir d2/d49/ded/d144 0 2024-09-20T19:06:10.865 INFO:tasks.workunit.client.0.smithi027.stdout:7/837: fdatasync d3/d8/d26/d45/d56/dec/d2e/d39/f10c 0 2024-09-20T19:06:10.868 INFO:tasks.workunit.client.0.smithi027.stdout:3/914: creat d0/d12d/d15/d6f/f136 x:0 0 0 2024-09-20T19:06:10.871 INFO:tasks.workunit.client.0.smithi027.stdout:4/848: mknod d5/d13/d36/d48/d3f/d7e/c10b 0 2024-09-20T19:06:10.877 INFO:tasks.workunit.client.0.smithi027.stdout:7/838: chown d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f7a 1046389 1 2024-09-20T19:06:10.878 INFO:tasks.workunit.client.0.smithi027.stdout:0/925: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/d108/l145 0 2024-09-20T19:06:10.878 INFO:tasks.workunit.client.0.smithi027.stdout:3/915: read - d0/d12d/d15/fea zero size 2024-09-20T19:06:10.879 INFO:tasks.workunit.client.0.smithi027.stdout:5/953: truncate d4/da/fac 936095 0 2024-09-20T19:06:10.879 INFO:tasks.workunit.client.0.smithi027.stdout:0/926: chown d2/d48/d6b/d79/d9f/ca1 7 1 2024-09-20T19:06:10.880 INFO:tasks.workunit.client.0.smithi027.stdout:5/954: chown d4/d1f/d7f/ced 2132462 1 2024-09-20T19:06:10.880 INFO:tasks.workunit.client.0.smithi027.stdout:4/849: rename d5/lf to d5/d11/d17/d1b/l10c 0 2024-09-20T19:06:10.881 INFO:tasks.workunit.client.0.smithi027.stdout:6/920: link d4/d6/d4b/fb4 d4/d9c/f137 0 2024-09-20T19:06:10.882 INFO:tasks.workunit.client.0.smithi027.stdout:5/955: fdatasync d4/da/de/d3e/d69/d75/fa8 0 2024-09-20T19:06:10.882 INFO:tasks.workunit.client.0.smithi027.stdout:4/850: chown d5/d11/d17/d1b/f101 971 1 2024-09-20T19:06:10.882 INFO:tasks.workunit.client.0.smithi027.stdout:4/851: chown d5/d9b/db0 4641 1 2024-09-20T19:06:10.883 INFO:tasks.workunit.client.0.smithi027.stdout:1/898: write d2/d8/d3b/d44/d93/fcb [672423,98119] 0 2024-09-20T19:06:10.885 INFO:tasks.workunit.client.0.smithi027.stdout:2/904: link d3/d1c/c1d d3/d13/d3c/d48/dba/de4/df3/c12c 0 2024-09-20T19:06:10.886 INFO:tasks.workunit.client.0.smithi027.stdout:1/899: stat d2/d61/df8/d56/d71/c86 0 2024-09-20T19:06:10.887 INFO:tasks.workunit.client.0.smithi027.stdout:2/905: readlink d3/de/l11 0 2024-09-20T19:06:10.888 INFO:tasks.workunit.client.0.smithi027.stdout:7/839: link d3/d8/d26/d45/d56/dec/d51/fcd d3/d8/d26/d45/d56/dec/dc/da9/f11d 0 2024-09-20T19:06:10.889 INFO:tasks.workunit.client.0.smithi027.stdout:5/956: symlink d4/da/de/d3e/l13f 0 2024-09-20T19:06:10.891 INFO:tasks.workunit.client.0.smithi027.stdout:4/852: write d5/d13/d36/d48/d9f/dc9/d8f/fce [922725,54367] 0 2024-09-20T19:06:10.894 INFO:tasks.workunit.client.0.smithi027.stdout:6/921: dwrite d4/d15/d37/d6a/d91/fff [0,4194304] 0 2024-09-20T19:06:10.894 INFO:tasks.workunit.client.0.smithi027.stdout:1/900: mkdir d2/d61/df8/d56/d71/d125 0 2024-09-20T19:06:10.895 INFO:tasks.workunit.client.0.smithi027.stdout:7/840: mknod d3/d8/d26/d65/dc4/d106/c11e 0 2024-09-20T19:06:10.896 INFO:tasks.workunit.client.0.smithi027.stdout:2/906: dread d3/d1c/d26/d2a/f107 [0,4194304] 0 2024-09-20T19:06:10.898 INFO:tasks.workunit.client.0.smithi027.stdout:1/901: mkdir d2/d61/df8/d56/d126 0 2024-09-20T19:06:10.899 INFO:tasks.workunit.client.0.smithi027.stdout:5/957: creat d4/da/de/d3e/d10b/dee/f140 x:0 0 0 2024-09-20T19:06:10.900 INFO:tasks.workunit.client.0.smithi027.stdout:7/841: stat d3/d8/d26/d45/d56/dec/d51/fcd 0 2024-09-20T19:06:10.901 INFO:tasks.workunit.client.0.smithi027.stdout:0/927: dread d2/db7/fde [0,4194304] 0 2024-09-20T19:06:10.902 INFO:tasks.workunit.client.0.smithi027.stdout:6/922: creat d4/d15/d37/d7a/d46/de7/f138 x:0 0 0 2024-09-20T19:06:10.903 INFO:tasks.workunit.client.0.smithi027.stdout:4/853: rename d5/d13/d16/f8b to d5/d13/d36/d48/d3f/d7e/f10d 0 2024-09-20T19:06:10.903 INFO:tasks.workunit.client.0.smithi027.stdout:6/923: chown d4/cf9 660 1 2024-09-20T19:06:10.904 INFO:tasks.workunit.client.0.smithi027.stdout:2/907: symlink d3/d1c/d26/d2a/dc2/l12d 0 2024-09-20T19:06:10.904 INFO:tasks.workunit.client.0.smithi027.stdout:3/916: dread d0/d12d/d15/f68 [0,4194304] 0 2024-09-20T19:06:10.906 INFO:tasks.workunit.client.1.smithi098.stdout:6/545: mkdir d0/d55/d82/da3/d43/da8 0 2024-09-20T19:06:10.907 INFO:tasks.workunit.client.1.smithi098.stdout:4/874: getdents d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50 0 2024-09-20T19:06:10.909 INFO:tasks.workunit.client.1.smithi098.stdout:7/866: symlink d3/d76/db8/da6/l114 0 2024-09-20T19:06:10.909 INFO:tasks.workunit.client.1.smithi098.stdout:1/715: write d1/d3/df/d34/d43/dad/dc1/dc7/fdf [1901085,113612] 0 2024-09-20T19:06:10.910 INFO:tasks.workunit.client.1.smithi098.stdout:3/747: fdatasync d4/da/d50/f78 0 2024-09-20T19:06:10.913 INFO:tasks.workunit.client.1.smithi098.stdout:7/867: fsync d3/d4c/fa1 0 2024-09-20T19:06:10.919 INFO:tasks.workunit.client.1.smithi098.stdout:6/546: mknod d0/d55/d82/da3/d8c/d9a/ca9 0 2024-09-20T19:06:10.920 INFO:tasks.workunit.client.1.smithi098.stdout:5/617: dread d1/fa2 [0,4194304] 0 2024-09-20T19:06:10.921 INFO:tasks.workunit.client.1.smithi098.stdout:9/841: dwrite d4/de/d24/d35/d2d/da6/dae/fc7 [0,4194304] 0 2024-09-20T19:06:10.921 INFO:tasks.workunit.client.0.smithi027.stdout:0/928: symlink d2/d48/d6b/d79/d84/d1b/l146 0 2024-09-20T19:06:10.923 INFO:tasks.workunit.client.0.smithi027.stdout:3/917: chown d0/d1 36121 1 2024-09-20T19:06:10.923 INFO:tasks.workunit.client.1.smithi098.stdout:3/748: truncate d4/d19/d1d/d22/f9b 1101514 0 2024-09-20T19:06:10.924 INFO:tasks.workunit.client.0.smithi027.stdout:2/908: chown d3/d1c/d26/df2/df6/fe8 636301466 1 2024-09-20T19:06:10.924 INFO:tasks.workunit.client.1.smithi098.stdout:3/749: fdatasync d4/d38/d39/f88 0 2024-09-20T19:06:10.924 INFO:tasks.workunit.client.0.smithi027.stdout:0/929: chown d2/d48/d6b/d79/d84/d1b/d39/d129 5010717 1 2024-09-20T19:06:10.925 INFO:tasks.workunit.client.0.smithi027.stdout:6/924: write d4/d15/d37/d6a/d91/fdd [442196,78260] 0 2024-09-20T19:06:10.925 INFO:tasks.workunit.client.1.smithi098.stdout:8/834: rename d7/de/d11/d19/d30/d59/d80/da5 to d7/de/d11/d19/d122 0 2024-09-20T19:06:10.928 INFO:tasks.workunit.client.0.smithi027.stdout:2/909: fsync d3/d1c/d26/d2a/dc2/f10e 0 2024-09-20T19:06:10.928 INFO:tasks.workunit.client.0.smithi027.stdout:6/925: write d4/d1b/f103 [1005057,100316] 0 2024-09-20T19:06:10.928 INFO:tasks.workunit.client.0.smithi027.stdout:3/918: read d0/d12d/d3c/f62 [4123978,105264] 0 2024-09-20T19:06:10.929 INFO:tasks.workunit.client.1.smithi098.stdout:7/868: fsync d3/d10/d16/d17/d33/d1f/d28/f61 0 2024-09-20T19:06:10.931 INFO:tasks.workunit.client.1.smithi098.stdout:7/869: stat d3/d10/d16/d17/d33/d1f/d2d/c68 0 2024-09-20T19:06:10.931 INFO:tasks.workunit.client.1.smithi098.stdout:5/618: creat d1/d17/d35/d54/dab/fb9 x:0 0 0 2024-09-20T19:06:10.932 INFO:tasks.workunit.client.1.smithi098.stdout:6/547: read d0/d55/d82/da3/d44/d24/d29/d50/f8e [102801,65806] 0 2024-09-20T19:06:10.935 INFO:tasks.workunit.client.1.smithi098.stdout:8/835: symlink d7/de/d11/d1d/d110/d11a/db0/l123 0 2024-09-20T19:06:10.937 INFO:tasks.workunit.client.1.smithi098.stdout:8/836: chown d7/de/d11/d19/d30/d68/f6c 7849 1 2024-09-20T19:06:10.938 INFO:tasks.workunit.client.1.smithi098.stdout:5/619: creat d1/d46/d69/d84/d87/fba x:0 0 0 2024-09-20T19:06:10.940 INFO:tasks.workunit.client.1.smithi098.stdout:4/875: write d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f10d [2353308,120528] 0 2024-09-20T19:06:10.942 INFO:tasks.workunit.client.1.smithi098.stdout:6/548: dwrite d0/d55/d82/da3/d44/d24/f3e [4194304,4194304] 0 2024-09-20T19:06:10.942 INFO:tasks.workunit.client.1.smithi098.stdout:3/750: write d4/d19/d1d/d2f/d4e/f93 [3473375,32021] 0 2024-09-20T19:06:10.942 INFO:tasks.workunit.client.1.smithi098.stdout:7/870: mkdir d3/d76/db8/da6/d115 0 2024-09-20T19:06:10.945 INFO:tasks.workunit.client.1.smithi098.stdout:8/837: write d7/de/d11/d19/d30/d55/fe4 [374981,77670] 0 2024-09-20T19:06:10.949 INFO:tasks.workunit.client.1.smithi098.stdout:1/716: dwrite d1/dbb/fde [4194304,4194304] 0 2024-09-20T19:06:10.950 INFO:tasks.workunit.client.1.smithi098.stdout:5/620: chown d1/d17/d25/d56/l92 24406637 1 2024-09-20T19:06:10.951 INFO:tasks.workunit.client.1.smithi098.stdout:7/871: write d3/d10/dcf/fd0 [3767416,106577] 0 2024-09-20T19:06:10.954 INFO:tasks.workunit.client.1.smithi098.stdout:3/751: creat d4/d19/d1d/d2f/d4e/da3/fef x:0 0 0 2024-09-20T19:06:10.958 INFO:tasks.workunit.client.1.smithi098.stdout:1/717: mknod d1/d3/d62/ce8 0 2024-09-20T19:06:10.959 INFO:tasks.workunit.client.1.smithi098.stdout:7/872: mknod d3/d76/d86/c116 0 2024-09-20T19:06:10.960 INFO:tasks.workunit.client.1.smithi098.stdout:7/873: fsync d3/d10/d16/f79 0 2024-09-20T19:06:10.961 INFO:tasks.workunit.client.1.smithi098.stdout:5/621: dread d1/d46/f83 [0,4194304] 0 2024-09-20T19:06:10.964 INFO:tasks.workunit.client.1.smithi098.stdout:6/549: rename d0/d55/d82/da3/d44/d24/d29/d2b/d65/l9d to d0/de/laa 0 2024-09-20T19:06:10.966 INFO:tasks.workunit.client.1.smithi098.stdout:5/622: mkdir d1/d46/daa/db3/dbb 0 2024-09-20T19:06:10.967 INFO:tasks.workunit.client.0.smithi027.stdout:9/966: sync 2024-09-20T19:06:10.967 INFO:tasks.workunit.client.0.smithi027.stdout:8/921: sync 2024-09-20T19:06:10.969 INFO:tasks.workunit.client.1.smithi098.stdout:7/874: creat d3/f117 x:0 0 0 2024-09-20T19:06:10.970 INFO:tasks.workunit.client.1.smithi098.stdout:4/876: write d3/d6/d8c/de7/df4/fa1 [54303,124767] 0 2024-09-20T19:06:10.974 INFO:tasks.workunit.client.1.smithi098.stdout:8/838: write d7/de/d11/d1d/d110/d11a/fe6 [442077,129833] 0 2024-09-20T19:06:10.978 INFO:tasks.workunit.client.1.smithi098.stdout:7/875: dwrite d3/d10/d16/d90/fb3 [0,4194304] 0 2024-09-20T19:06:10.980 INFO:tasks.workunit.client.0.smithi027.stdout:4/854: write d5/d13/d36/d48/d3f/fb6 [210106,126059] 0 2024-09-20T19:06:10.981 INFO:tasks.workunit.client.1.smithi098.stdout:1/718: truncate d1/d3/df/d34/d43/daa/fd6 2167154 0 2024-09-20T19:06:10.983 INFO:tasks.workunit.client.1.smithi098.stdout:5/623: rename d1/d46/daa to d1/d17/d25/d79/dbc 0 2024-09-20T19:06:10.983 INFO:tasks.workunit.client.1.smithi098.stdout:6/550: write d0/de/d1b/f28 [306414,36183] 0 2024-09-20T19:06:10.984 INFO:tasks.workunit.client.1.smithi098.stdout:1/719: write d1/d3/df/d4a/d6d/fe2 [84186,19052] 0 2024-09-20T19:06:10.986 INFO:tasks.workunit.client.1.smithi098.stdout:3/752: chown d4/d19/d1d/d22/f9b 11834 1 2024-09-20T19:06:10.987 INFO:tasks.workunit.client.1.smithi098.stdout:5/624: chown d1/d17/d25/d79/la5 86 1 2024-09-20T19:06:10.987 INFO:tasks.workunit.client.1.smithi098.stdout:4/877: truncate d3/d6/d8c/de7/d124/fd1 1436461 0 2024-09-20T19:06:10.988 INFO:tasks.workunit.client.0.smithi027.stdout:7/842: dread d3/d8/d26/d45/d56/dec/f44 [0,4194304] 0 2024-09-20T19:06:10.988 INFO:tasks.workunit.client.1.smithi098.stdout:6/551: truncate d0/f7b 1104717 0 2024-09-20T19:06:10.988 INFO:tasks.workunit.client.0.smithi027.stdout:4/855: dread - d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/fd6 zero size 2024-09-20T19:06:10.989 INFO:tasks.workunit.client.0.smithi027.stdout:3/919: truncate d0/d12d/d98/dc3/d104/de3/f112 890931 0 2024-09-20T19:06:10.989 INFO:tasks.workunit.client.1.smithi098.stdout:8/839: rename d7/f8 to d7/de/d11/d1d/d110/d11a/f124 0 2024-09-20T19:06:10.990 INFO:tasks.workunit.client.0.smithi027.stdout:8/922: mkdir d2/d3/d6/d6d/d75/d13a 0 2024-09-20T19:06:10.990 INFO:tasks.workunit.client.0.smithi027.stdout:3/920: chown d0/d12d/d3c/f42 0 1 2024-09-20T19:06:10.991 INFO:tasks.workunit.client.0.smithi027.stdout:2/910: dread d3/d1c/d31/f4c [0,4194304] 0 2024-09-20T19:06:10.991 INFO:tasks.workunit.client.1.smithi098.stdout:6/552: fsync d0/d55/d82/da3/d8c/f9f 0 2024-09-20T19:06:10.992 INFO:tasks.workunit.client.0.smithi027.stdout:6/926: getdents d4/d15/d2c/d119 0 2024-09-20T19:06:10.994 INFO:tasks.workunit.client.1.smithi098.stdout:5/625: creat d1/d46/fbd x:0 0 0 2024-09-20T19:06:10.994 INFO:tasks.workunit.client.0.smithi027.stdout:6/927: truncate d4/d15/d37/d7a/d46/d53/f127 394568 0 2024-09-20T19:06:10.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/876: link d3/d76/d86/faf d3/d76/d7a/dce/f118 0 2024-09-20T19:06:11.000 INFO:tasks.workunit.client.1.smithi098.stdout:8/840: dread d7/de/d11/d1d/d110/d11a/d72/ff9 [0,4194304] 0 2024-09-20T19:06:11.000 INFO:tasks.workunit.client.1.smithi098.stdout:7/877: fdatasync d3/d10/d16/d17/d33/d4b/ff7 0 2024-09-20T19:06:11.002 INFO:tasks.workunit.client.0.smithi027.stdout:4/856: creat d5/d11/d17/d1b/dd4/f10e x:0 0 0 2024-09-20T19:06:11.006 INFO:tasks.workunit.client.0.smithi027.stdout:8/923: fsync d2/d14/f20 0 2024-09-20T19:06:11.006 INFO:tasks.workunit.client.1.smithi098.stdout:4/878: truncate d3/d6/d8c/de7/df4/d57/d7f/f8b 5172165 0 2024-09-20T19:06:11.010 INFO:tasks.workunit.client.0.smithi027.stdout:2/911: mknod d3/d1c/d26/d2a/dc2/d6f/c12e 0 2024-09-20T19:06:11.011 INFO:tasks.workunit.client.1.smithi098.stdout:3/753: write d4/d19/d1d/d2f/f7e [504020,71528] 0 2024-09-20T19:06:11.011 INFO:tasks.workunit.client.1.smithi098.stdout:5/626: symlink d1/d46/lbe 0 2024-09-20T19:06:11.012 INFO:tasks.workunit.client.1.smithi098.stdout:5/627: readlink d1/d17/d25/d79/la5 0 2024-09-20T19:06:11.013 INFO:tasks.workunit.client.0.smithi027.stdout:9/967: link d0/d9/fd6 d0/d9/df/d1c/d6a/df7/f147 0 2024-09-20T19:06:11.015 INFO:tasks.workunit.client.0.smithi027.stdout:6/928: dread - d4/d15/d37/d6a/da5/fd2 zero size 2024-09-20T19:06:11.015 INFO:tasks.workunit.client.0.smithi027.stdout:3/921: dread d0/d12d/d98/dc3/d104/faa [0,4194304] 0 2024-09-20T19:06:11.017 INFO:tasks.workunit.client.0.smithi027.stdout:0/930: getdents d2/d48/d6b/d79/d84/d1b 0 2024-09-20T19:06:11.018 INFO:tasks.workunit.client.0.smithi027.stdout:3/922: truncate d0/d1/d5e/d1d/f106 1104177 0 2024-09-20T19:06:11.019 INFO:tasks.workunit.client.1.smithi098.stdout:8/841: read d7/de/f92 [1001942,21370] 0 2024-09-20T19:06:11.019 INFO:tasks.workunit.client.1.smithi098.stdout:7/878: creat d3/d76/d7a/dce/f119 x:0 0 0 2024-09-20T19:06:11.020 INFO:tasks.workunit.client.1.smithi098.stdout:8/842: dread - d7/de/d11/d19/d30/d82/f118 zero size 2024-09-20T19:06:11.024 INFO:tasks.workunit.client.1.smithi098.stdout:6/553: dread d0/d55/d82/da3/d44/f13 [12582912,4194304] 0 2024-09-20T19:06:11.026 INFO:tasks.workunit.client.0.smithi027.stdout:9/968: creat d0/d9/df/d57/f148 x:0 0 0 2024-09-20T19:06:11.027 INFO:tasks.workunit.client.1.smithi098.stdout:7/879: read d3/d10/d16/d17/d33/d1f/d10c/fc4 [3096541,25200] 0 2024-09-20T19:06:11.027 INFO:tasks.workunit.client.1.smithi098.stdout:6/554: chown d0/d55/d82/da3/d44 2588 1 2024-09-20T19:06:11.028 INFO:tasks.workunit.client.0.smithi027.stdout:9/969: dread d0/d2e/d110/f12f [0,4194304] 0 2024-09-20T19:06:11.028 INFO:tasks.workunit.client.1.smithi098.stdout:5/628: symlink d1/d17/d2e/lbf 0 2024-09-20T19:06:11.029 INFO:tasks.workunit.client.1.smithi098.stdout:5/629: write d1/d17/f97 [2783872,50663] 0 2024-09-20T19:06:11.030 INFO:tasks.workunit.client.0.smithi027.stdout:6/929: dread - d4/dc7/f104 zero size 2024-09-20T19:06:11.033 INFO:tasks.workunit.client.0.smithi027.stdout:0/931: symlink d2/d49/ded/l147 0 2024-09-20T19:06:11.034 INFO:tasks.workunit.client.0.smithi027.stdout:0/932: chown d2/d48/d6b/d79/d84/d1b/dc5/f88 2 1 2024-09-20T19:06:11.034 INFO:tasks.workunit.client.0.smithi027.stdout:4/857: symlink d5/d11/d1a/d2a/da3/de2/l10f 0 2024-09-20T19:06:11.035 INFO:tasks.workunit.client.1.smithi098.stdout:4/879: fsync d3/d6/d8c/de7/df4/d57/d7f/f8b 0 2024-09-20T19:06:11.039 INFO:tasks.workunit.client.1.smithi098.stdout:8/843: rename d7/de/d11/d19/d30/db5/cd4 to d7/de/d11/d19/d30/db5/c125 0 2024-09-20T19:06:11.040 INFO:tasks.workunit.client.1.smithi098.stdout:8/844: chown d7/c2e 13403606 1 2024-09-20T19:06:11.041 INFO:tasks.workunit.client.1.smithi098.stdout:1/720: link d1/d3/d2e/c69 d1/d3/df/d34/d43/d65/dbc/ce9 0 2024-09-20T19:06:11.044 INFO:tasks.workunit.client.0.smithi027.stdout:6/930: readlink d4/d15/d37/d5a/d78/l131 0 2024-09-20T19:06:11.045 INFO:tasks.workunit.client.1.smithi098.stdout:7/880: creat d3/d10/d16/d17/d33/d1f/d10c/f11a x:0 0 0 2024-09-20T19:06:11.046 INFO:tasks.workunit.client.0.smithi027.stdout:7/843: link d3/d8/d1c/c54 d3/d8/d26/d45/d56/dec/d2e/d39/d102/db2/dd4/c11f 0 2024-09-20T19:06:11.046 INFO:tasks.workunit.client.1.smithi098.stdout:3/754: dread d4/fd [0,4194304] 0 2024-09-20T19:06:11.047 INFO:tasks.workunit.client.1.smithi098.stdout:7/881: write d3/d10/d16/f79 [1204749,127586] 0 2024-09-20T19:06:11.049 INFO:tasks.workunit.client.0.smithi027.stdout:0/933: chown d2/d48/d6b/d79/d84/d1b/dc5/d2e/lfc 1978 1 2024-09-20T19:06:11.050 INFO:tasks.workunit.client.1.smithi098.stdout:5/630: symlink d1/d17/d35/d54/d68/lc0 0 2024-09-20T19:06:11.050 INFO:tasks.workunit.client.0.smithi027.stdout:0/934: readlink d2/d49/l10f 0 2024-09-20T19:06:11.051 INFO:tasks.workunit.client.0.smithi027.stdout:4/858: fsync d5/d13/d36/d48/d3f/d7e/f10d 0 2024-09-20T19:06:11.055 INFO:tasks.workunit.client.0.smithi027.stdout:7/844: dwrite d3/d8/d26/d45/d56/dec/d2e/d39/d102/fef [0,4194304] 0 2024-09-20T19:06:11.058 INFO:tasks.workunit.client.0.smithi027.stdout:6/931: rmdir d4/d6/d4b/d7c 39 2024-09-20T19:06:11.060 INFO:tasks.workunit.client.0.smithi027.stdout:7/845: read d3/d8/d26/d45/d56/f64 [1862388,100716] 0 2024-09-20T19:06:11.062 INFO:tasks.workunit.client.0.smithi027.stdout:9/970: dread d0/d9/df/d1b/f17 [0,4194304] 0 2024-09-20T19:06:11.063 INFO:tasks.workunit.client.1.smithi098.stdout:7/882: mknod d3/d10/d16/d17/d33/d1f/d10c/d8c/c11b 0 2024-09-20T19:06:11.063 INFO:tasks.workunit.client.0.smithi027.stdout:9/971: dread - d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/d132/f142 zero size 2024-09-20T19:06:11.065 INFO:tasks.workunit.client.0.smithi027.stdout:3/923: write d0/d12d/d15/d55/f5f [316013,60357] 0 2024-09-20T19:06:11.065 INFO:tasks.workunit.client.0.smithi027.stdout:0/935: mkdir d2/d119/d134/d148 0 2024-09-20T19:06:11.069 INFO:tasks.workunit.client.0.smithi027.stdout:8/924: write d2/d3/d6/d21/d33/d79/d9f/f101 [40837,33335] 0 2024-09-20T19:06:11.071 INFO:tasks.workunit.client.1.smithi098.stdout:7/883: unlink d3/d76/db8/da6/cc0 0 2024-09-20T19:06:11.075 INFO:tasks.workunit.client.1.smithi098.stdout:5/631: creat d1/d17/d35/d93/db1/fc1 x:0 0 0 2024-09-20T19:06:11.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/555: dwrite d0/de/f56 [0,4194304] 0 2024-09-20T19:06:11.079 INFO:tasks.workunit.client.1.smithi098.stdout:7/884: read d3/d10/d16/d17/d33/d1f/d10c/d8c/fd7 [768176,61192] 0 2024-09-20T19:06:11.084 INFO:tasks.workunit.client.1.smithi098.stdout:7/885: stat d3/d76/db8/da6/dec/f113 0 2024-09-20T19:06:11.086 INFO:tasks.workunit.client.0.smithi027.stdout:7/846: write d3/d8/d26/d45/d56/dec/d2e/d50/f86 [655082,72906] 0 2024-09-20T19:06:11.087 INFO:tasks.workunit.client.1.smithi098.stdout:6/556: fdatasync d0/d55/d82/da3/d44/d24/f52 0 2024-09-20T19:06:11.087 INFO:tasks.workunit.client.1.smithi098.stdout:1/721: dread d1/d3/d2e/f67 [4194304,4194304] 0 2024-09-20T19:06:11.087 INFO:tasks.workunit.client.1.smithi098.stdout:3/755: write d4/f1c [384305,1743] 0 2024-09-20T19:06:11.089 INFO:tasks.workunit.client.0.smithi027.stdout:6/932: link d4/d15/d37/d5a/d78/c134 d4/d12a/c139 0 2024-09-20T19:06:11.089 INFO:tasks.workunit.client.1.smithi098.stdout:4/880: dwrite d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f9d [0,4194304] 0 2024-09-20T19:06:11.096 INFO:tasks.workunit.client.0.smithi027.stdout:3/924: dwrite d0/d12d/d15/d6f/f83 [0,4194304] 0 2024-09-20T19:06:11.096 INFO:tasks.workunit.client.1.smithi098.stdout:7/886: creat d3/d10/d16/d90/f11c x:0 0 0 2024-09-20T19:06:11.097 INFO:tasks.workunit.client.0.smithi027.stdout:3/925: stat d0/d12d/d3c 0 2024-09-20T19:06:11.098 INFO:tasks.workunit.client.1.smithi098.stdout:3/756: fsync d4/d38/d48/f79 0 2024-09-20T19:06:11.100 INFO:tasks.workunit.client.0.smithi027.stdout:4/859: getdents d5/d11/d1a/d2a/da3/de2 0 2024-09-20T19:06:11.100 INFO:tasks.workunit.client.0.smithi027.stdout:4/860: stat d5/d13/d36/d60 0 2024-09-20T19:06:11.101 INFO:tasks.workunit.client.1.smithi098.stdout:5/632: dwrite d1/d46/fa1 [0,4194304] 0 2024-09-20T19:06:11.102 INFO:tasks.workunit.client.0.smithi027.stdout:8/925: symlink d2/d14/d13/d72/d12d/l13b 0 2024-09-20T19:06:11.105 INFO:tasks.workunit.client.1.smithi098.stdout:4/881: mknod d3/d6/d8c/de7/df4/d1e/d2a/c127 0 2024-09-20T19:06:11.107 INFO:tasks.workunit.client.0.smithi027.stdout:6/933: mkdir d4/d15/d37/d7a/d46/d13a 0 2024-09-20T19:06:11.111 INFO:tasks.workunit.client.1.smithi098.stdout:3/757: dwrite d4/d38/d48/fcc [0,4194304] 0 2024-09-20T19:06:11.111 INFO:tasks.workunit.client.1.smithi098.stdout:7/887: mkdir d3/d10/d16/d17/d7c/d11d 0 2024-09-20T19:06:11.111 INFO:tasks.workunit.client.1.smithi098.stdout:4/882: read d3/d6/d8c/de7/df4/d1e/d2a/fd9 [1762245,18999] 0 2024-09-20T19:06:11.112 INFO:tasks.workunit.client.0.smithi027.stdout:9/972: rmdir d0/d9/df/d1c/d6a/d6d/dd/d117 0 2024-09-20T19:06:11.113 INFO:tasks.workunit.client.1.smithi098.stdout:6/557: symlink d0/d83/lab 0 2024-09-20T19:06:11.114 INFO:tasks.workunit.client.1.smithi098.stdout:5/633: mkdir d1/d17/d35/d93/dc2 0 2024-09-20T19:06:11.115 INFO:tasks.workunit.client.0.smithi027.stdout:0/936: creat d2/d48/d6b/d79/d84/f149 x:0 0 0 2024-09-20T19:06:11.115 INFO:tasks.workunit.client.1.smithi098.stdout:6/558: readlink d0/d55/d82/da3/l73 0 2024-09-20T19:06:11.115 INFO:tasks.workunit.client.1.smithi098.stdout:4/883: write d3/d6/f18 [2831964,93167] 0 2024-09-20T19:06:11.116 INFO:tasks.workunit.client.0.smithi027.stdout:4/861: rmdir d5/d11/d17/d1b 39 2024-09-20T19:06:11.117 INFO:tasks.workunit.client.1.smithi098.stdout:4/884: fdatasync d3/d6/d8c/de7/df4/d64/f8f 0 2024-09-20T19:06:11.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/758: mkdir d4/da/d50/df0 0 2024-09-20T19:06:11.121 INFO:tasks.workunit.client.0.smithi027.stdout:6/934: creat d4/d15/d37/d7a/d8e/f13b x:0 0 0 2024-09-20T19:06:11.124 INFO:tasks.workunit.client.0.smithi027.stdout:9/973: dwrite d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f122 [0,4194304] 0 2024-09-20T19:06:11.131 INFO:tasks.workunit.client.1.smithi098.stdout:7/888: dwrite d3/d76/db8/da6/fcc [0,4194304] 0 2024-09-20T19:06:11.132 INFO:tasks.workunit.client.0.smithi027.stdout:4/862: dwrite d5/d11/d3d/db4/fd2 [0,4194304] 0 2024-09-20T19:06:11.132 INFO:tasks.workunit.client.1.smithi098.stdout:1/722: getdents d1/d3 0 2024-09-20T19:06:11.133 INFO:tasks.workunit.client.0.smithi027.stdout:0/937: symlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d51/l14a 0 2024-09-20T19:06:11.135 INFO:tasks.workunit.client.1.smithi098.stdout:5/634: dread d1/d17/f1a [0,4194304] 0 2024-09-20T19:06:11.135 INFO:tasks.workunit.client.1.smithi098.stdout:6/559: symlink d0/d55/d82/da3/lac 0 2024-09-20T19:06:11.136 INFO:tasks.workunit.client.0.smithi027.stdout:7/847: write d3/d8/d26/d45/d56/f64 [2588996,61145] 0 2024-09-20T19:06:11.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/723: dread - d1/d3/df/d4a/d6d/f92 zero size 2024-09-20T19:06:11.137 INFO:tasks.workunit.client.0.smithi027.stdout:0/938: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [4330627,128881] 0 2024-09-20T19:06:11.137 INFO:tasks.workunit.client.1.smithi098.stdout:3/759: rmdir d4/d38/d48/d60 39 2024-09-20T19:06:11.139 INFO:tasks.workunit.client.1.smithi098.stdout:6/560: read d0/d55/d82/da3/d43/f5e [259261,50920] 0 2024-09-20T19:06:11.140 INFO:tasks.workunit.client.0.smithi027.stdout:3/926: link d0/l4d d0/d19/dc2/d105/l137 0 2024-09-20T19:06:11.142 INFO:tasks.workunit.client.0.smithi027.stdout:0/939: fsync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d106/d118/f123 0 2024-09-20T19:06:11.145 INFO:tasks.workunit.client.1.smithi098.stdout:5/635: write d1/f2 [2941953,67055] 0 2024-09-20T19:06:11.148 INFO:tasks.workunit.client.0.smithi027.stdout:7/848: stat d3/d8/d26/l9d 0 2024-09-20T19:06:11.148 INFO:tasks.workunit.client.1.smithi098.stdout:1/724: stat d1/d3/d2e/d71/l9d 0 2024-09-20T19:06:11.151 INFO:tasks.workunit.client.0.smithi027.stdout:3/927: dwrite d0/d1/d5e/f1e [0,4194304] 0 2024-09-20T19:06:11.154 INFO:tasks.workunit.client.0.smithi027.stdout:8/926: dwrite d2/d3/d6/d9e/d137/f60 [0,4194304] 0 2024-09-20T19:06:11.157 INFO:tasks.workunit.client.1.smithi098.stdout:4/885: symlink d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/dab/dee/l128 0 2024-09-20T19:06:11.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/889: symlink d3/d10/d16/d17/d33/d1f/dfe/l11e 0 2024-09-20T19:06:11.160 INFO:tasks.workunit.client.0.smithi027.stdout:7/849: dwrite d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f42 [0,4194304] 0 2024-09-20T19:06:11.161 INFO:tasks.workunit.client.0.smithi027.stdout:3/928: unlink d0/fbd 0 2024-09-20T19:06:11.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/636: creat d1/d46/d69/fc3 x:0 0 0 2024-09-20T19:06:11.163 INFO:tasks.workunit.client.0.smithi027.stdout:3/929: chown d0/d1/d5e/d1d/f12e 11 1 2024-09-20T19:06:11.164 INFO:tasks.workunit.client.1.smithi098.stdout:1/725: fdatasync d1/d3/df/d4a/d6d/fb5 0 2024-09-20T19:06:11.164 INFO:tasks.workunit.client.0.smithi027.stdout:4/863: rename d5/d13/l15 to d5/d11/l110 0 2024-09-20T19:06:11.168 INFO:tasks.workunit.client.0.smithi027.stdout:3/930: mknod d0/dc5/deb/c138 0 2024-09-20T19:06:11.169 INFO:tasks.workunit.client.1.smithi098.stdout:7/890: fsync d3/d10/d16/d17/d33/d1f/d10c/d8c/ff3 0 2024-09-20T19:06:11.170 INFO:tasks.workunit.client.0.smithi027.stdout:8/927: symlink d2/d3/d6/d9e/d137/l13c 0 2024-09-20T19:06:11.172 INFO:tasks.workunit.client.0.smithi027.stdout:7/850: dwrite d3/d8/d26/f3d [0,4194304] 0 2024-09-20T19:06:11.172 INFO:tasks.workunit.client.0.smithi027.stdout:4/864: creat d5/d11/d1a/d2a/f111 x:0 0 0 2024-09-20T19:06:11.173 INFO:tasks.workunit.client.1.smithi098.stdout:5/637: write d1/d17/d35/d54/dab/db7/fb8 [9435194,104105] 0 2024-09-20T19:06:11.173 INFO:tasks.workunit.client.1.smithi098.stdout:5/638: write d1/fa3 [193651,5140] 0 2024-09-20T19:06:11.175 INFO:tasks.workunit.client.0.smithi027.stdout:3/931: mknod d0/d12d/d64/c139 0 2024-09-20T19:06:11.176 INFO:tasks.workunit.client.0.smithi027.stdout:3/932: fsync d0/d1/d5e/d1d/f131 0 2024-09-20T19:06:11.178 INFO:tasks.workunit.client.0.smithi027.stdout:6/935: truncate d4/d15/d37/d6a/d91/fdd 198414 0 2024-09-20T19:06:11.179 INFO:tasks.workunit.client.0.smithi027.stdout:8/928: rename d2/d3/d6/de0/f131 to d2/d3/d11d/df2/f13d 0 2024-09-20T19:06:11.181 INFO:tasks.workunit.client.0.smithi027.stdout:6/936: read d4/d15/d37/d6a/d91/fa2 [364113,38829] 0 2024-09-20T19:06:11.182 INFO:tasks.workunit.client.1.smithi098.stdout:4/886: creat d3/d6/d8c/de7/df4/d109/f129 x:0 0 0 2024-09-20T19:06:11.182 INFO:tasks.workunit.client.1.smithi098.stdout:3/760: dread d4/d38/d48/d60/f74 [0,4194304] 0 2024-09-20T19:06:11.184 INFO:tasks.workunit.client.1.smithi098.stdout:3/761: stat d4/da/d7a/lc3 0 2024-09-20T19:06:11.186 INFO:tasks.workunit.client.0.smithi027.stdout:3/933: dwrite d0/d12d/d15/d6f/d7f/f10e [0,4194304] 0 2024-09-20T19:06:11.187 INFO:tasks.workunit.client.1.smithi098.stdout:7/891: rmdir d3/d76/d7a 39 2024-09-20T19:06:11.187 INFO:tasks.workunit.client.0.smithi027.stdout:0/940: dwrite d2/d48/d6b/d79/f94 [0,4194304] 0 2024-09-20T19:06:11.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/561: dwrite d0/d55/d82/da3/f4b [0,4194304] 0 2024-09-20T19:06:11.190 INFO:tasks.workunit.client.0.smithi027.stdout:0/941: chown d2/d48/d6b/d79/d84/d1b/d39/f6f 124 1 2024-09-20T19:06:11.195 INFO:tasks.workunit.client.1.smithi098.stdout:3/762: dwrite d4/f1c [0,4194304] 0 2024-09-20T19:06:11.196 INFO:tasks.workunit.client.1.smithi098.stdout:4/887: mknod d3/d6/de3/c12a 0 2024-09-20T19:06:11.202 INFO:tasks.workunit.client.0.smithi027.stdout:3/934: symlink d0/d12d/d98/dc3/d104/l13a 0 2024-09-20T19:06:11.204 INFO:tasks.workunit.client.0.smithi027.stdout:0/942: mknod d2/d49/c14b 0 2024-09-20T19:06:11.205 INFO:tasks.workunit.client.1.smithi098.stdout:3/763: creat d4/d19/d1d/d2f/d4e/ff1 x:0 0 0 2024-09-20T19:06:11.210 INFO:tasks.workunit.client.1.smithi098.stdout:4/888: chown d3/d6/l49 55444423 1 2024-09-20T19:06:11.210 INFO:tasks.workunit.client.0.smithi027.stdout:6/937: symlink d4/d15/d37/d7a/d33/l13c 0 2024-09-20T19:06:11.210 INFO:tasks.workunit.client.1.smithi098.stdout:6/562: dwrite d0/de/f5f [0,4194304] 0 2024-09-20T19:06:11.212 INFO:tasks.workunit.client.0.smithi027.stdout:3/935: mknod d0/d19/dc2/d105/c13b 0 2024-09-20T19:06:11.213 INFO:tasks.workunit.client.1.smithi098.stdout:3/764: creat d4/da/d7a/ff2 x:0 0 0 2024-09-20T19:06:11.217 INFO:tasks.workunit.client.0.smithi027.stdout:3/936: mkdir d0/dc5/deb/d13c 0 2024-09-20T19:06:11.220 INFO:tasks.workunit.client.1.smithi098.stdout:4/889: rename d3/f7 to d3/d4f/f12b 0 2024-09-20T19:06:11.221 INFO:tasks.workunit.client.1.smithi098.stdout:4/890: chown d3/d5e 43 1 2024-09-20T19:06:11.223 INFO:tasks.workunit.client.1.smithi098.stdout:6/563: link d0/d55/d82/da3/d44/d24/f3e d0/d55/d82/da3/d8c/d4c/fad 0 2024-09-20T19:06:11.224 INFO:tasks.workunit.client.0.smithi027.stdout:3/937: symlink d0/d1/d65/d100/d111/l13d 0 2024-09-20T19:06:11.224 INFO:tasks.workunit.client.1.smithi098.stdout:6/564: write d0/de/d1b/f5d [635819,126993] 0 2024-09-20T19:06:11.226 INFO:tasks.workunit.client.1.smithi098.stdout:4/891: creat d3/d6/d8c/de7/f12c x:0 0 0 2024-09-20T19:06:11.227 INFO:tasks.workunit.client.1.smithi098.stdout:3/765: creat d4/d38/d48/ff3 x:0 0 0 2024-09-20T19:06:11.229 INFO:tasks.workunit.client.0.smithi027.stdout:3/938: mknod d0/d19/d54/d7a/d102/c13e 0 2024-09-20T19:06:11.230 INFO:tasks.workunit.client.0.smithi027.stdout:3/939: fdatasync d0/d19/d54/fbe 0 2024-09-20T19:06:11.231 INFO:tasks.workunit.client.1.smithi098.stdout:4/892: write d3/d4f/f12b [2085952,18824] 0 2024-09-20T19:06:11.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/766: rmdir d4/da/d7a 39 2024-09-20T19:06:11.233 INFO:tasks.workunit.client.0.smithi027.stdout:3/940: rmdir d0/d12d/d98 39 2024-09-20T19:06:11.236 INFO:tasks.workunit.client.0.smithi027.stdout:0/943: dread d2/d48/d6b/d79/d84/d1b/f2b [0,4194304] 0 2024-09-20T19:06:11.238 INFO:tasks.workunit.client.0.smithi027.stdout:0/944: dread - d2/d49/ded/d12f/f140 zero size 2024-09-20T19:06:11.238 INFO:tasks.workunit.client.0.smithi027.stdout:5/958: sync 2024-09-20T19:06:11.238 INFO:tasks.workunit.client.0.smithi027.stdout:1/902: sync 2024-09-20T19:06:11.241 INFO:tasks.workunit.client.0.smithi027.stdout:5/959: write d4/da/de/d3e/d69/d75/fa8 [1247284,21871] 0 2024-09-20T19:06:11.241 INFO:tasks.workunit.client.0.smithi027.stdout:7/851: write d3/d8/d26/d45/d56/dec/dc/f87 [662422,74915] 0 2024-09-20T19:06:11.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/726: dwrite d1/d3/df/f21 [0,4194304] 0 2024-09-20T19:06:11.244 INFO:tasks.workunit.client.0.smithi027.stdout:0/945: dread d2/d48/d6b/d79/fd4 [0,4194304] 0 2024-09-20T19:06:11.244 INFO:tasks.workunit.client.0.smithi027.stdout:3/941: rename d0/d1/l18 to d0/d12d/d3c/d93/d11b/l13f 0 2024-09-20T19:06:11.245 INFO:tasks.workunit.client.1.smithi098.stdout:3/767: dwrite d4/d19/d1d/d2f/f53 [4194304,4194304] 0 2024-09-20T19:06:11.245 INFO:tasks.workunit.client.0.smithi027.stdout:0/946: read d2/d48/d6b/d79/d84/d1b/dc5/d2e/fe5 [2097762,111842] 0 2024-09-20T19:06:11.247 INFO:tasks.workunit.client.0.smithi027.stdout:8/929: write d2/d3/d6/fa0 [3163379,59820] 0 2024-09-20T19:06:11.249 INFO:tasks.workunit.client.0.smithi027.stdout:5/960: fdatasync d4/da/de/d3e/d44/fae 0 2024-09-20T19:06:11.251 INFO:tasks.workunit.client.0.smithi027.stdout:5/961: read d4/da/d1a/f108 [578502,93327] 0 2024-09-20T19:06:11.252 INFO:tasks.workunit.client.1.smithi098.stdout:6/565: getdents d0/d55/d82/da3/d44/d24/d29/d2b 0 2024-09-20T19:06:11.253 INFO:tasks.workunit.client.0.smithi027.stdout:7/852: unlink d3/d8/d26/d45/d56/dec/d2e/d49/d8b/fc3 0 2024-09-20T19:06:11.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/566: readlink d0/de/d1b/l91 0 2024-09-20T19:06:11.261 INFO:tasks.workunit.client.0.smithi027.stdout:4/865: write d5/d11/d17/d1b/d8d/d26/f47 [2934332,105706] 0 2024-09-20T19:06:11.261 INFO:tasks.workunit.client.1.smithi098.stdout:5/639: dwrite d1/d17/d35/f6a [0,4194304] 0 2024-09-20T19:06:11.267 INFO:tasks.workunit.client.0.smithi027.stdout:1/903: creat d2/d61/df8/dde/d124/f127 x:0 0 0 2024-09-20T19:06:11.268 INFO:tasks.workunit.client.0.smithi027.stdout:1/904: stat d2/d61/df8/d56/c120 0 2024-09-20T19:06:11.269 INFO:tasks.workunit.client.1.smithi098.stdout:7/892: write d3/d76/d7a/dce/f118 [3937953,69050] 0 2024-09-20T19:06:11.271 INFO:tasks.workunit.client.1.smithi098.stdout:6/567: dwrite d0/de/f56 [0,4194304] 0 2024-09-20T19:06:11.273 INFO:tasks.workunit.client.0.smithi027.stdout:6/938: dwrite d4/d15/d37/d6a/dbf/f11c [0,4194304] 0 2024-09-20T19:06:11.273 INFO:tasks.workunit.client.1.smithi098.stdout:4/893: dread d3/d6/d8c/de7/df4/d57/d7f/d84/fbe [0,4194304] 0 2024-09-20T19:06:11.281 INFO:tasks.workunit.client.0.smithi027.stdout:7/853: dread d3/d8/d26/d45/d56/dec/dc/fe8 [0,4194304] 0 2024-09-20T19:06:11.288 INFO:tasks.workunit.client.0.smithi027.stdout:7/854: dwrite d3/d8/f115 [0,4194304] 0 2024-09-20T19:06:11.291 INFO:tasks.workunit.client.0.smithi027.stdout:1/905: mknod d2/d61/df8/d56/d71/c128 0 2024-09-20T19:06:11.295 INFO:tasks.workunit.client.0.smithi027.stdout:0/947: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/f46 [2161863,31308] 0 2024-09-20T19:06:11.297 INFO:tasks.workunit.client.0.smithi027.stdout:0/948: chown d2/d48/d6b/d79/d84/d1b/d39 124910104 1 2024-09-20T19:06:11.300 INFO:tasks.workunit.client.0.smithi027.stdout:5/962: link d4/da/de/d3e/db7/dc2/d105/f123 d4/da/d1a/f141 0 2024-09-20T19:06:11.304 INFO:tasks.workunit.client.0.smithi027.stdout:1/906: stat d2/d8/d2b/d2d/d73/lb8 0 2024-09-20T19:06:11.305 INFO:tasks.workunit.client.0.smithi027.stdout:8/930: dread d2/d3/d6/d21/d80/fdc [0,4194304] 0 2024-09-20T19:06:11.306 INFO:tasks.workunit.client.0.smithi027.stdout:1/907: stat d2/d8/d3b/d82/d90/d108/ffa 0 2024-09-20T19:06:11.306 INFO:tasks.workunit.client.0.smithi027.stdout:8/931: stat d2/d2a/df8/d36/d115/l128 0 2024-09-20T19:06:11.307 INFO:tasks.workunit.client.0.smithi027.stdout:1/908: write d2/d61/df8/dde/d124/f127 [320928,63562] 0 2024-09-20T19:06:11.309 INFO:tasks.workunit.client.0.smithi027.stdout:8/932: write d2/d3/d6/d21/d33/fa1 [103621,38336] 0 2024-09-20T19:06:11.309 INFO:tasks.workunit.client.0.smithi027.stdout:5/963: write d4/da/de/d3e/db7/dc2/d87/f9a [7885017,67254] 0 2024-09-20T19:06:11.311 INFO:tasks.workunit.client.0.smithi027.stdout:1/909: readlink d2/d8/d3b/d82/d90/d108/da3/dad/l10f 0 2024-09-20T19:06:11.315 INFO:tasks.workunit.client.0.smithi027.stdout:9/974: sync 2024-09-20T19:06:11.315 INFO:tasks.workunit.client.0.smithi027.stdout:2/912: sync 2024-09-20T19:06:11.315 INFO:tasks.workunit.client.1.smithi098.stdout:3/768: truncate d4/da/d7a/fd9 476831 0 2024-09-20T19:06:11.315 INFO:tasks.workunit.client.0.smithi027.stdout:4/866: getdents d5/d80 0 2024-09-20T19:06:11.316 INFO:tasks.workunit.client.0.smithi027.stdout:6/939: write d4/d15/d2c/f49 [3159812,93407] 0 2024-09-20T19:06:11.316 INFO:tasks.workunit.client.1.smithi098.stdout:3/769: fdatasync d4/d19/d1d/d2f/f53 0 2024-09-20T19:06:11.316 INFO:tasks.workunit.client.1.smithi098.stdout:1/727: rmdir d1/d3/df/d34/d43/d65 39 2024-09-20T19:06:11.317 INFO:tasks.workunit.client.0.smithi027.stdout:6/940: readlink d4/d15/d37/d7a/le8 0 2024-09-20T19:06:11.318 INFO:tasks.workunit.client.0.smithi027.stdout:8/933: creat d2/d3/d11d/df2/f13e x:0 0 0 2024-09-20T19:06:11.318 INFO:tasks.workunit.client.1.smithi098.stdout:1/728: read d1/d3/f1e [1690590,52355] 0 2024-09-20T19:06:11.319 INFO:tasks.workunit.client.0.smithi027.stdout:0/949: dread d2/d48/d6b/d79/fac [0,4194304] 0 2024-09-20T19:06:11.320 INFO:tasks.workunit.client.1.smithi098.stdout:1/729: write d1/d3/d2e/fca [1541051,35426] 0 2024-09-20T19:06:11.320 INFO:tasks.workunit.client.0.smithi027.stdout:7/855: creat d3/d8/d26/d45/d56/f120 x:0 0 0 2024-09-20T19:06:11.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/640: chown d1/d17/d25/l52 1763554 1 2024-09-20T19:06:11.324 INFO:tasks.workunit.client.0.smithi027.stdout:9/975: dwrite d0/d9/df/d1b/fcb [0,4194304] 0 2024-09-20T19:06:11.325 INFO:tasks.workunit.client.0.smithi027.stdout:1/910: unlink d2/d8/d3b/d4b/c122 0 2024-09-20T19:06:11.328 INFO:tasks.workunit.client.0.smithi027.stdout:7/856: dread d3/d8/d26/d45/f95 [0,4194304] 0 2024-09-20T19:06:11.329 INFO:tasks.workunit.client.1.smithi098.stdout:6/568: mknod d0/d55/d82/da3/d8c/d4c/cae 0 2024-09-20T19:06:11.330 INFO:tasks.workunit.client.1.smithi098.stdout:9/842: sync 2024-09-20T19:06:11.330 INFO:tasks.workunit.client.1.smithi098.stdout:0/595: sync 2024-09-20T19:06:11.331 INFO:tasks.workunit.client.1.smithi098.stdout:4/894: stat d3/d6/d8c/de7/d124/fd1 0 2024-09-20T19:06:11.332 INFO:tasks.workunit.client.0.smithi027.stdout:9/976: dwrite d0/d9/df/d1b/d64/fe0 [4194304,4194304] 0 2024-09-20T19:06:11.333 INFO:tasks.workunit.client.0.smithi027.stdout:9/977: chown d0/d9/df/d1b/c18 1103042025 1 2024-09-20T19:06:11.333 INFO:tasks.workunit.client.0.smithi027.stdout:4/867: creat d5/d11/d3d/db4/f112 x:0 0 0 2024-09-20T19:06:11.334 INFO:tasks.workunit.client.1.smithi098.stdout:9/843: truncate d4/de/d27/d4a/d58/d5b/d9c/f111 732637 0 2024-09-20T19:06:11.335 INFO:tasks.workunit.client.1.smithi098.stdout:9/844: read - d4/de/d27/d88/fea zero size 2024-09-20T19:06:11.336 INFO:tasks.workunit.client.0.smithi027.stdout:2/913: creat d3/d13/d3c/d48/dba/de4/f12f x:0 0 0 2024-09-20T19:06:11.338 INFO:tasks.workunit.client.1.smithi098.stdout:9/845: dread - d4/de/d24/d35/d6d/ff9 zero size 2024-09-20T19:06:11.340 INFO:tasks.workunit.client.1.smithi098.stdout:9/846: chown d4/de/d27/dc9 2018628 1 2024-09-20T19:06:11.341 INFO:tasks.workunit.client.1.smithi098.stdout:3/770: rename d4/d38/d39/dba to d4/d25/d40/d80/d94/df4 0 2024-09-20T19:06:11.342 INFO:tasks.workunit.client.1.smithi098.stdout:4/895: dwrite d3/d6/d8c/de7/df4/d1e/d2a/d45/f125 [0,4194304] 0 2024-09-20T19:06:11.342 INFO:tasks.workunit.client.1.smithi098.stdout:9/847: read d4/f16 [368061,26294] 0 2024-09-20T19:06:11.343 INFO:tasks.workunit.client.1.smithi098.stdout:3/771: chown d4/d19/d1d/d2f/faf 5181411 1 2024-09-20T19:06:11.345 INFO:tasks.workunit.client.1.smithi098.stdout:4/896: chown d3/d5e/d9f/fc5 55975644 1 2024-09-20T19:06:11.345 INFO:tasks.workunit.client.1.smithi098.stdout:3/772: write d4/da/d7a/ff2 [417226,92119] 0 2024-09-20T19:06:11.346 INFO:tasks.workunit.client.0.smithi027.stdout:8/934: dwrite d2/d3/d11d/fd3 [0,4194304] 0 2024-09-20T19:06:11.352 INFO:tasks.workunit.client.0.smithi027.stdout:5/964: write d4/da/f29 [1266992,54402] 0 2024-09-20T19:06:11.353 INFO:tasks.workunit.client.0.smithi027.stdout:5/965: fsync d4/da/de/d3e/d10b/fea 0 2024-09-20T19:06:11.354 INFO:tasks.workunit.client.1.smithi098.stdout:0/596: write d0/d6/f16 [87983,121517] 0 2024-09-20T19:06:11.355 INFO:tasks.workunit.client.1.smithi098.stdout:7/893: write d3/d10/d16/d17/d33/d37/f98 [9126171,58171] 0 2024-09-20T19:06:11.355 INFO:tasks.workunit.client.0.smithi027.stdout:3/942: link d0/d1/d5e/d1d/l127 d0/d1/d65/dbb/d129/l140 0 2024-09-20T19:06:11.356 INFO:tasks.workunit.client.0.smithi027.stdout:3/943: chown d0/d12d/d3c/c40 709390 1 2024-09-20T19:06:11.363 INFO:tasks.workunit.client.1.smithi098.stdout:1/730: creat d1/d3/df/d34/d43/daa/dd1/fea x:0 0 0 2024-09-20T19:06:11.363 INFO:tasks.workunit.client.1.smithi098.stdout:7/894: dread d3/d76/db8/fa9 [0,4194304] 0 2024-09-20T19:06:11.367 INFO:tasks.workunit.client.0.smithi027.stdout:2/914: symlink d3/d13/d3c/de7/l130 0 2024-09-20T19:06:11.368 INFO:tasks.workunit.client.1.smithi098.stdout:5/641: write d1/d71/f9d [573368,55778] 0 2024-09-20T19:06:11.369 INFO:tasks.workunit.client.0.smithi027.stdout:1/911: write d2/d8/d74/f79 [443950,81201] 0 2024-09-20T19:06:11.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/897: creat d3/d6/de3/def/f12d x:0 0 0 2024-09-20T19:06:11.371 INFO:tasks.workunit.client.0.smithi027.stdout:0/950: mknod d2/da2/d137/c14c 0 2024-09-20T19:06:11.373 INFO:tasks.workunit.client.1.smithi098.stdout:9/848: write d4/de/d27/d4a/d58/d5b/fa4 [2930745,115751] 0 2024-09-20T19:06:11.373 INFO:tasks.workunit.client.0.smithi027.stdout:1/912: dread d2/d61/df8/dde/d124/f127 [0,4194304] 0 2024-09-20T19:06:11.374 INFO:tasks.workunit.client.0.smithi027.stdout:5/966: creat d4/da/de/d3e/db7/dc2/d87/f142 x:0 0 0 2024-09-20T19:06:11.376 INFO:tasks.workunit.client.0.smithi027.stdout:3/944: fsync d0/d19/d54/d7a/f9e 0 2024-09-20T19:06:11.378 INFO:tasks.workunit.client.0.smithi027.stdout:1/913: truncate d2/d8/d3b/f110 754295 0 2024-09-20T19:06:11.379 INFO:tasks.workunit.client.0.smithi027.stdout:9/978: dwrite d0/ff6 [0,4194304] 0 2024-09-20T19:06:11.380 INFO:tasks.workunit.client.0.smithi027.stdout:3/945: chown d0/d12d/d3c/c40 15877 1 2024-09-20T19:06:11.380 INFO:tasks.workunit.client.0.smithi027.stdout:4/868: dwrite d5/d11/d17/d1b/d8d/f7a [0,4194304] 0 2024-09-20T19:06:11.381 INFO:tasks.workunit.client.1.smithi098.stdout:5/642: rmdir d1/d17/d35/d54 39 2024-09-20T19:06:11.381 INFO:tasks.workunit.client.1.smithi098.stdout:5/643: stat d1/d1b 0 2024-09-20T19:06:11.382 INFO:tasks.workunit.client.0.smithi027.stdout:4/869: chown d5/d13/d36/d48/d3f/d4c 3 1 2024-09-20T19:06:11.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/597: write d0/db/d1d/d8f/f6c [1720799,118539] 0 2024-09-20T19:06:11.383 INFO:tasks.workunit.client.1.smithi098.stdout:1/731: write d1/f84 [935217,30921] 0 2024-09-20T19:06:11.386 INFO:tasks.workunit.client.1.smithi098.stdout:6/569: creat d0/d55/d82/da3/d44/d24/faf x:0 0 0 2024-09-20T19:06:11.388 INFO:tasks.workunit.client.1.smithi098.stdout:9/849: creat d4/de/d27/d4a/d58/d5b/d8f/dd5/f11a x:0 0 0 2024-09-20T19:06:11.390 INFO:tasks.workunit.client.0.smithi027.stdout:4/870: dwrite d5/d11/d3d/db4/fd2 [4194304,4194304] 0 2024-09-20T19:06:11.395 INFO:tasks.workunit.client.0.smithi027.stdout:5/967: fsync d4/d1f/fe9 0 2024-09-20T19:06:11.395 INFO:tasks.workunit.client.0.smithi027.stdout:7/857: link d3/d8/d26/d45/d56/dec/d2e/d39/d102/db2/fc9 d3/d8/d26/d45/d56/dec/d2e/d39/d116/f121 0 2024-09-20T19:06:11.396 INFO:tasks.workunit.client.0.smithi027.stdout:2/915: mkdir d3/d1c/d131 0 2024-09-20T19:06:11.397 INFO:tasks.workunit.client.0.smithi027.stdout:7/858: chown d3/d24/d84 0 1 2024-09-20T19:06:11.398 INFO:tasks.workunit.client.0.smithi027.stdout:4/871: dwrite d5/d11/f68 [0,4194304] 0 2024-09-20T19:06:11.399 INFO:tasks.workunit.client.1.smithi098.stdout:6/570: dwrite d0/d55/d82/da3/d43/d6d/f75 [0,4194304] 0 2024-09-20T19:06:11.399 INFO:tasks.workunit.client.0.smithi027.stdout:3/946: rmdir d0/d38 39 2024-09-20T19:06:11.401 INFO:tasks.workunit.client.0.smithi027.stdout:3/947: chown d0/d19/d54/d7a/f9e 1309 1 2024-09-20T19:06:11.402 INFO:tasks.workunit.client.0.smithi027.stdout:9/979: mknod d0/d9/df/d1b/d9c/d4f/d8d/da0/c149 0 2024-09-20T19:06:11.404 INFO:tasks.workunit.client.0.smithi027.stdout:6/941: getdents d4/d15/d37/d5a/d78/dbc 0 2024-09-20T19:06:11.407 INFO:tasks.workunit.client.1.smithi098.stdout:3/773: getdents d4/d19/d7b 0 2024-09-20T19:06:11.412 INFO:tasks.workunit.client.0.smithi027.stdout:7/859: dwrite d3/d8/d26/d65/dc4/d106/f10f [0,4194304] 0 2024-09-20T19:06:11.413 INFO:tasks.workunit.client.0.smithi027.stdout:0/951: dwrite d2/d20/fca [0,4194304] 0 2024-09-20T19:06:11.413 INFO:tasks.workunit.client.1.smithi098.stdout:9/850: getdents d4/de/d27/d6c/d73/d106 0 2024-09-20T19:06:11.414 INFO:tasks.workunit.client.1.smithi098.stdout:9/851: chown d4/de/d24/d35/d2d/da6/dae/d86/c80 5918906 1 2024-09-20T19:06:11.415 INFO:tasks.workunit.client.0.smithi027.stdout:3/948: dread d0/d12d/d15/d6f/f83 [0,4194304] 0 2024-09-20T19:06:11.415 INFO:tasks.workunit.client.1.smithi098.stdout:9/852: chown d4/de/d24/d35/cd6 5455514 1 2024-09-20T19:06:11.416 INFO:tasks.workunit.client.1.smithi098.stdout:7/895: getdents d3/d76/d7a/dce 0 2024-09-20T19:06:11.419 INFO:tasks.workunit.client.0.smithi027.stdout:4/872: unlink d5/d13/cbc 0 2024-09-20T19:06:11.419 INFO:tasks.workunit.client.0.smithi027.stdout:3/949: dread - d0/d1/d5e/d1d/da7/db0/dc7/f109 zero size 2024-09-20T19:06:11.421 INFO:tasks.workunit.client.1.smithi098.stdout:4/898: getdents d3/dfb 0 2024-09-20T19:06:11.423 INFO:tasks.workunit.client.1.smithi098.stdout:1/732: creat d1/d3/d2e/feb x:0 0 0 2024-09-20T19:06:11.425 INFO:tasks.workunit.client.1.smithi098.stdout:1/733: write d1/f55 [1835894,103433] 0 2024-09-20T19:06:11.426 INFO:tasks.workunit.client.1.smithi098.stdout:7/896: mknod d3/daa/dd4/c11f 0 2024-09-20T19:06:11.428 INFO:tasks.workunit.client.0.smithi027.stdout:1/914: creat d2/d8/d3b/f129 x:0 0 0 2024-09-20T19:06:11.429 INFO:tasks.workunit.client.0.smithi027.stdout:9/980: chown d0/d9/df/d1b/d9c/fc2 31 1 2024-09-20T19:06:11.429 INFO:tasks.workunit.client.0.smithi027.stdout:3/950: dread - d0/d1/d65/f124 zero size 2024-09-20T19:06:11.429 INFO:tasks.workunit.client.0.smithi027.stdout:2/916: mkdir d3/d1c/d26/df2/d132 0 2024-09-20T19:06:11.429 INFO:tasks.workunit.client.1.smithi098.stdout:7/897: write d3/d76/f102 [476361,1195] 0 2024-09-20T19:06:11.432 INFO:tasks.workunit.client.1.smithi098.stdout:4/899: symlink d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/dcc/l12e 0 2024-09-20T19:06:11.433 INFO:tasks.workunit.client.0.smithi027.stdout:0/952: dwrite d2/d12c/f139 [0,4194304] 0 2024-09-20T19:06:11.434 INFO:tasks.workunit.client.0.smithi027.stdout:4/873: dread d5/d11/d17/d1b/d8d/f7a [0,4194304] 0 2024-09-20T19:06:11.436 INFO:tasks.workunit.client.1.smithi098.stdout:7/898: dread d3/d10/d16/f79 [4194304,4194304] 0 2024-09-20T19:06:11.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/734: rmdir d1/d3/df/d34/d43/dad 39 2024-09-20T19:06:11.442 INFO:tasks.workunit.client.1.smithi098.stdout:4/900: dwrite d3/d6/d8c/de7/d124/d6b/d73/f117 [0,4194304] 0 2024-09-20T19:06:11.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/571: getdents d0/de/d1b 0 2024-09-20T19:06:11.448 INFO:tasks.workunit.client.1.smithi098.stdout:5/644: dread d1/d17/d35/d54/dab/db7/fb8 [0,4194304] 0 2024-09-20T19:06:11.451 INFO:tasks.workunit.client.1.smithi098.stdout:3/774: write d4/d38/d39/f5a [1035403,8728] 0 2024-09-20T19:06:11.454 INFO:tasks.workunit.client.1.smithi098.stdout:3/775: write d4/d19/d1d/d2f/fc8 [173568,46063] 0 2024-09-20T19:06:11.455 INFO:tasks.workunit.client.1.smithi098.stdout:3/776: dread d4/d19/d1d/fc2 [0,4194304] 0 2024-09-20T19:06:11.457 INFO:tasks.workunit.client.1.smithi098.stdout:4/901: read d3/d6/faf [820821,44382] 0 2024-09-20T19:06:11.459 INFO:tasks.workunit.client.1.smithi098.stdout:9/853: write d4/de/d27/dbf/fc3 [437487,52793] 0 2024-09-20T19:06:11.461 INFO:tasks.workunit.client.1.smithi098.stdout:6/572: truncate d0/d55/d82/da3/d43/f5e 4697978 0 2024-09-20T19:06:11.461 INFO:tasks.workunit.client.1.smithi098.stdout:9/854: write d4/de/d27/d4a/d58/d5b/fa4 [2579410,39752] 0 2024-09-20T19:06:11.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/855: chown d4/f47 534788356 1 2024-09-20T19:06:11.463 INFO:tasks.workunit.client.1.smithi098.stdout:7/899: mknod d3/d76/db8/da6/d115/c120 0 2024-09-20T19:06:11.464 INFO:tasks.workunit.client.1.smithi098.stdout:9/856: stat d4/de/d24/d35/d2d/da6 0 2024-09-20T19:06:11.469 INFO:tasks.workunit.client.1.smithi098.stdout:6/573: dwrite d0/de/f18 [0,4194304] 0 2024-09-20T19:06:11.474 INFO:tasks.workunit.client.1.smithi098.stdout:7/900: creat d3/d76/d7a/dce/f121 x:0 0 0 2024-09-20T19:06:11.476 INFO:tasks.workunit.client.1.smithi098.stdout:7/901: chown d3/d10/d16/d17/d33/d1f/d2d/f77 1 1 2024-09-20T19:06:11.478 INFO:tasks.workunit.client.1.smithi098.stdout:7/902: truncate d3/d10/d16/d17/d33/f52 4272364 0 2024-09-20T19:06:11.479 INFO:tasks.workunit.client.1.smithi098.stdout:7/903: write d3/f12 [2954296,84025] 0 2024-09-20T19:06:11.481 INFO:tasks.workunit.client.0.smithi027.stdout:0/953: dwrite d2/d20/f12d [0,4194304] 0 2024-09-20T19:06:11.483 INFO:tasks.workunit.client.1.smithi098.stdout:1/735: rename d1/d3/c6a to d1/cec 0 2024-09-20T19:06:11.484 INFO:tasks.workunit.client.1.smithi098.stdout:6/574: symlink d0/d55/d82/da3/d8c/lb0 0 2024-09-20T19:06:11.485 INFO:tasks.workunit.client.0.smithi027.stdout:5/968: dread d4/da/f29 [0,4194304] 0 2024-09-20T19:06:11.486 INFO:tasks.workunit.client.0.smithi027.stdout:5/969: fdatasync d4/da/de/d3e/f10f 0 2024-09-20T19:06:11.487 INFO:tasks.workunit.client.0.smithi027.stdout:5/970: chown d4/da/de/feb 72 1 2024-09-20T19:06:11.488 INFO:tasks.workunit.client.0.smithi027.stdout:5/971: truncate d4/d1f/d91/d9b/d109/f139 701983 0 2024-09-20T19:06:11.489 INFO:tasks.workunit.client.1.smithi098.stdout:9/857: symlink d4/de/d27/d4a/d58/d5b/d112/l11b 0 2024-09-20T19:06:11.492 INFO:tasks.workunit.client.1.smithi098.stdout:9/858: readlink d4/de/d24/d35/d2d/da6/dae/d86/le6 0 2024-09-20T19:06:11.492 INFO:tasks.workunit.client.1.smithi098.stdout:6/575: dwrite d0/de/f56 [0,4194304] 0 2024-09-20T19:06:11.494 INFO:tasks.workunit.client.1.smithi098.stdout:6/576: chown d0/de/f6b 248164705 1 2024-09-20T19:06:11.494 INFO:tasks.workunit.client.1.smithi098.stdout:7/904: mknod d3/d76/db8/da6/dec/c122 0 2024-09-20T19:06:11.502 INFO:tasks.workunit.client.1.smithi098.stdout:3/777: getdents d4/d25 0 2024-09-20T19:06:11.503 INFO:tasks.workunit.client.1.smithi098.stdout:3/778: write d4/d19/fb9 [3878400,73890] 0 2024-09-20T19:06:11.505 INFO:tasks.workunit.client.1.smithi098.stdout:9/859: unlink d4/de/d24/d35/d2d/da6/dae/d86/f100 0 2024-09-20T19:06:11.506 INFO:tasks.workunit.client.1.smithi098.stdout:6/577: rmdir d0 39 2024-09-20T19:06:11.509 INFO:tasks.workunit.client.1.smithi098.stdout:7/905: symlink d3/d76/db8/l123 0 2024-09-20T19:06:11.511 INFO:tasks.workunit.client.1.smithi098.stdout:5/645: rename d1/d17/d25/f48 to d1/d17/d35/d54/d68/fc4 0 2024-09-20T19:06:11.512 INFO:tasks.workunit.client.0.smithi027.stdout:7/860: mkdir d3/d8/d26/d45/d56/dec/d2e/d122 0 2024-09-20T19:06:11.513 INFO:tasks.workunit.client.1.smithi098.stdout:1/736: creat d1/d3/df/d34/d43/d65/fed x:0 0 0 2024-09-20T19:06:11.514 INFO:tasks.workunit.client.0.smithi027.stdout:7/861: truncate d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f3a 5173869 0 2024-09-20T19:06:11.514 INFO:tasks.workunit.client.0.smithi027.stdout:9/981: dread - d0/d9/df/d1b/ff0 zero size 2024-09-20T19:06:11.517 INFO:tasks.workunit.client.0.smithi027.stdout:4/874: mknod d5/d13/d36/d48/d9f/dc9/d8f/dc5/c113 0 2024-09-20T19:06:11.518 INFO:tasks.workunit.client.1.smithi098.stdout:3/779: write d4/d25/d8d/fab [3730976,72782] 0 2024-09-20T19:06:11.520 INFO:tasks.workunit.client.1.smithi098.stdout:3/780: write d4/d25/d8d/fab [1073474,124513] 0 2024-09-20T19:06:11.521 INFO:tasks.workunit.client.1.smithi098.stdout:4/902: truncate d3/d6/d8c/fda 28847 0 2024-09-20T19:06:11.522 INFO:tasks.workunit.client.0.smithi027.stdout:0/954: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f14d x:0 0 0 2024-09-20T19:06:11.525 INFO:tasks.workunit.client.0.smithi027.stdout:4/875: dwrite d5/d11/d1a/d2a/da3/fde [0,4194304] 0 2024-09-20T19:06:11.527 INFO:tasks.workunit.client.0.smithi027.stdout:4/876: write d5/d13/d36/d48/d3f/fe9 [805014,8297] 0 2024-09-20T19:06:11.527 INFO:tasks.workunit.client.0.smithi027.stdout:1/915: mkdir d2/d8/d74/d12a 0 2024-09-20T19:06:11.528 INFO:tasks.workunit.client.1.smithi098.stdout:1/737: creat d1/d3/df/d34/d43/d65/dbc/fee x:0 0 0 2024-09-20T19:06:11.529 INFO:tasks.workunit.client.0.smithi027.stdout:4/877: chown d5/d13/d36/d48/d9f/dc9/d8f/dc5/ff6 61064 1 2024-09-20T19:06:11.529 INFO:tasks.workunit.client.0.smithi027.stdout:9/982: rmdir d0/d9/df/da2/de9 39 2024-09-20T19:06:11.535 INFO:tasks.workunit.client.1.smithi098.stdout:3/781: dread d4/d19/d1d/d2f/d4e/f93 [0,4194304] 0 2024-09-20T19:06:11.535 INFO:tasks.workunit.client.1.smithi098.stdout:4/903: creat d3/d6/de3/f12f x:0 0 0 2024-09-20T19:06:11.537 INFO:tasks.workunit.client.0.smithi027.stdout:3/951: truncate d0/d19/d54/d7a/f9e 2475433 0 2024-09-20T19:06:11.537 INFO:tasks.workunit.client.1.smithi098.stdout:4/904: read - d3/d6/d8c/de7/df4/d109/f129 zero size 2024-09-20T19:06:11.537 INFO:tasks.workunit.client.0.smithi027.stdout:5/972: dread d4/da/fc [0,4194304] 0 2024-09-20T19:06:11.538 INFO:tasks.workunit.client.0.smithi027.stdout:5/973: fsync d4/da/de/d3e/d69/d75/fad 0 2024-09-20T19:06:11.541 INFO:tasks.workunit.client.0.smithi027.stdout:5/974: read d4/d6c/d6f/d92/dc8/fd7 [702315,43709] 0 2024-09-20T19:06:11.541 INFO:tasks.workunit.client.1.smithi098.stdout:4/905: write d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f10d [1638692,50613] 0 2024-09-20T19:06:11.541 INFO:tasks.workunit.client.0.smithi027.stdout:5/975: chown d4/da/d1a/df8/f11d 101 1 2024-09-20T19:06:11.543 INFO:tasks.workunit.client.1.smithi098.stdout:7/906: link d3/d4c/ff2 d3/d76/db8/f124 0 2024-09-20T19:06:11.544 INFO:tasks.workunit.client.0.smithi027.stdout:6/942: getdents d4/d15/d37/d7a/d46 0 2024-09-20T19:06:11.547 INFO:tasks.workunit.client.1.smithi098.stdout:4/906: dwrite d3/d6/d8c/de7/d124/fa6 [4194304,4194304] 0 2024-09-20T19:06:11.550 INFO:tasks.workunit.client.1.smithi098.stdout:3/782: fsync d4/fd 0 2024-09-20T19:06:11.553 INFO:tasks.workunit.client.0.smithi027.stdout:5/976: dread d4/da/de/d3e/fc5 [0,4194304] 0 2024-09-20T19:06:11.554 INFO:tasks.workunit.client.0.smithi027.stdout:8/935: sync 2024-09-20T19:06:11.555 INFO:tasks.workunit.client.1.smithi098.stdout:9/860: write d4/de/d48/f7c [1551707,37894] 0 2024-09-20T19:06:11.555 INFO:tasks.workunit.client.0.smithi027.stdout:8/936: dread - d2/d3/d6/d9e/d137/d6c/f12c zero size 2024-09-20T19:06:11.557 INFO:tasks.workunit.client.0.smithi027.stdout:8/937: write d2/d3/d6/d21/d33/d79/d9f/f121 [2159809,86141] 0 2024-09-20T19:06:11.561 INFO:tasks.workunit.client.0.smithi027.stdout:8/938: read d2/d2a/df8/d36/f61 [761970,40865] 0 2024-09-20T19:06:11.562 INFO:tasks.workunit.client.0.smithi027.stdout:3/952: truncate d0/d12d/d15/d55/fce 2074659 0 2024-09-20T19:06:11.562 INFO:tasks.workunit.client.0.smithi027.stdout:8/939: fsync d2/d3/d6/d6d/fcc 0 2024-09-20T19:06:11.563 INFO:tasks.workunit.client.1.smithi098.stdout:6/578: mknod d0/d55/d82/da3/d43/d51/cb1 0 2024-09-20T19:06:11.567 INFO:tasks.workunit.client.1.smithi098.stdout:5/646: dwrite d1/d17/d5e/f81 [4194304,4194304] 0 2024-09-20T19:06:11.569 INFO:tasks.workunit.client.0.smithi027.stdout:7/862: dwrite d3/d8/d26/d45/d56/dec/dc/f63 [0,4194304] 0 2024-09-20T19:06:11.570 INFO:tasks.workunit.client.1.smithi098.stdout:4/907: dread d3/d6/d8c/de7/d124/f108 [0,4194304] 0 2024-09-20T19:06:11.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/783: rmdir d4/d38/d39 39 2024-09-20T19:06:11.580 INFO:tasks.workunit.client.0.smithi027.stdout:6/943: unlink d4/lf6 0 2024-09-20T19:06:11.581 INFO:tasks.workunit.client.0.smithi027.stdout:6/944: read - d4/d15/d37/d6a/dbf/f10e zero size 2024-09-20T19:06:11.584 INFO:tasks.workunit.client.0.smithi027.stdout:9/983: mknod d0/d9/df/d1b/d9c/c14a 0 2024-09-20T19:06:11.585 INFO:tasks.workunit.client.1.smithi098.stdout:6/579: creat d0/d55/d82/da3/d44/d24/d29/d2b/fb2 x:0 0 0 2024-09-20T19:06:11.588 INFO:tasks.workunit.client.0.smithi027.stdout:2/917: sync 2024-09-20T19:06:11.589 INFO:tasks.workunit.client.1.smithi098.stdout:1/738: link d1/d3/df/d4a/d6d/fd2 d1/fef 0 2024-09-20T19:06:11.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/908: dread d3/d6/d8c/de7/df4/d1e/f7b [0,4194304] 0 2024-09-20T19:06:11.594 INFO:tasks.workunit.client.1.smithi098.stdout:4/909: stat d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/db2 0 2024-09-20T19:06:11.596 INFO:tasks.workunit.client.1.smithi098.stdout:9/861: write d4/de/d24/d35/f43 [561587,2117] 0 2024-09-20T19:06:11.596 INFO:tasks.workunit.client.1.smithi098.stdout:4/910: write d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/f75 [707742,89689] 0 2024-09-20T19:06:11.598 INFO:tasks.workunit.client.0.smithi027.stdout:3/953: mknod d0/d1/d65/d100/d126/c141 0 2024-09-20T19:06:11.600 INFO:tasks.workunit.client.1.smithi098.stdout:6/580: rename d0/c3 to d0/cb3 0 2024-09-20T19:06:11.602 INFO:tasks.workunit.client.1.smithi098.stdout:6/581: chown d0/d55/d82/da3/d44/d24/d29/d2b/d66/c93 456910604 1 2024-09-20T19:06:11.603 INFO:tasks.workunit.client.0.smithi027.stdout:4/878: dwrite d5/d13/d36/f7b [0,4194304] 0 2024-09-20T19:06:11.603 INFO:tasks.workunit.client.1.smithi098.stdout:1/739: creat d1/d3/d2e/d61/ff0 x:0 0 0 2024-09-20T19:06:11.604 INFO:tasks.workunit.client.0.smithi027.stdout:1/916: truncate d2/d8/d3b/d82/d90/d108/fb3 73200 0 2024-09-20T19:06:11.605 INFO:tasks.workunit.client.1.smithi098.stdout:1/740: stat d1/d3/df 0 2024-09-20T19:06:11.605 INFO:tasks.workunit.client.1.smithi098.stdout:5/647: mknod d1/d17/cc5 0 2024-09-20T19:06:11.605 INFO:tasks.workunit.client.0.smithi027.stdout:4/879: fsync d5/d13/f30 0 2024-09-20T19:06:11.605 INFO:tasks.workunit.client.0.smithi027.stdout:3/954: dwrite d0/f12 [0,4194304] 0 2024-09-20T19:06:11.606 INFO:tasks.workunit.client.0.smithi027.stdout:3/955: chown d0/d19/d54/fcd 941 1 2024-09-20T19:06:11.608 INFO:tasks.workunit.client.0.smithi027.stdout:7/863: truncate d3/d8/d26/d45/d56/dec/dc/da9/fb7 358618 0 2024-09-20T19:06:11.609 INFO:tasks.workunit.client.0.smithi027.stdout:7/864: chown d3/d8/d26/f71 1485186148 1 2024-09-20T19:06:11.609 INFO:tasks.workunit.client.0.smithi027.stdout:0/955: rmdir d2/d48/d6b/d79/d84/d11e 0 2024-09-20T19:06:11.610 INFO:tasks.workunit.client.1.smithi098.stdout:7/907: link d3/d10/d16/d17/d33/c35 d3/d10/d16/dc1/d111/c125 0 2024-09-20T19:06:11.612 INFO:tasks.workunit.client.0.smithi027.stdout:6/945: symlink d4/d15/d2c/dcb/l13d 0 2024-09-20T19:06:11.614 INFO:tasks.workunit.client.1.smithi098.stdout:8/845: sync 2024-09-20T19:06:11.615 INFO:tasks.workunit.client.1.smithi098.stdout:4/911: mkdir d3/d6/d8c/de7/df4/d1e/d2a/d45/d91/d130 0 2024-09-20T19:06:11.616 INFO:tasks.workunit.client.0.smithi027.stdout:9/984: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/f14b x:0 0 0 2024-09-20T19:06:11.618 INFO:tasks.workunit.client.1.smithi098.stdout:5/648: symlink d1/d1b/d40/lc6 0 2024-09-20T19:06:11.618 INFO:tasks.workunit.client.1.smithi098.stdout:9/862: dread d4/de/d27/d4a/d21/d25/d51/f55 [4194304,4194304] 0 2024-09-20T19:06:11.625 INFO:tasks.workunit.client.1.smithi098.stdout:8/846: fdatasync d7/de/d11/d1f/d9c/f9e 0 2024-09-20T19:06:11.626 INFO:tasks.workunit.client.1.smithi098.stdout:9/863: dread f3 [0,4194304] 0 2024-09-20T19:06:11.627 INFO:tasks.workunit.client.1.smithi098.stdout:8/847: write d7/de/d11/d1f/d9c/fc6 [1102,70395] 0 2024-09-20T19:06:11.628 INFO:tasks.workunit.client.1.smithi098.stdout:3/784: truncate d4/d25/d8d/fab 62350 0 2024-09-20T19:06:11.629 INFO:tasks.workunit.client.1.smithi098.stdout:8/848: stat d7/de/d11/d19/d30/d55/d9d/fd3 0 2024-09-20T19:06:11.632 INFO:tasks.workunit.client.1.smithi098.stdout:4/912: creat d3/d6/d8c/de7/df4/d1e/d2a/d45/f131 x:0 0 0 2024-09-20T19:06:11.640 INFO:tasks.workunit.client.1.smithi098.stdout:6/582: write d0/d55/d82/da3/d43/f7e [718972,95021] 0 2024-09-20T19:06:11.641 INFO:tasks.workunit.client.1.smithi098.stdout:9/864: write d4/de/d27/d4a/d58/fab [4068826,116921] 0 2024-09-20T19:06:11.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/649: symlink d1/d1b/lc7 0 2024-09-20T19:06:11.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/785: truncate d4/d19/d1d/fed 1431537 0 2024-09-20T19:06:11.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/908: dwrite d3/f6 [0,4194304] 0 2024-09-20T19:06:11.655 INFO:tasks.workunit.client.0.smithi027.stdout:8/940: symlink d2/d3/d6/d21/l13f 0 2024-09-20T19:06:11.656 INFO:tasks.workunit.client.0.smithi027.stdout:3/956: mknod d0/d1/d5e/d1d/da7/db0/c142 0 2024-09-20T19:06:11.656 INFO:tasks.workunit.client.0.smithi027.stdout:2/918: dread - d3/d1c/d31/d9e/fcd zero size 2024-09-20T19:06:11.657 INFO:tasks.workunit.client.0.smithi027.stdout:0/956: rename d2/d20/c9b to d2/d48/d6b/d79/d84/dfa/c14e 0 2024-09-20T19:06:11.657 INFO:tasks.workunit.client.0.smithi027.stdout:6/946: creat d4/d15/d37/d6a/dbf/de0/f13e x:0 0 0 2024-09-20T19:06:11.657 INFO:tasks.workunit.client.0.smithi027.stdout:9/985: unlink d0/d9/la9 0 2024-09-20T19:06:11.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/786: rmdir d4/d19 39 2024-09-20T19:06:11.658 INFO:tasks.workunit.client.0.smithi027.stdout:5/977: write d4/da/de/d3e/d44/f60 [546587,29399] 0 2024-09-20T19:06:11.658 INFO:tasks.workunit.client.1.smithi098.stdout:5/650: dwrite d1/d17/d35/f6a [0,4194304] 0 2024-09-20T19:06:11.661 INFO:tasks.workunit.client.1.smithi098.stdout:4/913: dwrite d3/dfb/f122 [0,4194304] 0 2024-09-20T19:06:11.662 INFO:tasks.workunit.client.0.smithi027.stdout:0/957: truncate d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f114 935217 0 2024-09-20T19:06:11.662 INFO:tasks.workunit.client.1.smithi098.stdout:4/914: dread - d3/d7d/f9a zero size 2024-09-20T19:06:11.666 INFO:tasks.workunit.client.1.smithi098.stdout:6/583: dread d0/d55/d82/da3/d8c/d4c/fad [0,4194304] 0 2024-09-20T19:06:11.666 INFO:tasks.workunit.client.0.smithi027.stdout:1/917: mknod d2/d61/df8/c12b 0 2024-09-20T19:06:11.669 INFO:tasks.workunit.client.1.smithi098.stdout:8/849: link d7/de/d11/d1d/d110/d11a/fdf d7/de/f126 0 2024-09-20T19:06:11.674 INFO:tasks.workunit.client.0.smithi027.stdout:7/865: dread d3/d8/d26/d45/d56/dec/dc/da9/fb7 [0,4194304] 0 2024-09-20T19:06:11.674 INFO:tasks.workunit.client.0.smithi027.stdout:7/866: readlink d3/d8/l31 0 2024-09-20T19:06:11.675 INFO:tasks.workunit.client.0.smithi027.stdout:3/957: read - d0/d12d/d15/faf zero size 2024-09-20T19:06:11.676 INFO:tasks.workunit.client.1.smithi098.stdout:9/865: getdents d4/de/d24/d35/d2d/da6 0 2024-09-20T19:06:11.676 INFO:tasks.workunit.client.1.smithi098.stdout:6/584: dwrite d0/d55/d82/da3/d44/dc/f1a [0,4194304] 0 2024-09-20T19:06:11.680 INFO:tasks.workunit.client.0.smithi027.stdout:2/919: rmdir d3/d13/d3c/de7 39 2024-09-20T19:06:11.681 INFO:tasks.workunit.client.1.smithi098.stdout:4/915: mknod d3/d6/d8c/de7/d124/d107/c132 0 2024-09-20T19:06:11.682 INFO:tasks.workunit.client.0.smithi027.stdout:9/986: symlink d0/d9/dfb/l14c 0 2024-09-20T19:06:11.683 INFO:tasks.workunit.client.0.smithi027.stdout:9/987: read - d0/d9/df/d1b/ff0 zero size 2024-09-20T19:06:11.683 INFO:tasks.workunit.client.1.smithi098.stdout:8/850: mkdir d7/de/d11/d1f/d127 0 2024-09-20T19:06:11.685 INFO:tasks.workunit.client.0.smithi027.stdout:6/947: symlink d4/d15/d37/d6a/dbf/de0/l13f 0 2024-09-20T19:06:11.686 INFO:tasks.workunit.client.0.smithi027.stdout:6/948: dread - d4/d6/d4b/d106/f136 zero size 2024-09-20T19:06:11.686 INFO:tasks.workunit.client.1.smithi098.stdout:7/909: rename d3/d76/db8/da6/dec to d3/d10/d16/d17/d33/d1f/dba/d126 0 2024-09-20T19:06:11.688 INFO:tasks.workunit.client.1.smithi098.stdout:3/787: mknod d4/d38/d39/db4/cf5 0 2024-09-20T19:06:11.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/916: dwrite d3/d5e/d9f/fc5 [4194304,4194304] 0 2024-09-20T19:06:11.689 INFO:tasks.workunit.client.1.smithi098.stdout:3/788: chown d4/da/f51 6 1 2024-09-20T19:06:11.691 INFO:tasks.workunit.client.0.smithi027.stdout:0/958: symlink d2/d48/d6b/d79/d84/d1b/l14f 0 2024-09-20T19:06:11.691 INFO:tasks.workunit.client.0.smithi027.stdout:5/978: dread d4/d1f/d28/f3f [0,4194304] 0 2024-09-20T19:06:11.691 INFO:tasks.workunit.client.1.smithi098.stdout:3/789: dread - d4/da/d7a/fc9 zero size 2024-09-20T19:06:11.691 INFO:tasks.workunit.client.1.smithi098.stdout:5/651: fsync d1/d46/d69/f6d 0 2024-09-20T19:06:11.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/790: stat d4/da/l1a 0 2024-09-20T19:06:11.693 INFO:tasks.workunit.client.0.smithi027.stdout:1/918: symlink d2/d8/d3b/d82/d90/l12c 0 2024-09-20T19:06:11.694 INFO:tasks.workunit.client.1.smithi098.stdout:6/585: creat d0/d55/d82/da3/d8c/fb4 x:0 0 0 2024-09-20T19:06:11.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/866: mkdir d4/de/d24/d35/d2d/da6/dae/d86/d11c 0 2024-09-20T19:06:11.695 INFO:tasks.workunit.client.1.smithi098.stdout:6/586: truncate d0/f7b 1626552 0 2024-09-20T19:06:11.696 INFO:tasks.workunit.client.0.smithi027.stdout:3/958: mknod d0/d19/d54/d7a/c143 0 2024-09-20T19:06:11.699 INFO:tasks.workunit.client.0.smithi027.stdout:9/988: creat d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/d132/f14d x:0 0 0 2024-09-20T19:06:11.700 INFO:tasks.workunit.client.0.smithi027.stdout:3/959: fdatasync d0/d12d/d15/d6f/fcb 0 2024-09-20T19:06:11.702 INFO:tasks.workunit.client.0.smithi027.stdout:0/959: dwrite d2/d48/d6b/d79/d84/d1b/d39/f6f [0,4194304] 0 2024-09-20T19:06:11.705 INFO:tasks.workunit.client.0.smithi027.stdout:3/960: write d0/d12d/d64/f7c [664024,78476] 0 2024-09-20T19:06:11.705 INFO:tasks.workunit.client.0.smithi027.stdout:5/979: dwrite d4/d1f/d7f/f67 [0,4194304] 0 2024-09-20T19:06:11.706 INFO:tasks.workunit.client.1.smithi098.stdout:3/791: mknod d4/d25/d40/d4b/cf6 0 2024-09-20T19:06:11.707 INFO:tasks.workunit.client.0.smithi027.stdout:5/980: chown d4/da/de/d3e/db7/dc2/d87/f13b 90895103 1 2024-09-20T19:06:11.707 INFO:tasks.workunit.client.0.smithi027.stdout:5/981: chown d4/d1f/ld3 89024889 1 2024-09-20T19:06:11.708 INFO:tasks.workunit.client.0.smithi027.stdout:5/982: chown d4/da/de/d3e/d44/fae 518 1 2024-09-20T19:06:11.709 INFO:tasks.workunit.client.0.smithi027.stdout:5/983: write d4/da/de/d3e/d44/f77 [1021642,18084] 0 2024-09-20T19:06:11.711 INFO:tasks.workunit.client.0.smithi027.stdout:5/984: write d4/d1f/d28/f85 [2008462,42491] 0 2024-09-20T19:06:11.712 INFO:tasks.workunit.client.1.smithi098.stdout:9/867: unlink d4/de/d27/d4a/d58/d5b/d8f/d9e/f53 0 2024-09-20T19:06:11.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/868: chown d4/de/d27/d4a/l3e 549 1 2024-09-20T19:06:11.717 INFO:tasks.workunit.client.1.smithi098.stdout:6/587: dwrite d0/d55/d82/da3/d44/d24/f3e [4194304,4194304] 0 2024-09-20T19:06:11.720 INFO:tasks.workunit.client.1.smithi098.stdout:7/910: rename d3/l7 to d3/d10/d16/d17/l127 0 2024-09-20T19:06:11.722 INFO:tasks.workunit.client.0.smithi027.stdout:6/949: symlink d4/l140 0 2024-09-20T19:06:11.724 INFO:tasks.workunit.client.1.smithi098.stdout:5/652: truncate d1/fb 1912482 0 2024-09-20T19:06:11.724 INFO:tasks.workunit.client.1.smithi098.stdout:5/653: fsync d1/d1b/f1c 0 2024-09-20T19:06:11.727 INFO:tasks.workunit.client.1.smithi098.stdout:8/851: write d7/de/d11/d19/d47/f99 [6625115,30019] 0 2024-09-20T19:06:11.728 INFO:tasks.workunit.client.1.smithi098.stdout:9/869: chown d4/fb 0 1 2024-09-20T19:06:11.730 INFO:tasks.workunit.client.0.smithi027.stdout:2/920: dwrite d3/d96/f9a [0,4194304] 0 2024-09-20T19:06:11.732 INFO:tasks.workunit.client.0.smithi027.stdout:1/919: creat d2/d61/df8/d56/d126/f12d x:0 0 0 2024-09-20T19:06:11.734 INFO:tasks.workunit.client.1.smithi098.stdout:4/917: dwrite d3/d6/d8c/de7/df4/d1e/d2a/fd9 [0,4194304] 0 2024-09-20T19:06:11.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/654: rmdir d1/d17/d25 39 2024-09-20T19:06:11.734 INFO:tasks.workunit.client.0.smithi027.stdout:2/921: read d3/d1c/d26/fb5 [494783,55694] 0 2024-09-20T19:06:11.736 INFO:tasks.workunit.client.1.smithi098.stdout:4/918: stat d3/d6/d8c/de7/d124/d6b/d73/d98/de0/le2 0 2024-09-20T19:06:11.739 INFO:tasks.workunit.client.0.smithi027.stdout:8/941: rename d2/d3/d6/d9e/d137/d6c/d77/lee to d2/d3/d6/d21/d33/d79/l140 0 2024-09-20T19:06:11.740 INFO:tasks.workunit.client.0.smithi027.stdout:8/942: write d2/d3/d9a/f10c [1921048,84944] 0 2024-09-20T19:06:11.741 INFO:tasks.workunit.client.1.smithi098.stdout:9/870: creat d4/de/d48/dec/f11d x:0 0 0 2024-09-20T19:06:11.744 INFO:tasks.workunit.client.1.smithi098.stdout:3/792: symlink d4/d19/d1d/d2f/lf7 0 2024-09-20T19:06:11.745 INFO:tasks.workunit.client.0.smithi027.stdout:3/961: symlink d0/d1/d65/dbb/d129/l144 0 2024-09-20T19:06:11.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/852: dread - d7/de/dbb/fc0 zero size 2024-09-20T19:06:11.746 INFO:tasks.workunit.client.0.smithi027.stdout:3/962: read - d0/d12d/d15/db3/f134 zero size 2024-09-20T19:06:11.747 INFO:tasks.workunit.client.0.smithi027.stdout:3/963: chown d0/d12d/d3c/d93/cb1 1 1 2024-09-20T19:06:11.749 INFO:tasks.workunit.client.0.smithi027.stdout:4/880: sync 2024-09-20T19:06:11.751 INFO:tasks.workunit.client.0.smithi027.stdout:7/867: getdents d3/d8/d26/d45/d56/dec/d51 0 2024-09-20T19:06:11.752 INFO:tasks.workunit.client.1.smithi098.stdout:5/655: mkdir d1/d1b/d40/daf/dc8 0 2024-09-20T19:06:11.753 INFO:tasks.workunit.client.1.smithi098.stdout:3/793: dwrite d4/d25/d40/d4b/f8e [0,4194304] 0 2024-09-20T19:06:11.756 INFO:tasks.workunit.client.1.smithi098.stdout:9/871: mkdir d4/de/d24/d35/dc4/d11e 0 2024-09-20T19:06:11.757 INFO:tasks.workunit.client.0.smithi027.stdout:4/881: dwrite d5/d13/d36/d48/d3f/d4c/ffd [0,4194304] 0 2024-09-20T19:06:11.758 INFO:tasks.workunit.client.0.smithi027.stdout:4/882: fsync d5/d13/d36/d48/d9f/dc9/d8f/fce 0 2024-09-20T19:06:11.764 INFO:tasks.workunit.client.1.smithi098.stdout:6/588: getdents d0/d55 0 2024-09-20T19:06:11.766 INFO:tasks.workunit.client.1.smithi098.stdout:6/589: chown d0/d55/d82/da3/d8c/d9a/ca9 453 1 2024-09-20T19:06:11.766 INFO:tasks.workunit.client.0.smithi027.stdout:9/989: creat d0/d9/df/d1b/d9c/d4f/f14e x:0 0 0 2024-09-20T19:06:11.768 INFO:tasks.workunit.client.1.smithi098.stdout:7/911: dread d3/d10/dcf/fd6 [4194304,4194304] 0 2024-09-20T19:06:11.770 INFO:tasks.workunit.client.1.smithi098.stdout:3/794: truncate d4/d19/d1d/fc2 156305 0 2024-09-20T19:06:11.772 INFO:tasks.workunit.client.1.smithi098.stdout:9/872: symlink d4/de/d27/d4a/d58/d5b/d112/l11f 0 2024-09-20T19:06:11.772 INFO:tasks.workunit.client.1.smithi098.stdout:0/598: sync 2024-09-20T19:06:11.773 INFO:tasks.workunit.client.0.smithi027.stdout:3/964: mkdir d0/d1/d65/dbb/d129/d145 0 2024-09-20T19:06:11.774 INFO:tasks.workunit.client.0.smithi027.stdout:1/920: symlink d2/d8/d3b/d82/l12e 0 2024-09-20T19:06:11.775 INFO:tasks.workunit.client.1.smithi098.stdout:6/590: creat d0/d55/d82/fb5 x:0 0 0 2024-09-20T19:06:11.776 INFO:tasks.workunit.client.0.smithi027.stdout:1/921: write d2/d8/d3b/d44/d93/fcd [1255340,110196] 0 2024-09-20T19:06:11.776 INFO:tasks.workunit.client.1.smithi098.stdout:3/795: dread d4/da/f6c [0,4194304] 0 2024-09-20T19:06:11.776 INFO:tasks.workunit.client.1.smithi098.stdout:6/591: chown d0/d55/d82/da3/f9b 1 1 2024-09-20T19:06:11.778 INFO:tasks.workunit.client.1.smithi098.stdout:6/592: read d0/d55/d82/da3/d44/f85 [2930363,3200] 0 2024-09-20T19:06:11.778 INFO:tasks.workunit.client.0.smithi027.stdout:5/985: link d4/d1f/d91/f94 d4/da/de/d3e/db7/dc2/d87/df0/d120/f143 0 2024-09-20T19:06:11.780 INFO:tasks.workunit.client.0.smithi027.stdout:5/986: write d4/da/de/d3e/d44/fa6 [134081,92762] 0 2024-09-20T19:06:11.780 INFO:tasks.workunit.client.1.smithi098.stdout:3/796: dread d4/da/d7a/ff2 [0,4194304] 0 2024-09-20T19:06:11.781 INFO:tasks.workunit.client.1.smithi098.stdout:7/912: rename d3/d76/db8/f124 to d3/d10/d16/d17/d7c/d11d/f128 0 2024-09-20T19:06:11.781 INFO:tasks.workunit.client.0.smithi027.stdout:5/987: chown d4/d1f/d28/f8f 404045 1 2024-09-20T19:06:11.781 INFO:tasks.workunit.client.1.smithi098.stdout:4/919: write d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/f63 [1583584,81377] 0 2024-09-20T19:06:11.788 INFO:tasks.workunit.client.1.smithi098.stdout:8/853: write d7/de/d11/d1f/d10a/f5a [238452,108533] 0 2024-09-20T19:06:11.792 INFO:tasks.workunit.client.0.smithi027.stdout:0/960: getdents d2/d48/d6b/d79/ddc 0 2024-09-20T19:06:11.794 INFO:tasks.workunit.client.0.smithi027.stdout:1/922: dread d2/d61/df8/f1e [0,4194304] 0 2024-09-20T19:06:11.795 INFO:tasks.workunit.client.0.smithi027.stdout:1/923: write d2/d8/d74/d84/dca/deb/f102 [4257641,114114] 0 2024-09-20T19:06:11.797 INFO:tasks.workunit.client.1.smithi098.stdout:7/913: unlink d3/d10/d16/d17/d33/d1f/d10c/c5e 0 2024-09-20T19:06:11.798 INFO:tasks.workunit.client.1.smithi098.stdout:8/854: read d7/de/d11/d19/f4e [2044261,64289] 0 2024-09-20T19:06:11.799 INFO:tasks.workunit.client.1.smithi098.stdout:5/656: write d1/d1b/f6f [741656,67601] 0 2024-09-20T19:06:11.803 INFO:tasks.workunit.client.0.smithi027.stdout:4/883: dread d5/d13/d7c/f9c [0,4194304] 0 2024-09-20T19:06:11.804 INFO:tasks.workunit.client.0.smithi027.stdout:2/922: creat d3/d13/d3c/f133 x:0 0 0 2024-09-20T19:06:11.805 INFO:tasks.workunit.client.0.smithi027.stdout:5/988: creat d4/da/de/d3e/db7/dc2/d87/f144 x:0 0 0 2024-09-20T19:06:11.807 INFO:tasks.workunit.client.0.smithi027.stdout:6/950: getdents d4/d9c 0 2024-09-20T19:06:11.808 INFO:tasks.workunit.client.1.smithi098.stdout:3/797: truncate d4/d19/d1d/d2f/d4e/f90 1007465 0 2024-09-20T19:06:11.809 INFO:tasks.workunit.client.0.smithi027.stdout:9/990: dwrite d0/d9/df/d1c/d6a/f83 [0,4194304] 0 2024-09-20T19:06:11.809 INFO:tasks.workunit.client.0.smithi027.stdout:8/943: rename d2/d3/d11d/df2/f13d to d2/d3/d6/d9e/d137/f141 0 2024-09-20T19:06:11.810 INFO:tasks.workunit.client.1.smithi098.stdout:7/914: symlink d3/d10/d16/d17/l129 0 2024-09-20T19:06:11.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/920: fsync d3/d6/d8c/de7/d124/d6b/d73/d98/de0/f102 0 2024-09-20T19:06:11.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/915: chown d3/d10/d16/d17/d33/d1f/d10c/d8c/c11b 2820271 1 2024-09-20T19:06:11.813 INFO:tasks.workunit.client.0.smithi027.stdout:3/965: link d0/d1/d5e/d1d/da7/db0/dc7/fe8 d0/d1/d65/d119/f146 0 2024-09-20T19:06:11.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/855: fsync d7/de/d11/d19/daf/ff5 0 2024-09-20T19:06:11.815 INFO:tasks.workunit.client.0.smithi027.stdout:1/924: mknod d2/d61/df8/dde/d124/c12f 0 2024-09-20T19:06:11.817 INFO:tasks.workunit.client.1.smithi098.stdout:5/657: mknod d1/d46/d69/d84/d87/cc9 0 2024-09-20T19:06:11.817 INFO:tasks.workunit.client.1.smithi098.stdout:3/798: dwrite d4/d19/d1d/d2f/d4e/fc1 [0,4194304] 0 2024-09-20T19:06:11.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/658: fsync d1/f2 0 2024-09-20T19:06:11.820 INFO:tasks.workunit.client.0.smithi027.stdout:4/884: readlink d5/d11/d17/d1b/dd4/ld8 0 2024-09-20T19:06:11.820 INFO:tasks.workunit.client.1.smithi098.stdout:0/599: getdents d0/d6/d28/d31/d69/d9b/dae 0 2024-09-20T19:06:11.820 INFO:tasks.workunit.client.0.smithi027.stdout:4/885: fdatasync d5/d11/d17/d1b/dd4/f10e 0 2024-09-20T19:06:11.824 INFO:tasks.workunit.client.1.smithi098.stdout:8/856: write d7/de/d11/d19/d30/d55/fe4 [5046309,84285] 0 2024-09-20T19:06:11.828 INFO:tasks.workunit.client.1.smithi098.stdout:4/921: dwrite d3/d6/d8c/de7/df4/d1e/d2a/d45/ff8 [0,4194304] 0 2024-09-20T19:06:11.829 INFO:tasks.workunit.client.1.smithi098.stdout:9/873: rename d4/de/d24/d35/c57 to d4/de/d27/d4a/c120 0 2024-09-20T19:06:11.831 INFO:tasks.workunit.client.1.smithi098.stdout:4/922: chown d3/d6/d8c/de7/df4/d57/c6f 7001 1 2024-09-20T19:06:11.831 INFO:tasks.workunit.client.0.smithi027.stdout:5/989: creat d4/da/de/d3e/db7/dc2/d105/f145 x:0 0 0 2024-09-20T19:06:11.838 INFO:tasks.workunit.client.1.smithi098.stdout:1/741: sync 2024-09-20T19:06:11.840 INFO:tasks.workunit.client.0.smithi027.stdout:4/886: readlink d5/d13/dfb/l92 0 2024-09-20T19:06:11.843 INFO:tasks.workunit.client.1.smithi098.stdout:3/799: symlink d4/d19/d7b/lf8 0 2024-09-20T19:06:11.846 INFO:tasks.workunit.client.0.smithi027.stdout:5/990: fsync d4/da/de/d3e/db7/f11e 0 2024-09-20T19:06:11.847 INFO:tasks.workunit.client.1.smithi098.stdout:5/659: mkdir d1/d46/d69/dca 0 2024-09-20T19:06:11.848 INFO:tasks.workunit.client.0.smithi027.stdout:9/991: mknod d0/d9/df/d1c/d6a/d6d/dd/c14f 0 2024-09-20T19:06:11.849 INFO:tasks.workunit.client.0.smithi027.stdout:5/991: write d4/da/de/d3e/d44/fa6 [4333051,46717] 0 2024-09-20T19:06:11.851 INFO:tasks.workunit.client.0.smithi027.stdout:5/992: chown d4/da/l6d 15647 1 2024-09-20T19:06:11.851 INFO:tasks.workunit.client.0.smithi027.stdout:3/966: mkdir d0/d12d/d98/dc3/d147 0 2024-09-20T19:06:11.853 INFO:tasks.workunit.client.0.smithi027.stdout:4/887: mkdir d5/d11/d17/d1b/dd4/de3/d114 0 2024-09-20T19:06:11.854 INFO:tasks.workunit.client.0.smithi027.stdout:8/944: write d2/d3/d6/d9e/d137/d6c/d77/fa5 [4450667,61789] 0 2024-09-20T19:06:11.854 INFO:tasks.workunit.client.1.smithi098.stdout:6/593: rename d0/d83/lab to d0/lb6 0 2024-09-20T19:06:11.855 INFO:tasks.workunit.client.0.smithi027.stdout:2/923: dwrite d3/d13/d3c/fbe [0,4194304] 0 2024-09-20T19:06:11.856 INFO:tasks.workunit.client.1.smithi098.stdout:9/874: mknod d4/de/d24/d35/d6d/c121 0 2024-09-20T19:06:11.857 INFO:tasks.workunit.client.1.smithi098.stdout:6/594: truncate d0/d55/d82/da3/d8c/d4c/fa1 983647 0 2024-09-20T19:06:11.858 INFO:tasks.workunit.client.0.smithi027.stdout:0/961: dwrite d2/fe [0,4194304] 0 2024-09-20T19:06:11.859 INFO:tasks.workunit.client.0.smithi027.stdout:5/993: dread - d4/da/de/d3e/d10b/dee/f140 zero size 2024-09-20T19:06:11.861 INFO:tasks.workunit.client.1.smithi098.stdout:7/916: dwrite d3/d10/d16/d17/d33/d1f/d10c/f54 [4194304,4194304] 0 2024-09-20T19:06:11.861 INFO:tasks.workunit.client.0.smithi027.stdout:0/962: stat d2/d48/d6b/d79/l85 0 2024-09-20T19:06:11.862 INFO:tasks.workunit.client.1.smithi098.stdout:1/742: creat d1/d3/df/d34/d52/d77/ff1 x:0 0 0 2024-09-20T19:06:11.864 INFO:tasks.workunit.client.0.smithi027.stdout:2/924: read d3/d13/d3c/dce/f82 [139139,64288] 0 2024-09-20T19:06:11.866 INFO:tasks.workunit.client.0.smithi027.stdout:4/888: dread d5/d13/d36/d48/d3f/fe9 [0,4194304] 0 2024-09-20T19:06:11.866 INFO:tasks.workunit.client.0.smithi027.stdout:5/994: dread d4/d1f/d28/f3f [0,4194304] 0 2024-09-20T19:06:11.867 INFO:tasks.workunit.client.0.smithi027.stdout:9/992: dwrite d0/d9/dfb/f11d [0,4194304] 0 2024-09-20T19:06:11.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/660: truncate d1/f33 1955240 0 2024-09-20T19:06:11.874 INFO:tasks.workunit.client.1.smithi098.stdout:0/600: creat d0/d6/d28/d31/d69/d9b/dae/fb2 x:0 0 0 2024-09-20T19:06:11.875 INFO:tasks.workunit.client.0.smithi027.stdout:3/967: dread d0/d12d/d15/d6f/f83 [0,4194304] 0 2024-09-20T19:06:11.875 INFO:tasks.workunit.client.1.smithi098.stdout:0/601: dread - d0/d6/d28/d31/f53 zero size 2024-09-20T19:06:11.876 INFO:tasks.workunit.client.0.smithi027.stdout:8/945: mkdir d2/d3/d6/d9e/d137/d6c/d142 0 2024-09-20T19:06:11.876 INFO:tasks.workunit.client.0.smithi027.stdout:3/968: rename d0/d12d to d0/d12d/d15/d6f/dcc/d148 22 2024-09-20T19:06:11.881 INFO:tasks.workunit.client.1.smithi098.stdout:6/595: symlink d0/d55/d82/lb7 0 2024-09-20T19:06:11.883 INFO:tasks.workunit.client.0.smithi027.stdout:2/925: mkdir d3/d1c/dea/d11a/d134 0 2024-09-20T19:06:11.884 INFO:tasks.workunit.client.0.smithi027.stdout:2/926: readlink d3/d1c/d26/d2a/dc2/l12d 0 2024-09-20T19:06:11.884 INFO:tasks.workunit.client.1.smithi098.stdout:6/596: dread - d0/d55/d82/da3/d8c/d4c/f9c zero size 2024-09-20T19:06:11.885 INFO:tasks.workunit.client.1.smithi098.stdout:4/923: dwrite d3/d6/d8c/de7/d124/d6b/d73/d98/de0/f102 [0,4194304] 0 2024-09-20T19:06:11.886 INFO:tasks.workunit.client.1.smithi098.stdout:7/917: unlink d3/d76/db8/c8d 0 2024-09-20T19:06:11.887 INFO:tasks.workunit.client.0.smithi027.stdout:2/927: truncate d3/d1c/d26/df2/df6/fe8 1001936 0 2024-09-20T19:06:11.887 INFO:tasks.workunit.client.0.smithi027.stdout:0/963: dread d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f42 [0,4194304] 0 2024-09-20T19:06:11.889 INFO:tasks.workunit.client.1.smithi098.stdout:1/743: mknod d1/d3/d62/d9e/cf2 0 2024-09-20T19:06:11.889 INFO:tasks.workunit.client.1.smithi098.stdout:1/744: chown d1/d3/df/d34 14922 1 2024-09-20T19:06:11.891 INFO:tasks.workunit.client.1.smithi098.stdout:3/800: unlink d4/da/d50/l71 0 2024-09-20T19:06:11.893 INFO:tasks.workunit.client.1.smithi098.stdout:4/924: read d3/d6/d8c/de7/df4/d1e/d2a/d45/ffa [3382083,121536] 0 2024-09-20T19:06:11.894 INFO:tasks.workunit.client.1.smithi098.stdout:5/661: rename d1/d46/d69/c6c to d1/d1b/d40/daf/ccb 0 2024-09-20T19:06:11.897 INFO:tasks.workunit.client.1.smithi098.stdout:6/597: fdatasync d0/de/d1b/f1c 0 2024-09-20T19:06:11.899 INFO:tasks.workunit.client.0.smithi027.stdout:9/993: dread d0/d9/df/d1c/d6a/d6d/dd/d66/d79/ddb/df2/f135 [0,4194304] 0 2024-09-20T19:06:11.901 INFO:tasks.workunit.client.0.smithi027.stdout:3/969: symlink d0/d19/d54/l149 0 2024-09-20T19:06:11.902 INFO:tasks.workunit.client.1.smithi098.stdout:8/857: link d7/de/d11/d1d/d110/d11a/fc2 d7/de/d11/d19/d30/d68/f128 0 2024-09-20T19:06:11.902 INFO:tasks.workunit.client.1.smithi098.stdout:3/801: dread d4/d19/d1d/d22/f9f [0,4194304] 0 2024-09-20T19:06:11.903 INFO:tasks.workunit.client.1.smithi098.stdout:3/802: chown d4/d38/d39/db4/cf5 33 1 2024-09-20T19:06:11.906 INFO:tasks.workunit.client.0.smithi027.stdout:4/889: link d5/d13/d36/d48/d3f/fb6 d5/d11/d17/f115 0 2024-09-20T19:06:11.906 INFO:tasks.workunit.client.0.smithi027.stdout:2/928: dread d3/d13/f87 [0,4194304] 0 2024-09-20T19:06:11.907 INFO:tasks.workunit.client.0.smithi027.stdout:3/970: dwrite d0/d12d/f1c [0,4194304] 0 2024-09-20T19:06:11.908 INFO:tasks.workunit.client.1.smithi098.stdout:7/918: rename d3/d10/d16/dc1/c10e to d3/d10/d16/d17/d33/d37/c12a 0 2024-09-20T19:06:11.909 INFO:tasks.workunit.client.0.smithi027.stdout:3/971: dread - d0/dc5/deb/dfc/f120 zero size 2024-09-20T19:06:11.910 INFO:tasks.workunit.client.1.smithi098.stdout:5/662: rmdir d1/d1b/d40 39 2024-09-20T19:06:11.912 INFO:tasks.workunit.client.1.smithi098.stdout:4/925: mknod d3/d6/d8c/de7/df4/d64/dce/c133 0 2024-09-20T19:06:11.914 INFO:tasks.workunit.client.0.smithi027.stdout:8/946: creat d2/d2a/df8/f143 x:0 0 0 2024-09-20T19:06:11.914 INFO:tasks.workunit.client.1.smithi098.stdout:9/875: dwrite d4/de/d27/d4a/d21/d25/f75 [0,4194304] 0 2024-09-20T19:06:11.917 INFO:tasks.workunit.client.0.smithi027.stdout:9/994: unlink d0/d9/df/d1b/d9c/da4/fb0 0 2024-09-20T19:06:11.919 INFO:tasks.workunit.client.0.smithi027.stdout:5/995: dwrite d4/d1f/d7f/fb3 [0,4194304] 0 2024-09-20T19:06:11.921 INFO:tasks.workunit.client.1.smithi098.stdout:4/926: dwrite d3/d6/d8c/de7/df4/fe9 [0,4194304] 0 2024-09-20T19:06:11.927 INFO:tasks.workunit.client.1.smithi098.stdout:1/745: rmdir d1/d3/df/d34/d43/dad/dc1/dc7 39 2024-09-20T19:06:11.927 INFO:tasks.workunit.client.1.smithi098.stdout:1/746: stat d1/dda 0 2024-09-20T19:06:11.927 INFO:tasks.workunit.client.0.smithi027.stdout:4/890: rename d5/d11/d3d/d6e/c85 to d5/d13/d7c/df7/c116 0 2024-09-20T19:06:11.938 INFO:tasks.workunit.client.1.smithi098.stdout:3/803: creat d4/d19/d1d/d2f/d4e/da3/ff9 x:0 0 0 2024-09-20T19:06:11.939 INFO:tasks.workunit.client.1.smithi098.stdout:3/804: dread - d4/d25/d8d/fdf zero size 2024-09-20T19:06:11.941 INFO:tasks.workunit.client.0.smithi027.stdout:0/964: truncate d2/d48/d6b/d79/d84/d1b/d39/f6f 869984 0 2024-09-20T19:06:11.943 INFO:tasks.workunit.client.0.smithi027.stdout:8/947: link d2/d14/d13/d43/d5d/d90/f124 d2/d3/d6/d6d/d75/f144 0 2024-09-20T19:06:11.945 INFO:tasks.workunit.client.0.smithi027.stdout:9/995: unlink d0/d9/df/da2/de9/df8/f136 0 2024-09-20T19:06:11.946 INFO:tasks.workunit.client.1.smithi098.stdout:4/927: rmdir d3/d6/d8c/de7/df4/d64/dce 39 2024-09-20T19:06:11.947 INFO:tasks.workunit.client.1.smithi098.stdout:1/747: rename d1/d3/f1b to d1/d3/d62/ff3 0 2024-09-20T19:06:11.948 INFO:tasks.workunit.client.0.smithi027.stdout:0/965: stat d2/d48/d6b/d79/d84/d1b/d39/c111 0 2024-09-20T19:06:11.948 INFO:tasks.workunit.client.1.smithi098.stdout:1/748: chown d1/d3/d2e/d68/d7a/da1/fbd 7162 1 2024-09-20T19:06:11.949 INFO:tasks.workunit.client.1.smithi098.stdout:8/858: unlink d7/de/d11/d19/d30/d59/c5f 0 2024-09-20T19:06:11.950 INFO:tasks.workunit.client.1.smithi098.stdout:0/602: link d0/d6/d28/d31/d45/l4e d0/d7d/lb3 0 2024-09-20T19:06:11.953 INFO:tasks.workunit.client.1.smithi098.stdout:3/805: dread d4/da/d7a/ff2 [0,4194304] 0 2024-09-20T19:06:11.955 INFO:tasks.workunit.client.0.smithi027.stdout:9/996: dread d0/d9/df/d1c/d6a/d6d/dd/d66/f89 [0,4194304] 0 2024-09-20T19:06:11.956 INFO:tasks.workunit.client.1.smithi098.stdout:5/663: symlink d1/lcc 0 2024-09-20T19:06:11.957 INFO:tasks.workunit.client.0.smithi027.stdout:2/929: write d3/de/d34/f64 [806682,100806] 0 2024-09-20T19:06:11.957 INFO:tasks.workunit.client.0.smithi027.stdout:2/930: stat d3/d24/d89/l9b 0 2024-09-20T19:06:11.958 INFO:tasks.workunit.client.0.smithi027.stdout:0/966: stat d2/d48/d6b/d79/d84/d1b/d39/f6f 0 2024-09-20T19:06:11.959 INFO:tasks.workunit.client.1.smithi098.stdout:4/928: symlink d3/d6/d8c/de7/df4/d57/l134 0 2024-09-20T19:06:11.965 INFO:tasks.workunit.client.0.smithi027.stdout:5/996: dwrite d4/d1f/d7f/da4/dcf/fd4 [0,4194304] 0 2024-09-20T19:06:11.965 INFO:tasks.workunit.client.0.smithi027.stdout:4/891: write d5/d13/d36/d48/ff8 [670215,114375] 0 2024-09-20T19:06:11.966 INFO:tasks.workunit.client.0.smithi027.stdout:5/997: fdatasync d4/d1f/d91/f11b 0 2024-09-20T19:06:11.967 INFO:tasks.workunit.client.0.smithi027.stdout:2/931: rmdir d3/d13/d3c/d48/dba/de4/df3 39 2024-09-20T19:06:11.968 INFO:tasks.workunit.client.0.smithi027.stdout:0/967: mkdir d2/d48/d150 0 2024-09-20T19:06:11.969 INFO:tasks.workunit.client.0.smithi027.stdout:0/968: truncate d2/d49/ded/f143 430742 0 2024-09-20T19:06:11.970 INFO:tasks.workunit.client.0.smithi027.stdout:0/969: stat d2/d48/d6b/d79/d84/dfa/c133 0 2024-09-20T19:06:11.972 INFO:tasks.workunit.client.1.smithi098.stdout:7/919: creat d3/d76/db8/da6/f12b x:0 0 0 2024-09-20T19:06:11.975 INFO:tasks.workunit.client.1.smithi098.stdout:7/920: chown d3/cbd 81 1 2024-09-20T19:06:11.978 INFO:tasks.workunit.client.1.smithi098.stdout:9/876: dwrite d4/de/d27/d4a/d8e/fbb [0,4194304] 0 2024-09-20T19:06:11.980 INFO:tasks.workunit.client.1.smithi098.stdout:5/664: write d1/d17/d25/d79/f88 [1115287,122797] 0 2024-09-20T19:06:11.982 INFO:tasks.workunit.client.0.smithi027.stdout:8/948: dwrite d2/d3/d6/f3e [0,4194304] 0 2024-09-20T19:06:11.983 INFO:tasks.workunit.client.0.smithi027.stdout:5/998: fsync d4/da/f29 0 2024-09-20T19:06:11.984 INFO:tasks.workunit.client.0.smithi027.stdout:4/892: dread d5/d13/f30 [0,4194304] 0 2024-09-20T19:06:11.984 INFO:tasks.workunit.client.0.smithi027.stdout:8/949: chown d2/d3/d6/d21/d80/ccd 251934812 1 2024-09-20T19:06:11.986 INFO:tasks.workunit.client.1.smithi098.stdout:4/929: truncate d3/d6/d5b/fb1 785191 0 2024-09-20T19:06:11.987 INFO:tasks.workunit.client.0.smithi027.stdout:2/932: symlink d3/de/d109/l135 0 2024-09-20T19:06:11.988 INFO:tasks.workunit.client.0.smithi027.stdout:2/933: chown d3/d13/d3c/dce/fe0 0 1 2024-09-20T19:06:11.989 INFO:tasks.workunit.client.0.smithi027.stdout:2/934: dread - d3/d1c/d31/d9e/fcd zero size 2024-09-20T19:06:11.992 INFO:tasks.workunit.client.0.smithi027.stdout:9/997: creat d0/f150 x:0 0 0 2024-09-20T19:06:11.993 INFO:tasks.workunit.client.1.smithi098.stdout:0/603: mkdir d0/d7d/db4 0 2024-09-20T19:06:11.994 INFO:tasks.workunit.client.1.smithi098.stdout:8/859: dwrite d7/de/d11/d1d/d110/d11a/f9a [0,4194304] 0 2024-09-20T19:06:11.995 INFO:tasks.workunit.client.0.smithi027.stdout:0/970: stat d2/d48/d6b/d79/d84/d1b/cbe 0 2024-09-20T19:06:11.997 INFO:tasks.workunit.client.0.smithi027.stdout:2/935: dwrite d3/d1c/fe1 [0,4194304] 0 2024-09-20T19:06:12.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/921: mkdir d3/d10/d16/d17/d33/d1f/d28/d66/ddf/d12c 0 2024-09-20T19:06:12.005 INFO:tasks.workunit.client.0.smithi027.stdout:8/950: creat d2/d2a/df8/d36/d115/f145 x:0 0 0 2024-09-20T19:06:12.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/922: stat d3/d10/d16/d17/d33 0 2024-09-20T19:06:12.008 INFO:tasks.workunit.client.0.smithi027.stdout:5/999: creat d4/da/de/d3e/d69/d6a/d9e/f146 x:0 0 0 2024-09-20T19:06:12.009 INFO:tasks.workunit.client.1.smithi098.stdout:9/877: mkdir d4/de/d27/d88/d122 0 2024-09-20T19:06:12.010 INFO:tasks.workunit.client.1.smithi098.stdout:9/878: write d4/de/d24/d35/f43 [1322276,115835] 0 2024-09-20T19:06:12.013 INFO:tasks.workunit.client.0.smithi027.stdout:8/951: dwrite d2/d3/d11d/f4f [0,4194304] 0 2024-09-20T19:06:12.013 INFO:tasks.workunit.client.1.smithi098.stdout:1/749: creat d1/ff4 x:0 0 0 2024-09-20T19:06:12.014 INFO:tasks.workunit.client.1.smithi098.stdout:9/879: write d4/de/d27/d4a/fd4 [586589,104704] 0 2024-09-20T19:06:12.017 INFO:tasks.workunit.client.0.smithi027.stdout:2/936: unlink d3/d13/d3c/d48/dba/fcb 0 2024-09-20T19:06:12.018 INFO:tasks.workunit.client.0.smithi027.stdout:8/952: read d2/d3/d6/d21/f38 [1035638,64484] 0 2024-09-20T19:06:12.020 INFO:tasks.workunit.client.1.smithi098.stdout:0/604: mkdir d0/db/d7f/db5 0 2024-09-20T19:06:12.023 INFO:tasks.workunit.client.1.smithi098.stdout:7/923: fdatasync d3/d10/d16/d17/d7c/d11d/f128 0 2024-09-20T19:06:12.024 INFO:tasks.workunit.client.1.smithi098.stdout:7/924: chown d3/d10/d16/d17/d33/d37/da0/lae 160057991 1 2024-09-20T19:06:12.025 INFO:tasks.workunit.client.0.smithi027.stdout:8/953: dread d2/d3/d6/d21/d33/d79/dcf/fe7 [0,4194304] 0 2024-09-20T19:06:12.030 INFO:tasks.workunit.client.0.smithi027.stdout:4/893: write d5/d13/fa4 [1456726,5262] 0 2024-09-20T19:06:12.033 INFO:tasks.workunit.client.0.smithi027.stdout:8/954: rmdir d2/d14/d13/db5/d125 39 2024-09-20T19:06:12.037 INFO:tasks.workunit.client.1.smithi098.stdout:4/930: link d3/dfb/f122 d3/d6/d8c/de7/df4/d1e/d2a/d45/f135 0 2024-09-20T19:06:12.038 INFO:tasks.workunit.client.0.smithi027.stdout:4/894: dwrite d5/d13/d36/f7b [0,4194304] 0 2024-09-20T19:06:12.038 INFO:tasks.workunit.client.1.smithi098.stdout:8/860: dread d7/de/d11/d1f/d9c/f9e [0,4194304] 0 2024-09-20T19:06:12.039 INFO:tasks.workunit.client.0.smithi027.stdout:4/895: write d5/d11/d3d/d6e/ffa [225499,127144] 0 2024-09-20T19:06:12.040 INFO:tasks.workunit.client.1.smithi098.stdout:4/931: write d3/d6/d8c/f121 [649140,56162] 0 2024-09-20T19:06:12.041 INFO:tasks.workunit.client.0.smithi027.stdout:4/896: chown d5/d13/d36/d48/d9f/dc9/d8f 11423 1 2024-09-20T19:06:12.048 INFO:tasks.workunit.client.0.smithi027.stdout:8/955: mkdir d2/d14/d13/d146 0 2024-09-20T19:06:12.048 INFO:tasks.workunit.client.1.smithi098.stdout:3/806: dwrite d4/d19/d1d/d2f/d3e/dbb/fbc [0,4194304] 0 2024-09-20T19:06:12.048 INFO:tasks.workunit.client.0.smithi027.stdout:9/998: dwrite d0/d9/df/d1c/d6a/d6d/f68 [0,4194304] 0 2024-09-20T19:06:12.049 INFO:tasks.workunit.client.1.smithi098.stdout:8/861: read d7/de/d11/d1d/f81 [2400294,127507] 0 2024-09-20T19:06:12.049 INFO:tasks.workunit.client.0.smithi027.stdout:0/971: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f61 [0,4194304] 0 2024-09-20T19:06:12.050 INFO:tasks.workunit.client.0.smithi027.stdout:8/956: chown d2/d14/d13/d72/l112 232 1 2024-09-20T19:06:12.051 INFO:tasks.workunit.client.1.smithi098.stdout:1/750: getdents d1/dda 0 2024-09-20T19:06:12.051 INFO:tasks.workunit.client.1.smithi098.stdout:5/665: dwrite d1/d46/d69/f8f [0,4194304] 0 2024-09-20T19:06:12.052 INFO:tasks.workunit.client.0.smithi027.stdout:0/972: chown d2/d48/d6b/d79/fac 14615414 1 2024-09-20T19:06:12.052 INFO:tasks.workunit.client.0.smithi027.stdout:4/897: fdatasync d5/d11/d1a/d2a/fc2 0 2024-09-20T19:06:12.052 INFO:tasks.workunit.client.1.smithi098.stdout:3/807: stat d4/d38/d48/d60/f6b 0 2024-09-20T19:06:12.056 INFO:tasks.workunit.client.1.smithi098.stdout:1/751: chown d1/d3/df/cb4 318 1 2024-09-20T19:06:12.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/862: chown d7/de/d11/d1d/d110/d11a/db6/d11d 41 1 2024-09-20T19:06:12.059 INFO:tasks.workunit.client.1.smithi098.stdout:0/605: mknod d0/d6/d28/d31/d45/d60/d78/cb6 0 2024-09-20T19:06:12.060 INFO:tasks.workunit.client.0.smithi027.stdout:2/937: write d3/d13/d3c/d48/d6a/f8e [245598,108404] 0 2024-09-20T19:06:12.061 INFO:tasks.workunit.client.1.smithi098.stdout:7/925: chown d3/d10/d16/d17/d33/d1f/d2d/f3b 2 1 2024-09-20T19:06:12.062 INFO:tasks.workunit.client.0.smithi027.stdout:4/898: dwrite d5/d13/d16/f79 [0,4194304] 0 2024-09-20T19:06:12.063 INFO:tasks.workunit.client.1.smithi098.stdout:9/880: write d4/de/d27/d4a/d21/fb3 [1717133,112164] 0 2024-09-20T19:06:12.063 INFO:tasks.workunit.client.0.smithi027.stdout:2/938: chown d3/d24/c94 1144 1 2024-09-20T19:06:12.064 INFO:tasks.workunit.client.0.smithi027.stdout:4/899: chown d5/d11/d3d 0 1 2024-09-20T19:06:12.069 INFO:tasks.workunit.client.1.smithi098.stdout:7/926: readlink d3/d10/d16/d17/d7c/lb7 0 2024-09-20T19:06:12.069 INFO:tasks.workunit.client.0.smithi027.stdout:2/939: write d3/de/d34/f76 [2662243,19687] 0 2024-09-20T19:06:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:11 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:11 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:11 smithi027 ceph-mon[28196]: pgmap v14: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 141 MiB/s rd, 341 MiB/s wr, 702 op/s 2024-09-20T19:06:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:11 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:11 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.072 INFO:tasks.workunit.client.1.smithi098.stdout:5/666: dwrite d1/d17/d35/f80 [0,4194304] 0 2024-09-20T19:06:12.072 INFO:tasks.workunit.client.1.smithi098.stdout:1/752: creat d1/d3/df/d34/d43/d65/ff5 x:0 0 0 2024-09-20T19:06:12.074 INFO:tasks.workunit.client.0.smithi027.stdout:2/940: dread d3/d13/f87 [0,4194304] 0 2024-09-20T19:06:12.076 INFO:tasks.workunit.client.1.smithi098.stdout:1/753: fsync d1/d3/d2e/d68/d7a/da1/fbd 0 2024-09-20T19:06:12.076 INFO:tasks.workunit.client.1.smithi098.stdout:9/881: symlink d4/de/d27/d4a/d58/d5b/d8f/dd5/l123 0 2024-09-20T19:06:12.076 INFO:tasks.workunit.client.1.smithi098.stdout:8/863: creat d7/de/dbb/f129 x:0 0 0 2024-09-20T19:06:12.077 INFO:tasks.workunit.client.1.smithi098.stdout:0/606: mknod d0/d6/d28/d31/d69/d9b/cb7 0 2024-09-20T19:06:12.077 INFO:tasks.workunit.client.0.smithi027.stdout:4/900: mknod d5/d9b/db0/d10a/c117 0 2024-09-20T19:06:12.079 INFO:tasks.workunit.client.1.smithi098.stdout:3/808: mknod d4/d19/d1d/d2f/d4e/d59/cfa 0 2024-09-20T19:06:12.079 INFO:tasks.workunit.client.1.smithi098.stdout:8/864: chown d7/de/d11/d1f/c22 0 1 2024-09-20T19:06:12.081 INFO:tasks.workunit.client.0.smithi027.stdout:2/941: read d3/d1c/d26/d2a/f85 [737194,34247] 0 2024-09-20T19:06:12.081 INFO:tasks.workunit.client.1.smithi098.stdout:7/927: rmdir d3/d76/db8/da6 39 2024-09-20T19:06:12.086 INFO:tasks.workunit.client.1.smithi098.stdout:7/928: write d3/d4c/fff [403508,78196] 0 2024-09-20T19:06:12.087 INFO:tasks.workunit.client.0.smithi027.stdout:4/901: unlink d5/d13/d36/d48/d3f/fbf 0 2024-09-20T19:06:12.088 INFO:tasks.workunit.client.0.smithi027.stdout:9/999: write d0/d97/fa3 [580018,106086] 0 2024-09-20T19:06:12.090 INFO:tasks.workunit.client.1.smithi098.stdout:9/882: mknod d4/d74/d8a/d94/c124 0 2024-09-20T19:06:12.092 INFO:tasks.workunit.client.0.smithi027.stdout:2/942: creat d3/d13/d3c/d48/dba/f136 x:0 0 0 2024-09-20T19:06:12.093 INFO:tasks.workunit.client.0.smithi027.stdout:4/902: dwrite d5/d13/ff4 [0,4194304] 0 2024-09-20T19:06:12.095 INFO:tasks.workunit.client.1.smithi098.stdout:8/865: dwrite d7/dd2/f115 [0,4194304] 0 2024-09-20T19:06:12.099 INFO:tasks.workunit.client.0.smithi027.stdout:4/903: truncate d5/d11/d17/fb3 60628 0 2024-09-20T19:06:12.099 INFO:tasks.workunit.client.1.smithi098.stdout:5/667: dwrite d1/d17/d35/d93/f9e [0,4194304] 0 2024-09-20T19:06:12.102 INFO:tasks.workunit.client.1.smithi098.stdout:7/929: chown d3/d10/d16/d17/d33/d37/lca 0 1 2024-09-20T19:06:12.107 INFO:tasks.workunit.client.0.smithi027.stdout:0/973: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/f54 [4194304,4194304] 0 2024-09-20T19:06:12.108 INFO:tasks.workunit.client.1.smithi098.stdout:1/754: dwrite d1/f55 [0,4194304] 0 2024-09-20T19:06:12.113 INFO:tasks.workunit.client.0.smithi027.stdout:0/974: rename d2/d48/d6b/d79/d9f/da4/de6/f127 to d2/d20/f151 0 2024-09-20T19:06:12.114 INFO:tasks.workunit.client.0.smithi027.stdout:8/957: write d2/d14/d13/d43/f49 [1216609,73819] 0 2024-09-20T19:06:12.115 INFO:tasks.workunit.client.0.smithi027.stdout:8/958: stat d2/d3/d6/d21/d33/d79/d9f/fea 0 2024-09-20T19:06:12.118 INFO:tasks.workunit.client.0.smithi027.stdout:0/975: fdatasync d2/f19 0 2024-09-20T19:06:12.118 INFO:tasks.workunit.client.1.smithi098.stdout:9/883: getdents d4/de 0 2024-09-20T19:06:12.121 INFO:tasks.workunit.client.1.smithi098.stdout:3/809: dwrite d4/d38/d48/d60/f74 [0,4194304] 0 2024-09-20T19:06:12.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/607: dwrite d0/d55/d67/f68 [0,4194304] 0 2024-09-20T19:06:12.130 INFO:tasks.workunit.client.1.smithi098.stdout:1/755: rmdir d1/d3/df 39 2024-09-20T19:06:12.131 INFO:tasks.workunit.client.0.smithi027.stdout:0/976: unlink d2/d48/d6b/d79/d84/f31 0 2024-09-20T19:06:12.131 INFO:tasks.workunit.client.1.smithi098.stdout:4/932: dwrite d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/fdf [0,4194304] 0 2024-09-20T19:06:12.133 INFO:tasks.workunit.client.0.smithi027.stdout:6/951: sync 2024-09-20T19:06:12.133 INFO:tasks.workunit.client.0.smithi027.stdout:7/868: sync 2024-09-20T19:06:12.133 INFO:tasks.workunit.client.0.smithi027.stdout:1/925: sync 2024-09-20T19:06:12.134 INFO:tasks.workunit.client.0.smithi027.stdout:2/943: write d3/d1c/d26/df2/df6/fbc [309413,99290] 0 2024-09-20T19:06:12.135 INFO:tasks.workunit.client.1.smithi098.stdout:8/866: dwrite d7/de/d11/dca/f10e [0,4194304] 0 2024-09-20T19:06:12.135 INFO:tasks.workunit.client.1.smithi098.stdout:5/668: rename d1/d17/d35/f41 to d1/d17/d25/d79/dbc/fcd 0 2024-09-20T19:06:12.135 INFO:tasks.workunit.client.0.smithi027.stdout:3/972: sync 2024-09-20T19:06:12.135 INFO:tasks.workunit.client.0.smithi027.stdout:7/869: readlink d3/l7 0 2024-09-20T19:06:12.136 INFO:tasks.workunit.client.0.smithi027.stdout:6/952: write d4/d15/f2f [810621,41551] 0 2024-09-20T19:06:12.136 INFO:tasks.workunit.client.0.smithi027.stdout:8/959: creat d2/d3/d6/d6d/d75/d13a/f147 x:0 0 0 2024-09-20T19:06:12.137 INFO:tasks.workunit.client.0.smithi027.stdout:1/926: dread - d2/d8/d74/f119 zero size 2024-09-20T19:06:12.137 INFO:tasks.workunit.client.1.smithi098.stdout:4/933: stat d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/d71/d11a 0 2024-09-20T19:06:12.138 INFO:tasks.workunit.client.0.smithi027.stdout:0/977: creat d2/da2/f152 x:0 0 0 2024-09-20T19:06:12.139 INFO:tasks.workunit.client.1.smithi098.stdout:9/884: dread d4/de/d24/d35/dc4/fcc [0,4194304] 0 2024-09-20T19:06:12.142 INFO:tasks.workunit.client.1.smithi098.stdout:0/608: creat d0/d6/d28/d31/d69/d77/fb8 x:0 0 0 2024-09-20T19:06:12.142 INFO:tasks.workunit.client.1.smithi098.stdout:4/934: chown d3/d6/d8c/de7/df4/d57/l134 2 1 2024-09-20T19:06:12.146 INFO:tasks.workunit.client.0.smithi027.stdout:1/927: symlink d2/d8/d3b/d82/d90/d108/l130 0 2024-09-20T19:06:12.148 INFO:tasks.workunit.client.0.smithi027.stdout:6/953: write d4/d6/d4b/fc2 [771735,102034] 0 2024-09-20T19:06:12.148 INFO:tasks.workunit.client.0.smithi027.stdout:4/904: write d5/d11/d17/d1b/d8d/f33 [14640,24035] 0 2024-09-20T19:06:12.149 INFO:tasks.workunit.client.1.smithi098.stdout:1/756: chown d1/d3/df/d4a/fa8 295276 1 2024-09-20T19:06:12.149 INFO:tasks.workunit.client.0.smithi027.stdout:0/978: dwrite d2/d20/fd3 [0,4194304] 0 2024-09-20T19:06:12.150 INFO:tasks.workunit.client.1.smithi098.stdout:3/810: rename d4/d19/d1d/fed to d4/d38/d97/ffb 0 2024-09-20T19:06:12.153 INFO:tasks.workunit.client.0.smithi027.stdout:2/944: dwrite d3/d24/d89/fff [0,4194304] 0 2024-09-20T19:06:12.153 INFO:tasks.workunit.client.1.smithi098.stdout:4/935: chown d3/d6/f34 6 1 2024-09-20T19:06:12.154 INFO:tasks.workunit.client.1.smithi098.stdout:9/885: symlink d4/de/d27/d4a/d58/d5b/l125 0 2024-09-20T19:06:12.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/867: dread - d7/de/d11/d19/d30/d59/d80/fa1 zero size 2024-09-20T19:06:12.158 INFO:tasks.workunit.client.1.smithi098.stdout:0/609: creat d0/d6/d28/d31/d69/d77/fb9 x:0 0 0 2024-09-20T19:06:12.160 INFO:tasks.workunit.client.1.smithi098.stdout:5/669: dwrite d1/d1b/f7e [8388608,4194304] 0 2024-09-20T19:06:12.161 INFO:tasks.workunit.client.0.smithi027.stdout:6/954: mknod d4/d9c/c141 0 2024-09-20T19:06:12.162 INFO:tasks.workunit.client.1.smithi098.stdout:8/868: fdatasync d7/de/d11/d19/d30/d59/d80/f8a 0 2024-09-20T19:06:12.163 INFO:tasks.workunit.client.1.smithi098.stdout:8/869: fsync d7/f3a 0 2024-09-20T19:06:12.165 INFO:tasks.workunit.client.0.smithi027.stdout:7/870: rename d3/d8/d26/d45/d56/dec/d2e/d39/d102/ffd to d3/d8/d26/d45/d56/dec/d2e/f123 0 2024-09-20T19:06:12.165 INFO:tasks.workunit.client.1.smithi098.stdout:1/757: mknod d1/d3/df/d34/d43/dad/cf6 0 2024-09-20T19:06:12.168 INFO:tasks.workunit.client.0.smithi027.stdout:7/871: truncate d3/d8/d26/d45/d56/dec/d2e/d39/f10c 21007 0 2024-09-20T19:06:12.168 INFO:tasks.workunit.client.0.smithi027.stdout:2/945: mkdir d3/d1c/d31/d9e/d137 0 2024-09-20T19:06:12.169 INFO:tasks.workunit.client.0.smithi027.stdout:2/946: stat d3/d13/d3c/d48/dad/cd5 0 2024-09-20T19:06:12.171 INFO:tasks.workunit.client.1.smithi098.stdout:0/610: symlink d0/d6/d28/d31/d45/lba 0 2024-09-20T19:06:12.174 INFO:tasks.workunit.client.1.smithi098.stdout:5/670: creat d1/d17/d35/d54/dab/fce x:0 0 0 2024-09-20T19:06:12.175 INFO:tasks.workunit.client.1.smithi098.stdout:4/936: dwrite d3/d7d/f85 [0,4194304] 0 2024-09-20T19:06:12.176 INFO:tasks.workunit.client.1.smithi098.stdout:4/937: stat d3/d6/faf 0 2024-09-20T19:06:12.177 INFO:tasks.workunit.client.1.smithi098.stdout:8/870: mkdir d7/de/d11/d19/d47/d12a 0 2024-09-20T19:06:12.177 INFO:tasks.workunit.client.1.smithi098.stdout:5/671: write d1/d1b/f7e [4338619,98557] 0 2024-09-20T19:06:12.179 INFO:tasks.workunit.client.1.smithi098.stdout:4/938: chown d3/d6/d8c/de7/d124/d6b/d73/d98/lff 4 1 2024-09-20T19:06:12.180 INFO:tasks.workunit.client.1.smithi098.stdout:6/598: sync 2024-09-20T19:06:12.180 INFO:tasks.workunit.client.0.smithi027.stdout:0/979: rename d2/d20 to d2/d49/ded/d12f/d153 0 2024-09-20T19:06:12.183 INFO:tasks.workunit.client.0.smithi027.stdout:7/872: unlink d3/d8/d26/d45/d56/dec/f13 0 2024-09-20T19:06:12.184 INFO:tasks.workunit.client.0.smithi027.stdout:2/947: mknod d3/d1c/d26/d2a/c138 0 2024-09-20T19:06:12.189 INFO:tasks.workunit.client.0.smithi027.stdout:0/980: rename d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/fd0 to d2/d119/f154 0 2024-09-20T19:06:12.190 INFO:tasks.workunit.client.1.smithi098.stdout:0/611: dwrite d0/db/f14 [0,4194304] 0 2024-09-20T19:06:12.191 INFO:tasks.workunit.client.1.smithi098.stdout:5/672: symlink d1/d17/d35/d54/lcf 0 2024-09-20T19:06:12.191 INFO:tasks.workunit.client.0.smithi027.stdout:7/873: dwrite d3/d8/d26/d45/f52 [4194304,4194304] 0 2024-09-20T19:06:12.191 INFO:tasks.workunit.client.0.smithi027.stdout:0/981: chown d2/d48/c83 3 1 2024-09-20T19:06:12.192 INFO:tasks.workunit.client.0.smithi027.stdout:6/955: creat d4/d6/d4b/f142 x:0 0 0 2024-09-20T19:06:12.192 INFO:tasks.workunit.client.1.smithi098.stdout:3/811: getdents d4/d25 0 2024-09-20T19:06:12.193 INFO:tasks.workunit.client.0.smithi027.stdout:2/948: symlink d3/de/d34/l139 0 2024-09-20T19:06:12.203 INFO:tasks.workunit.client.0.smithi027.stdout:3/973: write d0/d19/f57 [265841,55200] 0 2024-09-20T19:06:12.204 INFO:tasks.workunit.client.0.smithi027.stdout:7/874: mknod d3/d8/d26/d65/c124 0 2024-09-20T19:06:12.205 INFO:tasks.workunit.client.1.smithi098.stdout:3/812: dwrite d4/d38/d39/f88 [0,4194304] 0 2024-09-20T19:06:12.206 INFO:tasks.workunit.client.1.smithi098.stdout:7/930: dwrite d3/d10/d16/d17/d33/d1f/f3c [0,4194304] 0 2024-09-20T19:06:12.207 INFO:tasks.workunit.client.1.smithi098.stdout:8/871: unlink d7/de/d11/f58 0 2024-09-20T19:06:12.208 INFO:tasks.workunit.client.0.smithi027.stdout:0/982: mknod d2/d48/d6b/d79/d84/d1b/d39/dc7/c155 0 2024-09-20T19:06:12.209 INFO:tasks.workunit.client.1.smithi098.stdout:8/872: chown d7/de/d11/d19/d30/d68/lc8 10227 1 2024-09-20T19:06:12.211 INFO:tasks.workunit.client.1.smithi098.stdout:5/673: truncate d1/d17/d35/d54/f62 346954 0 2024-09-20T19:06:12.214 INFO:tasks.workunit.client.1.smithi098.stdout:0/612: truncate d0/d6/d19/f33 1169263 0 2024-09-20T19:06:12.214 INFO:tasks.workunit.client.0.smithi027.stdout:6/956: creat d4/d15/d37/d7a/d46/de7/f143 x:0 0 0 2024-09-20T19:06:12.216 INFO:tasks.workunit.client.1.smithi098.stdout:0/613: write d0/d55/f76 [37794,109611] 0 2024-09-20T19:06:12.216 INFO:tasks.workunit.client.0.smithi027.stdout:2/949: rename d3/de/d34/cbb to d3/d24/c13a 0 2024-09-20T19:06:12.217 INFO:tasks.workunit.client.1.smithi098.stdout:0/614: stat d0/d7d/db4 0 2024-09-20T19:06:12.218 INFO:tasks.workunit.client.1.smithi098.stdout:6/599: truncate d0/d55/d82/da3/d43/f5e 1983739 0 2024-09-20T19:06:12.219 INFO:tasks.workunit.client.0.smithi027.stdout:1/928: write d2/d8/d41/f43 [1355223,63993] 0 2024-09-20T19:06:12.220 INFO:tasks.workunit.client.1.smithi098.stdout:1/758: rename d1/d3/df/d34/d43/dad to d1/d3/df/d34/d52/d77/df7 0 2024-09-20T19:06:12.221 INFO:tasks.workunit.client.0.smithi027.stdout:6/957: chown d4/d15/d37/d5a/d78/dbc/c126 6350500 1 2024-09-20T19:06:12.222 INFO:tasks.workunit.client.1.smithi098.stdout:6/600: dread - d0/d55/d82/da3/d43/d6d/f92 zero size 2024-09-20T19:06:12.223 INFO:tasks.workunit.client.0.smithi027.stdout:7/875: mknod d3/d8/d26/d65/c125 0 2024-09-20T19:06:12.224 INFO:tasks.workunit.client.0.smithi027.stdout:8/960: dwrite d2/d2a/df8/f9c [0,4194304] 0 2024-09-20T19:06:12.225 INFO:tasks.workunit.client.0.smithi027.stdout:6/958: write d4/d15/d2c/dcb/f115 [1017508,64126] 0 2024-09-20T19:06:12.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:11 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:11 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:11 smithi098 ceph-mon[35737]: pgmap v14: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 141 MiB/s rd, 341 MiB/s wr, 702 op/s 2024-09-20T19:06:12.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:11 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:11 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:12.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/886: write d4/de/d27/d4a/d21/d25/f30 [154913,80370] 0 2024-09-20T19:06:12.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/615: dread d0/db/f14 [0,4194304] 0 2024-09-20T19:06:12.228 INFO:tasks.workunit.client.0.smithi027.stdout:6/959: chown d4/lc 21439824 1 2024-09-20T19:06:12.230 INFO:tasks.workunit.client.1.smithi098.stdout:0/616: fsync d0/db/d1d/f34 0 2024-09-20T19:06:12.231 INFO:tasks.workunit.client.0.smithi027.stdout:4/905: dwrite d5/d11/d17/f115 [0,4194304] 0 2024-09-20T19:06:12.237 INFO:tasks.workunit.client.1.smithi098.stdout:7/931: symlink d3/d10/d16/d17/d33/d1f/dba/d126/l12d 0 2024-09-20T19:06:12.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/617: dwrite d0/d6/d28/d31/d69/d77/fb8 [0,4194304] 0 2024-09-20T19:06:12.244 INFO:tasks.workunit.client.0.smithi027.stdout:8/961: rmdir d2/d3/d6/d9e 39 2024-09-20T19:06:12.247 INFO:tasks.workunit.client.0.smithi027.stdout:7/876: creat d3/d8/d26/d45/d56/dec/d2e/d39/d116/f126 x:0 0 0 2024-09-20T19:06:12.248 INFO:tasks.workunit.client.0.smithi027.stdout:3/974: dread d0/d12d/d3c/f62 [4194304,4194304] 0 2024-09-20T19:06:12.249 INFO:tasks.workunit.client.0.smithi027.stdout:0/983: dread d2/d49/ded/d12f/d153/fd6 [0,4194304] 0 2024-09-20T19:06:12.250 INFO:tasks.workunit.client.0.smithi027.stdout:3/975: fdatasync d0/d19/d54/f67 0 2024-09-20T19:06:12.251 INFO:tasks.workunit.client.1.smithi098.stdout:8/873: rename d7/de/d11/d19/d47/f99 to d7/de/d11/d1f/d10a/f12b 0 2024-09-20T19:06:12.258 INFO:tasks.workunit.client.1.smithi098.stdout:0/618: dread d0/d6/d28/f5c [0,4194304] 0 2024-09-20T19:06:12.259 INFO:tasks.workunit.client.1.smithi098.stdout:0/619: chown d0/db/d7f/db5 658932 1 2024-09-20T19:06:12.260 INFO:tasks.workunit.client.1.smithi098.stdout:6/601: dread d0/d55/d82/da3/d44/f13 [4194304,4194304] 0 2024-09-20T19:06:12.260 INFO:tasks.workunit.client.1.smithi098.stdout:0/620: chown d0/d6/fe 8419 1 2024-09-20T19:06:12.262 INFO:tasks.workunit.client.0.smithi027.stdout:2/950: dread d3/de/f1a [0,4194304] 0 2024-09-20T19:06:12.263 INFO:tasks.workunit.client.0.smithi027.stdout:2/951: chown d3/de/d34/f76 5683 1 2024-09-20T19:06:12.321 INFO:tasks.workunit.client.1.smithi098.stdout:9/887: creat d4/de/d24/d35/d6d/f126 x:0 0 0 2024-09-20T19:06:12.323 INFO:tasks.workunit.client.0.smithi027.stdout:4/906: mkdir d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/d118 0 2024-09-20T19:06:12.324 INFO:tasks.workunit.client.0.smithi027.stdout:4/907: write d5/d13/d16/f79 [1571524,41538] 0 2024-09-20T19:06:12.329 INFO:tasks.workunit.client.1.smithi098.stdout:9/888: dwrite d4/de/d27/d4a/d58/d5b/d8f/dd5/f11a [0,4194304] 0 2024-09-20T19:06:12.340 INFO:tasks.workunit.client.1.smithi098.stdout:7/932: unlink d3/d10/d16/d17/d33/d37/l89 0 2024-09-20T19:06:12.342 INFO:tasks.workunit.client.0.smithi027.stdout:3/976: read d0/d12d/d15/d55/f96 [198328,125589] 0 2024-09-20T19:06:12.344 INFO:tasks.workunit.client.1.smithi098.stdout:4/939: truncate d3/d5e/d9f/fb7 171871 0 2024-09-20T19:06:12.349 INFO:tasks.workunit.client.0.smithi027.stdout:4/908: mkdir d5/d11/d17/d1b/dd4/d119 0 2024-09-20T19:06:12.350 INFO:tasks.workunit.client.0.smithi027.stdout:3/977: dwrite d0/d1/d5e/d1d/fb5 [0,4194304] 0 2024-09-20T19:06:12.352 INFO:tasks.workunit.client.0.smithi027.stdout:1/929: write d2/d8/d3b/fba [736318,80507] 0 2024-09-20T19:06:12.353 INFO:tasks.workunit.client.1.smithi098.stdout:3/813: dwrite d4/da/d7a/ff2 [0,4194304] 0 2024-09-20T19:06:12.355 INFO:tasks.workunit.client.0.smithi027.stdout:1/930: chown d2/d61/df8/dde/ff5 2009418637 1 2024-09-20T19:06:12.358 INFO:tasks.workunit.client.0.smithi027.stdout:6/960: link d4/d15/d2c/l121 d4/d15/d37/d5a/d78/dbc/l144 0 2024-09-20T19:06:12.358 INFO:tasks.workunit.client.1.smithi098.stdout:1/759: write d1/d3/df/d34/d52/f5b [5089733,38936] 0 2024-09-20T19:06:12.360 INFO:tasks.workunit.client.1.smithi098.stdout:3/814: read d4/d25/f2b [3128677,103391] 0 2024-09-20T19:06:12.365 INFO:tasks.workunit.client.0.smithi027.stdout:4/909: dwrite d5/d11/d17/d1b/dd4/f10e [0,4194304] 0 2024-09-20T19:06:12.372 INFO:tasks.workunit.client.0.smithi027.stdout:6/961: write d4/d15/d2c/dcb/fcf [970301,99521] 0 2024-09-20T19:06:12.376 INFO:tasks.workunit.client.1.smithi098.stdout:3/815: dread d4/d25/d40/f58 [0,4194304] 0 2024-09-20T19:06:12.377 INFO:tasks.workunit.client.1.smithi098.stdout:3/816: chown d4/d19/l42 194283111 1 2024-09-20T19:06:12.405 INFO:tasks.workunit.client.1.smithi098.stdout:3/817: dread d4/d25/f2b [0,4194304] 0 2024-09-20T19:06:12.406 INFO:tasks.workunit.client.1.smithi098.stdout:3/818: readlink d4/d19/d1d/d2f/d4e/la8 0 2024-09-20T19:06:12.408 INFO:tasks.workunit.client.1.smithi098.stdout:3/819: write d4/d19/d1d/d22/dc5/fc6 [574576,60641] 0 2024-09-20T19:06:12.409 INFO:tasks.workunit.client.1.smithi098.stdout:3/820: dread - d4/d19/d1d/d2f/d4e/da3/fef zero size 2024-09-20T19:06:12.410 INFO:tasks.workunit.client.1.smithi098.stdout:3/821: fdatasync d4/d19/d1d/d2f/fd8 0 2024-09-20T19:06:12.417 INFO:tasks.workunit.client.1.smithi098.stdout:9/889: mkdir d4/de/d27/dbf/d127 0 2024-09-20T19:06:12.419 INFO:tasks.workunit.client.1.smithi098.stdout:4/940: fsync d3/d6/d8c/de7/d124/fd1 0 2024-09-20T19:06:12.426 INFO:tasks.workunit.client.1.smithi098.stdout:3/822: fdatasync d4/da/d7a/fc9 0 2024-09-20T19:06:12.428 INFO:tasks.workunit.client.1.smithi098.stdout:6/602: creat d0/d55/d82/da3/d44/dc/da7/fb8 x:0 0 0 2024-09-20T19:06:12.432 INFO:tasks.workunit.client.1.smithi098.stdout:6/603: dread d0/de/f56 [0,4194304] 0 2024-09-20T19:06:12.451 INFO:tasks.workunit.client.1.smithi098.stdout:4/941: fdatasync d3/d7d/fad 0 2024-09-20T19:06:12.457 INFO:tasks.workunit.client.1.smithi098.stdout:9/890: link d4/de/d24/d35/dc4/fcc d4/de/d48/de8/d10e/f128 0 2024-09-20T19:06:12.459 INFO:tasks.workunit.client.1.smithi098.stdout:9/891: write d4/de/fe5 [1191854,123619] 0 2024-09-20T19:06:12.460 INFO:tasks.workunit.client.1.smithi098.stdout:9/892: stat d4/de/d27/d6c/d73/db5/c115 0 2024-09-20T19:06:12.461 INFO:tasks.workunit.client.1.smithi098.stdout:9/893: readlink d4/de/d27/d4a/d21/d25/l91 0 2024-09-20T19:06:12.467 INFO:tasks.workunit.client.1.smithi098.stdout:6/604: link d0/d55/d82/da3/l73 d0/d55/lb9 0 2024-09-20T19:06:12.468 INFO:tasks.workunit.client.1.smithi098.stdout:6/605: readlink d0/de/d1b/l91 0 2024-09-20T19:06:12.472 INFO:tasks.workunit.client.1.smithi098.stdout:6/606: mknod d0/d55/d82/da3/d8c/d9a/cba 0 2024-09-20T19:06:12.476 INFO:tasks.workunit.client.1.smithi098.stdout:6/607: mkdir d0/d55/d82/da3/d44/d24/d29/d2b/d66/d81/dbb 0 2024-09-20T19:06:12.485 INFO:tasks.workunit.client.1.smithi098.stdout:6/608: creat d0/d55/d82/da3/d43/da8/fbc x:0 0 0 2024-09-20T19:06:12.494 INFO:tasks.workunit.client.0.smithi027.stdout:4/910: unlink d5/d11/d17/d1b/d8d/le8 0 2024-09-20T19:06:12.503 INFO:tasks.workunit.client.0.smithi027.stdout:4/911: mknod d5/d11/d1a/d2a/da3/de2/c11a 0 2024-09-20T19:06:12.512 INFO:tasks.workunit.client.0.smithi027.stdout:8/962: write d2/d14/f27 [4172573,33469] 0 2024-09-20T19:06:12.519 INFO:tasks.workunit.client.1.smithi098.stdout:0/621: dwrite d0/d6/d28/d31/d69/d77/fb8 [4194304,4194304] 0 2024-09-20T19:06:12.520 INFO:tasks.workunit.client.0.smithi027.stdout:8/963: dwrite d2/d3/d6/d21/d33/f5a [4194304,4194304] 0 2024-09-20T19:06:12.521 INFO:tasks.workunit.client.1.smithi098.stdout:0/622: truncate d0/d55/f76 668230 0 2024-09-20T19:06:12.524 INFO:tasks.workunit.client.0.smithi027.stdout:8/964: fdatasync d2/d3/d11d/f3c 0 2024-09-20T19:06:12.525 INFO:tasks.workunit.client.1.smithi098.stdout:0/623: mknod d0/d6/d19/cbb 0 2024-09-20T19:06:12.526 INFO:tasks.workunit.client.1.smithi098.stdout:5/674: truncate d1/d1b/f6f 187575 0 2024-09-20T19:06:12.529 INFO:tasks.workunit.client.1.smithi098.stdout:5/675: creat d1/d46/d69/d84/fd0 x:0 0 0 2024-09-20T19:06:12.530 INFO:tasks.workunit.client.1.smithi098.stdout:5/676: stat d1/d71/d98/f9c 0 2024-09-20T19:06:12.531 INFO:tasks.workunit.client.1.smithi098.stdout:5/677: write d1/d1b/f26 [1420988,41911] 0 2024-09-20T19:06:12.532 INFO:tasks.workunit.client.1.smithi098.stdout:5/678: fdatasync d1/d71/d98/f9c 0 2024-09-20T19:06:12.539 INFO:tasks.workunit.client.1.smithi098.stdout:8/874: dwrite d7/de/dbb/fdb [0,4194304] 0 2024-09-20T19:06:12.550 INFO:tasks.workunit.client.1.smithi098.stdout:8/875: getdents d7/dd2 0 2024-09-20T19:06:12.552 INFO:tasks.workunit.client.0.smithi027.stdout:3/978: sync 2024-09-20T19:06:12.553 INFO:tasks.workunit.client.1.smithi098.stdout:8/876: chown d7/de/d11/d19/d30/db5/c125 7255 1 2024-09-20T19:06:12.553 INFO:tasks.workunit.client.1.smithi098.stdout:8/877: dread - d7/de/d11/d19/daf/ff5 zero size 2024-09-20T19:06:12.554 INFO:tasks.workunit.client.0.smithi027.stdout:3/979: write d0/d12d/d3c/d93/f122 [976019,40642] 0 2024-09-20T19:06:12.557 INFO:tasks.workunit.client.0.smithi027.stdout:6/962: truncate d4/d15/d37/fad 2434751 0 2024-09-20T19:06:12.560 INFO:tasks.workunit.client.0.smithi027.stdout:3/980: dread d0/d12d/d3c/d93/f122 [0,4194304] 0 2024-09-20T19:06:12.568 INFO:tasks.workunit.client.0.smithi027.stdout:2/952: creat d3/d13/d3c/f13b x:0 0 0 2024-09-20T19:06:12.571 INFO:tasks.workunit.client.0.smithi027.stdout:2/953: fdatasync d3/d13/d3c/d48/d6a/fb2 0 2024-09-20T19:06:12.573 INFO:tasks.workunit.client.0.smithi027.stdout:2/954: read - d3/d1c/d26/d2a/f7d zero size 2024-09-20T19:06:12.574 INFO:tasks.workunit.client.0.smithi027.stdout:2/955: write d3/d1c/d26/f57 [1671211,129635] 0 2024-09-20T19:06:12.576 INFO:tasks.workunit.client.0.smithi027.stdout:2/956: fsync d3/de/f46 0 2024-09-20T19:06:12.578 INFO:tasks.workunit.client.0.smithi027.stdout:2/957: truncate d3/d24/d89/ffa 497199 0 2024-09-20T19:06:12.579 INFO:tasks.workunit.client.0.smithi027.stdout:3/981: dread d0/d12d/d15/d6f/dcc/ff8 [0,4194304] 0 2024-09-20T19:06:12.582 INFO:tasks.workunit.client.0.smithi027.stdout:3/982: symlink d0/d1/d65/d119/l14a 0 2024-09-20T19:06:12.584 INFO:tasks.workunit.client.0.smithi027.stdout:3/983: symlink d0/d12d/d98/dc3/d104/de3/l14b 0 2024-09-20T19:06:12.586 INFO:tasks.workunit.client.0.smithi027.stdout:3/984: symlink d0/d12d/d98/dc3/d104/l14c 0 2024-09-20T19:06:12.589 INFO:tasks.workunit.client.0.smithi027.stdout:3/985: creat d0/d12d/d98/dc3/da2/f14d x:0 0 0 2024-09-20T19:06:12.596 INFO:tasks.workunit.client.0.smithi027.stdout:2/958: dread d3/d1c/d26/fb5 [0,4194304] 0 2024-09-20T19:06:12.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/942: dwrite d3/d6/d8c/de7/d124/f108 [0,4194304] 0 2024-09-20T19:06:12.599 INFO:tasks.workunit.client.0.smithi027.stdout:2/959: write d3/d1c/d26/df2/df6/ff5 [733223,114805] 0 2024-09-20T19:06:12.599 INFO:tasks.workunit.client.1.smithi098.stdout:9/894: dwrite d4/de/d27/d6c/d73/db5/fbe [4194304,4194304] 0 2024-09-20T19:06:12.605 INFO:tasks.workunit.client.0.smithi027.stdout:2/960: mknod d3/d1c/d31/d9e/c13c 0 2024-09-20T19:06:12.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/895: truncate d4/de/d27/d4a/d8e/f95 1115417 0 2024-09-20T19:06:12.607 INFO:tasks.workunit.client.0.smithi027.stdout:2/961: chown d3/d13/d3c/d48/f74 0 1 2024-09-20T19:06:12.608 INFO:tasks.workunit.client.0.smithi027.stdout:3/986: dread d0/d12d/d3c/d93/fd6 [0,4194304] 0 2024-09-20T19:06:12.608 INFO:tasks.workunit.client.0.smithi027.stdout:2/962: stat d3/d1c/d26/f57 0 2024-09-20T19:06:12.608 INFO:tasks.workunit.client.1.smithi098.stdout:9/896: creat d4/de/d27/d4a/d58/d5b/d8f/f129 x:0 0 0 2024-09-20T19:06:12.610 INFO:tasks.workunit.client.1.smithi098.stdout:4/943: rename d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/db2/fa9 to d3/d6/d8c/de7/df4/d1e/d2a/d45/d91/f136 0 2024-09-20T19:06:12.614 INFO:tasks.workunit.client.0.smithi027.stdout:3/987: creat d0/d19/f14e x:0 0 0 2024-09-20T19:06:12.615 INFO:tasks.workunit.client.0.smithi027.stdout:2/963: symlink d3/de/d34/l13d 0 2024-09-20T19:06:12.615 INFO:tasks.workunit.client.1.smithi098.stdout:9/897: dwrite d4/de/d48/f7c [0,4194304] 0 2024-09-20T19:06:12.616 INFO:tasks.workunit.client.1.smithi098.stdout:4/944: rmdir d3/d6/d8c/de7/df4/d1e 39 2024-09-20T19:06:12.618 INFO:tasks.workunit.client.0.smithi027.stdout:2/964: truncate d3/d1c/d26/d2a/dc2/fd7 804936 0 2024-09-20T19:06:12.618 INFO:tasks.workunit.client.0.smithi027.stdout:3/988: unlink d0/d1/d5e/d1d/d7d/db4/f10f 0 2024-09-20T19:06:12.622 INFO:tasks.workunit.client.1.smithi098.stdout:9/898: mknod d4/de/d27/d88/d122/c12a 0 2024-09-20T19:06:12.623 INFO:tasks.workunit.client.0.smithi027.stdout:3/989: dread d0/d12d/f8c [0,4194304] 0 2024-09-20T19:06:12.624 INFO:tasks.workunit.client.0.smithi027.stdout:3/990: chown d0/d12d/d64/cdd 62 1 2024-09-20T19:06:12.628 INFO:tasks.workunit.client.0.smithi027.stdout:3/991: dread - d0/d12d/d98/dc3/fdf zero size 2024-09-20T19:06:12.630 INFO:tasks.workunit.client.0.smithi027.stdout:3/992: dread d0/d12d/f8c [0,4194304] 0 2024-09-20T19:06:12.631 INFO:tasks.workunit.client.0.smithi027.stdout:3/993: readlink d0/d1/l48 0 2024-09-20T19:06:12.632 INFO:tasks.workunit.client.0.smithi027.stdout:3/994: chown d0/d19/f9c 6291914 1 2024-09-20T19:06:12.633 INFO:tasks.workunit.client.0.smithi027.stdout:4/912: truncate d5/d13/d16/f79 2337329 0 2024-09-20T19:06:12.634 INFO:tasks.workunit.client.1.smithi098.stdout:5/679: dread d1/d17/d35/d54/f62 [0,4194304] 0 2024-09-20T19:06:12.635 INFO:tasks.workunit.client.1.smithi098.stdout:5/680: chown d1/d46/d69/dca 41203995 1 2024-09-20T19:06:12.635 INFO:tasks.workunit.client.0.smithi027.stdout:4/913: dread - d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/fd6 zero size 2024-09-20T19:06:12.635 INFO:tasks.workunit.client.0.smithi027.stdout:6/963: rename d4/d15/d37/d7a/f135 to d4/d15/d37/d7a/f145 0 2024-09-20T19:06:12.636 INFO:tasks.workunit.client.1.smithi098.stdout:5/681: rmdir d1/d71 39 2024-09-20T19:06:12.637 INFO:tasks.workunit.client.0.smithi027.stdout:4/914: fdatasync d5/d11/d3d/db4/f112 0 2024-09-20T19:06:12.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/760: creat d1/d3/df/d34/d43/ff8 x:0 0 0 2024-09-20T19:06:12.638 INFO:tasks.workunit.client.0.smithi027.stdout:6/964: rmdir d4/d6/d4b 39 2024-09-20T19:06:12.639 INFO:tasks.workunit.client.0.smithi027.stdout:3/995: dwrite d0/d1/d5e/d1d/fb5 [0,4194304] 0 2024-09-20T19:06:12.639 INFO:tasks.workunit.client.1.smithi098.stdout:6/609: link d0/d55/d82/f95 d0/de/d1b/fbd 0 2024-09-20T19:06:12.639 INFO:tasks.workunit.client.1.smithi098.stdout:9/899: dread d4/de/d27/d4a/d21/d25/d51/f55 [0,4194304] 0 2024-09-20T19:06:12.640 INFO:tasks.workunit.client.1.smithi098.stdout:5/682: truncate d1/d17/f63 1591577 0 2024-09-20T19:06:12.640 INFO:tasks.workunit.client.0.smithi027.stdout:3/996: fsync d0/d12d/d15/d6f/d7f/f10e 0 2024-09-20T19:06:12.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/683: dread - d1/d46/d69/fc3 zero size 2024-09-20T19:06:12.644 INFO:tasks.workunit.client.1.smithi098.stdout:6/610: mkdir d0/d55/d82/da3/d44/d24/d29/d50/dbe 0 2024-09-20T19:06:12.645 INFO:tasks.workunit.client.0.smithi027.stdout:4/915: truncate d5/d11/d1a/f81 2474871 0 2024-09-20T19:06:12.650 INFO:tasks.workunit.client.0.smithi027.stdout:3/997: read - d0/d1/d65/dc9/fef zero size 2024-09-20T19:06:12.651 INFO:tasks.workunit.client.1.smithi098.stdout:5/684: fsync d1/d17/f1e 0 2024-09-20T19:06:12.651 INFO:tasks.workunit.client.0.smithi027.stdout:3/998: read - d0/dc5/deb/dfc/f120 zero size 2024-09-20T19:06:12.652 INFO:tasks.workunit.client.1.smithi098.stdout:5/685: write d1/d46/d69/f8f [4175546,9483] 0 2024-09-20T19:06:12.652 INFO:tasks.workunit.client.0.smithi027.stdout:6/965: stat d4/d6/d4b/d7c/c12b 0 2024-09-20T19:06:12.653 INFO:tasks.workunit.client.0.smithi027.stdout:8/965: truncate d2/d3/d9a/f10c 498330 0 2024-09-20T19:06:12.654 INFO:tasks.workunit.client.0.smithi027.stdout:6/966: write d4/d15/d37/d7a/d33/f12f [765839,86510] 0 2024-09-20T19:06:12.654 INFO:tasks.workunit.client.1.smithi098.stdout:6/611: rename d0/d55/d82/da3/d8c/f9f to d0/d55/d82/da3/d8c/d4c/fbf 0 2024-09-20T19:06:12.655 INFO:tasks.workunit.client.0.smithi027.stdout:6/967: stat d4/d15/d37/d39/f54 0 2024-09-20T19:06:12.656 INFO:tasks.workunit.client.1.smithi098.stdout:3/823: unlink d4/da/f51 0 2024-09-20T19:06:12.656 INFO:tasks.workunit.client.1.smithi098.stdout:6/612: truncate d0/d55/d82/da3/d44/f62 1470526 0 2024-09-20T19:06:12.659 INFO:tasks.workunit.client.1.smithi098.stdout:9/900: getdents d4/de/d27/d4a/d58/d5b/d9c/d10c 0 2024-09-20T19:06:12.661 INFO:tasks.workunit.client.1.smithi098.stdout:9/901: stat d4/d74/dc8/dfe 0 2024-09-20T19:06:12.664 INFO:tasks.workunit.client.1.smithi098.stdout:3/824: dwrite d4/d25/d40/d80/f86 [0,4194304] 0 2024-09-20T19:06:12.666 INFO:tasks.workunit.client.1.smithi098.stdout:3/825: write d4/d25/d8d/fdf [212293,44791] 0 2024-09-20T19:06:12.672 INFO:tasks.workunit.client.0.smithi027.stdout:8/966: truncate d2/d3/d6/d21/f38 3544681 0 2024-09-20T19:06:12.673 INFO:tasks.workunit.client.1.smithi098.stdout:8/878: dwrite d7/de/d11/d1d/f56 [0,4194304] 0 2024-09-20T19:06:12.675 INFO:tasks.workunit.client.1.smithi098.stdout:8/879: chown d7/de/d11/d19/d30/d59/d80/f10d 3572 1 2024-09-20T19:06:12.677 INFO:tasks.workunit.client.1.smithi098.stdout:5/686: dread d1/d17/d2e/f2f [0,4194304] 0 2024-09-20T19:06:12.679 INFO:tasks.workunit.client.1.smithi098.stdout:7/933: symlink d3/d10/l12e 0 2024-09-20T19:06:12.680 INFO:tasks.workunit.client.0.smithi027.stdout:3/999: link d0/d19/d54/l149 d0/dc5/deb/l14f 0 2024-09-20T19:06:12.682 INFO:tasks.workunit.client.1.smithi098.stdout:9/902: symlink d4/de/d24/d35/d2d/da6/dae/l12b 0 2024-09-20T19:06:12.683 INFO:tasks.workunit.client.1.smithi098.stdout:9/903: write d4/de/d27/d4a/d21/fb3 [359415,111607] 0 2024-09-20T19:06:12.684 INFO:tasks.workunit.client.0.smithi027.stdout:4/916: getdents d5/d13/d36/d48/d3f 0 2024-09-20T19:06:12.687 INFO:tasks.workunit.client.1.smithi098.stdout:8/880: chown d7/de/d11/d1d/f7c 146 1 2024-09-20T19:06:12.688 INFO:tasks.workunit.client.0.smithi027.stdout:8/967: creat d2/d3/d6/d21/d33/f148 x:0 0 0 2024-09-20T19:06:12.689 INFO:tasks.workunit.client.1.smithi098.stdout:5/687: readlink d1/d71/l7b 0 2024-09-20T19:06:12.690 INFO:tasks.workunit.client.0.smithi027.stdout:4/917: truncate d5/d11/d3d/d6e/fae 810197 0 2024-09-20T19:06:12.692 INFO:tasks.workunit.client.0.smithi027.stdout:8/968: read - d2/d3/d6/d6d/d75/f102 zero size 2024-09-20T19:06:12.692 INFO:tasks.workunit.client.0.smithi027.stdout:4/918: read d5/d11/d17/d1b/d8d/ddb/ff9 [7516528,20836] 0 2024-09-20T19:06:12.694 INFO:tasks.workunit.client.1.smithi098.stdout:8/881: dread d7/de/d11/d19/d30/f62 [0,4194304] 0 2024-09-20T19:06:12.696 INFO:tasks.workunit.client.0.smithi027.stdout:7/877: rename d3/d8/d26/d45/ld7 to d3/d8/d26/d45/daa/l127 0 2024-09-20T19:06:12.697 INFO:tasks.workunit.client.1.smithi098.stdout:3/826: mkdir d4/d19/d1d/d2f/d4e/d59/dfc 0 2024-09-20T19:06:12.697 INFO:tasks.workunit.client.0.smithi027.stdout:7/878: chown d3/d8/d26/d45/d56/dec/dc/l90 78040 1 2024-09-20T19:06:12.698 INFO:tasks.workunit.client.0.smithi027.stdout:8/969: creat d2/d3/d6/de0/f149 x:0 0 0 2024-09-20T19:06:12.698 INFO:tasks.workunit.client.1.smithi098.stdout:9/904: rmdir d4/de/d48/dec 39 2024-09-20T19:06:12.699 INFO:tasks.workunit.client.0.smithi027.stdout:4/919: creat d5/d13/d36/d48/d9f/dc9/f11b x:0 0 0 2024-09-20T19:06:12.702 INFO:tasks.workunit.client.1.smithi098.stdout:5/688: creat d1/d71/fd1 x:0 0 0 2024-09-20T19:06:12.705 INFO:tasks.workunit.client.1.smithi098.stdout:6/613: rename d0/d55/d82/da3/d44/d24/d29/d2b to d0/d55/d82/da3/d43/dc0 0 2024-09-20T19:06:12.709 INFO:tasks.workunit.client.1.smithi098.stdout:7/934: creat d3/d10/d16/d17/d33/d1f/d103/f12f x:0 0 0 2024-09-20T19:06:12.709 INFO:tasks.workunit.client.1.smithi098.stdout:5/689: dwrite d1/d17/d35/d54/dab/fce [0,4194304] 0 2024-09-20T19:06:12.710 INFO:tasks.workunit.client.0.smithi027.stdout:4/920: mkdir d5/d11/d3d/db4/d11c 0 2024-09-20T19:06:12.711 INFO:tasks.workunit.client.1.smithi098.stdout:5/690: write d1/d46/fa1 [4536566,48456] 0 2024-09-20T19:06:12.715 INFO:tasks.workunit.client.0.smithi027.stdout:0/984: rename d2/d48/d6b/d79/d84/d1b/d39/f57 to d2/d119/f156 0 2024-09-20T19:06:12.715 INFO:tasks.workunit.client.1.smithi098.stdout:3/827: mknod d4/d25/d40/d4b/cfd 0 2024-09-20T19:06:12.717 INFO:tasks.workunit.client.1.smithi098.stdout:9/905: truncate d4/fb 1293407 0 2024-09-20T19:06:12.719 INFO:tasks.workunit.client.0.smithi027.stdout:2/965: truncate d3/d1c/d26/d2a/dc2/fd8 1073490 0 2024-09-20T19:06:12.723 INFO:tasks.workunit.client.1.smithi098.stdout:4/945: dwrite d3/d6/d8c/de7/df4/d1e/d2a/d45/ffa [4194304,4194304] 0 2024-09-20T19:06:12.723 INFO:tasks.workunit.client.0.smithi027.stdout:1/931: rename d2/d8/d3b/de3 to d2/d8/d74/d84/d131 0 2024-09-20T19:06:12.723 INFO:tasks.workunit.client.1.smithi098.stdout:6/614: mknod d0/d55/d82/da3/d43/dc0/d66/d81/cc1 0 2024-09-20T19:06:12.729 INFO:tasks.workunit.client.0.smithi027.stdout:0/985: symlink d2/d49/ded/d12f/l157 0 2024-09-20T19:06:12.732 INFO:tasks.workunit.client.0.smithi027.stdout:2/966: creat d3/d13/d3c/d48/d6a/f13e x:0 0 0 2024-09-20T19:06:12.734 INFO:tasks.workunit.client.0.smithi027.stdout:0/986: read d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f65 [2109505,3768] 0 2024-09-20T19:06:12.738 INFO:tasks.workunit.client.0.smithi027.stdout:7/879: getdents d3 0 2024-09-20T19:06:12.740 INFO:tasks.workunit.client.0.smithi027.stdout:1/932: dwrite d2/d8/d3b/d82/d90/d108/de2/ff7 [4194304,4194304] 0 2024-09-20T19:06:12.742 INFO:tasks.workunit.client.0.smithi027.stdout:2/967: mkdir d3/d1c/dea/d11a/d13f 0 2024-09-20T19:06:12.753 INFO:tasks.workunit.client.0.smithi027.stdout:0/987: rename d2/d119/f154 to d2/f158 0 2024-09-20T19:06:12.754 INFO:tasks.workunit.client.0.smithi027.stdout:2/968: symlink d3/d1c/d31/d9e/d137/l140 0 2024-09-20T19:06:12.755 INFO:tasks.workunit.client.0.smithi027.stdout:2/969: stat d3/ff 0 2024-09-20T19:06:12.756 INFO:tasks.workunit.client.0.smithi027.stdout:7/880: creat d3/d8/d26/d45/d56/dec/d2e/f128 x:0 0 0 2024-09-20T19:06:12.756 INFO:tasks.workunit.client.0.smithi027.stdout:7/881: chown d3/d8/fff 23900408 1 2024-09-20T19:06:12.757 INFO:tasks.workunit.client.0.smithi027.stdout:0/988: chown d2/d48/d6b/d79/d84/d1b/d39/l7f 27063101 1 2024-09-20T19:06:12.759 INFO:tasks.workunit.client.0.smithi027.stdout:2/970: symlink d3/de/l141 0 2024-09-20T19:06:12.760 INFO:tasks.workunit.client.0.smithi027.stdout:0/989: creat d2/d48/d6b/d79/d84/dfa/f159 x:0 0 0 2024-09-20T19:06:12.764 INFO:tasks.workunit.client.0.smithi027.stdout:8/970: write d2/d14/f20 [5181852,92319] 0 2024-09-20T19:06:12.764 INFO:tasks.workunit.client.0.smithi027.stdout:2/971: dwrite d3/de/d34/f125 [0,4194304] 0 2024-09-20T19:06:12.768 INFO:tasks.workunit.client.0.smithi027.stdout:2/972: creat d3/d96/f142 x:0 0 0 2024-09-20T19:06:12.769 INFO:tasks.workunit.client.0.smithi027.stdout:8/971: symlink d2/d14/d13/d72/d12d/l14a 0 2024-09-20T19:06:12.770 INFO:tasks.workunit.client.0.smithi027.stdout:2/973: chown d3/de/cc5 3521603 1 2024-09-20T19:06:12.770 INFO:tasks.workunit.client.0.smithi027.stdout:0/990: link d2/d48/d6b/d79/d84/c131 d2/d48/d6b/d79/d84/d1b/dc5/d2e/c15a 0 2024-09-20T19:06:12.773 INFO:tasks.workunit.client.0.smithi027.stdout:0/991: fdatasync d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f114 0 2024-09-20T19:06:12.774 INFO:tasks.workunit.client.0.smithi027.stdout:8/972: mkdir d2/d3/d6/d21/d33/d79/dcf/d14b 0 2024-09-20T19:06:12.777 INFO:tasks.workunit.client.0.smithi027.stdout:8/973: dread - d2/d2a/df8/f143 zero size 2024-09-20T19:06:12.779 INFO:tasks.workunit.client.0.smithi027.stdout:4/921: dwrite d5/d13/f90 [0,4194304] 0 2024-09-20T19:06:12.780 INFO:tasks.workunit.client.0.smithi027.stdout:0/992: creat d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/d29/f15b x:0 0 0 2024-09-20T19:06:12.843 INFO:tasks.workunit.client.0.smithi027.stdout:6/968: sync 2024-09-20T19:06:12.844 INFO:tasks.workunit.client.0.smithi027.stdout:6/969: chown d4/d15/f2f 16566 1 2024-09-20T19:06:12.844 INFO:tasks.workunit.client.0.smithi027.stdout:4/922: dread d5/d11/f4d [0,4194304] 0 2024-09-20T19:06:12.844 INFO:tasks.workunit.client.0.smithi027.stdout:2/974: dread d3/de/d34/f4e [0,4194304] 0 2024-09-20T19:06:12.847 INFO:tasks.workunit.client.0.smithi027.stdout:6/970: mkdir d4/d15/d37/d6a/da5/d146 0 2024-09-20T19:06:12.847 INFO:tasks.workunit.client.0.smithi027.stdout:2/975: chown d3/d13/d3c/d48/d6a/f8e 521520 1 2024-09-20T19:06:12.848 INFO:tasks.workunit.client.0.smithi027.stdout:4/923: rename d5/d9b/db0/d10a to d5/d13/d36/d48/d3f/d4c/d11d 0 2024-09-20T19:06:12.849 INFO:tasks.workunit.client.0.smithi027.stdout:0/993: dread d2/d48/d6b/d79/d84/d1b/d39/dc7/ffd [0,4194304] 0 2024-09-20T19:06:12.849 INFO:tasks.workunit.client.1.smithi098.stdout:9/906: mknod d4/de/d27/d4a/d58/d5b/d8f/c12c 0 2024-09-20T19:06:12.850 INFO:tasks.workunit.client.1.smithi098.stdout:6/615: mkdir d0/dc2 0 2024-09-20T19:06:12.850 INFO:tasks.workunit.client.0.smithi027.stdout:2/976: symlink d3/d1c/d31/l143 0 2024-09-20T19:06:12.851 INFO:tasks.workunit.client.1.smithi098.stdout:4/946: chown d3/d5e/cc9 1358 1 2024-09-20T19:06:12.852 INFO:tasks.workunit.client.0.smithi027.stdout:8/974: dread d2/d2a/df8/d36/f61 [0,4194304] 0 2024-09-20T19:06:12.853 INFO:tasks.workunit.client.0.smithi027.stdout:8/975: stat d2/d2a/df8/d36/d115/f123 0 2024-09-20T19:06:12.853 INFO:tasks.workunit.client.1.smithi098.stdout:6/616: fdatasync d0/d55/d82/da3/d44/d24/d29/f35 0 2024-09-20T19:06:12.854 INFO:tasks.workunit.client.0.smithi027.stdout:4/924: symlink d5/d13/d36/d59/l11e 0 2024-09-20T19:06:12.855 INFO:tasks.workunit.client.1.smithi098.stdout:4/947: chown d3/d6/d8c/de7/df4/d1e/fd7 1503247 1 2024-09-20T19:06:12.856 INFO:tasks.workunit.client.1.smithi098.stdout:1/761: dwrite d1/d3/d2e/f3b [0,4194304] 0 2024-09-20T19:06:12.858 INFO:tasks.workunit.client.0.smithi027.stdout:2/977: mkdir d3/d1c/d26/d2a/d144 0 2024-09-20T19:06:12.859 INFO:tasks.workunit.client.1.smithi098.stdout:4/948: write d3/fc [3647174,31308] 0 2024-09-20T19:06:12.862 INFO:tasks.workunit.client.1.smithi098.stdout:8/882: dwrite d7/de/dbb/fc0 [0,4194304] 0 2024-09-20T19:06:12.862 INFO:tasks.workunit.client.1.smithi098.stdout:6/617: truncate d0/d55/d82/da3/d43/dc0/fb2 174716 0 2024-09-20T19:06:12.865 INFO:tasks.workunit.client.0.smithi027.stdout:6/971: truncate d4/d15/d37/d7a/d33/f12f 119814 0 2024-09-20T19:06:12.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/691: rename d1/d17/c42 to d1/d17/d25/cd2 0 2024-09-20T19:06:12.870 INFO:tasks.workunit.client.0.smithi027.stdout:2/978: link d3/d1c/d26/d2a/dc2/fd7 d3/d2f/def/f145 0 2024-09-20T19:06:12.872 INFO:tasks.workunit.client.1.smithi098.stdout:9/907: creat d4/de/d48/dec/f12d x:0 0 0 2024-09-20T19:06:12.873 INFO:tasks.workunit.client.0.smithi027.stdout:2/979: write d3/d96/ff0 [294393,91069] 0 2024-09-20T19:06:12.876 INFO:tasks.workunit.client.1.smithi098.stdout:7/935: link d3/d10/d16/d17/d33/d1f/d2d/c69 d3/d10/d16/d17/d33/c130 0 2024-09-20T19:06:12.877 INFO:tasks.workunit.client.1.smithi098.stdout:1/762: mkdir d1/d3/df/df9 0 2024-09-20T19:06:12.878 INFO:tasks.workunit.client.1.smithi098.stdout:8/883: mkdir d7/de/d11/d1d/d110/d11a/db0/d11f/d12c 0 2024-09-20T19:06:12.878 INFO:tasks.workunit.client.0.smithi027.stdout:2/980: read - d3/d1c/d26/d2a/f7d zero size 2024-09-20T19:06:12.879 INFO:tasks.workunit.client.0.smithi027.stdout:0/994: dwrite d2/d48/d6b/d79/d84/d1b/dc5/d2e/f10b [0,4194304] 0 2024-09-20T19:06:12.879 INFO:tasks.workunit.client.0.smithi027.stdout:4/925: dread d5/d11/d17/d1b/f91 [0,4194304] 0 2024-09-20T19:06:12.880 INFO:tasks.workunit.client.1.smithi098.stdout:9/908: unlink d4/de/d27/d4a/d21/d25/d51/d7b/c116 0 2024-09-20T19:06:12.880 INFO:tasks.workunit.client.1.smithi098.stdout:9/909: chown d4/de/f1d 1649003 1 2024-09-20T19:06:12.881 INFO:tasks.workunit.client.0.smithi027.stdout:2/981: rmdir d3/de/d34 39 2024-09-20T19:06:12.883 INFO:tasks.workunit.client.1.smithi098.stdout:5/692: unlink d1/d1b/d40/f4c 0 2024-09-20T19:06:12.884 INFO:tasks.workunit.client.1.smithi098.stdout:5/693: chown d1/d17/d25/l52 205 1 2024-09-20T19:06:12.884 INFO:tasks.workunit.client.0.smithi027.stdout:0/995: mknod d2/d48/d6b/d79/d84/dfa/c15c 0 2024-09-20T19:06:12.885 INFO:tasks.workunit.client.1.smithi098.stdout:7/936: creat d3/d10/d16/d17/d7c/f131 x:0 0 0 2024-09-20T19:06:12.885 INFO:tasks.workunit.client.0.smithi027.stdout:0/996: chown d2/d48/d6b/d79/d84/d1b/d39/dc7 485691 1 2024-09-20T19:06:12.888 INFO:tasks.workunit.client.0.smithi027.stdout:4/926: creat d5/d13/dff/f11f x:0 0 0 2024-09-20T19:06:12.893 INFO:tasks.workunit.client.0.smithi027.stdout:0/997: write d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/f67 [5532653,129770] 0 2024-09-20T19:06:12.893 INFO:tasks.workunit.client.1.smithi098.stdout:6/618: link d0/d55/d82/da3/d43/dc0/l69 d0/d55/d82/da3/d43/dc0/d66/d81/dbb/lc3 0 2024-09-20T19:06:12.894 INFO:tasks.workunit.client.1.smithi098.stdout:8/884: dwrite d7/de/d11/d1f/d10a/f12b [4194304,4194304] 0 2024-09-20T19:06:12.898 INFO:tasks.workunit.client.0.smithi027.stdout:4/927: chown d5/d11/d17/d1b/l10c 2781 1 2024-09-20T19:06:12.899 INFO:tasks.workunit.client.0.smithi027.stdout:4/928: chown d5/d13/d102 149 1 2024-09-20T19:06:12.900 INFO:tasks.workunit.client.1.smithi098.stdout:4/949: write d3/d7d/fad [2793891,506] 0 2024-09-20T19:06:12.902 INFO:tasks.workunit.client.0.smithi027.stdout:0/998: unlink d2/d48/d6b/d79/d84/d1b/dc5/d2e/dc4/l18 0 2024-09-20T19:06:12.902 INFO:tasks.workunit.client.0.smithi027.stdout:6/972: truncate d4/d15/d37/d6a/d91/fff 61492 0 2024-09-20T19:06:12.903 INFO:tasks.workunit.client.1.smithi098.stdout:4/950: read d3/d6/d8c/de7/df4/d57/d7f/d84/fbe [2727257,45774] 0 2024-09-20T19:06:12.904 INFO:tasks.workunit.client.0.smithi027.stdout:0/999: write d2/d48/d6b/d79/d9f/da4/ff4 [1861762,118829] 0 2024-09-20T19:06:12.904 INFO:tasks.workunit.client.1.smithi098.stdout:7/937: dread d3/d76/db8/fa9 [0,4194304] 0 2024-09-20T19:06:12.906 INFO:tasks.workunit.client.0.smithi027.stdout:4/929: mknod d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/c120 0 2024-09-20T19:06:12.909 INFO:tasks.workunit.client.0.smithi027.stdout:2/982: getdents d3/d1c/dea/d11a 0 2024-09-20T19:06:12.909 INFO:tasks.workunit.client.1.smithi098.stdout:5/694: dread d1/d17/f55 [0,4194304] 0 2024-09-20T19:06:12.910 INFO:tasks.workunit.client.1.smithi098.stdout:5/695: fdatasync d1/d46/d69/d84/fd0 0 2024-09-20T19:06:12.911 INFO:tasks.workunit.client.1.smithi098.stdout:6/619: creat d0/fc4 x:0 0 0 2024-09-20T19:06:12.911 INFO:tasks.workunit.client.0.smithi027.stdout:2/983: truncate d3/d13/d3c/d48/dba/de4/f12f 780280 0 2024-09-20T19:06:12.912 INFO:tasks.workunit.client.1.smithi098.stdout:6/620: write d0/d55/d82/da3/f9b [2452501,7321] 0 2024-09-20T19:06:12.914 INFO:tasks.workunit.client.0.smithi027.stdout:6/973: mknod d4/d6/d4b/dca/c147 0 2024-09-20T19:06:12.915 INFO:tasks.workunit.client.1.smithi098.stdout:9/910: write d4/f47 [3706355,108716] 0 2024-09-20T19:06:12.915 INFO:tasks.workunit.client.0.smithi027.stdout:4/930: fsync d5/d11/d1a/d2a/da3/fca 0 2024-09-20T19:06:12.917 INFO:tasks.workunit.client.1.smithi098.stdout:1/763: rmdir d1/d3/df/d34/d52/d77/d97 0 2024-09-20T19:06:12.918 INFO:tasks.workunit.client.0.smithi027.stdout:2/984: mkdir d3/d1c/d31/d9e/d146 0 2024-09-20T19:06:12.925 INFO:tasks.workunit.client.0.smithi027.stdout:4/931: creat d5/d11/d3d/db4/d11c/f121 x:0 0 0 2024-09-20T19:06:12.926 INFO:tasks.workunit.client.1.smithi098.stdout:6/621: readlink d0/d55/lb9 0 2024-09-20T19:06:12.926 INFO:tasks.workunit.client.0.smithi027.stdout:2/985: dwrite d3/d13/d3c/fbe [0,4194304] 0 2024-09-20T19:06:12.928 INFO:tasks.workunit.client.0.smithi027.stdout:2/986: truncate d3/d1c/d26/df2/df6/fe8 1200549 0 2024-09-20T19:06:12.931 INFO:tasks.workunit.client.1.smithi098.stdout:9/911: rename d4/de/d27/d4a/d58/d5b/fa4 to d4/de/d27/d4a/d21/d25/f12e 0 2024-09-20T19:06:12.932 INFO:tasks.workunit.client.1.smithi098.stdout:9/912: read - d4/de/d48/dec/f12d zero size 2024-09-20T19:06:12.932 INFO:tasks.workunit.client.1.smithi098.stdout:9/913: stat d4/de/d48/dec/f11d 0 2024-09-20T19:06:12.935 INFO:tasks.workunit.client.1.smithi098.stdout:4/951: truncate d3/d6/f23 2047743 0 2024-09-20T19:06:12.936 INFO:tasks.workunit.client.1.smithi098.stdout:8/885: truncate d7/de/d11/fa7 2934325 0 2024-09-20T19:06:12.936 INFO:tasks.workunit.client.0.smithi027.stdout:2/987: dwrite d3/d13/f4d [0,4194304] 0 2024-09-20T19:06:12.937 INFO:tasks.workunit.client.0.smithi027.stdout:4/932: mkdir d5/d13/d122 0 2024-09-20T19:06:12.941 INFO:tasks.workunit.client.0.smithi027.stdout:6/974: dwrite d4/d6/fa [4194304,4194304] 0 2024-09-20T19:06:12.942 INFO:tasks.workunit.client.0.smithi027.stdout:1/933: sync 2024-09-20T19:06:12.943 INFO:tasks.workunit.client.0.smithi027.stdout:2/988: creat d3/d1c/d26/d2a/dc2/d6f/f147 x:0 0 0 2024-09-20T19:06:12.944 INFO:tasks.workunit.client.1.smithi098.stdout:1/764: rmdir d1/d3/df/d34/d52/d77/df7/dc1/dc7 39 2024-09-20T19:06:12.948 INFO:tasks.workunit.client.1.smithi098.stdout:8/886: read - d7/de/f3b zero size 2024-09-20T19:06:12.949 INFO:tasks.workunit.client.0.smithi027.stdout:6/975: readlink d4/d15/d37/d6a/dbf/d105/l108 0 2024-09-20T19:06:12.951 INFO:tasks.workunit.client.1.smithi098.stdout:6/622: link d0/d55/d82/da3/f45 d0/d55/d82/da3/d43/d51/fc5 0 2024-09-20T19:06:12.952 INFO:tasks.workunit.client.0.smithi027.stdout:1/934: dread d2/d8/d41/f10b [0,4194304] 0 2024-09-20T19:06:12.953 INFO:tasks.workunit.client.0.smithi027.stdout:2/989: symlink d3/d24/d89/l148 0 2024-09-20T19:06:12.954 INFO:tasks.workunit.client.1.smithi098.stdout:5/696: truncate d1/d17/d5e/f81 6584218 0 2024-09-20T19:06:12.955 INFO:tasks.workunit.client.1.smithi098.stdout:9/914: mknod d4/de/d24/d35/dc4/dd7/c12f 0 2024-09-20T19:06:12.955 INFO:tasks.workunit.client.0.smithi027.stdout:4/933: getdents d5/d11/d17/d1b/dd4/de3/d114 0 2024-09-20T19:06:12.956 INFO:tasks.workunit.client.0.smithi027.stdout:1/935: rmdir d2/d8/d3b 39 2024-09-20T19:06:12.956 INFO:tasks.workunit.client.1.smithi098.stdout:9/915: write d4/de/d48/dec/f12d [281568,116474] 0 2024-09-20T19:06:12.956 INFO:tasks.workunit.client.0.smithi027.stdout:6/976: dwrite d4/dc7/f113 [0,4194304] 0 2024-09-20T19:06:12.957 INFO:tasks.workunit.client.0.smithi027.stdout:4/934: chown d5/d9b/f4e 2 1 2024-09-20T19:06:12.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/623: truncate d0/d55/d82/da3/d44/dc/f1a 713857 0 2024-09-20T19:06:12.959 INFO:tasks.workunit.client.0.smithi027.stdout:2/990: creat d3/d1c/dea/f149 x:0 0 0 2024-09-20T19:06:12.960 INFO:tasks.workunit.client.1.smithi098.stdout:6/624: chown d0/d55/d82/da3/d44/d24/l6f 69839 1 2024-09-20T19:06:12.961 INFO:tasks.workunit.client.1.smithi098.stdout:5/697: symlink d1/d17/d5e/ld3 0 2024-09-20T19:06:12.963 INFO:tasks.workunit.client.1.smithi098.stdout:8/887: link d7/de/d11/d19/d30/d55/d9d/fa0 d7/de/d11/d1f/d9c/f12d 0 2024-09-20T19:06:12.964 INFO:tasks.workunit.client.1.smithi098.stdout:9/916: dwrite d4/de/d27/d4a/d58/d5b/d9c/ff7 [0,4194304] 0 2024-09-20T19:06:12.965 INFO:tasks.workunit.client.0.smithi027.stdout:4/935: creat d5/d13/d36/d48/d3f/d4c/f123 x:0 0 0 2024-09-20T19:06:12.968 INFO:tasks.workunit.client.0.smithi027.stdout:6/977: symlink d4/d15/d37/d5a/d78/l148 0 2024-09-20T19:06:12.971 INFO:tasks.workunit.client.1.smithi098.stdout:9/917: dwrite d4/f8 [0,4194304] 0 2024-09-20T19:06:12.972 INFO:tasks.workunit.client.0.smithi027.stdout:2/991: mkdir d3/d1c/d31/d9e/d14a 0 2024-09-20T19:06:12.973 INFO:tasks.workunit.client.1.smithi098.stdout:9/918: write d4/de/d24/f8b [2277161,129300] 0 2024-09-20T19:06:12.975 INFO:tasks.workunit.client.1.smithi098.stdout:9/919: write d4/de/d24/d35/d2d/da6/dae/fc7 [360436,36840] 0 2024-09-20T19:06:12.977 INFO:tasks.workunit.client.1.smithi098.stdout:9/920: fdatasync d4/de/d27/d6c/d73/db5/fbe 0 2024-09-20T19:06:12.977 INFO:tasks.workunit.client.0.smithi027.stdout:4/936: rmdir d5/d13/d36/d48/d3f/d4c/d52/d87/d99 39 2024-09-20T19:06:12.979 INFO:tasks.workunit.client.1.smithi098.stdout:8/888: dread d7/de/d11/d19/d30/f62 [0,4194304] 0 2024-09-20T19:06:12.981 INFO:tasks.workunit.client.0.smithi027.stdout:1/936: mkdir d2/d8/d3b/d82/d87/dcf/d112/d132 0 2024-09-20T19:06:12.983 INFO:tasks.workunit.client.1.smithi098.stdout:5/698: creat d1/d82/fd4 x:0 0 0 2024-09-20T19:06:12.984 INFO:tasks.workunit.client.0.smithi027.stdout:4/937: fdatasync d5/d11/d17/d1b/d8d/ddb/ff9 0 2024-09-20T19:06:12.985 INFO:tasks.workunit.client.0.smithi027.stdout:8/976: sync 2024-09-20T19:06:12.985 INFO:tasks.workunit.client.0.smithi027.stdout:7/882: sync 2024-09-20T19:06:12.986 INFO:tasks.workunit.client.1.smithi098.stdout:6/625: dwrite d0/de/d1b/f5d [0,4194304] 0 2024-09-20T19:06:12.990 INFO:tasks.workunit.client.0.smithi027.stdout:1/937: rmdir d2/d61/df8 39 2024-09-20T19:06:12.991 INFO:tasks.workunit.client.1.smithi098.stdout:9/921: creat d4/de/d24/d35/d6d/f130 x:0 0 0 2024-09-20T19:06:12.992 INFO:tasks.workunit.client.1.smithi098.stdout:9/922: chown d4/de/d24/d35/d6d/ff9 9 1 2024-09-20T19:06:12.992 INFO:tasks.workunit.client.1.smithi098.stdout:9/923: stat d4/de/d24/d35 0 2024-09-20T19:06:12.993 INFO:tasks.workunit.client.1.smithi098.stdout:9/924: chown d4/d74/d8a/d94/fc0 633 1 2024-09-20T19:06:12.996 INFO:tasks.workunit.client.1.smithi098.stdout:8/889: symlink d7/de/d11/d19/d30/d55/da9/l12e 0 2024-09-20T19:06:12.999 INFO:tasks.workunit.client.0.smithi027.stdout:2/992: rename d3/d1c/d26/d2a/dc2/d6f/ce5 to d3/d13/c14b 0 2024-09-20T19:06:13.000 INFO:tasks.workunit.client.1.smithi098.stdout:6/626: symlink d0/d55/d82/da3/d8c/d9a/lc6 0 2024-09-20T19:06:13.002 INFO:tasks.workunit.client.1.smithi098.stdout:9/925: mknod d4/de/d27/dc9/c131 0 2024-09-20T19:06:13.004 INFO:tasks.workunit.client.1.smithi098.stdout:9/926: read - d4/de/d27/d4a/d58/d5b/d8f/f129 zero size 2024-09-20T19:06:13.006 INFO:tasks.workunit.client.0.smithi027.stdout:7/883: dread d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f6c [0,4194304] 0 2024-09-20T19:06:13.006 INFO:tasks.workunit.client.0.smithi027.stdout:6/978: link d4/d15/d37/d6a/d7f/ff8 d4/d15/d37/d7a/f149 0 2024-09-20T19:06:13.007 INFO:tasks.workunit.client.0.smithi027.stdout:8/977: getdents d2/d14/d13/d146 0 2024-09-20T19:06:13.008 INFO:tasks.workunit.client.1.smithi098.stdout:5/699: creat d1/d17/d2e/dac/fd5 x:0 0 0 2024-09-20T19:06:13.009 INFO:tasks.workunit.client.0.smithi027.stdout:2/993: mkdir d3/d13/d3c/dce/d14c 0 2024-09-20T19:06:13.012 INFO:tasks.workunit.client.0.smithi027.stdout:4/938: link d5/d11/d17/d1b/d8d/d26/f29 d5/d13/d36/d60/f124 0 2024-09-20T19:06:13.014 INFO:tasks.workunit.client.0.smithi027.stdout:7/884: rmdir d3/d8/d26/d45 39 2024-09-20T19:06:13.016 INFO:tasks.workunit.client.1.smithi098.stdout:9/927: rename d4/de/d27/d4a/d58 to d4/de/d27/d4a/d21/d25/df2/d132 0 2024-09-20T19:06:13.017 INFO:tasks.workunit.client.0.smithi027.stdout:6/979: fdatasync d4/d15/d37/d6a/d7f/fdc 0 2024-09-20T19:06:13.018 INFO:tasks.workunit.client.1.smithi098.stdout:8/890: dread d7/de/d11/d19/d30/db5/fd0 [0,4194304] 0 2024-09-20T19:06:13.018 INFO:tasks.workunit.client.1.smithi098.stdout:6/627: dread d0/de/d1b/fbd [0,4194304] 0 2024-09-20T19:06:13.020 INFO:tasks.workunit.client.0.smithi027.stdout:8/978: fdatasync d2/d3/d6/d6d/d75/f144 0 2024-09-20T19:06:13.021 INFO:tasks.workunit.client.1.smithi098.stdout:5/700: write d1/d17/d2e/f2f [4644553,116232] 0 2024-09-20T19:06:13.023 INFO:tasks.workunit.client.0.smithi027.stdout:2/994: creat d3/d13/d3c/d48/dad/f14d x:0 0 0 2024-09-20T19:06:13.024 INFO:tasks.workunit.client.1.smithi098.stdout:9/928: dread - d4/de/d27/d4a/d21/d25/d51/d7b/fba zero size 2024-09-20T19:06:13.025 INFO:tasks.workunit.client.1.smithi098.stdout:9/929: fdatasync d4/de/d24/d35/f43 0 2024-09-20T19:06:13.027 INFO:tasks.workunit.client.0.smithi027.stdout:4/939: dread d5/d13/d36/d48/d3f/d4c/ffd [0,4194304] 0 2024-09-20T19:06:13.027 INFO:tasks.workunit.client.0.smithi027.stdout:7/885: mknod d3/c129 0 2024-09-20T19:06:13.029 INFO:tasks.workunit.client.1.smithi098.stdout:6/628: rmdir d0/d55/d82/da3/d43/da8 39 2024-09-20T19:06:13.033 INFO:tasks.workunit.client.1.smithi098.stdout:9/930: dwrite d4/de/d27/d6c/f10a [0,4194304] 0 2024-09-20T19:06:13.036 INFO:tasks.workunit.client.0.smithi027.stdout:2/995: fdatasync d3/d1c/d26/d2a/dc2/fdb 0 2024-09-20T19:06:13.038 INFO:tasks.workunit.client.1.smithi098.stdout:9/931: dread d4/de/d27/d6c/d73/f99 [0,4194304] 0 2024-09-20T19:06:13.040 INFO:tasks.workunit.client.1.smithi098.stdout:6/629: creat d0/d55/d82/da3/d43/dc0/fc7 x:0 0 0 2024-09-20T19:06:13.046 INFO:tasks.workunit.client.1.smithi098.stdout:9/932: read - d4/de/d27/d4a/d21/d25/df2/d132/d5b/fd0 zero size 2024-09-20T19:06:13.046 INFO:tasks.workunit.client.1.smithi098.stdout:9/933: chown d4/de/d27/dc9 835147 1 2024-09-20T19:06:13.047 INFO:tasks.workunit.client.0.smithi027.stdout:8/979: rename d2/d14/d13/f1d to d2/d14/d13/db5/f14c 0 2024-09-20T19:06:13.048 INFO:tasks.workunit.client.1.smithi098.stdout:6/630: creat d0/d55/d82/da3/d43/dc0/d66/fc8 x:0 0 0 2024-09-20T19:06:13.050 INFO:tasks.workunit.client.1.smithi098.stdout:5/701: symlink d1/d17/d25/d79/dbc/ld6 0 2024-09-20T19:06:13.053 INFO:tasks.workunit.client.1.smithi098.stdout:9/934: chown d4/de/d27/d4a/d8e/cb8 205 1 2024-09-20T19:06:13.056 INFO:tasks.workunit.client.0.smithi027.stdout:8/980: mknod d2/d14/d13/d72/c14d 0 2024-09-20T19:06:13.056 INFO:tasks.workunit.client.1.smithi098.stdout:8/891: dwrite d7/de/d11/d1d/d110/d11a/d72/f8d [0,4194304] 0 2024-09-20T19:06:13.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/935: read d4/de/f34 [1291273,85430] 0 2024-09-20T19:06:13.057 INFO:tasks.workunit.client.1.smithi098.stdout:8/892: stat d7/de/d11/d19/d30/f70 0 2024-09-20T19:06:13.057 INFO:tasks.workunit.client.1.smithi098.stdout:5/702: unlink d1/d46/c73 0 2024-09-20T19:06:13.058 INFO:tasks.workunit.client.0.smithi027.stdout:2/996: write d3/d24/f28 [551450,123512] 0 2024-09-20T19:06:13.059 INFO:tasks.workunit.client.0.smithi027.stdout:2/997: truncate d3/d96/f142 707834 0 2024-09-20T19:06:13.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/631: dread d0/d55/d82/da3/d44/f3d [0,4194304] 0 2024-09-20T19:06:13.062 INFO:tasks.workunit.client.0.smithi027.stdout:8/981: rename d2/d3/f37 to d2/d2a/df8/d36/f14e 0 2024-09-20T19:06:13.062 INFO:tasks.workunit.client.1.smithi098.stdout:9/936: mknod d4/de/d27/d6c/d73/c133 0 2024-09-20T19:06:13.068 INFO:tasks.workunit.client.1.smithi098.stdout:6/632: readlink d0/de/d1b/l94 0 2024-09-20T19:06:13.068 INFO:tasks.workunit.client.0.smithi027.stdout:4/940: dwrite d5/d11/d3d/d6e/fae [0,4194304] 0 2024-09-20T19:06:13.070 INFO:tasks.workunit.client.1.smithi098.stdout:5/703: link d1/d17/fae d1/d71/fd7 0 2024-09-20T19:06:13.074 INFO:tasks.workunit.client.0.smithi027.stdout:2/998: dwrite d3/d13/d3c/f133 [0,4194304] 0 2024-09-20T19:06:13.074 INFO:tasks.workunit.client.0.smithi027.stdout:4/941: read d5/d13/d16/f8e [665449,58145] 0 2024-09-20T19:06:13.074 INFO:tasks.workunit.client.0.smithi027.stdout:4/942: fdatasync d5/d13/fa4 0 2024-09-20T19:06:13.078 INFO:tasks.workunit.client.1.smithi098.stdout:8/893: rename d7/de/d11/d1f/d9c/f12d to d7/de/d11/d19/d30/d68/f12f 0 2024-09-20T19:06:13.080 INFO:tasks.workunit.client.0.smithi027.stdout:8/982: dread d2/d14/d13/d51/f76 [0,4194304] 0 2024-09-20T19:06:13.083 INFO:tasks.workunit.client.0.smithi027.stdout:2/999: mknod d3/d1c/d26/c14e 0 2024-09-20T19:06:13.087 INFO:tasks.workunit.client.1.smithi098.stdout:8/894: mknod d7/de/d11/d1d/d110/d11a/c130 0 2024-09-20T19:06:13.089 INFO:tasks.workunit.client.0.smithi027.stdout:7/886: link d3/d8/d26/d45/dcc/f112 d3/d8/d26/d45/d56/dec/d2e/d39/f12a 0 2024-09-20T19:06:13.090 INFO:tasks.workunit.client.0.smithi027.stdout:7/887: read - d3/d8/d26/d45/d56/dec/d51/fde zero size 2024-09-20T19:06:13.090 INFO:tasks.workunit.client.1.smithi098.stdout:9/937: link d4/de/d27/d4a/d8e/f95 d4/d74/d8a/f134 0 2024-09-20T19:06:13.091 INFO:tasks.workunit.client.1.smithi098.stdout:6/633: dwrite d0/d55/d82/da3/d43/f5e [0,4194304] 0 2024-09-20T19:06:13.092 INFO:tasks.workunit.client.0.smithi027.stdout:7/888: write d3/d8/d26/d45/dcc/fe0 [161718,89799] 0 2024-09-20T19:06:13.097 INFO:tasks.workunit.client.1.smithi098.stdout:5/704: rename d1/c36 to d1/d17/d25/d56/cd8 0 2024-09-20T19:06:13.099 INFO:tasks.workunit.client.1.smithi098.stdout:6/634: dwrite d0/d55/d82/da3/f9b [0,4194304] 0 2024-09-20T19:06:13.102 INFO:tasks.workunit.client.1.smithi098.stdout:8/895: rename d7/de/dbb/fdc to d7/de/d11/d19/d30/d55/d9d/f131 0 2024-09-20T19:06:13.102 INFO:tasks.workunit.client.1.smithi098.stdout:5/705: mkdir d1/d17/d5e/dd9 0 2024-09-20T19:06:13.103 INFO:tasks.workunit.client.1.smithi098.stdout:6/635: creat d0/d55/d82/da3/d44/dc/da7/fc9 x:0 0 0 2024-09-20T19:06:13.105 INFO:tasks.workunit.client.1.smithi098.stdout:5/706: truncate d1/d17/f97 3342966 0 2024-09-20T19:06:13.106 INFO:tasks.workunit.client.1.smithi098.stdout:5/707: truncate d1/d71/fb2 977847 0 2024-09-20T19:06:13.107 INFO:tasks.workunit.client.1.smithi098.stdout:9/938: rename d4/de/d27/d4a/d21/d25/df2/d132/d5b/d9c/f111 to d4/de/d27/d4a/d21/d25/df2/d132/d5b/d112/f135 0 2024-09-20T19:06:13.114 INFO:tasks.workunit.client.1.smithi098.stdout:6/636: dwrite d0/d55/d82/da3/d8c/d4c/fbf [0,4194304] 0 2024-09-20T19:06:13.115 INFO:tasks.workunit.client.1.smithi098.stdout:8/896: creat d7/de/d11/d19/d30/d68/f132 x:0 0 0 2024-09-20T19:06:13.116 INFO:tasks.workunit.client.0.smithi027.stdout:4/943: dwrite d5/f6d [0,4194304] 0 2024-09-20T19:06:13.119 INFO:tasks.workunit.client.1.smithi098.stdout:5/708: creat d1/d1b/fda x:0 0 0 2024-09-20T19:06:13.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/897: write d7/de/d11/d19/d30/d55/da9/f103 [3365736,86359] 0 2024-09-20T19:06:13.122 INFO:tasks.workunit.client.0.smithi027.stdout:7/889: write d3/d8/d26/d45/d56/dec/d51/fde [845810,32445] 0 2024-09-20T19:06:13.123 INFO:tasks.workunit.client.0.smithi027.stdout:4/944: mkdir d5/d13/dff/d125 0 2024-09-20T19:06:13.124 INFO:tasks.workunit.client.1.smithi098.stdout:9/939: link d4/de/d27/d4a/d21/lcd d4/d74/dc8/dfc/l136 0 2024-09-20T19:06:13.125 INFO:tasks.workunit.client.1.smithi098.stdout:9/940: fdatasync d4/de/d27/d6c/d73/db5/fbe 0 2024-09-20T19:06:13.126 INFO:tasks.workunit.client.1.smithi098.stdout:5/709: mknod d1/d82/cdb 0 2024-09-20T19:06:13.127 INFO:tasks.workunit.client.1.smithi098.stdout:5/710: write d1/d46/fbd [562674,22435] 0 2024-09-20T19:06:13.128 INFO:tasks.workunit.client.0.smithi027.stdout:8/983: dwrite d2/d2a/df8/f70 [4194304,4194304] 0 2024-09-20T19:06:13.131 INFO:tasks.workunit.client.1.smithi098.stdout:8/898: creat d7/de/d11/d1d/d110/f133 x:0 0 0 2024-09-20T19:06:13.132 INFO:tasks.workunit.client.0.smithi027.stdout:8/984: chown d2/d3/d6/d21/d33/cd8 135686 1 2024-09-20T19:06:13.133 INFO:tasks.workunit.client.0.smithi027.stdout:7/890: mkdir d3/d5e/d12b 0 2024-09-20T19:06:13.134 INFO:tasks.workunit.client.1.smithi098.stdout:9/941: rename d4/de/d27/d6c/d73/d113 to d4/de/d27/d4a/d21/d25/d51/d7b/d137 0 2024-09-20T19:06:13.135 INFO:tasks.workunit.client.0.smithi027.stdout:4/945: dwrite d5/d11/d17/d1b/d8d/fa7 [0,4194304] 0 2024-09-20T19:06:13.137 INFO:tasks.workunit.client.0.smithi027.stdout:7/891: stat d3/d8/d26/d45/d56/dec/dc/da9/ddd 0 2024-09-20T19:06:13.137 INFO:tasks.workunit.client.1.smithi098.stdout:6/637: getdents d0/d55/d82/da3/d44/dc 0 2024-09-20T19:06:13.139 INFO:tasks.workunit.client.0.smithi027.stdout:8/985: truncate d2/d14/d13/f103 674 0 2024-09-20T19:06:13.143 INFO:tasks.workunit.client.1.smithi098.stdout:6/638: symlink d0/d55/d82/da3/d44/lca 0 2024-09-20T19:06:13.144 INFO:tasks.workunit.client.1.smithi098.stdout:5/711: link d1/d1b/f6f d1/d17/d35/d93/fdc 0 2024-09-20T19:06:13.145 INFO:tasks.workunit.client.1.smithi098.stdout:6/639: write d0/d55/d82/da3/d44/d24/d29/f99 [1009995,85025] 0 2024-09-20T19:06:13.146 INFO:tasks.workunit.client.0.smithi027.stdout:8/986: fdatasync d2/d3/f4a 0 2024-09-20T19:06:13.148 INFO:tasks.workunit.client.0.smithi027.stdout:8/987: write d2/d3/d6/d21/d33/d79/d9f/f121 [4823230,70303] 0 2024-09-20T19:06:13.153 INFO:tasks.workunit.client.0.smithi027.stdout:8/988: rmdir d2/d3/d9a/dbf 39 2024-09-20T19:06:13.153 INFO:tasks.workunit.client.1.smithi098.stdout:6/640: dwrite d0/d55/d82/da3/d44/d24/f3e [4194304,4194304] 0 2024-09-20T19:06:13.158 INFO:tasks.workunit.client.1.smithi098.stdout:6/641: unlink d0/d55/d82/da3/d44/l25 0 2024-09-20T19:06:13.159 INFO:tasks.workunit.client.1.smithi098.stdout:9/942: write d4/de/d27/d4a/d21/d25/df2/d132/d5b/d8f/d9e/f5a [687519,4187] 0 2024-09-20T19:06:13.161 INFO:tasks.workunit.client.1.smithi098.stdout:9/943: dread - d4/de/d27/d4a/d21/d25/df2/d132/d5b/fd0 zero size 2024-09-20T19:06:13.164 INFO:tasks.workunit.client.1.smithi098.stdout:9/944: fdatasync d4/de/d27/d4a/d21/f46 0 2024-09-20T19:06:13.164 INFO:tasks.workunit.client.0.smithi027.stdout:8/989: dwrite d2/d3/d6/d21/d33/f148 [0,4194304] 0 2024-09-20T19:06:13.166 INFO:tasks.workunit.client.0.smithi027.stdout:1/938: sync 2024-09-20T19:06:13.168 INFO:tasks.workunit.client.0.smithi027.stdout:8/990: mknod d2/d3/d6/d21/d80/c14f 0 2024-09-20T19:06:13.169 INFO:tasks.workunit.client.1.smithi098.stdout:6/642: dwrite d0/d55/d82/da3/d44/d24/d29/f35 [0,4194304] 0 2024-09-20T19:06:13.169 INFO:tasks.workunit.client.1.smithi098.stdout:5/712: dwrite d1/d17/d35/d54/f62 [0,4194304] 0 2024-09-20T19:06:13.171 INFO:tasks.workunit.client.0.smithi027.stdout:7/892: dwrite d3/d24/f37 [0,4194304] 0 2024-09-20T19:06:13.174 INFO:tasks.workunit.client.1.smithi098.stdout:5/713: mkdir d1/d46/ddd 0 2024-09-20T19:06:13.176 INFO:tasks.workunit.client.1.smithi098.stdout:6/643: symlink d0/d55/d82/da3/d44/dc/da7/lcb 0 2024-09-20T19:06:13.179 INFO:tasks.workunit.client.0.smithi027.stdout:7/893: chown d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f3a 48330 1 2024-09-20T19:06:13.180 INFO:tasks.workunit.client.1.smithi098.stdout:5/714: chown d1/d17/d5e/f81 1 1 2024-09-20T19:06:13.184 INFO:tasks.workunit.client.0.smithi027.stdout:7/894: creat d3/d8/de5/f12c x:0 0 0 2024-09-20T19:06:13.185 INFO:tasks.workunit.client.1.smithi098.stdout:8/899: dread d7/de/d11/d1f/d10a/f5a [0,4194304] 0 2024-09-20T19:06:13.186 INFO:tasks.workunit.client.1.smithi098.stdout:5/715: mkdir d1/d17/d35/d54/d68/dde 0 2024-09-20T19:06:13.186 INFO:tasks.workunit.client.0.smithi027.stdout:7/895: chown d3/d8/d26/d45/d56/dec/f44 11 1 2024-09-20T19:06:13.187 INFO:tasks.workunit.client.0.smithi027.stdout:7/896: readlink d3/d8/d26/d45/d56/dec/dc/da9/ddd/lfc 0 2024-09-20T19:06:13.189 INFO:tasks.workunit.client.1.smithi098.stdout:8/900: fsync d7/de/d11/d19/d30/d59/d80/f10d 0 2024-09-20T19:06:13.205 INFO:tasks.workunit.client.0.smithi027.stdout:1/939: write d2/d8/f8c [3338869,81425] 0 2024-09-20T19:06:13.206 INFO:tasks.workunit.client.0.smithi027.stdout:8/991: write d2/d3/d6/d9e/d137/fa8 [901334,62839] 0 2024-09-20T19:06:13.206 INFO:tasks.workunit.client.0.smithi027.stdout:1/940: readlink d2/d8/d3b/d44/l67 0 2024-09-20T19:06:13.210 INFO:tasks.workunit.client.0.smithi027.stdout:8/992: unlink d2/d3/d6/d6d/d75/lff 0 2024-09-20T19:06:13.213 INFO:tasks.workunit.client.1.smithi098.stdout:9/945: dwrite d4/de/d27/d4a/d21/d25/d51/f9d [0,4194304] 0 2024-09-20T19:06:13.216 INFO:tasks.workunit.client.0.smithi027.stdout:1/941: link d2/d8/d74/fb6 d2/d8/d74/d84/f133 0 2024-09-20T19:06:13.217 INFO:tasks.workunit.client.0.smithi027.stdout:8/993: dwrite d2/d14/d13/f111 [4194304,4194304] 0 2024-09-20T19:06:13.217 INFO:tasks.workunit.client.1.smithi098.stdout:6/644: dread d0/d55/d82/da3/d43/d6d/f75 [0,4194304] 0 2024-09-20T19:06:13.218 INFO:tasks.workunit.client.0.smithi027.stdout:8/994: chown d2/d2a/df8 22 1 2024-09-20T19:06:13.219 INFO:tasks.workunit.client.1.smithi098.stdout:9/946: creat d4/de/d27/f138 x:0 0 0 2024-09-20T19:06:13.219 INFO:tasks.workunit.client.1.smithi098.stdout:5/716: dwrite d1/d1b/d40/f85 [0,4194304] 0 2024-09-20T19:06:13.220 INFO:tasks.workunit.client.1.smithi098.stdout:8/901: dwrite d7/de/f3b [0,4194304] 0 2024-09-20T19:06:13.222 INFO:tasks.workunit.client.0.smithi027.stdout:7/897: dread d3/d24/f2c [0,4194304] 0 2024-09-20T19:06:13.224 INFO:tasks.workunit.client.0.smithi027.stdout:1/942: rename d2/d8/d3b/d82/d90/d108/de2 to d2/d8/d74/d84/dca/d134 0 2024-09-20T19:06:13.225 INFO:tasks.workunit.client.0.smithi027.stdout:8/995: write d2/d14/d13/db5/f14c [4452304,73285] 0 2024-09-20T19:06:13.227 INFO:tasks.workunit.client.0.smithi027.stdout:7/898: fdatasync d3/d8/d26/d45/d56/d8d/fd3 0 2024-09-20T19:06:13.228 INFO:tasks.workunit.client.0.smithi027.stdout:7/899: readlink d3/d8/l30 0 2024-09-20T19:06:13.229 INFO:tasks.workunit.client.1.smithi098.stdout:5/717: mknod d1/d46/da6/cdf 0 2024-09-20T19:06:13.230 INFO:tasks.workunit.client.0.smithi027.stdout:1/943: write d2/d61/df8/dde/ff5 [2025187,21152] 0 2024-09-20T19:06:13.232 INFO:tasks.workunit.client.1.smithi098.stdout:8/902: rename d7/de/d11/d19/d30/d59/dff to d7/de/d11/d19/d30/db5/d134 0 2024-09-20T19:06:13.233 INFO:tasks.workunit.client.0.smithi027.stdout:8/996: rmdir d2/d14/d13/d43/d5d 39 2024-09-20T19:06:13.237 INFO:tasks.workunit.client.1.smithi098.stdout:5/718: truncate d1/d46/fa1 2436556 0 2024-09-20T19:06:13.240 INFO:tasks.workunit.client.0.smithi027.stdout:7/900: rename d3/c19 to d3/d8/d26/d45/d56/dec/dc/da9/dbc/c12d 0 2024-09-20T19:06:13.242 INFO:tasks.workunit.client.1.smithi098.stdout:5/719: dread d1/d46/f83 [0,4194304] 0 2024-09-20T19:06:13.248 INFO:tasks.workunit.client.0.smithi027.stdout:8/997: link d2/d3/d6/d21/d33/d79/l140 d2/d3/d6/d21/d80/l150 0 2024-09-20T19:06:13.249 INFO:tasks.workunit.client.1.smithi098.stdout:8/903: dread d7/de/f93 [0,4194304] 0 2024-09-20T19:06:13.252 INFO:tasks.workunit.client.1.smithi098.stdout:5/720: dwrite d1/d46/d69/fc3 [0,4194304] 0 2024-09-20T19:06:13.254 INFO:tasks.workunit.client.0.smithi027.stdout:8/998: dwrite d2/d14/f27 [0,4194304] 0 2024-09-20T19:06:13.255 INFO:tasks.workunit.client.1.smithi098.stdout:9/947: write d4/d74/d8a/f134 [1360117,63533] 0 2024-09-20T19:06:13.258 INFO:tasks.workunit.client.1.smithi098.stdout:8/904: creat d7/de/d11/d19/d30/d55/f135 x:0 0 0 2024-09-20T19:06:13.261 INFO:tasks.workunit.client.0.smithi027.stdout:8/999: creat d2/d2a/df8/dda/f151 x:0 0 0 2024-09-20T19:06:13.266 INFO:tasks.workunit.client.1.smithi098.stdout:5/721: fsync d1/d17/d35/f3f 0 2024-09-20T19:06:13.266 INFO:tasks.workunit.client.1.smithi098.stdout:6/645: dwrite d0/de/f56 [0,4194304] 0 2024-09-20T19:06:13.267 INFO:tasks.workunit.client.0.smithi027.stdout:6/980: sync 2024-09-20T19:06:13.268 INFO:tasks.workunit.client.1.smithi098.stdout:5/722: write d1/d17/d35/f80 [579822,17573] 0 2024-09-20T19:06:13.276 INFO:tasks.workunit.client.0.smithi027.stdout:6/981: dwrite d4/d15/d37/d6a/dbf/f10e [0,4194304] 0 2024-09-20T19:06:13.277 INFO:tasks.workunit.client.0.smithi027.stdout:6/982: readlink d4/l2e 0 2024-09-20T19:06:13.279 INFO:tasks.workunit.client.0.smithi027.stdout:1/944: dread d2/d8/d74/ff1 [0,4194304] 0 2024-09-20T19:06:13.280 INFO:tasks.workunit.client.0.smithi027.stdout:1/945: stat d2/d8/d74/d84/dca/deb 0 2024-09-20T19:06:13.285 INFO:tasks.workunit.client.0.smithi027.stdout:6/983: rename d4/d6/c23 to d4/d15/d37/d6a/da5/d146/c14a 0 2024-09-20T19:06:13.288 INFO:tasks.workunit.client.0.smithi027.stdout:7/901: creat d3/d8/d26/d65/dc4/d106/f12e x:0 0 0 2024-09-20T19:06:13.291 INFO:tasks.workunit.client.0.smithi027.stdout:6/984: rename d4/d15/d37/d7a/d33/l13c to d4/d15/d93/dd5/l14b 0 2024-09-20T19:06:13.294 INFO:tasks.workunit.client.0.smithi027.stdout:1/946: getdents d2/d8/d2b 0 2024-09-20T19:06:13.296 INFO:tasks.workunit.client.0.smithi027.stdout:7/902: creat d3/f12f x:0 0 0 2024-09-20T19:06:13.297 INFO:tasks.workunit.client.0.smithi027.stdout:6/985: creat d4/d12a/f14c x:0 0 0 2024-09-20T19:06:13.300 INFO:tasks.workunit.client.0.smithi027.stdout:7/903: chown d3/d8/ca6 28070879 1 2024-09-20T19:06:13.301 INFO:tasks.workunit.client.0.smithi027.stdout:6/986: readlink d4/d15/d37/d5a/d78/dbc/lfa 0 2024-09-20T19:06:13.301 INFO:tasks.workunit.client.0.smithi027.stdout:7/904: chown d3/d8/d26/d45/d56/dec/d2e/d39/d102/db2/le9 973610 1 2024-09-20T19:06:13.302 INFO:tasks.workunit.client.0.smithi027.stdout:4/946: sync 2024-09-20T19:06:13.304 INFO:tasks.workunit.client.0.smithi027.stdout:6/987: mkdir d4/d6/d4b/dca/d14d 0 2024-09-20T19:06:13.305 INFO:tasks.workunit.client.0.smithi027.stdout:4/947: fsync d5/d13/d36/d48/d3f/d4c/d52/d87/d99/f61 0 2024-09-20T19:06:13.306 INFO:tasks.workunit.client.0.smithi027.stdout:4/948: stat d5/d11/d17/d1b/f101 0 2024-09-20T19:06:13.310 INFO:tasks.workunit.client.0.smithi027.stdout:4/949: creat d5/d13/d36/d48/d3f/f126 x:0 0 0 2024-09-20T19:06:13.314 INFO:tasks.workunit.client.1.smithi098.stdout:9/948: mkdir d4/d139 0 2024-09-20T19:06:13.317 INFO:tasks.workunit.client.0.smithi027.stdout:6/988: dread d4/d15/d37/fad [0,4194304] 0 2024-09-20T19:06:13.318 INFO:tasks.workunit.client.0.smithi027.stdout:6/989: dread - d4/fb3 zero size 2024-09-20T19:06:13.320 INFO:tasks.workunit.client.1.smithi098.stdout:8/905: rename d7/de/d11/l39 to d7/de/d11/d19/d122/l136 0 2024-09-20T19:06:13.324 INFO:tasks.workunit.client.1.smithi098.stdout:6/646: rename d0/d55/d82/da3/d8c/d9a/cba to d0/d55/d82/ccc 0 2024-09-20T19:06:13.325 INFO:tasks.workunit.client.0.smithi027.stdout:1/947: write d2/d8/d74/d84/f133 [2779347,47975] 0 2024-09-20T19:06:13.327 INFO:tasks.workunit.client.1.smithi098.stdout:8/906: mkdir d7/de/d11/d1d/d110/d11a/db6/d11d/d137 0 2024-09-20T19:06:13.329 INFO:tasks.workunit.client.1.smithi098.stdout:9/949: dread d4/f47 [0,4194304] 0 2024-09-20T19:06:13.330 INFO:tasks.workunit.client.1.smithi098.stdout:6/647: rename d0/l97 to d0/d55/d82/da3/d43/dc0/d65/lcd 0 2024-09-20T19:06:13.330 INFO:tasks.workunit.client.1.smithi098.stdout:9/950: write d4/de/d27/d4a/d21/d25/f75 [449795,17366] 0 2024-09-20T19:06:13.332 INFO:tasks.workunit.client.0.smithi027.stdout:1/948: symlink d2/d8/d74/l135 0 2024-09-20T19:06:13.333 INFO:tasks.workunit.client.1.smithi098.stdout:8/907: creat d7/de/d11/d1d/d110/d11a/d72/f138 x:0 0 0 2024-09-20T19:06:13.334 INFO:tasks.workunit.client.0.smithi027.stdout:6/990: dread d4/d15/d37/d7a/d8e/fbe [0,4194304] 0 2024-09-20T19:06:13.336 INFO:tasks.workunit.client.1.smithi098.stdout:6/648: write d0/de/d1b/f1f [1648106,89828] 0 2024-09-20T19:06:13.339 INFO:tasks.workunit.client.1.smithi098.stdout:9/951: rename d4/de/d27/l72 to d4/de/d27/d4a/d21/d25/df2/l13a 0 2024-09-20T19:06:13.340 INFO:tasks.workunit.client.0.smithi027.stdout:1/949: unlink d2/d8/f70 0 2024-09-20T19:06:13.340 INFO:tasks.workunit.client.0.smithi027.stdout:1/950: dread - d2/d8/d74/f119 zero size 2024-09-20T19:06:13.341 INFO:tasks.workunit.client.1.smithi098.stdout:8/908: mkdir d7/de/d11/d1d/d110/d139 0 2024-09-20T19:06:13.341 INFO:tasks.workunit.client.0.smithi027.stdout:1/951: chown d2/d8/d74/d84/dca 118 1 2024-09-20T19:06:13.343 INFO:tasks.workunit.client.1.smithi098.stdout:6/649: readlink d0/d55/d82/da3/d43/dc0/l69 0 2024-09-20T19:06:13.344 INFO:tasks.workunit.client.0.smithi027.stdout:4/950: fsync d5/d13/d36/d48/d3f/f86 0 2024-09-20T19:06:13.345 INFO:tasks.workunit.client.0.smithi027.stdout:4/951: read - d5/d11/d17/d1b/d8d/ddb/f105 zero size 2024-09-20T19:06:13.346 INFO:tasks.workunit.client.1.smithi098.stdout:9/952: unlink d4/de/d48/dec/f11d 0 2024-09-20T19:06:13.347 INFO:tasks.workunit.client.1.smithi098.stdout:9/953: stat d4/de/d27/d4a/d21/ce4 0 2024-09-20T19:06:13.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/909: rmdir d7/de/d11/d1f 39 2024-09-20T19:06:13.349 INFO:tasks.workunit.client.0.smithi027.stdout:4/952: write d5/f37 [3625984,28654] 0 2024-09-20T19:06:13.351 INFO:tasks.workunit.client.1.smithi098.stdout:6/650: rmdir d0/d55/d82/da3/d43/dc0/d65 39 2024-09-20T19:06:13.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/723: dwrite d1/d17/d35/d54/d68/fc4 [0,4194304] 0 2024-09-20T19:06:13.352 INFO:tasks.workunit.client.0.smithi027.stdout:1/952: creat d2/d8/d3b/d82/d87/dcf/d112/d132/f136 x:0 0 0 2024-09-20T19:06:13.353 INFO:tasks.workunit.client.0.smithi027.stdout:1/953: readlink d2/d8/d3b/d4b/l7e 0 2024-09-20T19:06:13.354 INFO:tasks.workunit.client.0.smithi027.stdout:6/991: write d4/f41 [2175432,9527] 0 2024-09-20T19:06:13.356 INFO:tasks.workunit.client.0.smithi027.stdout:4/953: symlink d5/d13/d36/d59/l127 0 2024-09-20T19:06:13.359 INFO:tasks.workunit.client.0.smithi027.stdout:4/954: write d5/d13/dff/f11f [172304,78615] 0 2024-09-20T19:06:13.359 INFO:tasks.workunit.client.0.smithi027.stdout:6/992: creat d4/d6/de3/f14e x:0 0 0 2024-09-20T19:06:13.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/954: mkdir d4/de/d27/d6c/d73/d106/d13b 0 2024-09-20T19:06:13.362 INFO:tasks.workunit.client.1.smithi098.stdout:8/910: rename d7/de/d11/d19/d30/d68/lc8 to d7/de/d11/d1f/d9c/l13a 0 2024-09-20T19:06:13.362 INFO:tasks.workunit.client.0.smithi027.stdout:1/954: dwrite d2/d8/d3b/d82/d87/dcf/d112/d132/f136 [0,4194304] 0 2024-09-20T19:06:13.363 INFO:tasks.workunit.client.1.smithi098.stdout:8/911: chown d7/de/d11/d19/d30/f62 1 1 2024-09-20T19:06:13.364 INFO:tasks.workunit.client.1.smithi098.stdout:5/724: symlink d1/d17/d5e/dd9/le0 0 2024-09-20T19:06:13.365 INFO:tasks.workunit.client.1.smithi098.stdout:8/912: write d7/de/d11/d19/d30/d55/da9/dbe/feb [369425,103065] 0 2024-09-20T19:06:13.365 INFO:tasks.workunit.client.1.smithi098.stdout:5/725: chown d1/d82 58440811 1 2024-09-20T19:06:13.367 INFO:tasks.workunit.client.0.smithi027.stdout:6/993: creat d4/d15/d37/d6a/da5/f14f x:0 0 0 2024-09-20T19:06:13.369 INFO:tasks.workunit.client.1.smithi098.stdout:6/651: creat d0/d55/d82/da3/d43/da8/fce x:0 0 0 2024-09-20T19:06:13.378 INFO:tasks.workunit.client.0.smithi027.stdout:4/955: creat d5/d9b/db0/dcd/f128 x:0 0 0 2024-09-20T19:06:13.379 INFO:tasks.workunit.client.0.smithi027.stdout:4/956: write d5/d11/d3d/db4/fd0 [971225,119815] 0 2024-09-20T19:06:13.381 INFO:tasks.workunit.client.0.smithi027.stdout:1/955: write d2/d8/d3b/d82/fda [192223,100986] 0 2024-09-20T19:06:13.382 INFO:tasks.workunit.client.1.smithi098.stdout:5/726: write d1/d71/fd7 [67075,12114] 0 2024-09-20T19:06:13.383 INFO:tasks.workunit.client.0.smithi027.stdout:4/957: mkdir d5/d13/d36/d48/d129 0 2024-09-20T19:06:13.384 INFO:tasks.workunit.client.1.smithi098.stdout:8/913: write d7/de/d11/d19/d30/d55/fd9 [676299,58293] 0 2024-09-20T19:06:13.384 INFO:tasks.workunit.client.1.smithi098.stdout:9/955: dwrite d4/de/d27/d4a/d21/d25/df2/d132/d5b/d8f/d9e/fd3 [0,4194304] 0 2024-09-20T19:06:13.385 INFO:tasks.workunit.client.0.smithi027.stdout:6/994: link d4/d15/d37/d7a/lc1 d4/d15/d93/l150 0 2024-09-20T19:06:13.385 INFO:tasks.workunit.client.1.smithi098.stdout:9/956: truncate f3 1646253 0 2024-09-20T19:06:13.386 INFO:tasks.workunit.client.1.smithi098.stdout:6/652: mkdir d0/d55/d82/da3/d44/dcf 0 2024-09-20T19:06:13.387 INFO:tasks.workunit.client.0.smithi027.stdout:1/956: unlink d2/d8/d3b/d82/d90/lfe 0 2024-09-20T19:06:13.388 INFO:tasks.workunit.client.1.smithi098.stdout:6/653: write d0/de/f18 [1195626,30750] 0 2024-09-20T19:06:13.389 INFO:tasks.workunit.client.0.smithi027.stdout:4/958: creat d5/d11/d1a/d2a/da3/f12a x:0 0 0 2024-09-20T19:06:13.391 INFO:tasks.workunit.client.0.smithi027.stdout:6/995: write d4/d15/d37/d7a/fba [373470,100625] 0 2024-09-20T19:06:13.392 INFO:tasks.workunit.client.1.smithi098.stdout:9/957: mknod d4/de/d24/d35/d2d/da6/c13c 0 2024-09-20T19:06:13.393 INFO:tasks.workunit.client.1.smithi098.stdout:9/958: chown d4/de/d27/d4a/d21/d25/ca9 4 1 2024-09-20T19:06:13.395 INFO:tasks.workunit.client.0.smithi027.stdout:4/959: symlink d5/d9b/db0/dcd/l12b 0 2024-09-20T19:06:13.398 INFO:tasks.workunit.client.0.smithi027.stdout:6/996: mkdir d4/d15/d37/d5a/d78/d151 0 2024-09-20T19:06:13.398 INFO:tasks.workunit.client.1.smithi098.stdout:8/914: write d7/de/f92 [95108,55034] 0 2024-09-20T19:06:13.400 INFO:tasks.workunit.client.0.smithi027.stdout:4/960: dread d5/d11/d17/d1b/dd4/f10e [0,4194304] 0 2024-09-20T19:06:13.400 INFO:tasks.workunit.client.1.smithi098.stdout:9/959: creat d4/de/d27/d4a/d21/d25/df2/d132/d5b/d112/f13d x:0 0 0 2024-09-20T19:06:13.401 INFO:tasks.workunit.client.1.smithi098.stdout:6/654: mknod d0/d55/d82/da3/d43/cd0 0 2024-09-20T19:06:13.403 INFO:tasks.workunit.client.1.smithi098.stdout:6/655: write d0/d55/d82/da3/d44/d24/d29/f99 [1540821,28809] 0 2024-09-20T19:06:13.408 INFO:tasks.workunit.client.0.smithi027.stdout:1/957: dread d2/d61/df8/f4f [0,4194304] 0 2024-09-20T19:06:13.408 INFO:tasks.workunit.client.0.smithi027.stdout:6/997: rename d4/d15/d37/d6a/da5/d146/c14a to d4/d15/d37/d5a/c152 0 2024-09-20T19:06:13.409 INFO:tasks.workunit.client.1.smithi098.stdout:9/960: creat d4/de/d48/de8/d10e/f13e x:0 0 0 2024-09-20T19:06:13.410 INFO:tasks.workunit.client.0.smithi027.stdout:4/961: mknod d5/d11/d3d/c12c 0 2024-09-20T19:06:13.411 INFO:tasks.workunit.client.1.smithi098.stdout:6/656: unlink d0/de/d1b/f1f 0 2024-09-20T19:06:13.414 INFO:tasks.workunit.client.1.smithi098.stdout:9/961: unlink d4/de/d27/d88/d122/c12a 0 2024-09-20T19:06:13.415 INFO:tasks.workunit.client.0.smithi027.stdout:4/962: rename d5/d11/d3d/lec to d5/d11/d3d/db4/l12d 0 2024-09-20T19:06:13.415 INFO:tasks.workunit.client.1.smithi098.stdout:9/962: chown d4/de/d48/f4d 44 1 2024-09-20T19:06:13.416 INFO:tasks.workunit.client.1.smithi098.stdout:8/915: dwrite d7/de/d11/fb8 [0,4194304] 0 2024-09-20T19:06:13.417 INFO:tasks.workunit.client.1.smithi098.stdout:6/657: chown d0/de/d1b/ca2 55325 1 2024-09-20T19:06:13.418 INFO:tasks.workunit.client.0.smithi027.stdout:6/998: creat d4/d15/d37/d5a/d78/d151/f153 x:0 0 0 2024-09-20T19:06:13.418 INFO:tasks.workunit.client.1.smithi098.stdout:6/658: dread - d0/d55/d82/da3/d44/dc/f5c zero size 2024-09-20T19:06:13.418 INFO:tasks.workunit.client.1.smithi098.stdout:9/963: creat d4/de/d27/f13f x:0 0 0 2024-09-20T19:06:13.420 INFO:tasks.workunit.client.1.smithi098.stdout:6/659: write d0/d55/d82/da3/d44/d24/d29/f35 [4586747,104840] 0 2024-09-20T19:06:13.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/916: symlink d7/de/d11/d1f/l13b 0 2024-09-20T19:06:13.422 INFO:tasks.workunit.client.0.smithi027.stdout:6/999: read d4/d15/d37/d7a/d46/d53/f101 [2508052,86487] 0 2024-09-20T19:06:13.423 INFO:tasks.workunit.client.1.smithi098.stdout:9/964: mknod d4/de/d24/d35/d6d/c140 0 2024-09-20T19:06:13.428 INFO:tasks.workunit.client.1.smithi098.stdout:6/660: dwrite d0/d55/d82/da3/d8c/d4c/fa1 [0,4194304] 0 2024-09-20T19:06:13.428 INFO:tasks.workunit.client.0.smithi027.stdout:1/958: write d2/d8/fa0 [6125185,58116] 0 2024-09-20T19:06:13.431 INFO:tasks.workunit.client.1.smithi098.stdout:8/917: symlink d7/de/d11/d1d/l13c 0 2024-09-20T19:06:13.432 INFO:tasks.workunit.client.0.smithi027.stdout:4/963: write d5/d9b/f5e [3442851,3319] 0 2024-09-20T19:06:13.433 INFO:tasks.workunit.client.0.smithi027.stdout:1/959: creat d2/d8/d3b/d82/d87/dcf/d112/f137 x:0 0 0 2024-09-20T19:06:13.434 INFO:tasks.workunit.client.1.smithi098.stdout:9/965: mkdir d4/de/d27/d4a/d21/d25/df2/d132/d141 0 2024-09-20T19:06:13.435 INFO:tasks.workunit.client.1.smithi098.stdout:6/661: mknod d0/d55/d82/da3/d43/dc0/d7c/cd1 0 2024-09-20T19:06:13.440 INFO:tasks.workunit.client.0.smithi027.stdout:1/960: dread - d2/d8/d3b/d82/d87/dcf/d112/f137 zero size 2024-09-20T19:06:13.442 INFO:tasks.workunit.client.1.smithi098.stdout:8/918: getdents d7/de/d11/d19/daf 0 2024-09-20T19:06:13.445 INFO:tasks.workunit.client.1.smithi098.stdout:6/662: mknod d0/d55/d82/da3/d44/dcf/cd2 0 2024-09-20T19:06:13.446 INFO:tasks.workunit.client.1.smithi098.stdout:8/919: rmdir d7/de/d11/d19/d30/d55/da9/dbe 39 2024-09-20T19:06:13.447 INFO:tasks.workunit.client.1.smithi098.stdout:9/966: getdents d4/d74/d8a 0 2024-09-20T19:06:13.448 INFO:tasks.workunit.client.1.smithi098.stdout:9/967: readlink d4/de/d24/d35/d2d/da6/dae/lca 0 2024-09-20T19:06:13.449 INFO:tasks.workunit.client.1.smithi098.stdout:8/920: rmdir d7/de/d11/d1d/d110/d11a/daa 39 2024-09-20T19:06:13.456 INFO:tasks.workunit.client.1.smithi098.stdout:9/968: getdents d4/de/d24/d35/d2d 0 2024-09-20T19:06:13.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/969: creat d4/de/d24/d35/dc4/f142 x:0 0 0 2024-09-20T19:06:13.463 INFO:tasks.workunit.client.1.smithi098.stdout:6/663: truncate d0/de/f18 3292003 0 2024-09-20T19:06:13.465 INFO:tasks.workunit.client.1.smithi098.stdout:9/970: link d4/de/f10b d4/de/d24/d35/d2d/da6/f143 0 2024-09-20T19:06:13.467 INFO:tasks.workunit.client.1.smithi098.stdout:8/921: write d7/de/d11/d1d/f7c [598118,130041] 0 2024-09-20T19:06:13.468 INFO:tasks.workunit.client.0.smithi027.stdout:7/905: sync 2024-09-20T19:06:13.470 INFO:tasks.workunit.client.1.smithi098.stdout:8/922: mknod d7/de/d11/d1d/d110/d11a/db0/c13d 0 2024-09-20T19:06:13.471 INFO:tasks.workunit.client.0.smithi027.stdout:7/906: truncate d3/d8/d26/d45/d56/dec/d51/fcd 417719 0 2024-09-20T19:06:13.474 INFO:tasks.workunit.client.1.smithi098.stdout:8/923: mknod d7/de/d11/d19/d30/d82/c13e 0 2024-09-20T19:06:13.478 INFO:tasks.workunit.client.1.smithi098.stdout:8/924: mknod d7/de/d11/d19/d30/db5/d134/c13f 0 2024-09-20T19:06:13.483 INFO:tasks.workunit.client.1.smithi098.stdout:9/971: dread d4/de/d24/d35/f42 [0,4194304] 0 2024-09-20T19:06:13.484 INFO:tasks.workunit.client.1.smithi098.stdout:9/972: readlink d4/de/d27/d4a/d8e/lfa 0 2024-09-20T19:06:13.484 INFO:tasks.workunit.client.1.smithi098.stdout:9/973: chown d4/de/d27/dc9/c131 5 1 2024-09-20T19:06:13.485 INFO:tasks.workunit.client.1.smithi098.stdout:8/925: symlink d7/de/d11/d19/d30/d55/da9/l140 0 2024-09-20T19:06:13.486 INFO:tasks.workunit.client.1.smithi098.stdout:9/974: chown d4/de/d24/d35/d2d/da6/dae/d86/fcb 75 1 2024-09-20T19:06:13.487 INFO:tasks.workunit.client.1.smithi098.stdout:6/664: write d0/d55/d82/da3/d43/d51/f72 [2975041,113871] 0 2024-09-20T19:06:13.487 INFO:tasks.workunit.client.1.smithi098.stdout:9/975: truncate d4/de/d27/f13f 477887 0 2024-09-20T19:06:13.488 INFO:tasks.workunit.client.1.smithi098.stdout:6/665: write d0/d55/d82/da3/d43/d6d/f92 [555768,107901] 0 2024-09-20T19:06:13.489 INFO:tasks.workunit.client.1.smithi098.stdout:8/926: truncate d7/de/d11/d1d/f1e 1072683 0 2024-09-20T19:06:13.491 INFO:tasks.workunit.client.1.smithi098.stdout:8/927: dread - d7/de/d11/d19/d30/d59/d80/fa1 zero size 2024-09-20T19:06:13.493 INFO:tasks.workunit.client.1.smithi098.stdout:9/976: creat d4/de/d48/de8/d10e/f144 x:0 0 0 2024-09-20T19:06:13.493 INFO:tasks.workunit.client.0.smithi027.stdout:4/964: truncate d5/d13/d36/d59/feb 166457 0 2024-09-20T19:06:13.494 INFO:tasks.workunit.client.0.smithi027.stdout:4/965: chown d5/d13/d36/d59/f5b 78 1 2024-09-20T19:06:13.495 INFO:tasks.workunit.client.1.smithi098.stdout:6/666: read d0/d55/d82/da3/d44/f85 [247746,61767] 0 2024-09-20T19:06:13.495 INFO:tasks.workunit.client.0.smithi027.stdout:1/961: symlink d2/d8/d3b/d44/d93/l138 0 2024-09-20T19:06:13.497 INFO:tasks.workunit.client.0.smithi027.stdout:7/907: creat d3/d8/d26/d65/dc4/d106/f130 x:0 0 0 2024-09-20T19:06:13.498 INFO:tasks.workunit.client.0.smithi027.stdout:4/966: rmdir d5/d13/d36/d48/d9f/dc9 39 2024-09-20T19:06:13.498 INFO:tasks.workunit.client.0.smithi027.stdout:7/908: stat d3/d8/d1c/cdc 0 2024-09-20T19:06:13.499 INFO:tasks.workunit.client.1.smithi098.stdout:8/928: mkdir d7/de/d11/d19/d30/d55/da9/dbe/d141 0 2024-09-20T19:06:13.500 INFO:tasks.workunit.client.0.smithi027.stdout:1/962: creat d2/d61/df8/dde/d124/f139 x:0 0 0 2024-09-20T19:06:13.500 INFO:tasks.workunit.client.1.smithi098.stdout:8/929: write d7/de/d11/d1f/d9c/fc6 [1458365,91629] 0 2024-09-20T19:06:13.502 INFO:tasks.workunit.client.1.smithi098.stdout:8/930: fsync d7/de/d11/d1d/d110/d11a/f11b 0 2024-09-20T19:06:13.502 INFO:tasks.workunit.client.1.smithi098.stdout:8/931: chown d7/f3a 10618616 1 2024-09-20T19:06:13.505 INFO:tasks.workunit.client.0.smithi027.stdout:7/909: rename d3/d8/d26/d45/daa/f111 to d3/d8/d26/d45/d56/dec/dc/da9/db6/f131 0 2024-09-20T19:06:13.506 INFO:tasks.workunit.client.1.smithi098.stdout:8/932: truncate d7/de/d11/d1d/d110/d11a/d72/f75 796960 0 2024-09-20T19:06:13.508 INFO:tasks.workunit.client.0.smithi027.stdout:1/963: mkdir d2/d8/d3b/d82/d87/d13a 0 2024-09-20T19:06:13.508 INFO:tasks.workunit.client.1.smithi098.stdout:6/667: dread d0/d55/d82/da3/d43/d51/f72 [0,4194304] 0 2024-09-20T19:06:13.509 INFO:tasks.workunit.client.1.smithi098.stdout:6/668: chown d0/d55/d82/da3/d43/dc0 170061000 1 2024-09-20T19:06:13.509 INFO:tasks.workunit.client.0.smithi027.stdout:7/910: unlink d3/d8/d26/d45/dcc/ff5 0 2024-09-20T19:06:13.510 INFO:tasks.workunit.client.0.smithi027.stdout:4/967: creat d5/d11/f12e x:0 0 0 2024-09-20T19:06:13.510 INFO:tasks.workunit.client.1.smithi098.stdout:8/933: unlink d7/de/d11/d1f/d10a/l107 0 2024-09-20T19:06:13.511 INFO:tasks.workunit.client.0.smithi027.stdout:1/964: mknod d2/d8/d3b/d82/d90/d108/da3/dad/df9/c13b 0 2024-09-20T19:06:13.511 INFO:tasks.workunit.client.1.smithi098.stdout:6/669: rmdir d0/d55/d82/da3/d43/dc0/d66 39 2024-09-20T19:06:13.512 INFO:tasks.workunit.client.0.smithi027.stdout:4/968: rmdir d5/d11/d17/d1b/d8d 39 2024-09-20T19:06:13.512 INFO:tasks.workunit.client.0.smithi027.stdout:4/969: readlink d5/d11/l19 0 2024-09-20T19:06:13.513 INFO:tasks.workunit.client.1.smithi098.stdout:8/934: creat d7/de/d11/d1f/f142 x:0 0 0 2024-09-20T19:06:13.514 INFO:tasks.workunit.client.0.smithi027.stdout:7/911: creat d3/d8/d26/d45/d56/dec/d2e/d39/d102/db2/f132 x:0 0 0 2024-09-20T19:06:13.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/935: dread - d7/de/d11/d1d/d110/d11a/d72/f138 zero size 2024-09-20T19:06:13.516 INFO:tasks.workunit.client.0.smithi027.stdout:4/970: symlink d5/d13/dff/l12f 0 2024-09-20T19:06:13.517 INFO:tasks.workunit.client.1.smithi098.stdout:8/936: symlink d7/de/l143 0 2024-09-20T19:06:13.517 INFO:tasks.workunit.client.0.smithi027.stdout:4/971: dread - d5/d11/d17/d1b/f101 zero size 2024-09-20T19:06:13.518 INFO:tasks.workunit.client.1.smithi098.stdout:8/937: write d7/de/d11/d19/d30/d55/da9/f103 [920454,40707] 0 2024-09-20T19:06:13.522 INFO:tasks.workunit.client.0.smithi027.stdout:4/972: chown d5/d13/d36/d48/d3f/d4c/d52/d87/d99/l57 0 1 2024-09-20T19:06:13.522 INFO:tasks.workunit.client.1.smithi098.stdout:8/938: mknod d7/dd2/c144 0 2024-09-20T19:06:13.523 INFO:tasks.workunit.client.0.smithi027.stdout:1/965: link d2/d8/d2b/d5e/d101/c77 d2/d8/d3b/d82/c13c 0 2024-09-20T19:06:13.524 INFO:tasks.workunit.client.0.smithi027.stdout:7/912: dread d3/d8/d26/d45/f95 [0,4194304] 0 2024-09-20T19:06:13.526 INFO:tasks.workunit.client.0.smithi027.stdout:1/966: chown d2/d8/d74/l26 8012923 1 2024-09-20T19:06:13.527 INFO:tasks.workunit.client.0.smithi027.stdout:7/913: creat d3/d8/d26/d45/d56/dec/d51/f133 x:0 0 0 2024-09-20T19:06:13.530 INFO:tasks.workunit.client.0.smithi027.stdout:1/967: creat d2/d8/d3b/d82/d87/dcf/d112/f13d x:0 0 0 2024-09-20T19:06:13.532 INFO:tasks.workunit.client.0.smithi027.stdout:4/973: creat d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/d118/f130 x:0 0 0 2024-09-20T19:06:13.533 INFO:tasks.workunit.client.0.smithi027.stdout:4/974: write d5/d13/d36/d48/d9f/dc9/d8f/dc5/ff6 [690469,16159] 0 2024-09-20T19:06:13.535 INFO:tasks.workunit.client.0.smithi027.stdout:7/914: mknod d3/d24/d84/c134 0 2024-09-20T19:06:13.537 INFO:tasks.workunit.client.0.smithi027.stdout:4/975: write d5/d13/d36/d48/d3f/fb6 [2179527,88480] 0 2024-09-20T19:06:13.539 INFO:tasks.workunit.client.0.smithi027.stdout:7/915: dread - d3/d8/d26/d45/d56/dec/d2e/d39/d116/f121 zero size 2024-09-20T19:06:13.542 INFO:tasks.workunit.client.0.smithi027.stdout:4/976: rename d5/d11/d1a/d2a/c9d to d5/d11/d17/d1b/dd4/c131 0 2024-09-20T19:06:13.543 INFO:tasks.workunit.client.0.smithi027.stdout:4/977: fdatasync d5/d9b/db0/fd7 0 2024-09-20T19:06:13.543 INFO:tasks.workunit.client.0.smithi027.stdout:7/916: unlink d3/d8/d26/d45/d56/dec/d2e/d39/d116/fee 0 2024-09-20T19:06:13.543 INFO:tasks.workunit.client.0.smithi027.stdout:4/978: stat d5/d11/d17/d1b/dd4 0 2024-09-20T19:06:13.547 INFO:tasks.workunit.client.0.smithi027.stdout:7/917: creat d3/d8/d26/d45/d56/d8d/dfb/f135 x:0 0 0 2024-09-20T19:06:13.550 INFO:tasks.workunit.client.0.smithi027.stdout:4/979: link d5/d11/d1a/d2a/da3/de2/c11a d5/d13/d36/d48/d9f/dc9/d8f/dc5/df2/c132 0 2024-09-20T19:06:13.551 INFO:tasks.workunit.client.0.smithi027.stdout:4/980: dread - d5/d11/d3d/db4/d11c/f121 zero size 2024-09-20T19:06:13.551 INFO:tasks.workunit.client.1.smithi098.stdout:6/670: dwrite d0/d55/d82/da3/d44/f13 [0,4194304] 0 2024-09-20T19:06:13.552 INFO:tasks.workunit.client.0.smithi027.stdout:7/918: creat d3/d8/d26/f136 x:0 0 0 2024-09-20T19:06:13.552 INFO:tasks.workunit.client.1.smithi098.stdout:6/671: chown d0/de/d1b/l94 127693 1 2024-09-20T19:06:13.553 INFO:tasks.workunit.client.0.smithi027.stdout:4/981: rmdir d5/d11/d1a/d2a/da3/de2 39 2024-09-20T19:06:13.554 INFO:tasks.workunit.client.1.smithi098.stdout:8/939: write d7/de/d11/d19/d30/d68/f12f [3881348,31602] 0 2024-09-20T19:06:13.556 INFO:tasks.workunit.client.0.smithi027.stdout:7/919: mkdir d3/d5e/d137 0 2024-09-20T19:06:13.558 INFO:tasks.workunit.client.1.smithi098.stdout:6/672: truncate d0/d55/d82/da3/d44/d24/f52 2810598 0 2024-09-20T19:06:13.561 INFO:tasks.workunit.client.1.smithi098.stdout:8/940: mknod d7/de/d11/d1d/d110/d11a/db0/d11f/c145 0 2024-09-20T19:06:13.564 INFO:tasks.workunit.client.1.smithi098.stdout:6/673: read d0/de/d1b/f28 [15137,20758] 0 2024-09-20T19:06:13.564 INFO:tasks.workunit.client.0.smithi027.stdout:7/920: creat d3/d8/d26/d45/d56/dec/d2e/d50/db8/df2/f138 x:0 0 0 2024-09-20T19:06:13.564 INFO:tasks.workunit.client.0.smithi027.stdout:1/968: dwrite d2/d8/d41/f88 [0,4194304] 0 2024-09-20T19:06:13.565 INFO:tasks.workunit.client.1.smithi098.stdout:6/674: fdatasync d0/d55/d82/da3/d43/dc0/fc7 0 2024-09-20T19:06:13.565 INFO:tasks.workunit.client.0.smithi027.stdout:7/921: readlink d3/d8/l30 0 2024-09-20T19:06:13.566 INFO:tasks.workunit.client.1.smithi098.stdout:6/675: read - d0/d55/d82/da3/d8c/d4c/f9c zero size 2024-09-20T19:06:13.567 INFO:tasks.workunit.client.0.smithi027.stdout:7/922: readlink d3/d8/d26/d45/daa/l127 0 2024-09-20T19:06:13.568 INFO:tasks.workunit.client.1.smithi098.stdout:6/676: mknod d0/d55/d82/da3/d43/dc0/d7c/cd3 0 2024-09-20T19:06:13.570 INFO:tasks.workunit.client.0.smithi027.stdout:1/969: mknod d2/d61/df8/d56/d71/d125/c13e 0 2024-09-20T19:06:13.571 INFO:tasks.workunit.client.0.smithi027.stdout:1/970: write d2/d8/d41/fe0 [556977,72087] 0 2024-09-20T19:06:13.572 INFO:tasks.workunit.client.0.smithi027.stdout:7/923: mknod d3/d8/d26/d45/d56/d8d/dc8/c139 0 2024-09-20T19:06:13.575 INFO:tasks.workunit.client.1.smithi098.stdout:6/677: mknod d0/d55/d82/da3/d44/d24/d29/d50/dbe/cd4 0 2024-09-20T19:06:13.576 INFO:tasks.workunit.client.1.smithi098.stdout:6/678: write d0/d55/d82/da3/d8c/fb4 [10756,102619] 0 2024-09-20T19:06:13.596 INFO:tasks.workunit.client.0.smithi027.stdout:7/924: read - d3/d8/d26/d45/dcc/ffa zero size 2024-09-20T19:06:13.598 INFO:tasks.workunit.client.0.smithi027.stdout:7/925: creat d3/d8/d26/d45/d56/dec/d2e/d50/f13a x:0 0 0 2024-09-20T19:06:13.602 INFO:tasks.workunit.client.0.smithi027.stdout:7/926: creat d3/d8/f13b x:0 0 0 2024-09-20T19:06:13.602 INFO:tasks.workunit.client.0.smithi027.stdout:4/982: write d5/d13/d36/d48/d3f/d4c/d52/fc1 [1877378,126057] 0 2024-09-20T19:06:13.603 INFO:tasks.workunit.client.0.smithi027.stdout:7/927: readlink d3/d8/d26/d45/d56/d8d/dc8/lcf 0 2024-09-20T19:06:13.604 INFO:tasks.workunit.client.0.smithi027.stdout:4/983: symlink d5/d11/d3d/d6e/l133 0 2024-09-20T19:06:13.607 INFO:tasks.workunit.client.0.smithi027.stdout:1/971: write d2/d8/d74/fed [316803,102117] 0 2024-09-20T19:06:13.608 INFO:tasks.workunit.client.1.smithi098.stdout:6/679: rename d0/d55/d82/da3/d44 to d0/d55/d82/dd5 0 2024-09-20T19:06:13.611 INFO:tasks.workunit.client.0.smithi027.stdout:1/972: rename d2/d8/d3b/d82/d90/d108 to d2/d8/d2b/d5e/d101/d13f 0 2024-09-20T19:06:13.614 INFO:tasks.workunit.client.1.smithi098.stdout:6/680: dwrite d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:13.617 INFO:tasks.workunit.client.0.smithi027.stdout:4/984: dread d5/d9b/f4e [0,4194304] 0 2024-09-20T19:06:13.621 INFO:tasks.workunit.client.0.smithi027.stdout:7/928: dread d3/d8/d26/f71 [0,4194304] 0 2024-09-20T19:06:13.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/681: dwrite d0/d55/d82/dd5/d24/d29/f35 [4194304,4194304] 0 2024-09-20T19:06:13.623 INFO:tasks.workunit.client.0.smithi027.stdout:4/985: read d5/d13/d36/d48/d3f/d7e/fd9 [149645,106144] 0 2024-09-20T19:06:13.623 INFO:tasks.workunit.client.0.smithi027.stdout:7/929: write d3/d8/d26/d45/d56/dec/d51/fde [371273,59865] 0 2024-09-20T19:06:13.626 INFO:tasks.workunit.client.0.smithi027.stdout:4/986: mkdir d5/d11/d3d/db4/d134 0 2024-09-20T19:06:13.631 INFO:tasks.workunit.client.0.smithi027.stdout:7/930: read d3/d8/d26/d45/d56/dec/d2e/d39/f3b [2098035,71447] 0 2024-09-20T19:06:13.633 INFO:tasks.workunit.client.0.smithi027.stdout:1/973: dread d2/d8/d2b/f9d [0,4194304] 0 2024-09-20T19:06:13.635 INFO:tasks.workunit.client.0.smithi027.stdout:7/931: mkdir d3/d8/d26/d45/d56/d8d/dc8/d13c 0 2024-09-20T19:06:13.637 INFO:tasks.workunit.client.0.smithi027.stdout:7/932: write d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f42 [2989471,124622] 0 2024-09-20T19:06:13.639 INFO:tasks.workunit.client.0.smithi027.stdout:7/933: mkdir d3/d24/d13d 0 2024-09-20T19:06:13.641 INFO:tasks.workunit.client.0.smithi027.stdout:4/987: dwrite d5/d13/d36/d48/d3f/d4c/d52/d87/fbe [0,4194304] 0 2024-09-20T19:06:13.641 INFO:tasks.workunit.client.0.smithi027.stdout:7/934: dread - d3/d8/d26/d45/d56/d8d/fd3 zero size 2024-09-20T19:06:13.641 INFO:tasks.workunit.client.1.smithi098.stdout:6/682: dread d0/d55/d82/da3/d43/f98 [0,4194304] 0 2024-09-20T19:06:13.642 INFO:tasks.workunit.client.0.smithi027.stdout:4/988: chown d5/d13/d36/d48/d3f/d4c/d52/d87 4631 1 2024-09-20T19:06:13.643 INFO:tasks.workunit.client.0.smithi027.stdout:4/989: mknod d5/d11/d3d/d6e/c135 0 2024-09-20T19:06:13.649 INFO:tasks.workunit.client.1.smithi098.stdout:6/683: truncate d0/de/f5f 3797044 0 2024-09-20T19:06:13.651 INFO:tasks.workunit.client.1.smithi098.stdout:6/684: readlink d0/d55/d82/da3/d43/d51/l57 0 2024-09-20T19:06:13.657 INFO:tasks.workunit.client.0.smithi027.stdout:4/990: dread d5/d9b/db0/fba [0,4194304] 0 2024-09-20T19:06:13.659 INFO:tasks.workunit.client.0.smithi027.stdout:4/991: read d5/d13/fa4 [1177713,117229] 0 2024-09-20T19:06:13.660 INFO:tasks.workunit.client.0.smithi027.stdout:4/992: mkdir d5/d13/d16/d136 0 2024-09-20T19:06:13.661 INFO:tasks.workunit.client.0.smithi027.stdout:4/993: chown d5/d11/d17/d1b/dd4/de3/d114 2329573 1 2024-09-20T19:06:13.663 INFO:tasks.workunit.client.1.smithi098.stdout:6/685: dwrite d0/d55/d82/dd5/d24/d29/f8d [0,4194304] 0 2024-09-20T19:06:13.663 INFO:tasks.workunit.client.0.smithi027.stdout:4/994: creat d5/d80/f137 x:0 0 0 2024-09-20T19:06:13.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/686: unlink d0/d55/d82/dd5/d24/d29/l33 0 2024-09-20T19:06:13.669 INFO:tasks.workunit.client.1.smithi098.stdout:6/687: write d0/d55/d82/dd5/d24/d29/f35 [1364495,65446] 0 2024-09-20T19:06:13.669 INFO:tasks.workunit.client.0.smithi027.stdout:4/995: mkdir d5/d13/d36/d59/d138 0 2024-09-20T19:06:13.671 INFO:tasks.workunit.client.1.smithi098.stdout:6/688: rmdir d0/d55/d82/da3/d43/da8 39 2024-09-20T19:06:13.671 INFO:tasks.workunit.client.1.smithi098.stdout:6/689: readlink d0/d55/lb9 0 2024-09-20T19:06:13.674 INFO:tasks.workunit.client.1.smithi098.stdout:6/690: mkdir d0/d55/d82/dd5/d24/dd6 0 2024-09-20T19:06:13.678 INFO:tasks.workunit.client.1.smithi098.stdout:6/691: link d0/d55/d82/da3/d43/c49 d0/d55/d82/dd5/d24/cd7 0 2024-09-20T19:06:13.679 INFO:tasks.workunit.client.1.smithi098.stdout:6/692: mkdir d0/d55/d82/dd5/dcf/dd8 0 2024-09-20T19:06:13.684 INFO:tasks.workunit.client.1.smithi098.stdout:6/693: dread d0/d55/d82/dd5/f85 [0,4194304] 0 2024-09-20T19:06:13.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/694: write d0/d55/d82/dd5/f3d [630449,87074] 0 2024-09-20T19:06:13.690 INFO:tasks.workunit.client.1.smithi098.stdout:6/695: unlink d0/d55/d82/dd5/dc/l4e 0 2024-09-20T19:06:13.692 INFO:tasks.workunit.client.1.smithi098.stdout:6/696: creat d0/d55/d82/da3/fd9 x:0 0 0 2024-09-20T19:06:13.700 INFO:tasks.workunit.client.1.smithi098.stdout:6/697: dwrite d0/de/d1b/f1c [0,4194304] 0 2024-09-20T19:06:13.703 INFO:tasks.workunit.client.1.smithi098.stdout:6/698: creat d0/d55/d82/da3/d43/dc0/fda x:0 0 0 2024-09-20T19:06:13.704 INFO:tasks.workunit.client.1.smithi098.stdout:6/699: chown d0/d55/d82/da3/d43/d51/cb1 226666 1 2024-09-20T19:06:13.707 INFO:tasks.workunit.client.1.smithi098.stdout:6/700: rename d0/de/c90 to d0/d55/d82/dd5/cdb 0 2024-09-20T19:06:13.708 INFO:tasks.workunit.client.1.smithi098.stdout:6/701: chown d0/d55/d82/da3/c5a 747549 1 2024-09-20T19:06:13.823 INFO:tasks.workunit.client.0.smithi027.stdout:7/935: sync 2024-09-20T19:06:13.823 INFO:tasks.workunit.client.0.smithi027.stdout:1/974: sync 2024-09-20T19:06:13.825 INFO:tasks.workunit.client.0.smithi027.stdout:7/936: mkdir d3/d8/d26/d45/d56/d8d/dc8/d13e 0 2024-09-20T19:06:13.825 INFO:tasks.workunit.client.0.smithi027.stdout:1/975: truncate d2/d8/d3b/d82/d87/fa5 282607 0 2024-09-20T19:06:13.828 INFO:tasks.workunit.client.0.smithi027.stdout:1/976: creat d2/d8/d3b/d82/d90/f140 x:0 0 0 2024-09-20T19:06:13.833 INFO:tasks.workunit.client.0.smithi027.stdout:1/977: dread d2/d8/d2b/d2d/d73/fa8 [0,4194304] 0 2024-09-20T19:06:13.836 INFO:tasks.workunit.client.0.smithi027.stdout:1/978: stat d2/d8/d74/d84/l118 0 2024-09-20T19:06:13.838 INFO:tasks.workunit.client.0.smithi027.stdout:1/979: unlink d2/d8/d3b/d44/fb2 0 2024-09-20T19:06:13.839 INFO:tasks.workunit.client.0.smithi027.stdout:7/937: dwrite d3/d8/d26/d45/d56/dec/d2e/d49/f9b [0,4194304] 0 2024-09-20T19:06:13.841 INFO:tasks.workunit.client.0.smithi027.stdout:1/980: rename d2/d8 to d2/d8/d2b/d5e/d141 22 2024-09-20T19:06:13.847 INFO:tasks.workunit.client.0.smithi027.stdout:1/981: rename d2/d8/d2b/d5e/d101/d13f/cc0 to d2/d61/df8/d56/d126/c142 0 2024-09-20T19:06:13.847 INFO:tasks.workunit.client.0.smithi027.stdout:1/982: chown d2/d8/d3b/d44 209155205 1 2024-09-20T19:06:13.847 INFO:tasks.workunit.client.0.smithi027.stdout:7/938: dread d3/d8/d26/f7f [0,4194304] 0 2024-09-20T19:06:13.848 INFO:tasks.workunit.client.0.smithi027.stdout:7/939: chown d3/d8/de5/cf8 112870075 1 2024-09-20T19:06:13.850 INFO:tasks.workunit.client.0.smithi027.stdout:1/983: creat d2/d8/d3b/d44/d93/df3/f143 x:0 0 0 2024-09-20T19:06:13.850 INFO:tasks.workunit.client.0.smithi027.stdout:1/984: fsync d2/d8/d74/d84/dca/d134/ff7 0 2024-09-20T19:06:13.856 INFO:tasks.workunit.client.0.smithi027.stdout:7/940: write d3/d8/d26/d45/d56/dec/d2e/d49/d8b/f6c [919188,5271] 0 2024-09-20T19:06:13.857 INFO:tasks.workunit.client.0.smithi027.stdout:1/985: write d2/d8/d41/fe8 [3442412,43916] 0 2024-09-20T19:06:13.858 INFO:tasks.workunit.client.0.smithi027.stdout:1/986: chown d2/d61/df8/d56/d71/f95 101 1 2024-09-20T19:06:13.858 INFO:tasks.workunit.client.0.smithi027.stdout:7/941: mkdir d3/d8/d1c/d13f 0 2024-09-20T19:06:13.860 INFO:tasks.workunit.client.0.smithi027.stdout:7/942: mknod d3/d8/c140 0 2024-09-20T19:06:13.861 INFO:tasks.workunit.client.0.smithi027.stdout:4/996: sync 2024-09-20T19:06:13.866 INFO:tasks.workunit.client.0.smithi027.stdout:7/943: truncate d3/d8/d26/f4a 405284 0 2024-09-20T19:06:13.872 INFO:tasks.workunit.client.0.smithi027.stdout:4/997: dwrite d5/d11/d1a/d2a/da3/fc8 [0,4194304] 0 2024-09-20T19:06:13.876 INFO:tasks.workunit.client.0.smithi027.stdout:7/944: dwrite d3/ff7 [0,4194304] 0 2024-09-20T19:06:13.877 INFO:tasks.workunit.client.0.smithi027.stdout:1/987: dread d2/d8/d74/d84/dca/deb/f102 [0,4194304] 0 2024-09-20T19:06:13.879 INFO:tasks.workunit.client.0.smithi027.stdout:4/998: write d5/d11/d17/d1b/dd4/f10e [761022,1862] 0 2024-09-20T19:06:13.881 INFO:tasks.workunit.client.0.smithi027.stdout:1/988: creat d2/d61/df8/d56/d126/f144 x:0 0 0 2024-09-20T19:06:13.882 INFO:tasks.workunit.client.0.smithi027.stdout:7/945: fsync d3/d8/d26/d45/d56/dec/d2e/d39/faf 0 2024-09-20T19:06:13.883 INFO:tasks.workunit.client.0.smithi027.stdout:4/999: mkdir d5/d13/d102/d139 0 2024-09-20T19:06:13.883 INFO:tasks.workunit.client.0.smithi027.stdout:1/989: chown d2/d8/d74/d84/dca/deb/f102 115184 1 2024-09-20T19:06:13.890 INFO:tasks.workunit.client.0.smithi027.stdout:7/946: dwrite d3/d8/d26/d45/d56/dec/d2e/f128 [0,4194304] 0 2024-09-20T19:06:13.898 INFO:tasks.workunit.client.0.smithi027.stdout:7/947: dwrite d3/d8/d26/d45/d56/dec/dc/dd9/d107/f10a [0,4194304] 0 2024-09-20T19:06:13.901 INFO:tasks.workunit.client.0.smithi027.stdout:7/948: creat d3/d8/d26/d45/d56/dec/d2e/d39/d102/f141 x:0 0 0 2024-09-20T19:06:13.903 INFO:tasks.workunit.client.0.smithi027.stdout:7/949: mkdir d3/d5e/d142 0 2024-09-20T19:06:13.903 INFO:tasks.workunit.client.0.smithi027.stdout:7/950: dread - d3/d8/fff zero size 2024-09-20T19:06:13.911 INFO:tasks.workunit.client.0.smithi027.stdout:7/951: dwrite d3/d8/d26/d45/d56/dec/d2e/f123 [0,4194304] 0 2024-09-20T19:06:13.915 INFO:tasks.workunit.client.0.smithi027.stdout:1/990: dread d2/d8/d2b/d5e/d101/f6e [0,4194304] 0 2024-09-20T19:06:13.916 INFO:tasks.workunit.client.0.smithi027.stdout:7/952: truncate d3/d8/d26/d45/d56/dec/d2e/d39/f10c 442562 0 2024-09-20T19:06:13.923 INFO:tasks.workunit.client.0.smithi027.stdout:1/991: dwrite d2/d61/df8/d56/d71/f95 [0,4194304] 0 2024-09-20T19:06:13.925 INFO:tasks.workunit.client.0.smithi027.stdout:1/992: chown d2/d8/d2b/d5e/d101/d13f/fe9 1647 1 2024-09-20T19:06:13.925 INFO:tasks.workunit.client.0.smithi027.stdout:7/953: dwrite d3/d8/d26/d45/d56/dec/d2e/d39/d102/f141 [0,4194304] 0 2024-09-20T19:06:13.929 INFO:tasks.workunit.client.0.smithi027.stdout:7/954: symlink d3/d8/d26/d45/d56/dec/d51/l143 0 2024-09-20T19:06:13.935 INFO:tasks.workunit.client.0.smithi027.stdout:1/993: truncate d2/d8/d3b/fb9 3982168 0 2024-09-20T19:06:13.938 INFO:tasks.workunit.client.0.smithi027.stdout:1/994: creat d2/d8/d74/d84/dca/deb/f145 x:0 0 0 2024-09-20T19:06:13.940 INFO:tasks.workunit.client.0.smithi027.stdout:7/955: dwrite d3/d8/d26/d45/d56/d8d/fad [4194304,4194304] 0 2024-09-20T19:06:13.941 INFO:tasks.workunit.client.0.smithi027.stdout:7/956: chown d3/d8/d26/d45/d56/dec/d2e/d50 251852191 1 2024-09-20T19:06:13.942 INFO:tasks.workunit.client.0.smithi027.stdout:7/957: chown d3/d8/d1c/d61/f97 25 1 2024-09-20T19:06:13.943 INFO:tasks.workunit.client.0.smithi027.stdout:1/995: rmdir d2/d8/d3b/d82/d11d 0 2024-09-20T19:06:13.945 INFO:tasks.workunit.client.0.smithi027.stdout:7/958: fdatasync d3/d8/d26/d45/d56/dec/dc/fe8 0 2024-09-20T19:06:13.946 INFO:tasks.workunit.client.0.smithi027.stdout:1/996: fdatasync d2/d8/d3b/d82/d90/fbe 0 2024-09-20T19:06:13.948 INFO:tasks.workunit.client.0.smithi027.stdout:1/997: mkdir d2/d8/d2b/d5e/d101/d146 0 2024-09-20T19:06:13.953 INFO:tasks.workunit.client.0.smithi027.stdout:1/998: unlink d2/d8/d3b/d82/d87/ce6 0 2024-09-20T19:06:13.953 INFO:tasks.workunit.client.0.smithi027.stdout:7/959: link d3/d24/d84/f92 d3/d8/d26/d45/d56/dec/f144 0 2024-09-20T19:06:13.959 INFO:tasks.workunit.client.0.smithi027.stdout:7/960: mknod d3/d8/d26/d45/d56/dec/d2e/c145 0 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: pgmap v15: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 94 MiB/s rd, 218 MiB/s wr, 458 op/s 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:13 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: pgmap v15: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 94 MiB/s rd, 218 MiB/s wr, 458 op/s 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:14.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:13 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:14.089 INFO:tasks.workunit.client.0.smithi027.stdout:7/961: creat d3/d5e/d12b/f146 x:0 0 0 2024-09-20T19:06:14.090 INFO:tasks.workunit.client.0.smithi027.stdout:1/999: truncate d2/d8/d3b/fba 366267 0 2024-09-20T19:06:14.091 INFO:tasks.workunit.client.0.smithi027.stdout:7/962: truncate d3/d8/d26/d65/f100 801241 0 2024-09-20T19:06:14.092 INFO:tasks.workunit.client.0.smithi027.stdout:7/963: write d3/d8/de5/f12c [571344,92156] 0 2024-09-20T19:06:14.094 INFO:tasks.workunit.client.0.smithi027.stdout:7/964: chown d3/d8/d26/d45/d56/d8d/dfb 4750017 1 2024-09-20T19:06:14.139 INFO:tasks.workunit.client.0.smithi027.stdout:7/965: rmdir d3/d8/d26/d45/d56/dec/d2e/d50/db8/df2 39 2024-09-20T19:06:14.142 INFO:tasks.workunit.client.0.smithi027.stdout:7/966: creat d3/d8/d26/d45/daa/f147 x:0 0 0 2024-09-20T19:06:14.147 INFO:tasks.workunit.client.0.smithi027.stdout:7/967: read d3/d8/d26/d45/f52 [4958251,82978] 0 2024-09-20T19:06:14.156 INFO:tasks.workunit.client.0.smithi027.stdout:7/968: dwrite d3/d8/d26/d45/d56/dec/d2e/d50/f8e [4194304,4194304] 0 2024-09-20T19:06:14.158 INFO:tasks.workunit.client.0.smithi027.stdout:7/969: symlink d3/l148 0 2024-09-20T19:06:14.164 INFO:tasks.workunit.client.0.smithi027.stdout:7/970: write d3/d8/d26/d45/d56/dec/d2e/d39/faf [1923317,14845] 0 2024-09-20T19:06:14.165 INFO:tasks.workunit.client.0.smithi027.stdout:7/971: chown d3/d8/d26/d45/d56/dec/dc/da9 79 1 2024-09-20T19:06:14.166 INFO:tasks.workunit.client.0.smithi027.stdout:7/972: fdatasync d3/d8/d26/d45/d56/dec/d51/fde 0 2024-09-20T19:06:14.169 INFO:tasks.workunit.client.0.smithi027.stdout:7/973: creat d3/d8/d26/d45/d56/dec/dc/f149 x:0 0 0 2024-09-20T19:06:14.170 INFO:tasks.workunit.client.0.smithi027.stdout:7/974: readlink d3/d8/d26/d45/d56/dec/dc/da9/ddd/lfc 0 2024-09-20T19:06:14.173 INFO:tasks.workunit.client.0.smithi027.stdout:7/975: creat d3/d8/d26/d45/d56/dec/dc/f14a x:0 0 0 2024-09-20T19:06:14.175 INFO:tasks.workunit.client.0.smithi027.stdout:7/976: rename d3/d8/d26/d45/d56/dec/d51/c109 to d3/d24/d84/c14b 0 2024-09-20T19:06:14.177 INFO:tasks.workunit.client.0.smithi027.stdout:7/977: mknod d3/d8/d26/d45/d56/dec/d2e/d39/d116/c14c 0 2024-09-20T19:06:14.178 INFO:tasks.workunit.client.0.smithi027.stdout:7/978: dread - d3/d8/d26/d65/dc4/d106/f130 zero size 2024-09-20T19:06:14.180 INFO:tasks.workunit.client.0.smithi027.stdout:7/979: mknod d3/d8/d26/d45/d56/dec/dc/da9/c14d 0 2024-09-20T19:06:14.194 INFO:tasks.workunit.client.0.smithi027.stdout:7/980: dread d3/d8/d26/d45/d56/dec/dc/f63 [0,4194304] 0 2024-09-20T19:06:14.199 INFO:tasks.workunit.client.0.smithi027.stdout:7/981: write d3/d8/d1c/d61/fa1 [47744,105645] 0 2024-09-20T19:06:14.201 INFO:tasks.workunit.client.0.smithi027.stdout:7/982: read d3/d8/d26/d45/d56/dec/f44 [1884947,88745] 0 2024-09-20T19:06:14.204 INFO:tasks.workunit.client.0.smithi027.stdout:7/983: mkdir d3/d8/d26/d45/d56/dec/d2e/d49/dfe/d14e 0 2024-09-20T19:06:14.204 INFO:tasks.workunit.client.0.smithi027.stdout:7/984: stat d3/d8/d26/d45/f52 0 2024-09-20T19:06:14.216 INFO:tasks.workunit.client.0.smithi027.stdout:7/985: dread d3/d8/d26/f3d [0,4194304] 0 2024-09-20T19:06:14.217 INFO:tasks.workunit.client.0.smithi027.stdout:7/986: chown d3/d8/d26/d45/d56/dec/dc/c22 14698498 1 2024-09-20T19:06:14.219 INFO:tasks.workunit.client.0.smithi027.stdout:7/987: symlink d3/d5e/d137/l14f 0 2024-09-20T19:06:14.220 INFO:tasks.workunit.client.0.smithi027.stdout:7/988: stat d3/d8/d26/d45/d56/dec/f46 0 2024-09-20T19:06:14.221 INFO:tasks.workunit.client.0.smithi027.stdout:7/989: symlink d3/d5e/d142/l150 0 2024-09-20T19:06:14.223 INFO:tasks.workunit.client.0.smithi027.stdout:7/990: rename d3/d8/d26/d45/d56/dec/dc/c22 to d3/d24/d13d/c151 0 2024-09-20T19:06:14.234 INFO:tasks.workunit.client.0.smithi027.stdout:7/991: dwrite d3/f2f [0,4194304] 0 2024-09-20T19:06:14.236 INFO:tasks.workunit.client.0.smithi027.stdout:7/992: stat d3/d8/d26/d45/d56/dec/d2e/d39/d116/f121 0 2024-09-20T19:06:14.239 INFO:tasks.workunit.client.0.smithi027.stdout:7/993: mkdir d3/d8/d26/d45/d56/d152 0 2024-09-20T19:06:14.240 INFO:tasks.workunit.client.0.smithi027.stdout:7/994: readlink d3/d8/d26/d45/d56/dec/d2e/d39/lc6 0 2024-09-20T19:06:14.241 INFO:tasks.workunit.client.0.smithi027.stdout:7/995: stat d3/d5e/fd2 0 2024-09-20T19:06:14.244 INFO:tasks.workunit.client.0.smithi027.stdout:7/996: creat d3/d8/d26/d45/d56/dec/dc/dd9/d107/f153 x:0 0 0 2024-09-20T19:06:14.246 INFO:tasks.workunit.client.0.smithi027.stdout:7/997: symlink d3/d8/d26/d45/d56/dec/d2e/l154 0 2024-09-20T19:06:14.248 INFO:tasks.workunit.client.0.smithi027.stdout:7/998: creat d3/d8/d26/d45/d56/dec/dc/da9/f155 x:0 0 0 2024-09-20T19:06:14.250 INFO:tasks.workunit.client.0.smithi027.stdout:7/999: chown d3/d8/d26/d45/d56/dec/d2e/d49/d8b/fdf 0 1 2024-09-20T19:06:14.253 INFO:tasks.workunit.client.0.smithi027.stderr:+ rm -rf -- ./tmp.lvDftocJUl 2024-09-20T19:06:14.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/828: sync 2024-09-20T19:06:14.313 INFO:tasks.workunit.client.1.smithi098.stdout:7/938: sync 2024-09-20T19:06:14.313 INFO:tasks.workunit.client.1.smithi098.stdout:0/624: sync 2024-09-20T19:06:14.313 INFO:tasks.workunit.client.1.smithi098.stdout:3/829: chown d4/fd 4 1 2024-09-20T19:06:14.313 INFO:tasks.workunit.client.1.smithi098.stdout:7/939: readlink d3/d10/d16/d17/d7c/lad 0 2024-09-20T19:06:14.315 INFO:tasks.workunit.client.1.smithi098.stdout:3/830: truncate d4/d19/d1d/d2f/fd8 14462 0 2024-09-20T19:06:14.316 INFO:tasks.workunit.client.1.smithi098.stdout:7/940: truncate d3/d10/d16/f84 459413 0 2024-09-20T19:06:14.319 INFO:tasks.workunit.client.1.smithi098.stdout:7/941: read - d3/d10/d16/d17/d33/d1f/dba/fdd zero size 2024-09-20T19:06:14.319 INFO:tasks.workunit.client.1.smithi098.stdout:7/942: readlink d3/d10/d16/d17/d33/d4b/l62 0 2024-09-20T19:06:14.323 INFO:tasks.workunit.client.1.smithi098.stdout:7/943: dread - d3/d10/d16/d17/d33/d1f/d2d/f107 zero size 2024-09-20T19:06:14.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/625: link d0/d55/d67/c7b d0/d6/d28/d31/d45/d60/d78/cbc 0 2024-09-20T19:06:14.324 INFO:tasks.workunit.client.1.smithi098.stdout:3/831: getdents d4 0 2024-09-20T19:06:14.325 INFO:tasks.workunit.client.1.smithi098.stdout:7/944: write d3/d10/d16/d17/d33/d1f/f3c [3028980,126422] 0 2024-09-20T19:06:14.326 INFO:tasks.workunit.client.1.smithi098.stdout:0/626: write d0/d6/d28/d31/d69/d9b/dae/fb2 [189931,24151] 0 2024-09-20T19:06:14.326 INFO:tasks.workunit.client.1.smithi098.stdout:7/945: chown d3/d76/d86/fa3 1159551 1 2024-09-20T19:06:14.328 INFO:tasks.workunit.client.1.smithi098.stdout:7/946: write d3/d10/d16/d17/d33/d4b/f55 [915472,83424] 0 2024-09-20T19:06:14.328 INFO:tasks.workunit.client.1.smithi098.stdout:0/627: rmdir d0/d6/d19 39 2024-09-20T19:06:14.329 INFO:tasks.workunit.client.1.smithi098.stdout:0/628: chown d0/db/d7f/db5 2961 1 2024-09-20T19:06:14.330 INFO:tasks.workunit.client.1.smithi098.stdout:0/629: chown d0/d6/d28/d31/d45/d60/da1 527 1 2024-09-20T19:06:14.332 INFO:tasks.workunit.client.1.smithi098.stdout:7/947: creat d3/daa/f132 x:0 0 0 2024-09-20T19:06:14.339 INFO:tasks.workunit.client.1.smithi098.stdout:0/630: getdents d0/d6/d28 0 2024-09-20T19:06:14.340 INFO:tasks.workunit.client.1.smithi098.stdout:0/631: write d0/db/d1d/f34 [1388451,120252] 0 2024-09-20T19:06:14.340 INFO:tasks.workunit.client.1.smithi098.stdout:0/632: readlink d0/d6/d28/d31/d69/l92 0 2024-09-20T19:06:14.343 INFO:tasks.workunit.client.1.smithi098.stdout:7/948: getdents d3/d10/d16/d17/d7c 0 2024-09-20T19:06:14.343 INFO:tasks.workunit.client.1.smithi098.stdout:3/832: dread d4/d38/d39/f88 [0,4194304] 0 2024-09-20T19:06:14.344 INFO:tasks.workunit.client.1.smithi098.stdout:0/633: creat d0/db/d7f/d93/fbd x:0 0 0 2024-09-20T19:06:14.344 INFO:tasks.workunit.client.1.smithi098.stdout:3/833: chown d4/d38/d48/d60/f99 124 1 2024-09-20T19:06:14.347 INFO:tasks.workunit.client.1.smithi098.stdout:5/727: sync 2024-09-20T19:06:14.347 INFO:tasks.workunit.client.1.smithi098.stdout:9/977: sync 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:4/952: sync 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:1/765: sync 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:6/702: sync 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/941: sync 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:7/949: read d3/d10/d16/f79 [2695911,53637] 0 2024-09-20T19:06:14.348 INFO:tasks.workunit.client.1.smithi098.stdout:3/834: symlink d4/d19/d7b/lfe 0 2024-09-20T19:06:14.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/978: chown d4/de/d24/d35/d6d 81 1 2024-09-20T19:06:14.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/728: dread - d1/d46/d69/d84/fd0 zero size 2024-09-20T19:06:14.350 INFO:tasks.workunit.client.1.smithi098.stdout:4/953: chown d3/d6/d8c/de7/df4/d1e/l55 424328216 1 2024-09-20T19:06:14.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/729: stat d1/d17/d35/c4d 0 2024-09-20T19:06:14.351 INFO:tasks.workunit.client.1.smithi098.stdout:0/634: rename d0/d6/d19/d4f/d70 to d0/d6/d19/dbe 0 2024-09-20T19:06:14.352 INFO:tasks.workunit.client.1.smithi098.stdout:1/766: chown d1/d3/lb3 3 1 2024-09-20T19:06:14.353 INFO:tasks.workunit.client.1.smithi098.stdout:7/950: rmdir d3/daa 39 2024-09-20T19:06:14.354 INFO:tasks.workunit.client.1.smithi098.stdout:8/942: mknod d7/de/d11/d19/d122/c146 0 2024-09-20T19:06:14.354 INFO:tasks.workunit.client.1.smithi098.stdout:8/943: dread - d7/de/d11/d19/daf/ff5 zero size 2024-09-20T19:06:14.355 INFO:tasks.workunit.client.1.smithi098.stdout:3/835: mkdir d4/d25/d8d/dff 0 2024-09-20T19:06:14.356 INFO:tasks.workunit.client.1.smithi098.stdout:9/979: symlink d4/d74/dc8/dfc/l145 0 2024-09-20T19:06:14.357 INFO:tasks.workunit.client.1.smithi098.stdout:9/980: readlink d4/de/d48/dec/lfb 0 2024-09-20T19:06:14.358 INFO:tasks.workunit.client.1.smithi098.stdout:3/836: truncate d4/d19/d1d/d2f/d4e/da3/fe2 994794 0 2024-09-20T19:06:14.358 INFO:tasks.workunit.client.1.smithi098.stdout:0/635: fsync d0/d6/d28/f5c 0 2024-09-20T19:06:14.359 INFO:tasks.workunit.client.1.smithi098.stdout:1/767: fsync d1/d3/df/d4a/f63 0 2024-09-20T19:06:14.359 INFO:tasks.workunit.client.1.smithi098.stdout:9/981: write d4/de/d24/d35/d6d/f130 [802911,96929] 0 2024-09-20T19:06:14.361 INFO:tasks.workunit.client.1.smithi098.stdout:0/636: write d0/db/d1d/f34 [2766943,95972] 0 2024-09-20T19:06:14.361 INFO:tasks.workunit.client.1.smithi098.stdout:7/951: creat d3/d10/d16/d90/f133 x:0 0 0 2024-09-20T19:06:14.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/637: chown d0/d55 6432412 1 2024-09-20T19:06:14.363 INFO:tasks.workunit.client.1.smithi098.stdout:9/982: dread - d4/de/d24/d35/d6d/f126 zero size 2024-09-20T19:06:14.366 INFO:tasks.workunit.client.1.smithi098.stdout:6/703: rename d0/de/f6c to d0/d55/d82/dd5/dc/da7/fdc 0 2024-09-20T19:06:14.367 INFO:tasks.workunit.client.1.smithi098.stdout:6/704: readlink d0/d55/d82/da3/l73 0 2024-09-20T19:06:14.370 INFO:tasks.workunit.client.1.smithi098.stdout:8/944: dread d7/de/d11/d1d/d110/d11a/f9a [0,4194304] 0 2024-09-20T19:06:14.378 INFO:tasks.workunit.client.1.smithi098.stdout:7/952: symlink d3/d4c/l134 0 2024-09-20T19:06:14.380 INFO:tasks.workunit.client.1.smithi098.stdout:0/638: mkdir d0/d6/d28/d31/d69/dbf 0 2024-09-20T19:06:14.388 INFO:tasks.workunit.client.1.smithi098.stdout:4/954: getdents d3/d5e/d110 0 2024-09-20T19:06:14.390 INFO:tasks.workunit.client.1.smithi098.stdout:7/953: unlink d3/d10/d16/d90/f9c 0 2024-09-20T19:06:14.391 INFO:tasks.workunit.client.1.smithi098.stdout:7/954: read d3/f2e [2979531,52510] 0 2024-09-20T19:06:14.392 INFO:tasks.workunit.client.1.smithi098.stdout:6/705: write d0/d55/d82/dd5/f85 [1009469,58928] 0 2024-09-20T19:06:14.394 INFO:tasks.workunit.client.1.smithi098.stdout:6/706: chown d0/d55/d82/dd5/f62 7501296 1 2024-09-20T19:06:14.396 INFO:tasks.workunit.client.1.smithi098.stdout:0/639: creat d0/d55/d67/fc0 x:0 0 0 2024-09-20T19:06:14.398 INFO:tasks.workunit.client.1.smithi098.stdout:0/640: write d0/db/d1d/d8f/fa7 [377822,86104] 0 2024-09-20T19:06:14.399 INFO:tasks.workunit.client.1.smithi098.stdout:7/955: dwrite d3/d10/d16/f39 [4194304,4194304] 0 2024-09-20T19:06:14.401 INFO:tasks.workunit.client.1.smithi098.stdout:5/730: getdents d1/d1b/d40/daf 0 2024-09-20T19:06:14.410 INFO:tasks.workunit.client.1.smithi098.stdout:0/641: dwrite d0/d6/d28/d31/d69/d9b/dae/fb2 [0,4194304] 0 2024-09-20T19:06:14.412 INFO:tasks.workunit.client.1.smithi098.stdout:0/642: chown d0/db/d1d/l2f 3 1 2024-09-20T19:06:14.412 INFO:tasks.workunit.client.1.smithi098.stdout:8/945: write d7/de/d11/fa7 [678098,28632] 0 2024-09-20T19:06:14.414 INFO:tasks.workunit.client.1.smithi098.stdout:9/983: dwrite d4/de/d27/d4a/d21/d25/f26 [0,4194304] 0 2024-09-20T19:06:14.417 INFO:tasks.workunit.client.1.smithi098.stdout:6/707: symlink d0/d55/ldd 0 2024-09-20T19:06:14.418 INFO:tasks.workunit.client.1.smithi098.stdout:9/984: read d4/de/d48/dec/f12d [13043,87142] 0 2024-09-20T19:06:14.419 INFO:tasks.workunit.client.1.smithi098.stdout:6/708: write d0/d55/d82/da3/d8c/d4c/fbf [3755628,116444] 0 2024-09-20T19:06:14.419 INFO:tasks.workunit.client.1.smithi098.stdout:5/731: unlink d1/d17/d35/f80 0 2024-09-20T19:06:14.420 INFO:tasks.workunit.client.1.smithi098.stdout:7/956: truncate d3/d10/d16/d17/d7c/d11d/f128 551960 0 2024-09-20T19:06:14.422 INFO:tasks.workunit.client.1.smithi098.stdout:3/837: getdents d4/d38/d48 0 2024-09-20T19:06:14.423 INFO:tasks.workunit.client.1.smithi098.stdout:4/955: symlink d3/d6/d8c/de7/d124/l137 0 2024-09-20T19:06:14.424 INFO:tasks.workunit.client.1.smithi098.stdout:1/768: getdents d1/d3/df/d34/d52 0 2024-09-20T19:06:14.428 INFO:tasks.workunit.client.1.smithi098.stdout:4/956: read d3/d6/d8c/de7/d124/d6b/d73/f117 [4086807,121058] 0 2024-09-20T19:06:14.429 INFO:tasks.workunit.client.1.smithi098.stdout:0/643: mkdir d0/d55/dc1 0 2024-09-20T19:06:14.432 INFO:tasks.workunit.client.1.smithi098.stdout:9/985: creat d4/de/d27/d4a/d21/d25/df2/d132/d5b/d9c/d10c/f146 x:0 0 0 2024-09-20T19:06:14.436 INFO:tasks.workunit.client.1.smithi098.stdout:6/709: dwrite d0/d55/d82/dd5/dc/f1a [0,4194304] 0 2024-09-20T19:06:14.436 INFO:tasks.workunit.client.1.smithi098.stdout:5/732: creat d1/d17/d35/fe1 x:0 0 0 2024-09-20T19:06:14.437 INFO:tasks.workunit.client.1.smithi098.stdout:0/644: mknod d0/d55/cc2 0 2024-09-20T19:06:14.438 INFO:tasks.workunit.client.1.smithi098.stdout:9/986: write d4/de/d27/d4a/fd4 [1694195,12636] 0 2024-09-20T19:06:14.439 INFO:tasks.workunit.client.1.smithi098.stdout:5/733: stat d1/d17/f1e 0 2024-09-20T19:06:14.439 INFO:tasks.workunit.client.1.smithi098.stdout:1/769: dwrite d1/d3/df/d34/d52/d77/ff1 [0,4194304] 0 2024-09-20T19:06:14.442 INFO:tasks.workunit.client.1.smithi098.stdout:9/987: readlink d4/de/d24/d35/d2d/da6/dae/l12b 0 2024-09-20T19:06:14.442 INFO:tasks.workunit.client.1.smithi098.stdout:4/957: unlink d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f80 0 2024-09-20T19:06:14.444 INFO:tasks.workunit.client.1.smithi098.stdout:4/958: stat d3/d6/d8c/de7/f12c 0 2024-09-20T19:06:14.445 INFO:tasks.workunit.client.1.smithi098.stdout:5/734: truncate d1/d17/d35/fe1 83952 0 2024-09-20T19:06:14.446 INFO:tasks.workunit.client.1.smithi098.stdout:5/735: chown d1/f6b 1387381234 1 2024-09-20T19:06:14.449 INFO:tasks.workunit.client.1.smithi098.stdout:0/645: fdatasync d0/db/d1d/d8f/f39 0 2024-09-20T19:06:14.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/838: dwrite d4/da/f8b [0,4194304] 0 2024-09-20T19:06:14.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/839: chown d4/d25/d40/d80/d94 5 1 2024-09-20T19:06:14.461 INFO:tasks.workunit.client.1.smithi098.stdout:1/770: mknod d1/dda/cfa 0 2024-09-20T19:06:14.468 INFO:tasks.workunit.client.1.smithi098.stdout:6/710: write d0/d55/f8f [453964,42266] 0 2024-09-20T19:06:14.469 INFO:tasks.workunit.client.1.smithi098.stdout:1/771: mknod d1/d3/d2e/d61/cfb 0 2024-09-20T19:06:14.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/736: dread d1/d17/d25/d79/dbc/fcd [0,4194304] 0 2024-09-20T19:06:14.472 INFO:tasks.workunit.client.1.smithi098.stdout:6/711: write d0/d55/d82/da3/d43/d6d/f92 [3377387,81130] 0 2024-09-20T19:06:14.473 INFO:tasks.workunit.client.1.smithi098.stdout:9/988: rename d4/de/f3d to d4/de/d24/f147 0 2024-09-20T19:06:14.474 INFO:tasks.workunit.client.1.smithi098.stdout:6/712: write d0/d55/d82/f95 [948755,116887] 0 2024-09-20T19:06:14.476 INFO:tasks.workunit.client.1.smithi098.stdout:6/713: write d0/d55/d82/da3/d43/dc0/fc7 [134380,116677] 0 2024-09-20T19:06:14.478 INFO:tasks.workunit.client.1.smithi098.stdout:6/714: fdatasync d0/d55/d82/da3/d8c/d4c/fbf 0 2024-09-20T19:06:14.483 INFO:tasks.workunit.client.1.smithi098.stdout:0/646: write d0/d6/d28/d31/d45/f5e [1019820,74748] 0 2024-09-20T19:06:14.484 INFO:tasks.workunit.client.1.smithi098.stdout:4/959: dwrite d3/d6/d8c/de7/d124/d6b/d73/d98/db3/f4c [0,4194304] 0 2024-09-20T19:06:14.491 INFO:tasks.workunit.client.1.smithi098.stdout:5/737: dread d1/d17/d2e/f5f [0,4194304] 0 2024-09-20T19:06:14.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/772: rename d1/d3/df/d34/d43/d53/f95 to d1/d3/ffc 0 2024-09-20T19:06:14.500 INFO:tasks.workunit.client.1.smithi098.stdout:9/989: write d4/de/d24/d35/dc4/f142 [992250,109382] 0 2024-09-20T19:06:14.503 INFO:tasks.workunit.client.1.smithi098.stdout:5/738: creat d1/d17/d35/d54/fe2 x:0 0 0 2024-09-20T19:06:14.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/960: dwrite d3/d5e/fae [0,4194304] 0 2024-09-20T19:06:14.510 INFO:tasks.workunit.client.1.smithi098.stdout:6/715: getdents d0/d55/d82/dd5 0 2024-09-20T19:06:14.519 INFO:tasks.workunit.client.1.smithi098.stdout:1/773: write d1/d3/df/d4a/fa8 [766253,2794] 0 2024-09-20T19:06:14.525 INFO:tasks.workunit.client.1.smithi098.stdout:6/716: dwrite d0/d55/d82/da3/d43/d6d/f75 [0,4194304] 0 2024-09-20T19:06:14.526 INFO:tasks.workunit.client.1.smithi098.stdout:9/990: write d4/de/d27/d4a/d21/d25/d51/d7b/fc5 [4379168,44604] 0 2024-09-20T19:06:14.530 INFO:tasks.workunit.client.1.smithi098.stdout:5/739: getdents d1/d17 0 2024-09-20T19:06:14.531 INFO:tasks.workunit.client.1.smithi098.stdout:1/774: unlink d1/d3/d2e/c80 0 2024-09-20T19:06:14.531 INFO:tasks.workunit.client.1.smithi098.stdout:5/740: dread - d1/d82/fd4 zero size 2024-09-20T19:06:14.534 INFO:tasks.workunit.client.1.smithi098.stdout:6/717: symlink d0/d55/d82/dd5/dcf/dd8/lde 0 2024-09-20T19:06:14.538 INFO:tasks.workunit.client.1.smithi098.stdout:4/961: dwrite d3/d6/d8c/de7/d124/d6b/d73/fd2 [0,4194304] 0 2024-09-20T19:06:14.540 INFO:tasks.workunit.client.1.smithi098.stdout:6/718: dread d0/d55/d82/da3/d43/dc0/fc7 [0,4194304] 0 2024-09-20T19:06:14.542 INFO:tasks.workunit.client.1.smithi098.stdout:4/962: chown d3/d6/d8c/de7/df4/d1e/d2a/c127 600612 1 2024-09-20T19:06:14.544 INFO:tasks.workunit.client.1.smithi098.stdout:4/963: fdatasync d3/d6/d8c/de7/d124/fa6 0 2024-09-20T19:06:14.546 INFO:tasks.workunit.client.1.smithi098.stdout:6/719: fdatasync d0/de/f8b 0 2024-09-20T19:06:14.550 INFO:tasks.workunit.client.1.smithi098.stdout:6/720: dread d0/d55/d82/dd5/d24/d29/f8d [0,4194304] 0 2024-09-20T19:06:14.553 INFO:tasks.workunit.client.1.smithi098.stdout:1/775: getdents d1/d3/df/d34/d52/d77/df7/dc1/dc7 0 2024-09-20T19:06:14.554 INFO:tasks.workunit.client.1.smithi098.stdout:1/776: dread - d1/d3/df/d34/d52/d77/df7/dc1/fe4 zero size 2024-09-20T19:06:14.557 INFO:tasks.workunit.client.1.smithi098.stdout:1/777: dread - d1/d3/df/d34/d43/d53/f74 zero size 2024-09-20T19:06:14.558 INFO:tasks.workunit.client.1.smithi098.stdout:1/778: stat d1/d3/d62/fa2 0 2024-09-20T19:06:14.560 INFO:tasks.workunit.client.1.smithi098.stdout:1/779: read - d1/d3/f49 zero size 2024-09-20T19:06:14.560 INFO:tasks.workunit.client.1.smithi098.stdout:5/741: dwrite d1/d17/d25/f90 [0,4194304] 0 2024-09-20T19:06:14.563 INFO:tasks.workunit.client.1.smithi098.stdout:6/721: rename d0/d55/d82/dd5/dc/da7/fdc to d0/d55/d82/da3/d43/dc0/d66/d81/fdf 0 2024-09-20T19:06:14.566 INFO:tasks.workunit.client.1.smithi098.stdout:5/742: fsync d1/d17/d5e/f7d 0 2024-09-20T19:06:14.570 INFO:tasks.workunit.client.1.smithi098.stdout:1/780: mknod d1/d3/cfd 0 2024-09-20T19:06:14.575 INFO:tasks.workunit.client.1.smithi098.stdout:5/743: creat d1/d17/d35/d93/fe3 x:0 0 0 2024-09-20T19:06:14.576 INFO:tasks.workunit.client.1.smithi098.stdout:5/744: read - d1/d17/d35/d54/dab/fb9 zero size 2024-09-20T19:06:14.576 INFO:tasks.workunit.client.1.smithi098.stdout:6/722: creat d0/d55/d82/da3/d43/dc0/d65/fe0 x:0 0 0 2024-09-20T19:06:14.576 INFO:tasks.workunit.client.1.smithi098.stdout:5/745: chown d1/fa2 0 1 2024-09-20T19:06:14.577 INFO:tasks.workunit.client.1.smithi098.stdout:5/746: chown d1/d1b 28682 1 2024-09-20T19:06:14.577 INFO:tasks.workunit.client.1.smithi098.stdout:5/747: chown d1/d17/d35/f6a 89036225 1 2024-09-20T19:06:14.578 INFO:tasks.workunit.client.1.smithi098.stdout:6/723: truncate d0/d55/d82/dd5/d24/d29/f99 2133914 0 2024-09-20T19:06:14.579 INFO:tasks.workunit.client.1.smithi098.stdout:1/781: creat d1/d3/df/d34/d52/ffe x:0 0 0 2024-09-20T19:06:14.579 INFO:tasks.workunit.client.1.smithi098.stdout:6/724: write d0/de/d1b/f1c [145779,26692] 0 2024-09-20T19:06:14.583 INFO:tasks.workunit.client.1.smithi098.stdout:6/725: mknod d0/d55/d82/da3/d8c/d9a/ce1 0 2024-09-20T19:06:14.584 INFO:tasks.workunit.client.1.smithi098.stdout:5/748: dread d1/fa2 [0,4194304] 0 2024-09-20T19:06:14.585 INFO:tasks.workunit.client.1.smithi098.stdout:1/782: creat d1/d3/df/fff x:0 0 0 2024-09-20T19:06:14.586 INFO:tasks.workunit.client.1.smithi098.stdout:5/749: fdatasync d1/d46/d69/d84/fd0 0 2024-09-20T19:06:14.587 INFO:tasks.workunit.client.1.smithi098.stdout:6/726: read d0/de/d1b/f28 [246774,72369] 0 2024-09-20T19:06:14.588 INFO:tasks.workunit.client.1.smithi098.stdout:1/783: chown d1/d3/df/d34/l45 52476378 1 2024-09-20T19:06:14.589 INFO:tasks.workunit.client.1.smithi098.stdout:5/750: mkdir d1/d17/d2e/dac/de4 0 2024-09-20T19:06:14.590 INFO:tasks.workunit.client.1.smithi098.stdout:1/784: symlink d1/dda/l100 0 2024-09-20T19:06:14.592 INFO:tasks.workunit.client.1.smithi098.stdout:5/751: fsync d1/d46/d69/d84/d87/f8e 0 2024-09-20T19:06:14.593 INFO:tasks.workunit.client.1.smithi098.stdout:5/752: write d1/d46/fa7 [4814739,122022] 0 2024-09-20T19:06:14.595 INFO:tasks.workunit.client.1.smithi098.stdout:1/785: creat d1/d3/d2e/d68/d7a/f101 x:0 0 0 2024-09-20T19:06:14.597 INFO:tasks.workunit.client.1.smithi098.stdout:1/786: truncate d1/d3/df/d34/d43/f56 1132025 0 2024-09-20T19:06:14.603 INFO:tasks.workunit.client.1.smithi098.stdout:6/727: truncate d0/d55/d82/da3/f4b 934088 0 2024-09-20T19:06:14.604 INFO:tasks.workunit.client.1.smithi098.stdout:5/753: creat d1/d46/d69/d84/d87/fe5 x:0 0 0 2024-09-20T19:06:14.605 INFO:tasks.workunit.client.1.smithi098.stdout:6/728: truncate d0/d55/d82/da3/d8c/fb4 589440 0 2024-09-20T19:06:14.612 INFO:tasks.workunit.client.1.smithi098.stdout:1/787: dread d1/d3/f2d [0,4194304] 0 2024-09-20T19:06:14.613 INFO:tasks.workunit.client.1.smithi098.stdout:5/754: truncate d1/f2 287731 0 2024-09-20T19:06:14.614 INFO:tasks.workunit.client.1.smithi098.stdout:5/755: chown d1/d17/d35/f3f 119295906 1 2024-09-20T19:06:14.619 INFO:tasks.workunit.client.1.smithi098.stdout:6/729: dwrite d0/d55/d82/dd5/dc/f41 [0,4194304] 0 2024-09-20T19:06:14.627 INFO:tasks.workunit.client.1.smithi098.stdout:6/730: rename d0/d55/d82/dd5/dc to d0/d55/d82/dd5/de2 0 2024-09-20T19:06:14.633 INFO:tasks.workunit.client.1.smithi098.stdout:6/731: dread d0/de/d1b/fbd [0,4194304] 0 2024-09-20T19:06:14.635 INFO:tasks.workunit.client.1.smithi098.stdout:1/788: dwrite d1/d3/f2d [0,4194304] 0 2024-09-20T19:06:14.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/789: chown d1/l27 1 1 2024-09-20T19:06:14.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/756: dwrite d1/d46/f83 [0,4194304] 0 2024-09-20T19:06:14.641 INFO:tasks.workunit.client.1.smithi098.stdout:6/732: mkdir d0/d55/d82/dd5/dcf/dd8/de3 0 2024-09-20T19:06:14.641 INFO:tasks.workunit.client.1.smithi098.stdout:6/733: chown d0/de 41 1 2024-09-20T19:06:14.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/757: rmdir d1/d17/d5e 39 2024-09-20T19:06:14.649 INFO:tasks.workunit.client.1.smithi098.stdout:5/758: mknod d1/d82/ce6 0 2024-09-20T19:06:14.652 INFO:tasks.workunit.client.1.smithi098.stdout:6/734: mknod d0/d55/d82/da3/d43/dc0/d66/d81/dbb/ce4 0 2024-09-20T19:06:14.653 INFO:tasks.workunit.client.1.smithi098.stdout:1/790: write d1/d3/df/dbe/fb7 [2486210,16048] 0 2024-09-20T19:06:14.656 INFO:tasks.workunit.client.1.smithi098.stdout:6/735: dread d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:14.660 INFO:tasks.workunit.client.1.smithi098.stdout:6/736: mkdir d0/dc2/de5 0 2024-09-20T19:06:14.661 INFO:tasks.workunit.client.1.smithi098.stdout:5/759: rmdir d1/d17/d35/d54/d68/dde 0 2024-09-20T19:06:14.662 INFO:tasks.workunit.client.1.smithi098.stdout:5/760: fsync d1/d17/d35/d54/d68/fc4 0 2024-09-20T19:06:14.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/737: rename d0/d55/d82/dd5/d24/d29/f99 to d0/d55/d82/dd5/d24/d29/fe6 0 2024-09-20T19:06:14.672 INFO:tasks.workunit.client.1.smithi098.stdout:5/761: creat d1/d17/d25/d56/fe7 x:0 0 0 2024-09-20T19:06:14.681 INFO:tasks.workunit.client.1.smithi098.stdout:5/762: unlink d1/c5d 0 2024-09-20T19:06:14.684 INFO:tasks.workunit.client.1.smithi098.stdout:6/738: write d0/d55/d82/dd5/d24/d29/f8d [4331295,5979] 0 2024-09-20T19:06:14.686 INFO:tasks.workunit.client.1.smithi098.stdout:6/739: chown d0/de/f8b 16316250 1 2024-09-20T19:06:14.689 INFO:tasks.workunit.client.1.smithi098.stdout:6/740: mkdir d0/d55/d82/dd5/d24/dd6/de7 0 2024-09-20T19:06:14.690 INFO:tasks.workunit.client.1.smithi098.stdout:6/741: creat d0/dc2/fe8 x:0 0 0 2024-09-20T19:06:14.691 INFO:tasks.workunit.client.1.smithi098.stdout:5/763: write d1/f6b [555947,49507] 0 2024-09-20T19:06:14.692 INFO:tasks.workunit.client.1.smithi098.stdout:5/764: chown d1/d46/d69/d84/d87/cc9 1476531 1 2024-09-20T19:06:14.693 INFO:tasks.workunit.client.1.smithi098.stdout:5/765: write d1/d17/d25/d79/f88 [918549,24480] 0 2024-09-20T19:06:14.696 INFO:tasks.workunit.client.1.smithi098.stdout:6/742: creat d0/d55/d82/dd5/dcf/dd8/de3/fe9 x:0 0 0 2024-09-20T19:06:14.699 INFO:tasks.workunit.client.1.smithi098.stdout:5/766: dread d1/d1b/f1c [0,4194304] 0 2024-09-20T19:06:14.705 INFO:tasks.workunit.client.1.smithi098.stdout:5/767: link d1/d17/d25/d79/dbc/ld6 d1/d17/d25/d79/dbc/db3/dbb/le8 0 2024-09-20T19:06:14.709 INFO:tasks.workunit.client.1.smithi098.stdout:5/768: dwrite d1/d17/d35/f6a [0,4194304] 0 2024-09-20T19:06:14.716 INFO:tasks.workunit.client.1.smithi098.stdout:5/769: dwrite d1/d1b/f7e [4194304,4194304] 0 2024-09-20T19:06:14.718 INFO:tasks.workunit.client.1.smithi098.stdout:5/770: dread - d1/d82/fd4 zero size 2024-09-20T19:06:14.727 INFO:tasks.workunit.client.1.smithi098.stdout:5/771: dread d1/d17/d25/d79/f88 [0,4194304] 0 2024-09-20T19:06:14.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/772: link d1/d17/d25/d79/la5 d1/d17/d35/da9/le9 0 2024-09-20T19:06:14.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/773: fdatasync d1/d1b/f7e 0 2024-09-20T19:06:14.740 INFO:tasks.workunit.client.1.smithi098.stdout:5/774: link d1/d46/d69/ca0 d1/d71/cea 0 2024-09-20T19:06:14.741 INFO:tasks.workunit.client.1.smithi098.stdout:5/775: write d1/d71/fd1 [416704,104531] 0 2024-09-20T19:06:14.751 INFO:tasks.workunit.client.1.smithi098.stdout:5/776: write d1/d1b/f6f [387341,3495] 0 2024-09-20T19:06:14.758 INFO:tasks.workunit.client.1.smithi098.stdout:5/777: dwrite d1/d17/d2e/f2f [0,4194304] 0 2024-09-20T19:06:14.765 INFO:tasks.workunit.client.1.smithi098.stdout:5/778: rename d1/d17/c9b to d1/d17/d5e/dd9/ceb 0 2024-09-20T19:06:14.767 INFO:tasks.workunit.client.1.smithi098.stdout:5/779: write d1/d82/fd4 [398844,125574] 0 2024-09-20T19:06:14.771 INFO:tasks.workunit.client.1.smithi098.stdout:5/780: getdents d1/d17/d5e 0 2024-09-20T19:06:14.773 INFO:tasks.workunit.client.1.smithi098.stdout:5/781: creat d1/d71/d98/fec x:0 0 0 2024-09-20T19:06:14.774 INFO:tasks.workunit.client.1.smithi098.stdout:5/782: chown d1/d17/d2e/f67 40814733 1 2024-09-20T19:06:14.789 INFO:tasks.workunit.client.1.smithi098.stdout:5/783: dread d1/fe [0,4194304] 0 2024-09-20T19:06:14.791 INFO:tasks.workunit.client.1.smithi098.stdout:5/784: mkdir d1/d17/d25/d79/dbc/db3/ded 0 2024-09-20T19:06:14.796 INFO:tasks.workunit.client.1.smithi098.stdout:5/785: dwrite d1/d82/fd4 [0,4194304] 0 2024-09-20T19:06:14.800 INFO:tasks.workunit.client.1.smithi098.stdout:5/786: chown d1/d46/d69/ca0 429 1 2024-09-20T19:06:14.802 INFO:tasks.workunit.client.1.smithi098.stdout:5/787: mkdir d1/d17/d5e/dd9/dee 0 2024-09-20T19:06:14.808 INFO:tasks.workunit.client.1.smithi098.stdout:5/788: dwrite d1/d46/fa1 [4194304,4194304] 0 2024-09-20T19:06:14.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/789: dwrite d1/d17/f55 [0,4194304] 0 2024-09-20T19:06:14.819 INFO:tasks.workunit.client.1.smithi098.stdout:5/790: chown d1/d17/d5e/dd9/dee 177839703 1 2024-09-20T19:06:14.821 INFO:tasks.workunit.client.1.smithi098.stdout:5/791: chown d1/d17/fae 220 1 2024-09-20T19:06:14.844 INFO:tasks.workunit.client.1.smithi098.stdout:5/792: dread d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:06:14.859 INFO:tasks.workunit.client.1.smithi098.stdout:5/793: dread d1/d17/d35/d54/dab/db7/fb8 [0,4194304] 0 2024-09-20T19:06:14.861 INFO:tasks.workunit.client.1.smithi098.stdout:5/794: mkdir d1/d46/d69/dca/def 0 2024-09-20T19:06:14.862 INFO:tasks.workunit.client.1.smithi098.stdout:5/795: unlink d1/d1b/f1c 0 2024-09-20T19:06:14.864 INFO:tasks.workunit.client.1.smithi098.stdout:5/796: symlink d1/d71/d98/lf0 0 2024-09-20T19:06:14.866 INFO:tasks.workunit.client.1.smithi098.stdout:5/797: rename d1/l31 to d1/d1b/lf1 0 2024-09-20T19:06:14.881 INFO:tasks.workunit.client.1.smithi098.stdout:5/798: dwrite d1/d17/d5e/f81 [0,4194304] 0 2024-09-20T19:06:14.888 INFO:tasks.workunit.client.1.smithi098.stdout:5/799: rename d1/d17/d25/f58 to d1/d17/d35/d54/d68/ff2 0 2024-09-20T19:06:14.892 INFO:tasks.workunit.client.1.smithi098.stdout:5/800: rename d1/d46/d69/d84/d87/cc9 to d1/d17/d25/d79/dbc/db3/cf3 0 2024-09-20T19:06:14.895 INFO:tasks.workunit.client.1.smithi098.stdout:5/801: mknod d1/d17/d25/cf4 0 2024-09-20T19:06:14.895 INFO:tasks.workunit.client.1.smithi098.stdout:5/802: chown d1/d46/ddd 7647254 1 2024-09-20T19:06:14.898 INFO:tasks.workunit.client.1.smithi098.stdout:5/803: dread d1/d17/d35/d54/dab/db7/fb8 [4194304,4194304] 0 2024-09-20T19:06:14.900 INFO:tasks.workunit.client.1.smithi098.stdout:5/804: write d1/d17/d25/d79/f88 [924324,113498] 0 2024-09-20T19:06:14.904 INFO:tasks.workunit.client.1.smithi098.stdout:5/805: dread d1/fa2 [0,4194304] 0 2024-09-20T19:06:14.907 INFO:tasks.workunit.client.1.smithi098.stdout:5/806: creat d1/d17/d2e/dac/ff5 x:0 0 0 2024-09-20T19:06:14.912 INFO:tasks.workunit.client.1.smithi098.stdout:5/807: dwrite d1/d17/d35/fe1 [0,4194304] 0 2024-09-20T19:06:14.938 INFO:tasks.workunit.client.1.smithi098.stdout:5/808: dwrite d1/d46/d69/f6d [0,4194304] 0 2024-09-20T19:06:14.939 INFO:tasks.workunit.client.1.smithi098.stdout:5/809: chown d1/d17/d35/d93/f9e 3244 1 2024-09-20T19:06:14.944 INFO:tasks.workunit.client.1.smithi098.stdout:5/810: creat d1/d46/d69/dca/def/ff6 x:0 0 0 2024-09-20T19:06:14.945 INFO:tasks.workunit.client.1.smithi098.stdout:5/811: fsync d1/d46/fa7 0 2024-09-20T19:06:14.956 INFO:tasks.workunit.client.1.smithi098.stdout:5/812: write d1/d17/d35/d54/d68/ff2 [1688069,22446] 0 2024-09-20T19:06:14.957 INFO:tasks.workunit.client.1.smithi098.stdout:5/813: stat d1/d1b/d40/lc6 0 2024-09-20T19:06:14.963 INFO:tasks.workunit.client.1.smithi098.stdout:5/814: rename d1/d1b/f7e to d1/d17/d25/ff7 0 2024-09-20T19:06:14.966 INFO:tasks.workunit.client.1.smithi098.stdout:5/815: mknod d1/d46/cf8 0 2024-09-20T19:06:14.966 INFO:tasks.workunit.client.1.smithi098.stdout:5/816: fsync d1/d17/f55 0 2024-09-20T19:06:14.969 INFO:tasks.workunit.client.1.smithi098.stdout:5/817: rename d1/fa2 to d1/d1b/d40/daf/dc8/ff9 0 2024-09-20T19:06:14.970 INFO:tasks.workunit.client.1.smithi098.stdout:5/818: chown d1/fa3 3505346 1 2024-09-20T19:06:14.972 INFO:tasks.workunit.client.1.smithi098.stdout:5/819: mknod d1/cfa 0 2024-09-20T19:06:14.972 INFO:tasks.workunit.client.1.smithi098.stdout:8/946: sync 2024-09-20T19:06:14.973 INFO:tasks.workunit.client.1.smithi098.stdout:5/820: stat d1/d17/f1e 0 2024-09-20T19:06:14.974 INFO:tasks.workunit.client.1.smithi098.stdout:5/821: stat d1/d17/d25/d56/fe7 0 2024-09-20T19:06:14.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:14 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi027 to 1216M 2024-09-20T19:06:14.975 INFO:tasks.workunit.client.1.smithi098.stdout:5/822: chown d1/d17/d35/d93/fe3 4 1 2024-09-20T19:06:15.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:14 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi027 to 1216M 2024-09-20T19:06:15.134 INFO:tasks.workunit.client.1.smithi098.stdout:7/957: sync 2024-09-20T19:06:15.201 INFO:tasks.workunit.client.1.smithi098.stdout:5/823: mknod d1/d17/cfb 0 2024-09-20T19:06:15.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/947: getdents d7/de/d11/d19/d30/d59/d80 0 2024-09-20T19:06:15.202 INFO:tasks.workunit.client.1.smithi098.stdout:5/824: chown d1/d17/fae 26863 1 2024-09-20T19:06:15.208 INFO:tasks.workunit.client.1.smithi098.stdout:8/948: creat d7/de/d11/d1d/d110/d11a/db6/d11d/d137/f147 x:0 0 0 2024-09-20T19:06:15.213 INFO:tasks.workunit.client.1.smithi098.stdout:8/949: creat d7/de/f148 x:0 0 0 2024-09-20T19:06:15.228 INFO:tasks.workunit.client.1.smithi098.stdout:7/958: dwrite d3/d10/d16/d17/d33/d1f/d10c/f3f [0,4194304] 0 2024-09-20T19:06:15.230 INFO:tasks.workunit.client.1.smithi098.stdout:7/959: chown d3/d10/d16/d17/d33/d1f/d28/f61 0 1 2024-09-20T19:06:15.231 INFO:tasks.workunit.client.1.smithi098.stdout:5/825: write d1/d17/d35/f89 [979856,43033] 0 2024-09-20T19:06:15.242 INFO:tasks.workunit.client.1.smithi098.stdout:5/826: mkdir d1/d17/d35/d93/db1/dfc 0 2024-09-20T19:06:15.245 INFO:tasks.workunit.client.1.smithi098.stdout:5/827: symlink d1/d46/lfd 0 2024-09-20T19:06:15.249 INFO:tasks.workunit.client.1.smithi098.stdout:8/950: dwrite d7/de/d11/d19/d30/d82/f8e [0,4194304] 0 2024-09-20T19:06:15.250 INFO:tasks.workunit.client.1.smithi098.stdout:5/828: stat d1/d17/d25/d79/dbc/db3/cf3 0 2024-09-20T19:06:15.253 INFO:tasks.workunit.client.1.smithi098.stdout:8/951: symlink d7/de/d11/d1d/l149 0 2024-09-20T19:06:15.253 INFO:tasks.workunit.client.1.smithi098.stdout:5/829: stat d1/d17/d25/d56/l66 0 2024-09-20T19:06:15.255 INFO:tasks.workunit.client.1.smithi098.stdout:3/840: sync 2024-09-20T19:06:15.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/952: creat d7/de/f14a x:0 0 0 2024-09-20T19:06:15.257 INFO:tasks.workunit.client.1.smithi098.stdout:8/953: fdatasync d7/de/f14a 0 2024-09-20T19:06:15.259 INFO:tasks.workunit.client.1.smithi098.stdout:5/830: rename d1/d17/d35/d54/dab/db7/fb8 to d1/d46/d69/ffe 0 2024-09-20T19:06:15.262 INFO:tasks.workunit.client.1.smithi098.stdout:3/841: symlink d4/d19/d1d/d2f/d4e/da3/l100 0 2024-09-20T19:06:15.264 INFO:tasks.workunit.client.1.smithi098.stdout:3/842: read - d4/d19/d7b/fde zero size 2024-09-20T19:06:15.266 INFO:tasks.workunit.client.1.smithi098.stdout:7/960: dwrite d3/d10/d16/d17/d33/d37/ffa [0,4194304] 0 2024-09-20T19:06:15.273 INFO:tasks.workunit.client.1.smithi098.stdout:8/954: creat d7/de/d11/d1d/d110/d11a/d72/d10b/f14b x:0 0 0 2024-09-20T19:06:15.275 INFO:tasks.workunit.client.1.smithi098.stdout:8/955: chown d7/de/d11/d19/d30/d55/da9/f103 42071 1 2024-09-20T19:06:15.293 INFO:tasks.workunit.client.1.smithi098.stdout:3/843: dread d4/f1b [0,4194304] 0 2024-09-20T19:06:15.299 INFO:tasks.workunit.client.1.smithi098.stdout:7/961: dread - d3/d76/d86/f105 zero size 2024-09-20T19:06:15.302 INFO:tasks.workunit.client.1.smithi098.stdout:5/831: creat d1/d17/d25/fff x:0 0 0 2024-09-20T19:06:15.306 INFO:tasks.workunit.client.1.smithi098.stdout:7/962: dwrite d3/d10/d16/d17/d33/d1f/d2d/f107 [0,4194304] 0 2024-09-20T19:06:15.308 INFO:tasks.workunit.client.1.smithi098.stdout:5/832: mkdir d1/d17/d35/d54/dab/d100 0 2024-09-20T19:06:15.309 INFO:tasks.workunit.client.1.smithi098.stdout:8/956: getdents d7/de/d11/d19/d30 0 2024-09-20T19:06:15.309 INFO:tasks.workunit.client.1.smithi098.stdout:9/991: sync 2024-09-20T19:06:15.309 INFO:tasks.workunit.client.1.smithi098.stdout:0/647: sync 2024-09-20T19:06:15.311 INFO:tasks.workunit.client.1.smithi098.stdout:0/648: chown d0/d6/d28/l2d 14949622 1 2024-09-20T19:06:15.312 INFO:tasks.workunit.client.1.smithi098.stdout:9/992: rmdir d4/d74/d8a 39 2024-09-20T19:06:15.313 INFO:tasks.workunit.client.1.smithi098.stdout:8/957: mknod d7/de/d11/d19/d30/c14c 0 2024-09-20T19:06:15.317 INFO:tasks.workunit.client.1.smithi098.stdout:9/993: chown d4/d74/d8a/f134 6953 1 2024-09-20T19:06:15.317 INFO:tasks.workunit.client.1.smithi098.stdout:8/958: creat d7/de/d11/d1d/d110/d11a/db6/d11d/f14d x:0 0 0 2024-09-20T19:06:15.318 INFO:tasks.workunit.client.1.smithi098.stdout:9/994: chown d4/de/d27/d4a/d21/d25/d51/f9d 268383 1 2024-09-20T19:06:15.319 INFO:tasks.workunit.client.1.smithi098.stdout:5/833: mkdir d1/d17/d2e/dac/de4/d101 0 2024-09-20T19:06:15.319 INFO:tasks.workunit.client.1.smithi098.stdout:9/995: chown d4/de 871 1 2024-09-20T19:06:15.320 INFO:tasks.workunit.client.1.smithi098.stdout:8/959: creat d7/dd2/f14e x:0 0 0 2024-09-20T19:06:15.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/649: getdents d0/d6/d19 0 2024-09-20T19:06:15.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/834: creat d1/d46/ddd/f102 x:0 0 0 2024-09-20T19:06:15.325 INFO:tasks.workunit.client.1.smithi098.stdout:9/996: symlink d4/d139/l148 0 2024-09-20T19:06:15.326 INFO:tasks.workunit.client.1.smithi098.stdout:0/650: creat d0/d6/d19/dbe/fc3 x:0 0 0 2024-09-20T19:06:15.329 INFO:tasks.workunit.client.1.smithi098.stdout:9/997: mkdir d4/de/d24/d35/d6d/d78/d149 0 2024-09-20T19:06:15.330 INFO:tasks.workunit.client.1.smithi098.stdout:5/835: fdatasync d1/f33 0 2024-09-20T19:06:15.331 INFO:tasks.workunit.client.1.smithi098.stdout:0/651: mknod d0/db/d7f/d93/cc4 0 2024-09-20T19:06:15.333 INFO:tasks.workunit.client.1.smithi098.stdout:3/844: write d4/d25/d40/d4b/f8e [4161972,112931] 0 2024-09-20T19:06:15.336 INFO:tasks.workunit.client.1.smithi098.stdout:0/652: symlink d0/d6/d28/d31/d45/d60/lc5 0 2024-09-20T19:06:15.338 INFO:tasks.workunit.client.1.smithi098.stdout:3/845: fsync d4/d19/d1d/d2f/faf 0 2024-09-20T19:06:15.345 INFO:tasks.workunit.client.1.smithi098.stdout:8/960: write d7/de/d11/d1f/d10a/f5a [40032,39374] 0 2024-09-20T19:06:15.345 INFO:tasks.workunit.client.1.smithi098.stdout:0/653: symlink d0/d55/lc6 0 2024-09-20T19:06:15.346 INFO:tasks.workunit.client.1.smithi098.stdout:3/846: fdatasync d4/da/fbf 0 2024-09-20T19:06:15.358 INFO:tasks.workunit.client.1.smithi098.stdout:8/961: creat d7/de/d11/d19/d30/d68/d78/f14f x:0 0 0 2024-09-20T19:06:15.358 INFO:tasks.workunit.client.1.smithi098.stdout:9/998: dwrite d4/de/f34 [4194304,4194304] 0 2024-09-20T19:06:15.360 INFO:tasks.workunit.client.1.smithi098.stdout:5/836: dwrite d1/f9 [0,4194304] 0 2024-09-20T19:06:15.364 INFO:tasks.workunit.client.1.smithi098.stdout:5/837: fsync d1/fc 0 2024-09-20T19:06:15.369 INFO:tasks.workunit.client.1.smithi098.stdout:0/654: dwrite d0/d6/d28/d31/f53 [0,4194304] 0 2024-09-20T19:06:15.370 INFO:tasks.workunit.client.1.smithi098.stdout:8/962: truncate d7/de/d11/d1f/ffc 976013 0 2024-09-20T19:06:15.372 INFO:tasks.workunit.client.1.smithi098.stdout:0/655: chown d0/d6/f12 1 1 2024-09-20T19:06:15.373 INFO:tasks.workunit.client.1.smithi098.stdout:0/656: dread - d0/d55/f5b zero size 2024-09-20T19:06:15.374 INFO:tasks.workunit.client.1.smithi098.stdout:0/657: chown d0/db/f14 46474 1 2024-09-20T19:06:15.378 INFO:tasks.workunit.client.1.smithi098.stdout:0/658: dread - d0/db/d32/f7c zero size 2024-09-20T19:06:15.378 INFO:tasks.workunit.client.1.smithi098.stdout:3/847: dwrite d4/d25/f2b [0,4194304] 0 2024-09-20T19:06:15.380 INFO:tasks.workunit.client.1.smithi098.stdout:5/838: rmdir d1/d17/d2e/dac/de4/d101 0 2024-09-20T19:06:15.382 INFO:tasks.workunit.client.1.smithi098.stdout:5/839: write d1/d46/d69/fc3 [502216,41854] 0 2024-09-20T19:06:15.385 INFO:tasks.workunit.client.1.smithi098.stdout:3/848: link d4/d38/f91 d4/d19/d1d/d2f/f101 0 2024-09-20T19:06:15.386 INFO:tasks.workunit.client.1.smithi098.stdout:0/659: link d0/db/c2b d0/d6/d19/dbe/cc7 0 2024-09-20T19:06:15.387 INFO:tasks.workunit.client.1.smithi098.stdout:3/849: mknod d4/d25/c102 0 2024-09-20T19:06:15.391 INFO:tasks.workunit.client.1.smithi098.stdout:3/850: mkdir d4/da/d103 0 2024-09-20T19:06:15.393 INFO:tasks.workunit.client.1.smithi098.stdout:3/851: mkdir d4/da/d50/d104 0 2024-09-20T19:06:15.395 INFO:tasks.workunit.client.1.smithi098.stdout:3/852: write d4/d19/d1d/d2f/f53 [2518192,73247] 0 2024-09-20T19:06:15.396 INFO:tasks.workunit.client.1.smithi098.stdout:8/963: write d7/de/d11/f71 [2922050,90132] 0 2024-09-20T19:06:15.401 INFO:tasks.workunit.client.1.smithi098.stdout:9/999: dwrite d4/de/d27/d4a/d21/f46 [0,4194304] 0 2024-09-20T19:06:15.404 INFO:tasks.workunit.client.1.smithi098.stdout:3/853: fdatasync d4/d38/d48/f79 0 2024-09-20T19:06:15.406 INFO:tasks.workunit.client.1.smithi098.stdout:3/854: fdatasync d4/d38/d39/f5a 0 2024-09-20T19:06:15.410 INFO:tasks.workunit.client.1.smithi098.stdout:0/660: dwrite d0/d7d/f8c [0,4194304] 0 2024-09-20T19:06:15.413 INFO:tasks.workunit.client.1.smithi098.stdout:8/964: link d7/de/l1a d7/de/l150 0 2024-09-20T19:06:15.417 INFO:tasks.workunit.client.1.smithi098.stdout:0/661: rename d0/d6/d19/dbe/l7e to d0/d6/d28/d31/d69/d9b/dae/lc8 0 2024-09-20T19:06:15.419 INFO:tasks.workunit.client.1.smithi098.stdout:8/965: mkdir d7/de/d11/d19/d47/d12a/d151 0 2024-09-20T19:06:15.419 INFO:tasks.workunit.client.1.smithi098.stdout:3/855: write d4/d25/d8d/fab [864746,104598] 0 2024-09-20T19:06:15.420 INFO:tasks.workunit.client.1.smithi098.stdout:0/662: creat d0/d6/d28/d31/d45/d60/d78/fc9 x:0 0 0 2024-09-20T19:06:15.421 INFO:tasks.workunit.client.1.smithi098.stdout:0/663: dread - d0/d55/f5b zero size 2024-09-20T19:06:15.428 INFO:tasks.workunit.client.1.smithi098.stdout:0/664: dwrite d0/d55/f76 [0,4194304] 0 2024-09-20T19:06:15.428 INFO:tasks.workunit.client.1.smithi098.stdout:3/856: write d4/d19/d1d/d2f/d3e/f52 [3355175,106931] 0 2024-09-20T19:06:15.430 INFO:tasks.workunit.client.1.smithi098.stdout:8/966: getdents d7/de/d11/dca 0 2024-09-20T19:06:15.434 INFO:tasks.workunit.client.1.smithi098.stdout:3/857: dread - d4/d19/d1d/d2f/f101 zero size 2024-09-20T19:06:15.437 INFO:tasks.workunit.client.1.smithi098.stdout:3/858: creat d4/d25/d8d/f105 x:0 0 0 2024-09-20T19:06:15.443 INFO:tasks.workunit.client.1.smithi098.stdout:0/665: dwrite d0/d6/d28/f5c [0,4194304] 0 2024-09-20T19:06:15.443 INFO:tasks.workunit.client.1.smithi098.stdout:3/859: link d4/d19/d1d/d2f/d3e/l77 d4/da/d50/d104/l106 0 2024-09-20T19:06:15.446 INFO:tasks.workunit.client.1.smithi098.stdout:0/666: dread - d0/d7d/f9d zero size 2024-09-20T19:06:15.447 INFO:tasks.workunit.client.1.smithi098.stdout:0/667: readlink d0/d6/d28/d31/d69/l8d 0 2024-09-20T19:06:15.448 INFO:tasks.workunit.client.1.smithi098.stdout:0/668: chown d0/d6/d28/c3b 94 1 2024-09-20T19:06:15.452 INFO:tasks.workunit.client.1.smithi098.stdout:8/967: dread d7/de/d11/d19/d30/d55/fe4 [0,4194304] 0 2024-09-20T19:06:15.456 INFO:tasks.workunit.client.1.smithi098.stdout:0/669: dwrite d0/d6/d28/f5c [0,4194304] 0 2024-09-20T19:06:15.460 INFO:tasks.workunit.client.1.smithi098.stdout:0/670: creat d0/db/d1d/d8f/fca x:0 0 0 2024-09-20T19:06:15.470 INFO:tasks.workunit.client.1.smithi098.stdout:0/671: rename d0/db/d1d/d8f/d51 to d0/d7d/dcb 0 2024-09-20T19:06:15.475 INFO:tasks.workunit.client.1.smithi098.stdout:3/860: dread d4/d19/d1d/d2f/d3e/f52 [0,4194304] 0 2024-09-20T19:06:15.480 INFO:tasks.workunit.client.1.smithi098.stdout:3/861: dwrite d4/d38/d48/ff3 [0,4194304] 0 2024-09-20T19:06:15.487 INFO:tasks.workunit.client.1.smithi098.stdout:3/862: rename d4/d19/d1d/d2f/d4e/f90 to d4/d92/f107 0 2024-09-20T19:06:15.490 INFO:tasks.workunit.client.1.smithi098.stdout:3/863: rmdir d4/da/d50/d104 39 2024-09-20T19:06:15.494 INFO:tasks.workunit.client.1.smithi098.stdout:3/864: creat d4/da/d50/df0/f108 x:0 0 0 2024-09-20T19:06:15.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/672: dwrite d0/d6/d19/f33 [0,4194304] 0 2024-09-20T19:06:15.495 INFO:tasks.workunit.client.1.smithi098.stdout:3/865: chown d4/d19/d1d/c4d 110116 1 2024-09-20T19:06:15.498 INFO:tasks.workunit.client.1.smithi098.stdout:0/673: fdatasync d0/db/d1d/f26 0 2024-09-20T19:06:15.503 INFO:tasks.workunit.client.1.smithi098.stdout:0/674: truncate d0/db/f17 319434 0 2024-09-20T19:06:15.507 INFO:tasks.workunit.client.1.smithi098.stdout:3/866: creat d4/d19/d1d/f109 x:0 0 0 2024-09-20T19:06:15.514 INFO:tasks.workunit.client.1.smithi098.stdout:3/867: creat d4/d19/d1d/d2f/d4e/d59/f10a x:0 0 0 2024-09-20T19:06:15.518 INFO:tasks.workunit.client.1.smithi098.stdout:3/868: mknod d4/da/d50/d104/c10b 0 2024-09-20T19:06:15.521 INFO:tasks.workunit.client.1.smithi098.stdout:3/869: symlink d4/d38/l10c 0 2024-09-20T19:06:15.523 INFO:tasks.workunit.client.1.smithi098.stdout:3/870: fsync d4/d38/d39/f88 0 2024-09-20T19:06:15.528 INFO:tasks.workunit.client.1.smithi098.stdout:3/871: rename d4/d25/d40/d80/d94 to d4/da/d10d 0 2024-09-20T19:06:15.529 INFO:tasks.workunit.client.1.smithi098.stdout:3/872: write d4/d38/d48/ff3 [5106096,106980] 0 2024-09-20T19:06:15.530 INFO:tasks.workunit.client.1.smithi098.stdout:3/873: chown d4/d19/d1d/d2f/d4e/da3/fef 508 1 2024-09-20T19:06:15.531 INFO:tasks.workunit.client.1.smithi098.stdout:3/874: write d4/d25/d8d/fdf [568934,1561] 0 2024-09-20T19:06:15.532 INFO:tasks.workunit.client.1.smithi098.stdout:3/875: write d4/d38/d48/fcc [430461,36292] 0 2024-09-20T19:06:15.537 INFO:tasks.workunit.client.1.smithi098.stdout:3/876: mknod d4/da/d7a/c10e 0 2024-09-20T19:06:15.567 INFO:tasks.workunit.client.1.smithi098.stdout:3/877: truncate d4/d19/d1d/d2f/fc8 3852 0 2024-09-20T19:06:15.569 INFO:tasks.workunit.client.1.smithi098.stdout:3/878: creat d4/d19/d1d/d22/dc5/f10f x:0 0 0 2024-09-20T19:06:15.575 INFO:tasks.workunit.client.1.smithi098.stdout:3/879: dread d4/d19/d1d/f3b [0,4194304] 0 2024-09-20T19:06:15.577 INFO:tasks.workunit.client.1.smithi098.stdout:3/880: dread - d4/da/d10d/fac zero size 2024-09-20T19:06:15.578 INFO:tasks.workunit.client.1.smithi098.stdout:3/881: chown d4/da/d7a/lc3 935780754 1 2024-09-20T19:06:15.579 INFO:tasks.workunit.client.1.smithi098.stdout:3/882: write d4/d19/d1d/d2f/d4e/da3/ff9 [747581,16740] 0 2024-09-20T19:06:15.582 INFO:tasks.workunit.client.1.smithi098.stdout:3/883: rename d4/da/f6c to d4/da/d50/df0/f110 0 2024-09-20T19:06:15.586 INFO:tasks.workunit.client.1.smithi098.stdout:3/884: mknod d4/da/d103/c111 0 2024-09-20T19:06:15.600 INFO:tasks.workunit.client.1.smithi098.stdout:3/885: dwrite d4/d25/d8d/fdd [0,4194304] 0 2024-09-20T19:06:15.603 INFO:tasks.workunit.client.1.smithi098.stdout:1/791: sync 2024-09-20T19:06:15.603 INFO:tasks.workunit.client.1.smithi098.stdout:4/964: sync 2024-09-20T19:06:15.603 INFO:tasks.workunit.client.1.smithi098.stdout:6/743: sync 2024-09-20T19:06:15.606 INFO:tasks.workunit.client.1.smithi098.stdout:3/886: creat d4/da/d50/d104/f112 x:0 0 0 2024-09-20T19:06:15.611 INFO:tasks.workunit.client.1.smithi098.stdout:6/744: symlink d0/d55/d82/dd5/d24/dd6/lea 0 2024-09-20T19:06:15.614 INFO:tasks.workunit.client.1.smithi098.stdout:1/792: rename d1/d3/l39 to d1/d3/df/d34/d52/d77/df7/dc1/dc7/l102 0 2024-09-20T19:06:15.615 INFO:tasks.workunit.client.1.smithi098.stdout:4/965: fdatasync d3/d2e/fb9 0 2024-09-20T19:06:15.617 INFO:tasks.workunit.client.1.smithi098.stdout:4/966: fsync d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f10d 0 2024-09-20T19:06:15.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/745: mkdir d0/de/d1b/deb 0 2024-09-20T19:06:15.622 INFO:tasks.workunit.client.1.smithi098.stdout:6/746: chown d0/de/d1b/deb 2395097 1 2024-09-20T19:06:15.627 INFO:tasks.workunit.client.1.smithi098.stdout:1/793: dread d1/d3/df/f21 [4194304,4194304] 0 2024-09-20T19:06:15.628 INFO:tasks.workunit.client.1.smithi098.stdout:4/967: truncate d3/d6/d8c/de7/df4/f62 4765754 0 2024-09-20T19:06:15.631 INFO:tasks.workunit.client.1.smithi098.stdout:3/887: getdents d4/da/d50 0 2024-09-20T19:06:15.633 INFO:tasks.workunit.client.1.smithi098.stdout:4/968: truncate d3/d6/d8c/de7/df4/d57/f9b 3907038 0 2024-09-20T19:06:15.634 INFO:tasks.workunit.client.1.smithi098.stdout:4/969: chown d3/d6/d8c/de7/df4/fe9 3758614 1 2024-09-20T19:06:15.636 INFO:tasks.workunit.client.1.smithi098.stdout:3/888: fdatasync d4/d38/d48/f79 0 2024-09-20T19:06:15.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/794: symlink d1/d3/df/df9/l103 0 2024-09-20T19:06:15.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/889: rmdir d4/da/d50/d104 39 2024-09-20T19:06:15.643 INFO:tasks.workunit.client.1.smithi098.stdout:6/747: dwrite d0/de/f8b [4194304,4194304] 0 2024-09-20T19:06:15.643 INFO:tasks.workunit.client.1.smithi098.stdout:1/795: truncate d1/d3/d2e/d61/fc8 249663 0 2024-09-20T19:06:15.645 INFO:tasks.workunit.client.1.smithi098.stdout:4/970: rename d3/d7d/fc1 to d3/f138 0 2024-09-20T19:06:15.651 INFO:tasks.workunit.client.1.smithi098.stdout:3/890: truncate d4/d19/d1d/f6d 430399 0 2024-09-20T19:06:15.653 INFO:tasks.workunit.client.1.smithi098.stdout:6/748: symlink d0/d55/d82/dd5/d24/dd6/de7/lec 0 2024-09-20T19:06:15.656 INFO:tasks.workunit.client.1.smithi098.stdout:4/971: truncate d3/d2e/f68 6110290 0 2024-09-20T19:06:15.657 INFO:tasks.workunit.client.1.smithi098.stdout:4/972: chown d3/d5e/de4/d120 365718 1 2024-09-20T19:06:15.657 INFO:tasks.workunit.client.1.smithi098.stdout:3/891: unlink d4/d19/d1d/d22/f9b 0 2024-09-20T19:06:15.659 INFO:tasks.workunit.client.1.smithi098.stdout:1/796: rename d1/d3/df/d34/d52/d77/df7/dc1/dc7/fdf to d1/d3/df/d34/d43/f104 0 2024-09-20T19:06:15.661 INFO:tasks.workunit.client.1.smithi098.stdout:6/749: creat d0/d55/d82/da3/d43/dc0/d7c/fed x:0 0 0 2024-09-20T19:06:15.662 INFO:tasks.workunit.client.1.smithi098.stdout:3/892: creat d4/d25/d40/f113 x:0 0 0 2024-09-20T19:06:15.666 INFO:tasks.workunit.client.1.smithi098.stdout:4/973: link d3/d6/d8c/de7/df4/d57/d7f/d84/f114 d3/d6/d8c/de7/df4/d1e/d2a/d45/d91/d130/f139 0 2024-09-20T19:06:15.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/750: dwrite d0/d55/d82/da3/d8c/d4c/fbf [0,4194304] 0 2024-09-20T19:06:15.667 INFO:tasks.workunit.client.1.smithi098.stdout:3/893: rename d4/d19/d1d/d2f/c98 to d4/da/d10d/df4/c114 0 2024-09-20T19:06:15.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/894: stat d4/d25/d8d/fab 0 2024-09-20T19:06:15.668 INFO:tasks.workunit.client.1.smithi098.stdout:1/797: fdatasync d1/d3/df/d34/d43/daa/fd6 0 2024-09-20T19:06:15.670 INFO:tasks.workunit.client.1.smithi098.stdout:3/895: chown d4/d19/d1d/d2f/lf7 47342 1 2024-09-20T19:06:15.671 INFO:tasks.workunit.client.1.smithi098.stdout:6/751: rmdir d0/d55 39 2024-09-20T19:06:15.672 INFO:tasks.workunit.client.1.smithi098.stdout:6/752: chown d0/fc4 58 1 2024-09-20T19:06:15.675 INFO:tasks.workunit.client.1.smithi098.stdout:4/974: creat d3/d6/d5b/dd0/f13a x:0 0 0 2024-09-20T19:06:15.676 INFO:tasks.workunit.client.1.smithi098.stdout:1/798: rename d1/d3/df/d4a/ce3 to d1/d3/d62/c105 0 2024-09-20T19:06:15.685 INFO:tasks.workunit.client.1.smithi098.stdout:4/975: rename d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/f10d to d3/d6/d8c/de7/d124/d107/f13b 0 2024-09-20T19:06:15.685 INFO:tasks.workunit.client.1.smithi098.stdout:1/799: rmdir d1/d3/df 39 2024-09-20T19:06:15.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/896: creat d4/da/d50/df0/f115 x:0 0 0 2024-09-20T19:06:15.693 INFO:tasks.workunit.client.1.smithi098.stdout:6/753: creat d0/fee x:0 0 0 2024-09-20T19:06:15.694 INFO:tasks.workunit.client.1.smithi098.stdout:3/897: read d4/d38/d48/fcc [2967245,121734] 0 2024-09-20T19:06:15.694 INFO:tasks.workunit.client.1.smithi098.stdout:4/976: mkdir d3/d6/d8c/de7/df4/d64/dce/d13c 0 2024-09-20T19:06:15.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/898: creat d4/d25/f116 x:0 0 0 2024-09-20T19:06:15.728 INFO:tasks.workunit.client.1.smithi098.stdout:7/963: sync 2024-09-20T19:06:15.728 INFO:tasks.workunit.client.1.smithi098.stdout:4/977: mknod d3/d6/de3/def/c13d 0 2024-09-20T19:06:15.728 INFO:tasks.workunit.client.1.smithi098.stdout:6/754: symlink d0/d55/d82/da3/d8c/d4c/lef 0 2024-09-20T19:06:15.730 INFO:tasks.workunit.client.1.smithi098.stdout:3/899: unlink d4/d19/d1d/d2f/l37 0 2024-09-20T19:06:15.730 INFO:tasks.workunit.client.1.smithi098.stdout:3/900: readlink d4/d19/d1d/l83 0 2024-09-20T19:06:15.731 INFO:tasks.workunit.client.1.smithi098.stdout:6/755: read d0/d55/d82/da3/d8c/fb4 [393893,101063] 0 2024-09-20T19:06:15.733 INFO:tasks.workunit.client.1.smithi098.stdout:7/964: fdatasync d3/d76/db8/da6/fcc 0 2024-09-20T19:06:15.733 INFO:tasks.workunit.client.1.smithi098.stdout:1/800: dread d1/d3/df/d4a/f63 [0,4194304] 0 2024-09-20T19:06:15.735 INFO:tasks.workunit.client.1.smithi098.stdout:1/801: chown d1/d3/df/d34/d43/d53 1702 1 2024-09-20T19:06:15.738 INFO:tasks.workunit.client.1.smithi098.stdout:1/802: dread d1/d3/df/d4a/fa8 [0,4194304] 0 2024-09-20T19:06:15.739 INFO:tasks.workunit.client.1.smithi098.stdout:3/901: symlink d4/d38/d97/l117 0 2024-09-20T19:06:15.742 INFO:tasks.workunit.client.1.smithi098.stdout:6/756: mknod d0/d55/d82/da3/d43/dc0/d66/cf0 0 2024-09-20T19:06:15.750 INFO:tasks.workunit.client.1.smithi098.stdout:7/965: rename d3/d10/d16/d17/d33/d37/ffa to d3/d10/d16/d17/d33/d1f/d28/d66/ddf/f135 0 2024-09-20T19:06:15.755 INFO:tasks.workunit.client.1.smithi098.stdout:1/803: mkdir d1/dda/d106 0 2024-09-20T19:06:15.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/902: dread d4/d25/f3c [0,4194304] 0 2024-09-20T19:06:15.767 INFO:tasks.workunit.client.1.smithi098.stdout:3/903: dwrite d4/d25/d40/d80/f86 [0,4194304] 0 2024-09-20T19:06:15.775 INFO:tasks.workunit.client.1.smithi098.stdout:6/757: dread d0/f22 [0,4194304] 0 2024-09-20T19:06:15.776 INFO:tasks.workunit.client.1.smithi098.stdout:4/978: dwrite d3/d7d/da3/f56 [0,4194304] 0 2024-09-20T19:06:15.787 INFO:tasks.workunit.client.1.smithi098.stdout:1/804: write d1/d3/df/d4a/d6d/f92 [471755,129664] 0 2024-09-20T19:06:15.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/904: write d4/d19/f8f [1754955,4740] 0 2024-09-20T19:06:15.791 INFO:tasks.workunit.client.1.smithi098.stdout:7/966: dwrite d3/d10/dcf/fd6 [4194304,4194304] 0 2024-09-20T19:06:15.791 INFO:tasks.workunit.client.1.smithi098.stdout:3/905: truncate d4/da/d50/df0/f110 1791739 0 2024-09-20T19:06:15.794 INFO:tasks.workunit.client.1.smithi098.stdout:7/967: mkdir d3/d76/d7a/d136 0 2024-09-20T19:06:15.796 INFO:tasks.workunit.client.1.smithi098.stdout:3/906: dread d4/da/fbf [0,4194304] 0 2024-09-20T19:06:15.797 INFO:tasks.workunit.client.1.smithi098.stdout:7/968: chown d3/daa/dd4 1613063512 1 2024-09-20T19:06:15.798 INFO:tasks.workunit.client.1.smithi098.stdout:4/979: dread d3/d6/d8c/de7/df4/d1e/d2a/fd9 [0,4194304] 0 2024-09-20T19:06:15.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/980: chown d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/dcc 96981106 1 2024-09-20T19:06:15.801 INFO:tasks.workunit.client.1.smithi098.stdout:1/805: link d1/d3/d2e/d68/d7a/da1/ldc d1/d3/df/d34/d52/d77/df7/l107 0 2024-09-20T19:06:15.803 INFO:tasks.workunit.client.1.smithi098.stdout:7/969: rename d3/daa/dd4/c108 to d3/d10/d16/d17/d33/d1f/d103/c137 0 2024-09-20T19:06:15.803 INFO:tasks.workunit.client.1.smithi098.stdout:6/758: dread d0/d55/d82/da3/d43/dc0/d66/d81/fdf [0,4194304] 0 2024-09-20T19:06:15.804 INFO:tasks.workunit.client.1.smithi098.stdout:6/759: readlink d0/d55/d82/da3/d43/l47 0 2024-09-20T19:06:15.806 INFO:tasks.workunit.client.1.smithi098.stdout:1/806: unlink d1/d3/d2e/f47 0 2024-09-20T19:06:15.809 INFO:tasks.workunit.client.1.smithi098.stdout:3/907: creat d4/d19/d1d/f118 x:0 0 0 2024-09-20T19:06:15.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/807: fsync d1/d3/f1e 0 2024-09-20T19:06:15.816 INFO:tasks.workunit.client.1.smithi098.stdout:3/908: symlink d4/d38/d97/l119 0 2024-09-20T19:06:15.817 INFO:tasks.workunit.client.1.smithi098.stdout:6/760: dwrite d0/d55/d82/f95 [0,4194304] 0 2024-09-20T19:06:15.821 INFO:tasks.workunit.client.1.smithi098.stdout:4/981: link d3/d7d/ldc d3/d6/d8c/de7/df4/d57/d7f/l13e 0 2024-09-20T19:06:15.822 INFO:tasks.workunit.client.1.smithi098.stdout:4/982: stat d3/d6/d8c/de7/d124/lb4 0 2024-09-20T19:06:15.823 INFO:tasks.workunit.client.1.smithi098.stdout:7/970: rmdir d3/d4c/d10a 0 2024-09-20T19:06:15.824 INFO:tasks.workunit.client.1.smithi098.stdout:4/983: chown d3/d6/d8c/de7/d124/d6b/d73/d98/db3/d50/d58/dab/dee/l128 18780294 1 2024-09-20T19:06:15.829 INFO:tasks.workunit.client.1.smithi098.stdout:1/808: mknod d1/d3/c108 0 2024-09-20T19:06:15.835 INFO:tasks.workunit.client.1.smithi098.stdout:3/909: write d4/d25/d40/fd7 [131486,27748] 0 2024-09-20T19:06:15.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/761: rename d0/d55/d82/da3/d8c/d4c/lef to d0/de/d1b/lf1 0 2024-09-20T19:06:15.843 INFO:tasks.workunit.client.1.smithi098.stdout:3/910: creat d4/d25/d40/d4b/f11a x:0 0 0 2024-09-20T19:06:15.844 INFO:tasks.workunit.client.1.smithi098.stdout:7/971: creat d3/d10/d16/dc1/f138 x:0 0 0 2024-09-20T19:06:15.846 INFO:tasks.workunit.client.1.smithi098.stdout:4/984: rmdir d3/d5e/de4/df9 0 2024-09-20T19:06:15.849 INFO:tasks.workunit.client.1.smithi098.stdout:3/911: creat d4/d19/d1d/d22/f11b x:0 0 0 2024-09-20T19:06:15.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/912: truncate d4/d19/d7b/fde 138248 0 2024-09-20T19:06:15.853 INFO:tasks.workunit.client.1.smithi098.stdout:4/985: dread d3/f5 [4194304,4194304] 0 2024-09-20T19:06:15.856 INFO:tasks.workunit.client.1.smithi098.stdout:6/762: write d0/de/d1b/f28 [888251,15635] 0 2024-09-20T19:06:15.862 INFO:tasks.workunit.client.1.smithi098.stdout:7/972: write d3/d10/d16/d17/f7e [704412,103295] 0 2024-09-20T19:06:15.863 INFO:tasks.workunit.client.1.smithi098.stdout:3/913: write d4/d19/d1d/f3b [1171161,17449] 0 2024-09-20T19:06:15.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/809: dwrite d1/d3/df/d34/d52/d77/fa0 [0,4194304] 0 2024-09-20T19:06:15.866 INFO:tasks.workunit.client.1.smithi098.stdout:6/763: creat d0/d55/d82/da3/d43/d6d/ff2 x:0 0 0 2024-09-20T19:06:15.868 INFO:tasks.workunit.client.1.smithi098.stdout:6/764: fsync d0/d55/d82/dd5/d24/d29/f35 0 2024-09-20T19:06:15.871 INFO:tasks.workunit.client.1.smithi098.stdout:7/973: unlink d3/f12 0 2024-09-20T19:06:15.872 INFO:tasks.workunit.client.1.smithi098.stdout:4/986: dread d3/d6/d8c/de7/d124/d107/f13b [0,4194304] 0 2024-09-20T19:06:15.872 INFO:tasks.workunit.client.1.smithi098.stdout:3/914: creat d4/d25/d40/f11c x:0 0 0 2024-09-20T19:06:15.874 INFO:tasks.workunit.client.1.smithi098.stdout:1/810: fdatasync d1/d3/df/d34/d43/d65/f75 0 2024-09-20T19:06:15.877 INFO:tasks.workunit.client.1.smithi098.stdout:7/974: mkdir d3/d10/d16/d17/d7c/d11d/d139 0 2024-09-20T19:06:15.879 INFO:tasks.workunit.client.1.smithi098.stdout:1/811: fsync d1/f96 0 2024-09-20T19:06:15.881 INFO:tasks.workunit.client.1.smithi098.stdout:4/987: mkdir d3/d6/d8c/de7/d124/d6b/d73/d13f 0 2024-09-20T19:06:15.882 INFO:tasks.workunit.client.1.smithi098.stdout:7/975: unlink d3/d10/d16/d17/d7c/fe3 0 2024-09-20T19:06:15.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/988: chown d3/d6/d8c/de7/df4/l31 476334 1 2024-09-20T19:06:15.884 INFO:tasks.workunit.client.1.smithi098.stdout:6/765: dwrite d0/d55/d82/da3/d43/da8/fbc [0,4194304] 0 2024-09-20T19:06:15.886 INFO:tasks.workunit.client.1.smithi098.stdout:4/989: chown d3/d5e/lba 66542570 1 2024-09-20T19:06:15.889 INFO:tasks.workunit.client.1.smithi098.stdout:1/812: dread d1/d3/df/f21 [4194304,4194304] 0 2024-09-20T19:06:15.890 INFO:tasks.workunit.client.1.smithi098.stdout:6/766: chown d0/d55/d82/da3/d43/dc0/d65/fe0 18107781 1 2024-09-20T19:06:15.892 INFO:tasks.workunit.client.1.smithi098.stdout:1/813: fsync d1/dbb/fde 0 2024-09-20T19:06:15.893 INFO:tasks.workunit.client.1.smithi098.stdout:7/976: dwrite d3/d10/d16/d17/d7c/f131 [0,4194304] 0 2024-09-20T19:06:15.897 INFO:tasks.workunit.client.1.smithi098.stdout:4/990: fsync d3/d6/d8c/de7/df4/d57/d7f/d84/fc8 0 2024-09-20T19:06:15.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/767: truncate d0/d55/d82/dd5/de2/f5c 36257 0 2024-09-20T19:06:15.899 INFO:tasks.workunit.client.1.smithi098.stdout:1/814: truncate d1/d3/df/f23 4928555 0 2024-09-20T19:06:15.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/977: truncate d3/d10/d16/d17/d33/d1f/d2d/f3b 304274 0 2024-09-20T19:06:15.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/768: fdatasync d0/d55/d82/dd5/de2/f41 0 2024-09-20T19:06:15.901 INFO:tasks.workunit.client.1.smithi098.stdout:4/991: creat d3/dfb/f140 x:0 0 0 2024-09-20T19:06:15.901 INFO:tasks.workunit.client.1.smithi098.stdout:7/978: write d3/d4c/fff [1151072,63771] 0 2024-09-20T19:06:15.907 INFO:tasks.workunit.client.1.smithi098.stdout:7/979: mknod d3/d10/d16/d17/d33/d1f/dfe/c13a 0 2024-09-20T19:06:15.909 INFO:tasks.workunit.client.1.smithi098.stdout:7/980: chown d3/d10/d16/d17/d33/d1f/dba/d126 12 1 2024-09-20T19:06:15.910 INFO:tasks.workunit.client.1.smithi098.stdout:4/992: dwrite d3/d6/d8c/de7/d124/d6b/d73/d98/de0/f102 [4194304,4194304] 0 2024-09-20T19:06:15.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/769: write d0/f22 [1156796,120440] 0 2024-09-20T19:06:15.919 INFO:tasks.workunit.client.1.smithi098.stdout:4/993: fsync d3/d6/d8c/de7/df4/f62 0 2024-09-20T19:06:15.920 INFO:tasks.workunit.client.1.smithi098.stdout:1/815: dwrite d1/d3/d62/f8e [0,4194304] 0 2024-09-20T19:06:15.923 INFO:tasks.workunit.client.1.smithi098.stdout:1/816: rmdir d1/d3/d62/d9e 39 2024-09-20T19:06:15.925 INFO:tasks.workunit.client.1.smithi098.stdout:6/770: creat d0/de/d1b/deb/ff3 x:0 0 0 2024-09-20T19:06:15.926 INFO:tasks.workunit.client.1.smithi098.stdout:6/771: dread - d0/d55/d82/da3/fd9 zero size 2024-09-20T19:06:15.926 INFO:tasks.workunit.client.1.smithi098.stdout:7/981: write d3/d10/d16/d17/d33/d1f/d10c/fc4 [1555024,16197] 0 2024-09-20T19:06:15.929 INFO:tasks.workunit.client.1.smithi098.stdout:4/994: symlink d3/d6/d8c/de7/d124/d6b/d73/d13f/l141 0 2024-09-20T19:06:15.933 INFO:tasks.workunit.client.1.smithi098.stdout:1/817: mkdir d1/d3/df/dbe/d109 0 2024-09-20T19:06:15.935 INFO:tasks.workunit.client.1.smithi098.stdout:7/982: dwrite d3/d4c/fff [0,4194304] 0 2024-09-20T19:06:15.936 INFO:tasks.workunit.client.1.smithi098.stdout:6/772: creat d0/d55/d82/dd5/d24/ff4 x:0 0 0 2024-09-20T19:06:15.939 INFO:tasks.workunit.client.1.smithi098.stdout:6/773: write d0/d55/d82/da3/d43/da8/fce [39936,64026] 0 2024-09-20T19:06:15.942 INFO:tasks.workunit.client.1.smithi098.stdout:7/983: unlink d3/d4c/f101 0 2024-09-20T19:06:15.943 INFO:tasks.workunit.client.1.smithi098.stdout:7/984: stat d3/d10/d16/d17/fbb 0 2024-09-20T19:06:15.946 INFO:tasks.workunit.client.1.smithi098.stdout:1/818: truncate d1/d3/df/f23 4841875 0 2024-09-20T19:06:15.947 INFO:tasks.workunit.client.1.smithi098.stdout:6/774: fdatasync d0/d55/d82/da3/f4b 0 2024-09-20T19:06:15.955 INFO:tasks.workunit.client.1.smithi098.stdout:7/985: dwrite d3/d10/d16/d17/d33/d1f/d103/f12f [0,4194304] 0 2024-09-20T19:06:15.961 INFO:tasks.workunit.client.1.smithi098.stdout:7/986: fdatasync d3/d10/d16/d17/d7c/f131 0 2024-09-20T19:06:15.961 INFO:tasks.workunit.client.1.smithi098.stdout:1/819: dwrite d1/d3/df/d34/d52/d77/fa0 [0,4194304] 0 2024-09-20T19:06:15.961 INFO:tasks.workunit.client.1.smithi098.stdout:4/995: dread d3/d6/d8c/de7/d124/f108 [0,4194304] 0 2024-09-20T19:06:15.964 INFO:tasks.workunit.client.1.smithi098.stdout:6/775: dwrite d0/d55/d82/da3/d8c/d4c/f9c [0,4194304] 0 2024-09-20T19:06:15.967 INFO:tasks.workunit.client.1.smithi098.stdout:4/996: readlink d3/d6/d8c/de7/df4/d57/l79 0 2024-09-20T19:06:15.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:15 smithi098 ceph-mon[35737]: pgmap v16: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 119 MiB/s rd, 268 MiB/s wr, 550 op/s 2024-09-20T19:06:15.976 INFO:tasks.workunit.client.1.smithi098.stdout:4/997: dwrite d3/d6/d8c/de7/df4/d57/d7f/f8b [4194304,4194304] 0 2024-09-20T19:06:15.978 INFO:tasks.workunit.client.1.smithi098.stdout:7/987: creat d3/d10/d16/d17/d7c/d11d/d139/f13b x:0 0 0 2024-09-20T19:06:15.985 INFO:tasks.workunit.client.1.smithi098.stdout:6/776: rename d0/d55/d82/dd5/f3d to d0/ff5 0 2024-09-20T19:06:15.987 INFO:tasks.workunit.client.1.smithi098.stdout:6/777: mknod d0/d55/d82/da3/d43/dc0/d66/cf6 0 2024-09-20T19:06:15.989 INFO:tasks.workunit.client.1.smithi098.stdout:6/778: mknod d0/d55/d82/da3/d43/dc0/d7c/cf7 0 2024-09-20T19:06:15.990 INFO:tasks.workunit.client.1.smithi098.stdout:6/779: write d0/d55/d82/fb5 [645665,14553] 0 2024-09-20T19:06:15.992 INFO:tasks.workunit.client.1.smithi098.stdout:1/820: dread d1/d3/d2e/d68/d7a/da1/fbd [0,4194304] 0 2024-09-20T19:06:15.993 INFO:tasks.workunit.client.1.smithi098.stdout:6/780: truncate d0/fc4 102463 0 2024-09-20T19:06:15.995 INFO:tasks.workunit.client.1.smithi098.stdout:6/781: mkdir d0/d55/d82/dd5/de2/da7/df8 0 2024-09-20T19:06:15.999 INFO:tasks.workunit.client.1.smithi098.stdout:6/782: creat d0/d55/d82/da3/d43/dc0/ff9 x:0 0 0 2024-09-20T19:06:16.001 INFO:tasks.workunit.client.1.smithi098.stdout:6/783: read d0/d55/d82/da3/d8c/d4c/fbf [14827,55855] 0 2024-09-20T19:06:16.001 INFO:tasks.workunit.client.1.smithi098.stdout:7/988: write d3/d76/d7a/dce/fde [985450,56523] 0 2024-09-20T19:06:16.005 INFO:tasks.workunit.client.1.smithi098.stdout:6/784: read - d0/de/d1b/f89 zero size 2024-09-20T19:06:16.006 INFO:tasks.workunit.client.1.smithi098.stdout:4/998: dwrite d3/d7d/fd3 [0,4194304] 0 2024-09-20T19:06:16.011 INFO:tasks.workunit.client.1.smithi098.stdout:4/999: truncate d3/d2e/fb9 164760 0 2024-09-20T19:06:16.016 INFO:tasks.workunit.client.1.smithi098.stdout:1/821: dwrite d1/f50 [4194304,4194304] 0 2024-09-20T19:06:16.018 INFO:tasks.workunit.client.1.smithi098.stdout:1/822: symlink d1/d3/df/d34/d52/d77/l10a 0 2024-09-20T19:06:16.021 INFO:tasks.workunit.client.1.smithi098.stdout:1/823: creat d1/d3/df/d34/d52/d77/df7/dc1/f10b x:0 0 0 2024-09-20T19:06:16.022 INFO:tasks.workunit.client.1.smithi098.stdout:7/989: dread d3/d10/d16/d17/d33/d37/da0/f63 [4194304,4194304] 0 2024-09-20T19:06:16.046 INFO:tasks.workunit.client.1.smithi098.stdout:1/824: rename d1/d3/df/d34/d43/d65/l94 to d1/d3/df/d4a/l10c 0 2024-09-20T19:06:16.046 INFO:tasks.workunit.client.1.smithi098.stdout:0/675: sync 2024-09-20T19:06:16.046 INFO:tasks.workunit.client.1.smithi098.stdout:5/840: sync 2024-09-20T19:06:16.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/968: sync 2024-09-20T19:06:16.048 INFO:tasks.workunit.client.1.smithi098.stdout:5/841: fdatasync d1/d46/fa1 0 2024-09-20T19:06:16.051 INFO:tasks.workunit.client.1.smithi098.stdout:5/842: write d1/d17/d5e/f81 [3571360,61959] 0 2024-09-20T19:06:16.053 INFO:tasks.workunit.client.1.smithi098.stdout:7/990: dwrite d3/d10/d16/d17/d33/d4b/f85 [0,4194304] 0 2024-09-20T19:06:16.054 INFO:tasks.workunit.client.1.smithi098.stdout:0/676: mkdir d0/d6/d19/dbe/dcc 0 2024-09-20T19:06:16.057 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:15 smithi027 ceph-mon[28196]: pgmap v16: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 119 MiB/s rd, 268 MiB/s wr, 550 op/s 2024-09-20T19:06:16.063 INFO:tasks.workunit.client.1.smithi098.stdout:0/677: fsync d0/f3 0 2024-09-20T19:06:16.070 INFO:tasks.workunit.client.1.smithi098.stdout:1/825: dwrite d1/f9f [0,4194304] 0 2024-09-20T19:06:16.073 INFO:tasks.workunit.client.1.smithi098.stdout:5/843: truncate d1/d17/d35/fe1 3311617 0 2024-09-20T19:06:16.075 INFO:tasks.workunit.client.1.smithi098.stdout:0/678: fsync d0/f4a 0 2024-09-20T19:06:16.076 INFO:tasks.workunit.client.1.smithi098.stdout:7/991: dwrite d3/fda [0,4194304] 0 2024-09-20T19:06:16.079 INFO:tasks.workunit.client.1.smithi098.stdout:8/969: getdents d7/de/d11/d1f/dcd/db3/dcb 0 2024-09-20T19:06:16.081 INFO:tasks.workunit.client.1.smithi098.stdout:7/992: truncate d3/d10/d16/d17/d33/d4b/ff7 658940 0 2024-09-20T19:06:16.086 INFO:tasks.workunit.client.1.smithi098.stdout:1/826: creat d1/d3/d2e/d68/de5/f10d x:0 0 0 2024-09-20T19:06:16.089 INFO:tasks.workunit.client.1.smithi098.stdout:8/970: rmdir d7/de/d11/d19/d30/d55/da9 39 2024-09-20T19:06:16.092 INFO:tasks.workunit.client.1.smithi098.stdout:1/827: rmdir d1/d3/d2e/d68/d7a/da1 39 2024-09-20T19:06:16.095 INFO:tasks.workunit.client.1.smithi098.stdout:7/993: creat d3/d10/d16/d17/d33/d1f/d2d/f13c x:0 0 0 2024-09-20T19:06:16.096 INFO:tasks.workunit.client.1.smithi098.stdout:1/828: mknod d1/d3/df/d34/d52/d77/c10e 0 2024-09-20T19:06:16.098 INFO:tasks.workunit.client.1.smithi098.stdout:8/971: creat d7/de/d11/d19/f152 x:0 0 0 2024-09-20T19:06:16.100 INFO:tasks.workunit.client.1.smithi098.stdout:7/994: read d3/d10/d16/d17/d33/d1f/f6d [3645615,7486] 0 2024-09-20T19:06:16.100 INFO:tasks.workunit.client.1.smithi098.stdout:1/829: mknod d1/d3/d2e/d71/c10f 0 2024-09-20T19:06:16.101 INFO:tasks.workunit.client.1.smithi098.stdout:1/830: fdatasync d1/d3/d2e/d68/d7a/f101 0 2024-09-20T19:06:16.104 INFO:tasks.workunit.client.1.smithi098.stdout:5/844: dread d1/d1b/f26 [0,4194304] 0 2024-09-20T19:06:16.104 INFO:tasks.workunit.client.1.smithi098.stdout:8/972: chown d7/de/d11/d19/d30/d59/l97 20740 1 2024-09-20T19:06:16.104 INFO:tasks.workunit.client.1.smithi098.stdout:0/679: write d0/d6/f12 [1554466,111674] 0 2024-09-20T19:06:16.111 INFO:tasks.workunit.client.1.smithi098.stdout:0/680: chown d0/d6/d28/d31/laa 338217334 1 2024-09-20T19:06:16.111 INFO:tasks.workunit.client.1.smithi098.stdout:5/845: dwrite d1/f2c [0,4194304] 0 2024-09-20T19:06:16.112 INFO:tasks.workunit.client.1.smithi098.stdout:7/995: creat d3/d10/d16/d17/d33/d37/da0/f13d x:0 0 0 2024-09-20T19:06:16.113 INFO:tasks.workunit.client.1.smithi098.stdout:7/996: fsync d3/d10/d16/d17/d7c/f131 0 2024-09-20T19:06:16.116 INFO:tasks.workunit.client.1.smithi098.stdout:1/831: creat d1/d3/df/d34/f110 x:0 0 0 2024-09-20T19:06:16.119 INFO:tasks.workunit.client.1.smithi098.stdout:8/973: creat d7/f153 x:0 0 0 2024-09-20T19:06:16.122 INFO:tasks.workunit.client.1.smithi098.stdout:0/681: mknod d0/db/ccd 0 2024-09-20T19:06:16.123 INFO:tasks.workunit.client.1.smithi098.stdout:7/997: getdents d3/d10/dcf 0 2024-09-20T19:06:16.125 INFO:tasks.workunit.client.1.smithi098.stdout:1/832: dwrite d1/d3/df/d4a/d6d/fe2 [0,4194304] 0 2024-09-20T19:06:16.129 INFO:tasks.workunit.client.1.smithi098.stdout:8/974: creat d7/de/d11/d1f/d127/f154 x:0 0 0 2024-09-20T19:06:16.130 INFO:tasks.workunit.client.1.smithi098.stdout:7/998: mkdir d3/d10/d16/d17/d33/d1f/d28/d66/d13e 0 2024-09-20T19:06:16.130 INFO:tasks.workunit.client.1.smithi098.stdout:0/682: dwrite d0/d6/d28/d31/f53 [0,4194304] 0 2024-09-20T19:06:16.131 INFO:tasks.workunit.client.1.smithi098.stdout:5/846: getdents d1/d17/d35/d93 0 2024-09-20T19:06:16.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/833: mkdir d1/d3/df/d34/d52/d111 0 2024-09-20T19:06:16.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/975: mknod d7/de/d11/d19/d30/d59/c155 0 2024-09-20T19:06:16.142 INFO:tasks.workunit.client.1.smithi098.stdout:7/999: rename d3/d10/d16/d17/d33/d1f/d10c/d8c/fd7 to d3/d76/d86/f13f 0 2024-09-20T19:06:16.142 INFO:tasks.workunit.client.1.smithi098.stdout:5/847: dwrite d1/d17/d35/d54/fe2 [0,4194304] 0 2024-09-20T19:06:16.154 INFO:tasks.workunit.client.1.smithi098.stdout:1/834: link d1/d3/d2e/d71/c10f d1/d3/df/d34/d43/d65/c112 0 2024-09-20T19:06:16.154 INFO:tasks.workunit.client.1.smithi098.stdout:0/683: write d0/db/d1d/f3f [206674,87166] 0 2024-09-20T19:06:16.156 INFO:tasks.workunit.client.1.smithi098.stdout:5/848: rename d1/d1b/lc7 to d1/d1b/l103 0 2024-09-20T19:06:16.157 INFO:tasks.workunit.client.1.smithi098.stdout:8/976: link d7/de/l1a d7/de/d11/d19/d30/d59/l156 0 2024-09-20T19:06:16.159 INFO:tasks.workunit.client.1.smithi098.stdout:0/684: truncate d0/d55/f88 193265 0 2024-09-20T19:06:16.160 INFO:tasks.workunit.client.1.smithi098.stdout:5/849: chown d1/d17/d25/d56/c7f 0 1 2024-09-20T19:06:16.162 INFO:tasks.workunit.client.1.smithi098.stdout:8/977: mkdir d7/da2/d157 0 2024-09-20T19:06:16.165 INFO:tasks.workunit.client.1.smithi098.stdout:0/685: creat d0/db/d7f/fce x:0 0 0 2024-09-20T19:06:16.166 INFO:tasks.workunit.client.1.smithi098.stdout:5/850: dwrite d1/d46/d69/f6d [0,4194304] 0 2024-09-20T19:06:16.168 INFO:tasks.workunit.client.1.smithi098.stdout:1/835: write d1/d3/d2e/d61/fcd [503769,59753] 0 2024-09-20T19:06:16.171 INFO:tasks.workunit.client.1.smithi098.stdout:0/686: symlink d0/d7d/db4/lcf 0 2024-09-20T19:06:16.179 INFO:tasks.workunit.client.1.smithi098.stdout:8/978: creat d7/de/d11/d1f/dcd/f158 x:0 0 0 2024-09-20T19:06:16.180 INFO:tasks.workunit.client.1.smithi098.stdout:1/836: mknod d1/d3/df/d34/d52/d111/c113 0 2024-09-20T19:06:16.182 INFO:tasks.workunit.client.1.smithi098.stdout:5/851: dwrite d1/d17/f97 [0,4194304] 0 2024-09-20T19:06:16.184 INFO:tasks.workunit.client.1.smithi098.stdout:0/687: creat d0/db/d1d/fd0 x:0 0 0 2024-09-20T19:06:16.185 INFO:tasks.workunit.client.1.smithi098.stdout:8/979: mkdir d7/de/d11/d1d/d110/d11a/db6/d11d/d137/d159 0 2024-09-20T19:06:16.188 INFO:tasks.workunit.client.1.smithi098.stdout:1/837: rename d1/d3/d2e/d68/lc5 to d1/dbb/l114 0 2024-09-20T19:06:16.191 INFO:tasks.workunit.client.1.smithi098.stdout:5/852: rename d1/f6b to d1/d46/d69/f104 0 2024-09-20T19:06:16.193 INFO:tasks.workunit.client.1.smithi098.stdout:0/688: creat d0/d7d/fd1 x:0 0 0 2024-09-20T19:06:16.233 INFO:tasks.workunit.client.1.smithi098.stdout:1/838: symlink d1/d3/df/d34/d52/l115 0 2024-09-20T19:06:16.233 INFO:tasks.workunit.client.1.smithi098.stdout:0/689: readlink d0/d6/d28/d31/d45/d60/lc5 0 2024-09-20T19:06:16.235 INFO:tasks.workunit.client.1.smithi098.stdout:0/690: write d0/d6/d19/f33 [3470329,24409] 0 2024-09-20T19:06:16.235 INFO:tasks.workunit.client.1.smithi098.stdout:8/980: rename d7/de/d11/d19/d30/l116 to d7/de/d11/d1d/d110/d139/l15a 0 2024-09-20T19:06:16.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/691: dread - d0/d6/d28/f6f zero size 2024-09-20T19:06:16.239 INFO:tasks.workunit.client.1.smithi098.stdout:8/981: symlink d7/de/d11/d1d/l15b 0 2024-09-20T19:06:16.243 INFO:tasks.workunit.client.1.smithi098.stdout:0/692: link d0/d6/f61 d0/d6/d28/d31/d45/d60/fd2 0 2024-09-20T19:06:16.246 INFO:tasks.workunit.client.1.smithi098.stdout:0/693: mkdir d0/dd3 0 2024-09-20T19:06:16.247 INFO:tasks.workunit.client.1.smithi098.stdout:5/853: dread d1/d1b/f5a [0,4194304] 0 2024-09-20T19:06:16.253 INFO:tasks.workunit.client.1.smithi098.stdout:5/854: dread d1/f2 [0,4194304] 0 2024-09-20T19:06:16.253 INFO:tasks.workunit.client.1.smithi098.stdout:8/982: dread d7/de/d11/f71 [0,4194304] 0 2024-09-20T19:06:16.253 INFO:tasks.workunit.client.1.smithi098.stdout:5/855: chown d1/d17/d25/d79/f9f 3 1 2024-09-20T19:06:16.257 INFO:tasks.workunit.client.1.smithi098.stdout:5/856: mknod d1/d1b/d40/daf/c105 0 2024-09-20T19:06:16.257 INFO:tasks.workunit.client.1.smithi098.stdout:8/983: write d7/de/d11/d19/d30/d82/f8e [2300226,36802] 0 2024-09-20T19:06:16.260 INFO:tasks.workunit.client.1.smithi098.stdout:1/839: dwrite d1/d3/f19 [4194304,4194304] 0 2024-09-20T19:06:16.262 INFO:tasks.workunit.client.1.smithi098.stdout:5/857: creat d1/d1b/d40/daf/dc8/f106 x:0 0 0 2024-09-20T19:06:16.262 INFO:tasks.workunit.client.1.smithi098.stdout:0/694: dread d0/d6/d19/d4f/f72 [0,4194304] 0 2024-09-20T19:06:16.267 INFO:tasks.workunit.client.1.smithi098.stdout:5/858: unlink d1/d46/d69/fc3 0 2024-09-20T19:06:16.268 INFO:tasks.workunit.client.1.smithi098.stdout:0/695: mkdir d0/db/d7f/d93/dd4 0 2024-09-20T19:06:16.270 INFO:tasks.workunit.client.1.smithi098.stdout:8/984: rename d7/de/d11/d19/d30/d55/da9/dbe/ce9 to d7/de/d11/d1d/d110/d139/c15c 0 2024-09-20T19:06:16.271 INFO:tasks.workunit.client.1.smithi098.stdout:1/840: symlink d1/d3/d2e/d68/d7a/da1/l116 0 2024-09-20T19:06:16.280 INFO:tasks.workunit.client.1.smithi098.stdout:0/696: fsync d0/db/d32/f7c 0 2024-09-20T19:06:16.280 INFO:tasks.workunit.client.1.smithi098.stdout:5/859: dwrite d1/d46/d69/d84/d87/fba [0,4194304] 0 2024-09-20T19:06:16.313 INFO:tasks.workunit.client.1.smithi098.stdout:8/985: creat d7/de/d11/d19/f15d x:0 0 0 2024-09-20T19:06:16.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/860: mkdir d1/d107 0 2024-09-20T19:06:16.316 INFO:tasks.workunit.client.1.smithi098.stdout:8/986: mknod d7/de/d11/d19/daf/c15e 0 2024-09-20T19:06:16.318 INFO:tasks.workunit.client.1.smithi098.stdout:0/697: rename d0/db/d7f/d93/fbd to d0/d55/fd5 0 2024-09-20T19:06:16.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/698: chown d0/f57 1 1 2024-09-20T19:06:16.321 INFO:tasks.workunit.client.1.smithi098.stdout:8/987: creat d7/de/d11/d1d/d110/d11a/d72/de8/f15f x:0 0 0 2024-09-20T19:06:16.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/699: dread d0/d55/f88 [0,4194304] 0 2024-09-20T19:06:16.324 INFO:tasks.workunit.client.1.smithi098.stdout:5/861: getdents d1/d17/d35/d54 0 2024-09-20T19:06:16.327 INFO:tasks.workunit.client.1.smithi098.stdout:8/988: mkdir d7/de/d11/d19/d30/d160 0 2024-09-20T19:06:16.328 INFO:tasks.workunit.client.1.smithi098.stdout:5/862: dread d1/d1b/f5a [0,4194304] 0 2024-09-20T19:06:16.329 INFO:tasks.workunit.client.1.smithi098.stdout:5/863: chown d1/d46/d69/d84/d87/c9a 2612491 1 2024-09-20T19:06:16.331 INFO:tasks.workunit.client.1.smithi098.stdout:5/864: fdatasync d1/d17/d25/f43 0 2024-09-20T19:06:16.333 INFO:tasks.workunit.client.1.smithi098.stdout:5/865: readlink d1/d17/d35/d54/d68/l74 0 2024-09-20T19:06:16.339 INFO:tasks.workunit.client.1.smithi098.stdout:5/866: getdents d1/d17/d35/d54 0 2024-09-20T19:06:16.344 INFO:tasks.workunit.client.1.smithi098.stdout:5/867: dwrite d1/d17/f55 [0,4194304] 0 2024-09-20T19:06:16.348 INFO:tasks.workunit.client.1.smithi098.stdout:5/868: rename d1/d46/d69/f104 to d1/d71/f108 0 2024-09-20T19:06:16.351 INFO:tasks.workunit.client.1.smithi098.stdout:0/700: dwrite d0/f5 [0,4194304] 0 2024-09-20T19:06:16.352 INFO:tasks.workunit.client.1.smithi098.stdout:5/869: creat d1/d17/d2e/f109 x:0 0 0 2024-09-20T19:06:16.353 INFO:tasks.workunit.client.1.smithi098.stdout:0/701: chown d0/f47 2674813 1 2024-09-20T19:06:16.358 INFO:tasks.workunit.client.1.smithi098.stdout:5/870: mkdir d1/d17/d5e/dd9/dee/d10a 0 2024-09-20T19:06:16.359 INFO:tasks.workunit.client.1.smithi098.stdout:0/702: mkdir d0/d6/d19/dbe/dd6 0 2024-09-20T19:06:16.359 INFO:tasks.workunit.client.1.smithi098.stdout:8/989: dwrite d7/de/d11/d19/d30/f83 [0,4194304] 0 2024-09-20T19:06:16.361 INFO:tasks.workunit.client.1.smithi098.stdout:0/703: rmdir d0/db 39 2024-09-20T19:06:16.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/704: write d0/d6/d28/f5c [4919821,2238] 0 2024-09-20T19:06:16.363 INFO:tasks.workunit.client.1.smithi098.stdout:5/871: rename d1/d17/d35/d93/fdc to d1/d1b/d40/db5/f10b 0 2024-09-20T19:06:16.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/705: stat d0/d6/d28/c3b 0 2024-09-20T19:06:16.366 INFO:tasks.workunit.client.1.smithi098.stdout:0/706: symlink d0/d6/d28/d31/d45/ld7 0 2024-09-20T19:06:16.368 INFO:tasks.workunit.client.1.smithi098.stdout:8/990: rename d7/de/d11/d19/d30/db5/d134 to d7/de/d11/d19/d30/d68/d78/d161 0 2024-09-20T19:06:16.370 INFO:tasks.workunit.client.1.smithi098.stdout:5/872: mkdir d1/d17/d25/d10c 0 2024-09-20T19:06:16.371 INFO:tasks.workunit.client.1.smithi098.stdout:8/991: fsync d7/de/d11/d19/d30/d55/fa8 0 2024-09-20T19:06:16.373 INFO:tasks.workunit.client.1.smithi098.stdout:5/873: unlink d1/d17/d25/d56/ca4 0 2024-09-20T19:06:16.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/707: creat d0/db/d32/d65/fd8 x:0 0 0 2024-09-20T19:06:16.377 INFO:tasks.workunit.client.1.smithi098.stdout:5/874: mkdir d1/d10d 0 2024-09-20T19:06:16.384 INFO:tasks.workunit.client.1.smithi098.stdout:0/708: dwrite d0/d6/d19/d4f/f72 [0,4194304] 0 2024-09-20T19:06:16.385 INFO:tasks.workunit.client.1.smithi098.stdout:5/875: dwrite d1/d71/f108 [0,4194304] 0 2024-09-20T19:06:16.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/709: read d0/d6/d28/f5c [289533,50299] 0 2024-09-20T19:06:16.392 INFO:tasks.workunit.client.1.smithi098.stdout:5/876: dwrite d1/d71/d98/fec [0,4194304] 0 2024-09-20T19:06:16.397 INFO:tasks.workunit.client.1.smithi098.stdout:5/877: creat d1/d17/d35/d54/f10e x:0 0 0 2024-09-20T19:06:16.405 INFO:tasks.workunit.client.1.smithi098.stdout:5/878: dread d1/d46/d69/f6d [0,4194304] 0 2024-09-20T19:06:16.405 INFO:tasks.workunit.client.1.smithi098.stdout:8/992: dwrite d7/fb7 [0,4194304] 0 2024-09-20T19:06:16.417 INFO:tasks.workunit.client.1.smithi098.stdout:5/879: getdents d1/d46/d69/dca 0 2024-09-20T19:06:16.419 INFO:tasks.workunit.client.1.smithi098.stdout:8/993: link d7/de/d11/d19/c44 d7/de/d11/d19/d30/c162 0 2024-09-20T19:06:16.420 INFO:tasks.workunit.client.1.smithi098.stdout:8/994: stat d7/de/d11/d19/daf 0 2024-09-20T19:06:16.423 INFO:tasks.workunit.client.1.smithi098.stdout:5/880: dwrite d1/d17/d25/d56/fe7 [0,4194304] 0 2024-09-20T19:06:16.425 INFO:tasks.workunit.client.1.smithi098.stdout:8/995: creat d7/de/d11/d19/d47/f163 x:0 0 0 2024-09-20T19:06:16.427 INFO:tasks.workunit.client.1.smithi098.stdout:5/881: write d1/d1b/d40/db5/f10b [596459,3297] 0 2024-09-20T19:06:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:8/996: unlink d7/de/d11/d1d/d110/d139/c15c 0 2024-09-20T19:06:16.431 INFO:tasks.workunit.client.1.smithi098.stdout:8/997: dread - d7/de/d11/d19/d30/d68/fde zero size 2024-09-20T19:06:16.432 INFO:tasks.workunit.client.1.smithi098.stdout:5/882: dread d1/d17/fae [0,4194304] 0 2024-09-20T19:06:16.433 INFO:tasks.workunit.client.1.smithi098.stdout:8/998: dread - d7/de/d11/d1d/d110/d11a/d72/de8/f15f zero size 2024-09-20T19:06:16.435 INFO:tasks.workunit.client.1.smithi098.stdout:5/883: read d1/d17/d35/d54/d68/ff2 [1955601,58849] 0 2024-09-20T19:06:16.436 INFO:tasks.workunit.client.1.smithi098.stdout:5/884: write d1/d17/d25/f90 [2252199,31136] 0 2024-09-20T19:06:16.437 INFO:tasks.workunit.client.1.smithi098.stdout:5/885: stat d1/d17/d25/d56/c7f 0 2024-09-20T19:06:16.438 INFO:tasks.workunit.client.1.smithi098.stdout:8/999: symlink d7/de/d11/d19/l164 0 2024-09-20T19:06:16.439 INFO:tasks.workunit.client.1.smithi098.stdout:5/886: write d1/d1b/d40/daf/dc8/ff9 [466231,41196] 0 2024-09-20T19:06:16.453 INFO:tasks.workunit.client.1.smithi098.stdout:5/887: write d1/d17/f1e [1603981,23129] 0 2024-09-20T19:06:16.455 INFO:tasks.workunit.client.1.smithi098.stdout:5/888: truncate d1/d46/d69/d84/fd0 270750 0 2024-09-20T19:06:16.459 INFO:tasks.workunit.client.1.smithi098.stdout:5/889: rename d1/d17/d25/c28 to d1/d17/d25/d79/c10f 0 2024-09-20T19:06:16.461 INFO:tasks.workunit.client.1.smithi098.stdout:5/890: creat d1/d82/f110 x:0 0 0 2024-09-20T19:06:16.462 INFO:tasks.workunit.client.1.smithi098.stdout:5/891: write d1/d17/d25/d79/f88 [3600466,38030] 0 2024-09-20T19:06:16.463 INFO:tasks.workunit.client.1.smithi098.stdout:5/892: read d1/f33 [1714759,68057] 0 2024-09-20T19:06:16.469 INFO:tasks.workunit.client.1.smithi098.stdout:5/893: link d1/d46/d69/f6d d1/d17/d25/d10c/f111 0 2024-09-20T19:06:16.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/894: symlink d1/d17/d25/d10c/l112 0 2024-09-20T19:06:16.473 INFO:tasks.workunit.client.1.smithi098.stdout:5/895: chown d1/d17/d2e/dac/de4 5 1 2024-09-20T19:06:16.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/896: rename d1/d1b/d40/db5 to d1/d17/d35/d54/dab/db7/d113 0 2024-09-20T19:06:16.481 INFO:tasks.workunit.client.1.smithi098.stdout:5/897: creat d1/d10d/f114 x:0 0 0 2024-09-20T19:06:16.502 INFO:tasks.workunit.client.1.smithi098.stdout:5/898: truncate d1/f2c 351595 0 2024-09-20T19:06:16.507 INFO:tasks.workunit.client.1.smithi098.stdout:5/899: dwrite d1/d17/d35/f6a [0,4194304] 0 2024-09-20T19:06:16.507 INFO:tasks.workunit.client.1.smithi098.stdout:5/900: readlink d1/d46/lbe 0 2024-09-20T19:06:16.510 INFO:tasks.workunit.client.1.smithi098.stdout:5/901: symlink d1/d46/ddd/l115 0 2024-09-20T19:06:16.529 INFO:tasks.workunit.client.1.smithi098.stdout:5/902: dread d1/d17/d5e/f7d [0,4194304] 0 2024-09-20T19:06:16.535 INFO:tasks.workunit.client.1.smithi098.stdout:5/903: dwrite d1/d17/d35/d54/fe2 [0,4194304] 0 2024-09-20T19:06:16.570 INFO:tasks.workunit.client.1.smithi098.stdout:5/904: dwrite d1/f33 [0,4194304] 0 2024-09-20T19:06:16.570 INFO:tasks.workunit.client.1.smithi098.stdout:5/905: readlink d1/d17/d35/l77 0 2024-09-20T19:06:16.575 INFO:tasks.workunit.client.1.smithi098.stdout:5/906: rename d1/d17/d5e/dd9 to d1/d46/ddd/d116 0 2024-09-20T19:06:16.577 INFO:tasks.workunit.client.1.smithi098.stdout:5/907: symlink d1/d46/ddd/d116/l117 0 2024-09-20T19:06:16.579 INFO:tasks.workunit.client.1.smithi098.stdout:5/908: mkdir d1/d17/d35/d54/d68/d118 0 2024-09-20T19:06:16.579 INFO:tasks.workunit.client.1.smithi098.stdout:5/909: dread - d1/d46/d69/dca/def/ff6 zero size 2024-09-20T19:06:16.580 INFO:tasks.workunit.client.1.smithi098.stdout:5/910: truncate d1/d46/fa7 5802851 0 2024-09-20T19:06:16.581 INFO:tasks.workunit.client.1.smithi098.stdout:5/911: write d1/d1b/fda [713838,21401] 0 2024-09-20T19:06:16.586 INFO:tasks.workunit.client.1.smithi098.stdout:5/912: link d1/d46/lbe d1/d17/d35/d54/d68/l119 0 2024-09-20T19:06:16.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/913: mknod d1/d71/c11a 0 2024-09-20T19:06:16.595 INFO:tasks.workunit.client.1.smithi098.stdout:5/914: truncate d1/d1b/f26 1733390 0 2024-09-20T19:06:16.596 INFO:tasks.workunit.client.1.smithi098.stdout:5/915: fsync d1/d17/f1a 0 2024-09-20T19:06:16.600 INFO:tasks.workunit.client.1.smithi098.stdout:5/916: getdents d1/d17/d35/d54/dab/db7/d113 0 2024-09-20T19:06:16.606 INFO:tasks.workunit.client.1.smithi098.stdout:5/917: dwrite d1/d1b/fda [0,4194304] 0 2024-09-20T19:06:16.609 INFO:tasks.workunit.client.1.smithi098.stdout:5/918: symlink d1/d17/d2e/dac/de4/l11b 0 2024-09-20T19:06:16.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/919: dwrite d1/d17/d35/f3f [0,4194304] 0 2024-09-20T19:06:16.625 INFO:tasks.workunit.client.1.smithi098.stdout:5/920: stat d1/d17/d35/d54/f10e 0 2024-09-20T19:06:16.625 INFO:tasks.workunit.client.1.smithi098.stdout:5/921: readlink d1/d17/d25/d56/l66 0 2024-09-20T19:06:16.632 INFO:tasks.workunit.client.1.smithi098.stdout:5/922: dwrite d1/d17/d25/fff [0,4194304] 0 2024-09-20T19:06:16.640 INFO:tasks.workunit.client.1.smithi098.stdout:5/923: dwrite d1/d1b/f6f [0,4194304] 0 2024-09-20T19:06:16.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/924: readlink d1/d17/d35/d54/d68/lc0 0 2024-09-20T19:06:16.647 INFO:tasks.workunit.client.1.smithi098.stdout:5/925: creat d1/d1b/f11c x:0 0 0 2024-09-20T19:06:16.648 INFO:tasks.workunit.client.1.smithi098.stdout:5/926: write d1/d46/ddd/f102 [229523,106823] 0 2024-09-20T19:06:16.651 INFO:tasks.workunit.client.1.smithi098.stdout:5/927: unlink d1/d46/fa1 0 2024-09-20T19:06:16.666 INFO:tasks.workunit.client.1.smithi098.stdout:5/928: write d1/d17/f63 [566569,13236] 0 2024-09-20T19:06:16.668 INFO:tasks.workunit.client.1.smithi098.stdout:5/929: write d1/d17/d35/d54/dab/fb9 [576854,68444] 0 2024-09-20T19:06:16.679 INFO:tasks.workunit.client.1.smithi098.stdout:5/930: dwrite d1/d46/d69/d84/d87/f8e [0,4194304] 0 2024-09-20T19:06:16.683 INFO:tasks.workunit.client.1.smithi098.stdout:5/931: symlink d1/d17/d2e/dac/de4/l11d 0 2024-09-20T19:06:16.683 INFO:tasks.workunit.client.1.smithi098.stdout:5/932: chown d1/d71/d98 59527 1 2024-09-20T19:06:16.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/933: symlink d1/d17/d25/d79/dbc/db3/ded/l11e 0 2024-09-20T19:06:16.690 INFO:tasks.workunit.client.1.smithi098.stdout:5/934: symlink d1/d71/l11f 0 2024-09-20T19:06:16.690 INFO:tasks.workunit.client.1.smithi098.stdout:5/935: write d1/f33 [512498,57474] 0 2024-09-20T19:06:16.699 INFO:tasks.workunit.client.1.smithi098.stdout:3/915: sync 2024-09-20T19:06:16.699 INFO:tasks.workunit.client.1.smithi098.stdout:6/785: sync 2024-09-20T19:06:16.705 INFO:tasks.workunit.client.1.smithi098.stdout:3/916: dwrite d4/d25/d40/d4b/f8e [0,4194304] 0 2024-09-20T19:06:16.707 INFO:tasks.workunit.client.1.smithi098.stdout:6/786: getdents d0/d55 0 2024-09-20T19:06:16.711 INFO:tasks.workunit.client.1.smithi098.stdout:3/917: mkdir d4/d19/d11d 0 2024-09-20T19:06:16.711 INFO:tasks.workunit.client.1.smithi098.stdout:5/936: dread d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:06:16.712 INFO:tasks.workunit.client.1.smithi098.stdout:6/787: write d0/d55/d82/dd5/d24/d29/fe6 [1842068,12983] 0 2024-09-20T19:06:16.712 INFO:tasks.workunit.client.1.smithi098.stdout:5/937: chown d1/d71 47847 1 2024-09-20T19:06:16.712 INFO:tasks.workunit.client.1.smithi098.stdout:3/918: chown d4/da/d7a/c10e 361 1 2024-09-20T19:06:16.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/919: fsync d4/d19/d1d/d2f/d4e/da3/fe2 0 2024-09-20T19:06:16.714 INFO:tasks.workunit.client.1.smithi098.stdout:6/788: mkdir d0/dc2/dfa 0 2024-09-20T19:06:16.714 INFO:tasks.workunit.client.1.smithi098.stdout:5/938: rmdir d1/d46/d69/dca/def 39 2024-09-20T19:06:16.718 INFO:tasks.workunit.client.1.smithi098.stdout:6/789: mkdir d0/d55/d82/da3/d43/da8/dfb 0 2024-09-20T19:06:16.720 INFO:tasks.workunit.client.1.smithi098.stdout:5/939: creat d1/d17/f120 x:0 0 0 2024-09-20T19:06:16.720 INFO:tasks.workunit.client.1.smithi098.stdout:6/790: truncate d0/d55/d82/da3/d43/dc0/fb2 651705 0 2024-09-20T19:06:16.720 INFO:tasks.workunit.client.1.smithi098.stdout:5/940: dread - d1/d1b/f11c zero size 2024-09-20T19:06:16.728 INFO:tasks.workunit.client.1.smithi098.stdout:5/941: symlink d1/d17/d35/d54/d68/d118/l121 0 2024-09-20T19:06:16.729 INFO:tasks.workunit.client.1.smithi098.stdout:3/920: write d4/d19/d1d/d2f/faf [69764,67031] 0 2024-09-20T19:06:16.733 INFO:tasks.workunit.client.1.smithi098.stdout:6/791: write d0/d55/d82/dd5/f8a [8088,47637] 0 2024-09-20T19:06:16.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/942: creat d1/d46/d69/d84/d87/f122 x:0 0 0 2024-09-20T19:06:16.737 INFO:tasks.workunit.client.1.smithi098.stdout:6/792: mknod d0/de/cfc 0 2024-09-20T19:06:16.739 INFO:tasks.workunit.client.1.smithi098.stdout:6/793: truncate d0/d55/d82/da3/d43/dc0/d66/fc8 799696 0 2024-09-20T19:06:16.740 INFO:tasks.workunit.client.1.smithi098.stdout:5/943: link d1/d17/d35/d93/db1/fc1 d1/d46/d69/f123 0 2024-09-20T19:06:16.741 INFO:tasks.workunit.client.1.smithi098.stdout:5/944: write d1/f33 [4881288,44240] 0 2024-09-20T19:06:16.741 INFO:tasks.workunit.client.1.smithi098.stdout:6/794: symlink d0/dc2/lfd 0 2024-09-20T19:06:16.742 INFO:tasks.workunit.client.1.smithi098.stdout:3/921: dread d4/da/f8b [0,4194304] 0 2024-09-20T19:06:16.743 INFO:tasks.workunit.client.1.smithi098.stdout:6/795: read d0/d55/d82/da3/d43/da8/fbc [313121,80919] 0 2024-09-20T19:06:16.746 INFO:tasks.workunit.client.1.smithi098.stdout:3/922: mkdir d4/da/d103/d11e 0 2024-09-20T19:06:16.750 INFO:tasks.workunit.client.1.smithi098.stdout:6/796: rename d0/de/d1b/deb to d0/d55/d82/da3/d8c/d9a/dfe 0 2024-09-20T19:06:16.752 INFO:tasks.workunit.client.1.smithi098.stdout:3/923: rename d4/d19/d1d/d22/dc5/f10f to d4/d19/d1d/d22/dc5/f11f 0 2024-09-20T19:06:16.758 INFO:tasks.workunit.client.1.smithi098.stdout:5/945: write d1/d1b/f5a [4977390,129925] 0 2024-09-20T19:06:16.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/946: dread d1/f2 [0,4194304] 0 2024-09-20T19:06:16.762 INFO:tasks.workunit.client.1.smithi098.stdout:5/947: mknod d1/d17/d35/d54/d68/c124 0 2024-09-20T19:06:16.762 INFO:tasks.workunit.client.1.smithi098.stdout:1/841: sync 2024-09-20T19:06:16.764 INFO:tasks.workunit.client.1.smithi098.stdout:5/948: mknod d1/d1b/d40/c125 0 2024-09-20T19:06:16.765 INFO:tasks.workunit.client.1.smithi098.stdout:1/842: write d1/d3/df/d34/d43/f56 [999819,124005] 0 2024-09-20T19:06:16.767 INFO:tasks.workunit.client.1.smithi098.stdout:3/924: getdents d4/d25/d40/d80 0 2024-09-20T19:06:16.768 INFO:tasks.workunit.client.1.smithi098.stdout:6/797: dread d0/d55/d82/dd5/f8a [0,4194304] 0 2024-09-20T19:06:16.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/949: truncate d1/d17/d5e/f7d 2463578 0 2024-09-20T19:06:16.771 INFO:tasks.workunit.client.1.smithi098.stdout:3/925: mkdir d4/d38/d97/d120 0 2024-09-20T19:06:16.772 INFO:tasks.workunit.client.1.smithi098.stdout:5/950: mkdir d1/d17/d35/d54/d68/d126 0 2024-09-20T19:06:16.774 INFO:tasks.workunit.client.1.smithi098.stdout:6/798: creat d0/d55/d82/da3/d8c/d4c/fff x:0 0 0 2024-09-20T19:06:16.778 INFO:tasks.workunit.client.1.smithi098.stdout:5/951: dwrite d1/d17/d35/f3f [0,4194304] 0 2024-09-20T19:06:16.786 INFO:tasks.workunit.client.1.smithi098.stdout:6/799: mknod d0/d55/d82/dd5/c100 0 2024-09-20T19:06:16.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/926: dread d4/d25/f2b [0,4194304] 0 2024-09-20T19:06:16.788 INFO:tasks.workunit.client.1.smithi098.stdout:5/952: mkdir d1/d17/d25/d56/d127 0 2024-09-20T19:06:16.792 INFO:tasks.workunit.client.1.smithi098.stdout:3/927: fsync d4/d19/d1d/d2f/f7e 0 2024-09-20T19:06:16.793 INFO:tasks.workunit.client.1.smithi098.stdout:3/928: dread - d4/d25/d40/f11c zero size 2024-09-20T19:06:16.793 INFO:tasks.workunit.client.1.smithi098.stdout:1/843: dwrite d1/d3/df/d34/d43/d53/f74 [0,4194304] 0 2024-09-20T19:06:16.796 INFO:tasks.workunit.client.1.smithi098.stdout:5/953: rename d1/d46/da6 to d1/d17/d35/d54/d128 0 2024-09-20T19:06:16.800 INFO:tasks.workunit.client.1.smithi098.stdout:3/929: rmdir d4/d25/d40 39 2024-09-20T19:06:16.801 INFO:tasks.workunit.client.1.smithi098.stdout:3/930: read - d4/d19/d1d/f109 zero size 2024-09-20T19:06:16.808 INFO:tasks.workunit.client.1.smithi098.stdout:6/800: dwrite d0/d55/d82/da3/d8c/d4c/f6e [0,4194304] 0 2024-09-20T19:06:16.809 INFO:tasks.workunit.client.1.smithi098.stdout:1/844: mkdir d1/d3/df/d117 0 2024-09-20T19:06:16.809 INFO:tasks.workunit.client.1.smithi098.stdout:3/931: dread - d4/da/d7a/fb0 zero size 2024-09-20T19:06:16.810 INFO:tasks.workunit.client.1.smithi098.stdout:3/932: chown d4/d92/cea 77 1 2024-09-20T19:06:16.812 INFO:tasks.workunit.client.1.smithi098.stdout:3/933: truncate d4/da/d50/df0/f115 758904 0 2024-09-20T19:06:16.815 INFO:tasks.workunit.client.1.smithi098.stdout:6/801: symlink d0/d55/d82/da3/d43/da8/l101 0 2024-09-20T19:06:16.816 INFO:tasks.workunit.client.1.smithi098.stdout:3/934: read d4/d19/d1d/d2f/faf [37959,35872] 0 2024-09-20T19:06:16.821 INFO:tasks.workunit.client.1.smithi098.stdout:1/845: dwrite d1/d3/df/d34/d43/daa/fd7 [0,4194304] 0 2024-09-20T19:06:16.823 INFO:tasks.workunit.client.1.smithi098.stdout:6/802: dread d0/d55/d82/da3/d43/f7e [0,4194304] 0 2024-09-20T19:06:16.824 INFO:tasks.workunit.client.1.smithi098.stdout:6/803: dread - d0/d55/d82/da3/d8c/d9a/dfe/ff3 zero size 2024-09-20T19:06:16.825 INFO:tasks.workunit.client.1.smithi098.stdout:1/846: creat d1/d3/d2e/d68/de5/f118 x:0 0 0 2024-09-20T19:06:16.826 INFO:tasks.workunit.client.1.smithi098.stdout:6/804: chown d0/d55/d82/da3/d43/f7e 851 1 2024-09-20T19:06:16.826 INFO:tasks.workunit.client.1.smithi098.stdout:5/954: truncate d1/d17/d35/d54/f62 2730715 0 2024-09-20T19:06:16.827 INFO:tasks.workunit.client.1.smithi098.stdout:5/955: fdatasync d1/d17/d35/f6a 0 2024-09-20T19:06:16.828 INFO:tasks.workunit.client.1.smithi098.stdout:6/805: read d0/de/d1b/f1c [2746893,48992] 0 2024-09-20T19:06:16.828 INFO:tasks.workunit.client.1.smithi098.stdout:1/847: creat d1/d3/df/d4a/d6d/f119 x:0 0 0 2024-09-20T19:06:16.832 INFO:tasks.workunit.client.1.smithi098.stdout:3/935: write d4/d38/d48/d60/f6b [526780,29579] 0 2024-09-20T19:06:16.833 INFO:tasks.workunit.client.1.smithi098.stdout:3/936: chown d4/d38/d48/d60/dd0 2 1 2024-09-20T19:06:16.837 INFO:tasks.workunit.client.1.smithi098.stdout:3/937: creat d4/d19/d1d/d22/dc5/f121 x:0 0 0 2024-09-20T19:06:16.838 INFO:tasks.workunit.client.1.smithi098.stdout:3/938: fdatasync d4/da/d7a/fc9 0 2024-09-20T19:06:16.838 INFO:tasks.workunit.client.1.smithi098.stdout:3/939: readlink d4/da/l96 0 2024-09-20T19:06:16.842 INFO:tasks.workunit.client.1.smithi098.stdout:1/848: symlink d1/d3/df/d34/d52/d77/df7/dc1/dc7/l11a 0 2024-09-20T19:06:16.844 INFO:tasks.workunit.client.1.smithi098.stdout:0/710: sync 2024-09-20T19:06:16.845 INFO:tasks.workunit.client.1.smithi098.stdout:5/956: write d1/d17/d25/d79/f9f [863796,94500] 0 2024-09-20T19:06:16.845 INFO:tasks.workunit.client.1.smithi098.stdout:6/806: link d0/d55/d82/dd5/d24/l27 d0/dc2/dfa/l102 0 2024-09-20T19:06:16.848 INFO:tasks.workunit.client.1.smithi098.stdout:5/957: fsync d1/d17/d25/d79/f9f 0 2024-09-20T19:06:16.850 INFO:tasks.workunit.client.1.smithi098.stdout:0/711: dread d0/d6/d19/d4f/f72 [0,4194304] 0 2024-09-20T19:06:16.851 INFO:tasks.workunit.client.1.smithi098.stdout:1/849: mkdir d1/d3/df/d4a/d6d/d11b 0 2024-09-20T19:06:16.855 INFO:tasks.workunit.client.1.smithi098.stdout:3/940: dread d4/d25/d8d/fdd [0,4194304] 0 2024-09-20T19:06:16.855 INFO:tasks.workunit.client.1.smithi098.stdout:6/807: mknod d0/d55/d82/dd5/dcf/dd8/de3/c103 0 2024-09-20T19:06:16.858 INFO:tasks.workunit.client.1.smithi098.stdout:1/850: write d1/d3/df/f21 [4114853,73125] 0 2024-09-20T19:06:16.862 INFO:tasks.workunit.client.1.smithi098.stdout:6/808: unlink d0/c3c 0 2024-09-20T19:06:16.864 INFO:tasks.workunit.client.1.smithi098.stdout:0/712: symlink d0/d7d/ld9 0 2024-09-20T19:06:16.865 INFO:tasks.workunit.client.1.smithi098.stdout:1/851: fsync d1/f81 0 2024-09-20T19:06:16.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/852: fsync d1/dbb/fde 0 2024-09-20T19:06:16.867 INFO:tasks.workunit.client.1.smithi098.stdout:3/941: dwrite d4/d25/d8d/fdd [0,4194304] 0 2024-09-20T19:06:16.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/958: link d1/d17/d25/ff7 d1/d17/d25/f129 0 2024-09-20T19:06:16.870 INFO:tasks.workunit.client.1.smithi098.stdout:6/809: read d0/de/f6b [1400169,63304] 0 2024-09-20T19:06:16.870 INFO:tasks.workunit.client.1.smithi098.stdout:6/810: chown d0/d55 0 1 2024-09-20T19:06:16.872 INFO:tasks.workunit.client.1.smithi098.stdout:6/811: stat d0/d55/d82/da3/d43/da8/dfb 0 2024-09-20T19:06:16.873 INFO:tasks.workunit.client.1.smithi098.stdout:6/812: dread d0/d55/d82/da3/d43/da8/fce [0,4194304] 0 2024-09-20T19:06:16.874 INFO:tasks.workunit.client.1.smithi098.stdout:3/942: fdatasync d4/d38/d48/f75 0 2024-09-20T19:06:16.878 INFO:tasks.workunit.client.1.smithi098.stdout:1/853: mkdir d1/d3/df/d34/d52/d77/df7/dc1/dc7/d11c 0 2024-09-20T19:06:16.885 INFO:tasks.workunit.client.1.smithi098.stdout:0/713: dread d0/f47 [0,4194304] 0 2024-09-20T19:06:16.886 INFO:tasks.workunit.client.1.smithi098.stdout:6/813: creat d0/d55/d82/dd5/d24/d29/f104 x:0 0 0 2024-09-20T19:06:16.888 INFO:tasks.workunit.client.1.smithi098.stdout:1/854: creat d1/d3/df/d34/d52/f11d x:0 0 0 2024-09-20T19:06:16.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/714: fsync d0/db/d1d/f21 0 2024-09-20T19:06:16.892 INFO:tasks.workunit.client.1.smithi098.stdout:0/715: rmdir d0/db/d1d 39 2024-09-20T19:06:16.893 INFO:tasks.workunit.client.1.smithi098.stdout:3/943: dread d4/d19/f8f [0,4194304] 0 2024-09-20T19:06:16.894 INFO:tasks.workunit.client.1.smithi098.stdout:6/814: dwrite d0/d55/d82/da3/f9b [4194304,4194304] 0 2024-09-20T19:06:16.897 INFO:tasks.workunit.client.1.smithi098.stdout:5/959: dread d1/d17/d35/fe1 [0,4194304] 0 2024-09-20T19:06:16.900 INFO:tasks.workunit.client.1.smithi098.stdout:6/815: rmdir d0/d55/d82/dd5/d24 39 2024-09-20T19:06:16.905 INFO:tasks.workunit.client.1.smithi098.stdout:0/716: link d0/db/d7f/d93/cc4 d0/d7d/db4/cda 0 2024-09-20T19:06:16.908 INFO:tasks.workunit.client.1.smithi098.stdout:6/816: rename d0/de/laa to d0/d55/d82/da3/d43/d6d/l105 0 2024-09-20T19:06:16.911 INFO:tasks.workunit.client.1.smithi098.stdout:0/717: dwrite d0/db/d7f/fce [0,4194304] 0 2024-09-20T19:06:16.916 INFO:tasks.workunit.client.1.smithi098.stdout:0/718: creat d0/d6/d28/d31/d69/d9b/dae/fdb x:0 0 0 2024-09-20T19:06:16.918 INFO:tasks.workunit.client.1.smithi098.stdout:5/960: dread d1/fe [0,4194304] 0 2024-09-20T19:06:16.920 INFO:tasks.workunit.client.1.smithi098.stdout:0/719: creat d0/dd3/fdc x:0 0 0 2024-09-20T19:06:16.922 INFO:tasks.workunit.client.1.smithi098.stdout:3/944: dread d4/da/f32 [0,4194304] 0 2024-09-20T19:06:16.923 INFO:tasks.workunit.client.1.smithi098.stdout:3/945: chown d4/d38/d97 503 1 2024-09-20T19:06:16.927 INFO:tasks.workunit.client.1.smithi098.stdout:5/961: dwrite d1/d17/d35/d54/dab/fce [4194304,4194304] 0 2024-09-20T19:06:16.933 INFO:tasks.workunit.client.1.smithi098.stdout:6/817: dread d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:16.942 INFO:tasks.workunit.client.1.smithi098.stdout:6/818: dwrite d0/d55/d82/dd5/f8a [4194304,4194304] 0 2024-09-20T19:06:16.945 INFO:tasks.workunit.client.1.smithi098.stdout:0/720: dread d0/db/fd [0,4194304] 0 2024-09-20T19:06:16.949 INFO:tasks.workunit.client.1.smithi098.stdout:5/962: dread d1/d17/d25/f90 [0,4194304] 0 2024-09-20T19:06:16.949 INFO:tasks.workunit.client.1.smithi098.stdout:0/721: creat d0/d6/d19/dbe/dcc/fdd x:0 0 0 2024-09-20T19:06:16.951 INFO:tasks.workunit.client.1.smithi098.stdout:6/819: dwrite d0/d55/d82/da3/d43/f5e [4194304,4194304] 0 2024-09-20T19:06:16.951 INFO:tasks.workunit.client.1.smithi098.stdout:0/722: chown d0/d55/f1e 17 1 2024-09-20T19:06:16.954 INFO:tasks.workunit.client.1.smithi098.stdout:5/963: mknod d1/d46/ddd/d116/dee/d10a/c12a 0 2024-09-20T19:06:16.960 INFO:tasks.workunit.client.1.smithi098.stdout:5/964: rename d1/d17/d2e to d1/d46/ddd/d116/dee/d10a/d12b 0 2024-09-20T19:06:16.966 INFO:tasks.workunit.client.1.smithi098.stdout:6/820: rename d0/d55/d82/da3/d43/d51/fc5 to d0/d55/d82/dd5/d24/d29/f106 0 2024-09-20T19:06:16.969 INFO:tasks.workunit.client.1.smithi098.stdout:6/821: creat d0/d55/d82/da3/d43/f107 x:0 0 0 2024-09-20T19:06:16.973 INFO:tasks.workunit.client.1.smithi098.stdout:6/822: dread d0/d55/d82/da3/d43/f5e [4194304,4194304] 0 2024-09-20T19:06:16.974 INFO:tasks.workunit.client.1.smithi098.stdout:5/965: dread d1/fb [0,4194304] 0 2024-09-20T19:06:16.975 INFO:tasks.workunit.client.1.smithi098.stdout:5/966: chown d1/d46/f83 3 1 2024-09-20T19:06:16.975 INFO:tasks.workunit.client.1.smithi098.stdout:0/723: write d0/d6/d28/d31/d45/f9f [936844,45974] 0 2024-09-20T19:06:16.978 INFO:tasks.workunit.client.1.smithi098.stdout:6/823: rename d0/d55/d82/da3/d43/dc0/d66/d81/dbb to d0/d55/d82/da3/d43/dc0/d66/d81/dbb/d108 22 2024-09-20T19:06:16.985 INFO:tasks.workunit.client.1.smithi098.stdout:6/824: dwrite d0/f7b [0,4194304] 0 2024-09-20T19:06:16.988 INFO:tasks.workunit.client.1.smithi098.stdout:5/967: creat d1/d1b/f12c x:0 0 0 2024-09-20T19:06:16.989 INFO:tasks.workunit.client.1.smithi098.stdout:0/724: write d0/d6/fe [1618528,118689] 0 2024-09-20T19:06:16.990 INFO:tasks.workunit.client.1.smithi098.stdout:6/825: mknod d0/dc2/c109 0 2024-09-20T19:06:16.993 INFO:tasks.workunit.client.1.smithi098.stdout:6/826: chown d0/d55/d82/ccc 4048 1 2024-09-20T19:06:16.995 INFO:tasks.workunit.client.1.smithi098.stdout:0/725: truncate d0/db/d1d/d8f/f39 2046956 0 2024-09-20T19:06:16.995 INFO:tasks.workunit.client.1.smithi098.stdout:5/968: dread d1/d17/d35/f89 [0,4194304] 0 2024-09-20T19:06:16.999 INFO:tasks.workunit.client.1.smithi098.stdout:5/969: mknod d1/d17/d25/d79/dbc/db3/dbb/c12d 0 2024-09-20T19:06:17.000 INFO:tasks.workunit.client.1.smithi098.stdout:5/970: fdatasync d1/d1b/d40/f85 0 2024-09-20T19:06:17.007 INFO:tasks.workunit.client.1.smithi098.stdout:6/827: write d0/d55/d82/da3/d43/da8/fbc [4887038,54453] 0 2024-09-20T19:06:17.007 INFO:tasks.workunit.client.1.smithi098.stdout:5/971: stat d1/d46/d69/dca/def/ff6 0 2024-09-20T19:06:17.007 INFO:tasks.workunit.client.1.smithi098.stdout:0/726: link d0/d6/d28/d31/d45/l90 d0/lde 0 2024-09-20T19:06:17.008 INFO:tasks.workunit.client.1.smithi098.stdout:6/828: stat d0/d55/d82/dd5/de2/f1a 0 2024-09-20T19:06:17.012 INFO:tasks.workunit.client.1.smithi098.stdout:0/727: creat d0/d55/d67/fdf x:0 0 0 2024-09-20T19:06:17.013 INFO:tasks.workunit.client.1.smithi098.stdout:5/972: dwrite d1/d46/f83 [0,4194304] 0 2024-09-20T19:06:17.016 INFO:tasks.workunit.client.1.smithi098.stdout:6/829: symlink d0/d55/d82/da3/d43/dc0/d66/l10a 0 2024-09-20T19:06:17.017 INFO:tasks.workunit.client.1.smithi098.stdout:6/830: write d0/f7b [3561143,12236] 0 2024-09-20T19:06:17.019 INFO:tasks.workunit.client.1.smithi098.stdout:5/973: creat d1/d46/ddd/f12e x:0 0 0 2024-09-20T19:06:17.024 INFO:tasks.workunit.client.1.smithi098.stdout:5/974: dread d1/d46/d69/d84/d87/f8e [0,4194304] 0 2024-09-20T19:06:17.028 INFO:tasks.workunit.client.1.smithi098.stdout:5/975: creat d1/d46/d69/dca/def/f12f x:0 0 0 2024-09-20T19:06:17.032 INFO:tasks.workunit.client.1.smithi098.stdout:6/831: creat d0/de/f10b x:0 0 0 2024-09-20T19:06:17.033 INFO:tasks.workunit.client.1.smithi098.stdout:0/728: write d0/d6/d19/d4f/f6b [794229,23256] 0 2024-09-20T19:06:17.033 INFO:tasks.workunit.client.1.smithi098.stdout:5/976: dwrite d1/d1b/d40/f85 [0,4194304] 0 2024-09-20T19:06:17.035 INFO:tasks.workunit.client.1.smithi098.stdout:0/729: fdatasync d0/d6/d28/d31/d69/d77/fb9 0 2024-09-20T19:06:17.036 INFO:tasks.workunit.client.1.smithi098.stdout:5/977: unlink d1/d71/l7b 0 2024-09-20T19:06:17.038 INFO:tasks.workunit.client.1.smithi098.stdout:5/978: truncate d1/d17/d25/d10c/f111 5039584 0 2024-09-20T19:06:17.039 INFO:tasks.workunit.client.1.smithi098.stdout:6/832: getdents d0/d55/d82/dd5/d24/d29/d50 0 2024-09-20T19:06:17.041 INFO:tasks.workunit.client.1.smithi098.stdout:5/979: chown d1/d1b/d40/l94 0 1 2024-09-20T19:06:17.042 INFO:tasks.workunit.client.1.smithi098.stdout:6/833: creat d0/d55/d82/dd5/de2/f10c x:0 0 0 2024-09-20T19:06:17.044 INFO:tasks.workunit.client.1.smithi098.stdout:5/980: symlink d1/d17/d25/d79/dbc/db3/l130 0 2024-09-20T19:06:17.045 INFO:tasks.workunit.client.1.smithi098.stdout:6/834: write d0/d55/d82/da3/d43/f5e [7452068,79797] 0 2024-09-20T19:06:17.045 INFO:tasks.workunit.client.1.smithi098.stdout:5/981: chown d1/d46/ddd/d116/dee/d10a/c12a 1617870 1 2024-09-20T19:06:17.046 INFO:tasks.workunit.client.1.smithi098.stdout:0/730: dread d0/db/d1d/f99 [0,4194304] 0 2024-09-20T19:06:17.047 INFO:tasks.workunit.client.1.smithi098.stdout:5/982: chown d1/f2 1348553 1 2024-09-20T19:06:17.049 INFO:tasks.workunit.client.1.smithi098.stdout:5/983: write d1/d17/d35/d54/dab/fb9 [1342393,92781] 0 2024-09-20T19:06:17.051 INFO:tasks.workunit.client.1.smithi098.stdout:5/984: truncate d1/d46/ddd/f12e 131751 0 2024-09-20T19:06:17.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/731: write d0/d7d/f80 [591992,100655] 0 2024-09-20T19:06:17.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/835: dread d0/d55/d82/dd5/d24/d29/f35 [0,4194304] 0 2024-09-20T19:06:17.062 INFO:tasks.workunit.client.1.smithi098.stdout:0/732: fdatasync d0/d6/d19/dbe/fa3 0 2024-09-20T19:06:17.064 INFO:tasks.workunit.client.1.smithi098.stdout:0/733: write d0/d6/d19/dbe/dcc/fdd [41580,75052] 0 2024-09-20T19:06:17.065 INFO:tasks.workunit.client.1.smithi098.stdout:6/836: readlink d0/de/d1b/lf1 0 2024-09-20T19:06:17.071 INFO:tasks.workunit.client.1.smithi098.stdout:6/837: dwrite d0/de/f10b [0,4194304] 0 2024-09-20T19:06:17.072 INFO:tasks.workunit.client.1.smithi098.stdout:0/734: dwrite d0/db/d1d/fd0 [0,4194304] 0 2024-09-20T19:06:17.080 INFO:tasks.workunit.client.1.smithi098.stdout:0/735: mknod d0/d55/d67/dad/ce0 0 2024-09-20T19:06:17.083 INFO:tasks.workunit.client.1.smithi098.stdout:6/838: dwrite d0/d55/f8f [0,4194304] 0 2024-09-20T19:06:17.087 INFO:tasks.workunit.client.1.smithi098.stdout:6/839: mknod d0/d55/d82/da3/d43/dc0/d66/d81/dbb/c10d 0 2024-09-20T19:06:17.088 INFO:tasks.workunit.client.1.smithi098.stdout:0/736: getdents d0/d6/d19 0 2024-09-20T19:06:17.089 INFO:tasks.workunit.client.1.smithi098.stdout:0/737: dread - d0/d55/d67/fc0 zero size 2024-09-20T19:06:17.091 INFO:tasks.workunit.client.1.smithi098.stdout:6/840: symlink d0/d55/d82/dd5/de2/da7/df8/l10e 0 2024-09-20T19:06:17.092 INFO:tasks.workunit.client.1.smithi098.stdout:6/841: write d0/d55/d82/da3/d43/dc0/d7c/fed [225677,85120] 0 2024-09-20T19:06:17.093 INFO:tasks.workunit.client.1.smithi098.stdout:0/738: symlink d0/d6/d28/d31/d69/d77/le1 0 2024-09-20T19:06:17.127 INFO:tasks.workunit.client.1.smithi098.stdout:6/842: symlink d0/d55/d82/da3/d8c/l10f 0 2024-09-20T19:06:17.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/739: write d0/d6/f89 [149949,96618] 0 2024-09-20T19:06:17.130 INFO:tasks.workunit.client.1.smithi098.stdout:6/843: write d0/d55/d82/dd5/f62 [996955,122365] 0 2024-09-20T19:06:17.130 INFO:tasks.workunit.client.1.smithi098.stdout:0/740: chown d0/db/d32/d65 8666 1 2024-09-20T19:06:17.131 INFO:tasks.workunit.client.1.smithi098.stdout:6/844: truncate d0/fc4 168156 0 2024-09-20T19:06:17.132 INFO:tasks.workunit.client.1.smithi098.stdout:6/845: dread - d0/d55/d82/da3/d43/dc0/fda zero size 2024-09-20T19:06:17.136 INFO:tasks.workunit.client.1.smithi098.stdout:6/846: creat d0/d55/d82/dd5/d24/d29/d50/dbe/f110 x:0 0 0 2024-09-20T19:06:17.139 INFO:tasks.workunit.client.1.smithi098.stdout:0/741: link d0/db/d32/fa9 d0/d6/fe2 0 2024-09-20T19:06:17.141 INFO:tasks.workunit.client.1.smithi098.stdout:0/742: creat d0/d7d/dcb/fe3 x:0 0 0 2024-09-20T19:06:17.149 INFO:tasks.workunit.client.1.smithi098.stdout:6/847: write d0/d55/d82/da3/d8c/fb4 [225923,122666] 0 2024-09-20T19:06:17.151 INFO:tasks.workunit.client.1.smithi098.stdout:0/743: rename d0/d6/d19/dbe/da5 to d0/d6/d28/d31/de4 0 2024-09-20T19:06:17.154 INFO:tasks.workunit.client.1.smithi098.stdout:6/848: dread d0/d55/d82/dd5/f62 [0,4194304] 0 2024-09-20T19:06:17.156 INFO:tasks.workunit.client.1.smithi098.stdout:6/849: write d0/d55/d82/da3/fd9 [1042711,9019] 0 2024-09-20T19:06:17.169 INFO:tasks.workunit.client.1.smithi098.stdout:6/850: creat d0/d55/d82/da3/d43/dc0/f111 x:0 0 0 2024-09-20T19:06:17.170 INFO:tasks.workunit.client.1.smithi098.stdout:6/851: write d0/d55/d82/da3/d43/f107 [891199,59825] 0 2024-09-20T19:06:17.171 INFO:tasks.workunit.client.1.smithi098.stdout:0/744: write d0/f4a [1519606,63817] 0 2024-09-20T19:06:17.171 INFO:tasks.workunit.client.1.smithi098.stdout:6/852: readlink d0/d55/d82/dd5/de2/da7/lcb 0 2024-09-20T19:06:17.174 INFO:tasks.workunit.client.1.smithi098.stdout:0/745: dread d0/db/f17 [0,4194304] 0 2024-09-20T19:06:17.177 INFO:tasks.workunit.client.1.smithi098.stdout:0/746: dread d0/d6/f89 [0,4194304] 0 2024-09-20T19:06:17.191 INFO:tasks.workunit.client.1.smithi098.stdout:6/853: link d0/d55/d82/da3/d43/dc0/d65/lcd d0/d55/d82/da3/d8c/d4c/l112 0 2024-09-20T19:06:17.192 INFO:tasks.workunit.client.1.smithi098.stdout:6/854: rmdir d0/d55/d82/da3/d43/d6d 39 2024-09-20T19:06:17.193 INFO:tasks.workunit.client.1.smithi098.stdout:6/855: chown d0/dc2/c109 3 1 2024-09-20T19:06:17.194 INFO:tasks.workunit.client.1.smithi098.stdout:6/856: dread - d0/d55/d82/dd5/d24/faf zero size 2024-09-20T19:06:17.195 INFO:tasks.workunit.client.1.smithi098.stdout:6/857: chown d0/d55/d82/dd5/d24/d29/d50/dbe/f110 1 1 2024-09-20T19:06:17.195 INFO:tasks.workunit.client.1.smithi098.stdout:6/858: chown d0/de/cfc 0 1 2024-09-20T19:06:17.199 INFO:tasks.workunit.client.1.smithi098.stdout:0/747: truncate d0/d55/d67/f68 1921468 0 2024-09-20T19:06:17.201 INFO:tasks.workunit.client.1.smithi098.stdout:6/859: dwrite d0/d55/d82/dd5/d24/d29/fe6 [0,4194304] 0 2024-09-20T19:06:17.203 INFO:tasks.workunit.client.1.smithi098.stdout:0/748: mknod d0/d6/d19/d4f/ce5 0 2024-09-20T19:06:17.203 INFO:tasks.workunit.client.1.smithi098.stdout:0/749: chown d0/d6/d28/f6f 23 1 2024-09-20T19:06:17.203 INFO:tasks.workunit.client.1.smithi098.stdout:6/860: dread d0/d55/d82/da3/d43/dc0/fb2 [0,4194304] 0 2024-09-20T19:06:17.211 INFO:tasks.workunit.client.1.smithi098.stdout:6/861: dwrite d0/d55/d82/dd5/d24/f3e [4194304,4194304] 0 2024-09-20T19:06:17.215 INFO:tasks.workunit.client.1.smithi098.stdout:6/862: truncate d0/d55/d82/da3/d43/dc0/fc7 51764 0 2024-09-20T19:06:17.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/750: dwrite d0/d6/d28/d31/d45/d60/f91 [4194304,4194304] 0 2024-09-20T19:06:17.237 INFO:tasks.workunit.client.1.smithi098.stdout:0/751: chown d0/d55/f1e 116538 1 2024-09-20T19:06:17.246 INFO:tasks.workunit.client.1.smithi098.stdout:6/863: dwrite d0/d55/d82/dd5/de2/f5c [0,4194304] 0 2024-09-20T19:06:17.260 INFO:tasks.workunit.client.1.smithi098.stdout:6/864: dread d0/d55/d82/dd5/d24/d29/d50/f8e [0,4194304] 0 2024-09-20T19:06:17.262 INFO:tasks.workunit.client.1.smithi098.stdout:6/865: write d0/de/f56 [5118560,103903] 0 2024-09-20T19:06:17.353 INFO:tasks.workunit.client.1.smithi098.stdout:0/752: write d0/d6/fe2 [1105502,35619] 0 2024-09-20T19:06:17.354 INFO:tasks.workunit.client.1.smithi098.stdout:0/753: chown d0/d6/d28/d31/c37 287005 1 2024-09-20T19:06:17.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/855: sync 2024-09-20T19:06:17.542 INFO:tasks.workunit.client.1.smithi098.stdout:1/856: read d1/d3/d62/f7b [2281034,23138] 0 2024-09-20T19:06:17.544 INFO:tasks.workunit.client.1.smithi098.stdout:1/857: fdatasync d1/d3/df/d4a/fa8 0 2024-09-20T19:06:17.546 INFO:tasks.workunit.client.1.smithi098.stdout:1/858: dread - d1/d3/d2e/d71/f8b zero size 2024-09-20T19:06:17.546 INFO:tasks.workunit.client.1.smithi098.stdout:1/859: readlink d1/d3/l11 0 2024-09-20T19:06:17.548 INFO:tasks.workunit.client.1.smithi098.stdout:1/860: read d1/d3/df/d4a/d6d/fe2 [1294164,43277] 0 2024-09-20T19:06:17.553 INFO:tasks.workunit.client.1.smithi098.stdout:1/861: creat d1/d3/df/d34/d52/d77/df7/dc1/dc7/d11c/f11e x:0 0 0 2024-09-20T19:06:17.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/754: unlink d0/d7d/f8c 0 2024-09-20T19:06:17.603 INFO:tasks.workunit.client.1.smithi098.stdout:1/862: dwrite d1/d3/df/d34/d43/f6e [0,4194304] 0 2024-09-20T19:06:17.607 INFO:tasks.workunit.client.1.smithi098.stdout:1/863: truncate d1/d3/df/d34/f5f 687299 0 2024-09-20T19:06:17.609 INFO:tasks.workunit.client.1.smithi098.stdout:1/864: unlink d1/d3/ca3 0 2024-09-20T19:06:17.611 INFO:tasks.workunit.client.1.smithi098.stdout:1/865: truncate d1/dbb/fde 8531584 0 2024-09-20T19:06:17.615 INFO:tasks.workunit.client.1.smithi098.stdout:1/866: rename d1/d3/df/d34/d52/d77/df7/dc1/f10b to d1/d3/df/d34/d52/f11f 0 2024-09-20T19:06:17.616 INFO:tasks.workunit.client.1.smithi098.stdout:1/867: chown d1/d3 952338736 1 2024-09-20T19:06:17.617 INFO:tasks.workunit.client.1.smithi098.stdout:1/868: creat d1/d3/df/d34/d43/d65/f120 x:0 0 0 2024-09-20T19:06:17.619 INFO:tasks.workunit.client.1.smithi098.stdout:1/869: mkdir d1/d121 0 2024-09-20T19:06:17.621 INFO:tasks.workunit.client.1.smithi098.stdout:1/870: creat d1/d3/dd5/f122 x:0 0 0 2024-09-20T19:06:17.621 INFO:tasks.workunit.client.1.smithi098.stdout:1/871: chown d1/d3/df/dbe/d109 2 1 2024-09-20T19:06:17.623 INFO:tasks.workunit.client.1.smithi098.stdout:1/872: mkdir d1/d3/df/d34/d43/d65/dbc/d123 0 2024-09-20T19:06:17.624 INFO:tasks.workunit.client.1.smithi098.stdout:1/873: read d1/d3/df/d4a/f63 [452735,6241] 0 2024-09-20T19:06:17.625 INFO:tasks.workunit.client.1.smithi098.stdout:1/874: fsync d1/d3/fa5 0 2024-09-20T19:06:17.626 INFO:tasks.workunit.client.1.smithi098.stdout:1/875: mkdir d1/d3/d62/d124 0 2024-09-20T19:06:17.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/876: mkdir d1/d3/df/d34/d43/d65/dbc/d125 0 2024-09-20T19:06:17.630 INFO:tasks.workunit.client.1.smithi098.stdout:1/877: creat d1/d3/df/d34/d43/d65/dbc/d123/f126 x:0 0 0 2024-09-20T19:06:17.630 INFO:tasks.workunit.client.1.smithi098.stdout:1/878: chown d1/d3/df/d4a/fa8 83 1 2024-09-20T19:06:17.631 INFO:tasks.workunit.client.1.smithi098.stdout:1/879: symlink d1/d3/dd5/l127 0 2024-09-20T19:06:17.632 INFO:tasks.workunit.client.1.smithi098.stdout:1/880: fsync d1/d3/df/d34/d43/f104 0 2024-09-20T19:06:17.633 INFO:tasks.workunit.client.1.smithi098.stdout:1/881: readlink d1/d3/df/d34/d52/l7e 0 2024-09-20T19:06:17.635 INFO:tasks.workunit.client.1.smithi098.stdout:1/882: unlink d1/d3/d62/f8e 0 2024-09-20T19:06:17.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/883: dread - d1/d3/df/fff zero size 2024-09-20T19:06:17.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/884: link d1/d3/f2d d1/d3/d2e/d68/de5/f128 0 2024-09-20T19:06:17.639 INFO:tasks.workunit.client.1.smithi098.stdout:1/885: chown d1/d3/df/df9 43884408 1 2024-09-20T19:06:17.640 INFO:tasks.workunit.client.1.smithi098.stdout:1/886: creat d1/d3/df/d34/d43/d53/f129 x:0 0 0 2024-09-20T19:06:17.643 INFO:tasks.workunit.client.1.smithi098.stdout:1/887: rename d1/d3/f2d to d1/d3/df/dbe/f12a 0 2024-09-20T19:06:17.765 INFO:tasks.workunit.client.1.smithi098.stdout:1/888: write d1/ff4 [671560,88666] 0 2024-09-20T19:06:17.769 INFO:tasks.workunit.client.1.smithi098.stdout:1/889: mknod d1/d3/c12b 0 2024-09-20T19:06:17.773 INFO:tasks.workunit.client.1.smithi098.stdout:1/890: rmdir d1/d3/d62/d124 0 2024-09-20T19:06:17.776 INFO:tasks.workunit.client.1.smithi098.stdout:1/891: mkdir d1/d3/df/d34/d43/d65/dbc/d125/d12c 0 2024-09-20T19:06:17.780 INFO:tasks.workunit.client.1.smithi098.stdout:1/892: creat d1/d3/df/f12d x:0 0 0 2024-09-20T19:06:17.783 INFO:tasks.workunit.client.1.smithi098.stdout:1/893: mkdir d1/d3/df/d34/d52/d77/df7/dc1/dc7/d11c/d12e 0 2024-09-20T19:06:17.784 INFO:tasks.workunit.client.1.smithi098.stdout:1/894: fsync d1/d3/df/d34/d52/ffe 0 2024-09-20T19:06:17.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/895: rename d1/d3/df/d34/d52/d77/df7/dc1 to d1/d3/d62/d9e/d12f 0 2024-09-20T19:06:17.796 INFO:tasks.workunit.client.1.smithi098.stdout:1/896: creat d1/d3/df/d34/d52/f130 x:0 0 0 2024-09-20T19:06:17.803 INFO:tasks.workunit.client.1.smithi098.stdout:6/866: sync 2024-09-20T19:06:17.803 INFO:tasks.workunit.client.1.smithi098.stdout:5/985: sync 2024-09-20T19:06:17.803 INFO:tasks.workunit.client.1.smithi098.stdout:3/946: sync 2024-09-20T19:06:17.805 INFO:tasks.workunit.client.1.smithi098.stdout:5/986: creat d1/d46/f131 x:0 0 0 2024-09-20T19:06:17.805 INFO:tasks.workunit.client.1.smithi098.stdout:3/947: symlink d4/d19/d1d/d2f/d3e/l122 0 2024-09-20T19:06:17.808 INFO:tasks.workunit.client.1.smithi098.stdout:5/987: mknod d1/d17/d5e/c132 0 2024-09-20T19:06:17.809 INFO:tasks.workunit.client.1.smithi098.stdout:6/867: dwrite d0/d55/d82/dd5/d24/d29/f35 [0,4194304] 0 2024-09-20T19:06:17.813 INFO:tasks.workunit.client.1.smithi098.stdout:3/948: rename d4/da/d50/df0/f110 to d4/d25/d40/f123 0 2024-09-20T19:06:17.815 INFO:tasks.workunit.client.1.smithi098.stdout:5/988: dread d1/d17/d25/f43 [0,4194304] 0 2024-09-20T19:06:17.816 INFO:tasks.workunit.client.1.smithi098.stdout:5/989: readlink d1/d1b/l30 0 2024-09-20T19:06:17.817 INFO:tasks.workunit.client.1.smithi098.stdout:6/868: dwrite d0/d55/d82/fb5 [0,4194304] 0 2024-09-20T19:06:17.817 INFO:tasks.workunit.client.1.smithi098.stdout:3/949: read d4/d19/d1d/d2f/d4e/da3/ff9 [458577,118693] 0 2024-09-20T19:06:17.819 INFO:tasks.workunit.client.1.smithi098.stdout:3/950: read d4/da/f32 [2849494,105155] 0 2024-09-20T19:06:17.820 INFO:tasks.workunit.client.1.smithi098.stdout:6/869: write d0/d55/d82/da3/d43/dc0/fda [375133,123756] 0 2024-09-20T19:06:17.820 INFO:tasks.workunit.client.1.smithi098.stdout:3/951: chown d4/d38/d97/dcb/ce6 580834284 1 2024-09-20T19:06:17.821 INFO:tasks.workunit.client.1.smithi098.stdout:5/990: creat d1/d17/d25/d79/dbc/db3/f133 x:0 0 0 2024-09-20T19:06:17.825 INFO:tasks.workunit.client.1.smithi098.stdout:6/870: chown d0/lb6 26 1 2024-09-20T19:06:17.828 INFO:tasks.workunit.client.1.smithi098.stdout:3/952: symlink d4/d19/d1d/d22/l124 0 2024-09-20T19:06:17.829 INFO:tasks.workunit.client.1.smithi098.stdout:5/991: dwrite d1/d1b/d40/f85 [0,4194304] 0 2024-09-20T19:06:17.830 INFO:tasks.workunit.client.1.smithi098.stdout:3/953: write d4/d25/d40/d4b/f11a [471814,57076] 0 2024-09-20T19:06:17.831 INFO:tasks.workunit.client.1.smithi098.stdout:3/954: stat d4/d19/d1d/d2f/d3e 0 2024-09-20T19:06:17.845 INFO:tasks.workunit.client.1.smithi098.stdout:3/955: mkdir d4/d19/d11d/d125 0 2024-09-20T19:06:17.850 INFO:tasks.workunit.client.1.smithi098.stdout:3/956: mkdir d4/d19/d1d/d2f/d4e/d59/dfc/d126 0 2024-09-20T19:06:17.851 INFO:tasks.workunit.client.1.smithi098.stdout:6/871: truncate d0/d55/d82/da3/d8c/d4c/fad 4672038 0 2024-09-20T19:06:17.854 INFO:tasks.workunit.client.1.smithi098.stdout:5/992: dread d1/d46/d69/d84/d87/fba [0,4194304] 0 2024-09-20T19:06:17.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/993: chown d1/d17/d35/d54/dab/db7/d113 628397853 1 2024-09-20T19:06:17.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/994: chown d1/d46/d69/f6d 43 1 2024-09-20T19:06:17.856 INFO:tasks.workunit.client.1.smithi098.stdout:3/957: truncate d4/d19/d1d/d2f/d4e/da3/fe2 832352 0 2024-09-20T19:06:17.863 INFO:tasks.workunit.client.1.smithi098.stdout:5/995: link d1/f9 d1/d46/ddd/d116/f134 0 2024-09-20T19:06:17.863 INFO:tasks.workunit.client.1.smithi098.stdout:3/958: dwrite d4/d19/d1d/d22/f11b [0,4194304] 0 2024-09-20T19:06:17.865 INFO:tasks.workunit.client.1.smithi098.stdout:6/872: dread d0/d55/d82/dd5/d24/f52 [0,4194304] 0 2024-09-20T19:06:17.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/996: mknod d1/d71/d98/c135 0 2024-09-20T19:06:17.875 INFO:tasks.workunit.client.1.smithi098.stdout:6/873: symlink d0/d55/d82/da3/d43/da8/dfb/l113 0 2024-09-20T19:06:17.878 INFO:tasks.workunit.client.1.smithi098.stdout:6/874: creat d0/d83/f114 x:0 0 0 2024-09-20T19:06:17.881 INFO:tasks.workunit.client.1.smithi098.stdout:5/997: rmdir d1/d17/d35/d93/dc2 0 2024-09-20T19:06:17.885 INFO:tasks.workunit.client.1.smithi098.stdout:5/998: fdatasync d1/d46/d69/d84/d87/f8e 0 2024-09-20T19:06:17.886 INFO:tasks.workunit.client.1.smithi098.stdout:6/875: dwrite d0/d55/d82/dd5/de2/da7/fc9 [0,4194304] 0 2024-09-20T19:06:17.887 INFO:tasks.workunit.client.1.smithi098.stdout:6/876: chown d0/l88 352658 1 2024-09-20T19:06:17.888 INFO:tasks.workunit.client.1.smithi098.stdout:6/877: chown d0/d55/d82/da3/d8c/d4c/fa1 88000945 1 2024-09-20T19:06:17.890 INFO:tasks.workunit.client.1.smithi098.stdout:5/999: symlink d1/d17/d35/d54/dab/d100/l136 0 2024-09-20T19:06:17.891 INFO:tasks.workunit.client.1.smithi098.stdout:3/959: dread d4/d19/fb9 [0,4194304] 0 2024-09-20T19:06:17.894 INFO:tasks.workunit.client.1.smithi098.stdout:6/878: read d0/d55/d82/dd5/f85 [546644,45405] 0 2024-09-20T19:06:17.895 INFO:tasks.workunit.client.1.smithi098.stdout:6/879: fdatasync d0/fc4 0 2024-09-20T19:06:17.895 INFO:tasks.workunit.client.1.smithi098.stdout:3/960: dread d4/da/d7a/fd9 [0,4194304] 0 2024-09-20T19:06:17.900 INFO:tasks.workunit.client.1.smithi098.stdout:6/880: symlink d0/d55/d82/da3/l115 0 2024-09-20T19:06:17.902 INFO:tasks.workunit.client.1.smithi098.stdout:6/881: symlink d0/d55/d82/da3/d8c/d9a/dfe/l116 0 2024-09-20T19:06:17.905 INFO:tasks.workunit.client.1.smithi098.stdout:6/882: mkdir d0/d55/d82/dd5/d24/dd6/de7/d117 0 2024-09-20T19:06:17.912 INFO:tasks.workunit.client.1.smithi098.stdout:3/961: dread d4/da/d7a/ff2 [0,4194304] 0 2024-09-20T19:06:17.914 INFO:tasks.workunit.client.1.smithi098.stdout:3/962: creat d4/d19/d1d/d2f/d4e/d59/d7c/f127 x:0 0 0 2024-09-20T19:06:17.916 INFO:tasks.workunit.client.1.smithi098.stdout:3/963: mknod d4/d25/d40/c128 0 2024-09-20T19:06:17.920 INFO:tasks.workunit.client.1.smithi098.stdout:3/964: getdents d4/d38/d48 0 2024-09-20T19:06:17.921 INFO:tasks.workunit.client.1.smithi098.stdout:6/883: dread d0/d55/d82/dd5/f13 [12582912,4194304] 0 2024-09-20T19:06:17.921 INFO:tasks.workunit.client.1.smithi098.stdout:6/884: readlink d0/d55/ldd 0 2024-09-20T19:06:17.922 INFO:tasks.workunit.client.1.smithi098.stdout:3/965: fsync d4/d19/d1d/d2f/d3e/dbb/fbc 0 2024-09-20T19:06:17.928 INFO:tasks.workunit.client.1.smithi098.stdout:6/885: dwrite d0/d55/d82/da3/d43/dc0/f111 [0,4194304] 0 2024-09-20T19:06:17.937 INFO:tasks.workunit.client.1.smithi098.stdout:6/886: creat d0/d55/d82/dd5/d24/d29/f118 x:0 0 0 2024-09-20T19:06:17.941 INFO:tasks.workunit.client.1.smithi098.stdout:6/887: dread d0/ff5 [0,4194304] 0 2024-09-20T19:06:17.944 INFO:tasks.workunit.client.1.smithi098.stdout:3/966: write d4/d38/d48/d60/f99 [700637,102027] 0 2024-09-20T19:06:17.948 INFO:tasks.workunit.client.1.smithi098.stdout:3/967: creat d4/d19/d1d/d2f/d3e/f129 x:0 0 0 2024-09-20T19:06:17.949 INFO:tasks.workunit.client.1.smithi098.stdout:6/888: dread d0/d55/d82/da3/d43/f98 [0,4194304] 0 2024-09-20T19:06:17.951 INFO:tasks.workunit.client.1.smithi098.stdout:3/968: creat d4/da/d7a/f12a x:0 0 0 2024-09-20T19:06:17.953 INFO:tasks.workunit.client.1.smithi098.stdout:6/889: creat d0/d55/d82/dd5/d24/dd6/de7/f119 x:0 0 0 2024-09-20T19:06:17.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/890: readlink d0/d55/d82/dd5/d24/la4 0 2024-09-20T19:06:17.957 INFO:tasks.workunit.client.1.smithi098.stdout:6/891: rename d0/d55/d82/dd5/d24/l6f to d0/d55/d82/l11a 0 2024-09-20T19:06:17.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/892: truncate d0/d55/d82/da3/d8c/fb4 1042170 0 2024-09-20T19:06:17.961 INFO:tasks.workunit.client.1.smithi098.stdout:6/893: mknod d0/d55/d82/dd5/de2/da7/c11b 0 2024-09-20T19:06:17.961 INFO:tasks.workunit.client.1.smithi098.stdout:3/969: write d4/da/fbf [329876,51521] 0 2024-09-20T19:06:17.965 INFO:tasks.workunit.client.1.smithi098.stdout:6/894: dread d0/d55/f8f [0,4194304] 0 2024-09-20T19:06:17.966 INFO:tasks.workunit.client.1.smithi098.stdout:6/895: write d0/d55/d82/dd5/de2/da7/fc9 [5140966,78619] 0 2024-09-20T19:06:17.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/970: getdents d4/d19/d1d/d22 0 2024-09-20T19:06:17.972 INFO:tasks.workunit.client.1.smithi098.stdout:6/896: unlink d0/d55/d82/dd5/d24/c4f 0 2024-09-20T19:06:17.975 INFO:tasks.workunit.client.1.smithi098.stdout:6/897: dread d0/f7b [0,4194304] 0 2024-09-20T19:06:17.976 INFO:tasks.workunit.client.1.smithi098.stdout:6/898: chown d0/d55/d82/da3/la6 400 1 2024-09-20T19:06:17.979 INFO:tasks.workunit.client.1.smithi098.stdout:6/899: symlink d0/d55/d82/dd5/d24/d29/d50/dbe/l11c 0 2024-09-20T19:06:17.979 INFO:tasks.workunit.client.1.smithi098.stdout:3/971: write d4/d19/d1d/d2f/d4e/da3/fe2 [1119683,50523] 0 2024-09-20T19:06:17.980 INFO:tasks.workunit.client.1.smithi098.stdout:6/900: chown d0/d55/d82/dd5/d24 5 1 2024-09-20T19:06:17.981 INFO:tasks.workunit.client.1.smithi098.stdout:3/972: rmdir d4/d19/d1d/d2f/d4e/da3 39 2024-09-20T19:06:17.990 INFO:tasks.workunit.client.1.smithi098.stdout:6/901: dwrite d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:17.992 INFO:tasks.workunit.client.1.smithi098.stdout:6/902: readlink d0/d55/d82/da3/d43/da8/dfb/l113 0 2024-09-20T19:06:17.993 INFO:tasks.workunit.client.1.smithi098.stdout:6/903: write d0/d55/d82/dd5/d24/d29/fe6 [1131605,104872] 0 2024-09-20T19:06:17.995 INFO:tasks.workunit.client.1.smithi098.stdout:3/973: dread d4/d38/d48/ff3 [0,4194304] 0 2024-09-20T19:06:17.997 INFO:tasks.workunit.client.1.smithi098.stdout:6/904: mknod d0/d55/d82/dd5/de2/da7/df8/c11d 0 2024-09-20T19:06:17.999 INFO:tasks.workunit.client.1.smithi098.stdout:3/974: symlink d4/d19/d1d/d2f/d4e/d59/dfc/d126/l12b 0 2024-09-20T19:06:18.000 INFO:tasks.workunit.client.1.smithi098.stdout:6/905: creat d0/d55/d82/da3/d43/dc0/d7c/f11e x:0 0 0 2024-09-20T19:06:18.001 INFO:tasks.workunit.client.1.smithi098.stdout:3/975: fdatasync d4/d25/f2b 0 2024-09-20T19:06:18.001 INFO:tasks.workunit.client.1.smithi098.stdout:6/906: stat d0/d55/d82/dd5/d24/d29/d50/c80 0 2024-09-20T19:06:18.004 INFO:tasks.workunit.client.1.smithi098.stdout:3/976: symlink d4/d38/d97/l12c 0 2024-09-20T19:06:18.005 INFO:tasks.workunit.client.1.smithi098.stdout:3/977: write d4/d38/d48/f75 [2229790,118938] 0 2024-09-20T19:06:18.005 INFO:tasks.workunit.client.1.smithi098.stdout:6/907: creat d0/d55/d82/da3/d43/d6d/f11f x:0 0 0 2024-09-20T19:06:18.006 INFO:tasks.workunit.client.1.smithi098.stdout:3/978: dread - d4/d19/d1d/f118 zero size 2024-09-20T19:06:18.007 INFO:tasks.workunit.client.1.smithi098.stdout:6/908: write d0/d55/d82/da3/d43/dc0/ff9 [1034822,22603] 0 2024-09-20T19:06:18.009 INFO:tasks.workunit.client.1.smithi098.stdout:6/909: readlink d0/d55/d82/dd5/d24/dd6/de7/lec 0 2024-09-20T19:06:18.009 INFO:tasks.workunit.client.1.smithi098.stdout:3/979: truncate d4/d25/d40/fd7 1093558 0 2024-09-20T19:06:18.010 INFO:tasks.workunit.client.1.smithi098.stdout:6/910: readlink d0/d55/d82/da3/l115 0 2024-09-20T19:06:18.014 INFO:tasks.workunit.client.1.smithi098.stdout:6/911: creat d0/d55/d82/dd5/de2/da7/df8/f120 x:0 0 0 2024-09-20T19:06:18.014 INFO:tasks.workunit.client.1.smithi098.stdout:3/980: truncate d4/d19/d1d/d2f/d4e/da3/ff9 831602 0 2024-09-20T19:06:18.019 INFO:tasks.workunit.client.1.smithi098.stdout:3/981: dread d4/d25/f3c [0,4194304] 0 2024-09-20T19:06:18.021 INFO:tasks.workunit.client.1.smithi098.stdout:6/912: dwrite d0/f7b [4194304,4194304] 0 2024-09-20T19:06:18.026 INFO:tasks.workunit.client.1.smithi098.stdout:6/913: creat d0/d55/d82/da3/d43/dc0/d65/f121 x:0 0 0 2024-09-20T19:06:18.031 INFO:tasks.workunit.client.1.smithi098.stdout:6/914: rename d0/de/l30 to d0/d55/d82/da3/d43/dc0/d66/l122 0 2024-09-20T19:06:18.034 INFO:tasks.workunit.client.1.smithi098.stdout:6/915: rmdir d0/d55/d82/dd5 39 2024-09-20T19:06:18.035 INFO:tasks.workunit.client.1.smithi098.stdout:3/982: dread d4/d25/d40/d80/f86 [0,4194304] 0 2024-09-20T19:06:18.036 INFO:tasks.workunit.client.1.smithi098.stdout:3/983: chown d4/da/d10d/cb8 153021 1 2024-09-20T19:06:18.038 INFO:tasks.workunit.client.1.smithi098.stdout:6/916: write d0/d55/d82/dd5/de2/f5c [3382942,129086] 0 2024-09-20T19:06:18.039 INFO:tasks.workunit.client.1.smithi098.stdout:0/755: sync 2024-09-20T19:06:18.043 INFO:tasks.workunit.client.1.smithi098.stdout:6/917: symlink d0/d55/d82/da3/d8c/l123 0 2024-09-20T19:06:18.044 INFO:tasks.workunit.client.1.smithi098.stdout:6/918: stat d0/d55/d82/da3/d8c/c77 0 2024-09-20T19:06:18.045 INFO:tasks.workunit.client.1.smithi098.stdout:3/984: rmdir d4/da/d50/d104 39 2024-09-20T19:06:18.046 INFO:tasks.workunit.client.1.smithi098.stdout:3/985: dread - d4/d25/d40/f11c zero size 2024-09-20T19:06:18.046 INFO:tasks.workunit.client.1.smithi098.stdout:6/919: write d0/d55/d82/da3/d43/dc0/d66/fc8 [127037,30621] 0 2024-09-20T19:06:18.048 INFO:tasks.workunit.client.1.smithi098.stdout:0/756: dread d0/db/d1d/f4d [4194304,4194304] 0 2024-09-20T19:06:18.051 INFO:tasks.workunit.client.1.smithi098.stdout:3/986: creat d4/d38/d48/d60/dd0/f12d x:0 0 0 2024-09-20T19:06:18.054 INFO:tasks.workunit.client.1.smithi098.stdout:0/757: chown d0/d55/d67/f68 76 1 2024-09-20T19:06:18.061 INFO:tasks.workunit.client.1.smithi098.stdout:0/758: creat d0/d55/fe6 x:0 0 0 2024-09-20T19:06:18.064 INFO:tasks.workunit.client.1.smithi098.stdout:3/987: dwrite d4/d19/fb9 [4194304,4194304] 0 2024-09-20T19:06:18.070 INFO:tasks.workunit.client.1.smithi098.stdout:6/920: dread d0/d55/d82/dd5/d24/f3e [0,4194304] 0 2024-09-20T19:06:18.071 INFO:tasks.workunit.client.1.smithi098.stdout:0/759: dwrite d0/db/d1d/f34 [4194304,4194304] 0 2024-09-20T19:06:18.074 INFO:tasks.workunit.client.1.smithi098.stdout:3/988: dwrite d4/d38/d48/ff3 [0,4194304] 0 2024-09-20T19:06:18.075 INFO:tasks.workunit.client.1.smithi098.stdout:6/921: mkdir d0/de/d1b/d124 0 2024-09-20T19:06:18.078 INFO:tasks.workunit.client.1.smithi098.stdout:6/922: write d0/d55/d82/dd5/d24/d29/f8d [2858231,44586] 0 2024-09-20T19:06:18.081 INFO:tasks.workunit.client.1.smithi098.stdout:3/989: rename d4/d19/d1d/d2f/d4e/c6a to d4/d25/c12e 0 2024-09-20T19:06:18.084 INFO:tasks.workunit.client.1.smithi098.stdout:3/990: truncate d4/d25/d8d/f9e 5242809 0 2024-09-20T19:06:18.087 INFO:tasks.workunit.client.1.smithi098.stdout:6/923: dwrite d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:18.092 INFO:tasks.workunit.client.1.smithi098.stdout:3/991: creat d4/d38/f12f x:0 0 0 2024-09-20T19:06:18.094 INFO:tasks.workunit.client.1.smithi098.stdout:3/992: stat d4/d19/d1d/d2f/d4e/d59/c81 0 2024-09-20T19:06:18.097 INFO:tasks.workunit.client.1.smithi098.stdout:6/924: dwrite d0/d55/d82/dd5/d24/dd6/de7/f119 [0,4194304] 0 2024-09-20T19:06:18.100 INFO:tasks.workunit.client.1.smithi098.stdout:6/925: unlink d0/de/d1b/f89 0 2024-09-20T19:06:18.104 INFO:tasks.workunit.client.1.smithi098.stdout:6/926: mkdir d0/d55/d82/da3/d8c/d125 0 2024-09-20T19:06:18.107 INFO:tasks.workunit.client.1.smithi098.stdout:6/927: mkdir d0/d55/d82/da3/d43/dc0/d7c/d126 0 2024-09-20T19:06:18.109 INFO:tasks.workunit.client.1.smithi098.stdout:6/928: read d0/d55/d82/da3/d43/dc0/ff9 [208530,115544] 0 2024-09-20T19:06:18.111 INFO:tasks.workunit.client.1.smithi098.stdout:6/929: fdatasync d0/d55/d82/da3/d43/dc0/d65/fe0 0 2024-09-20T19:06:18.113 INFO:tasks.workunit.client.1.smithi098.stdout:6/930: truncate d0/d55/d82/dd5/de2/da7/fb8 1011210 0 2024-09-20T19:06:18.114 INFO:tasks.workunit.client.1.smithi098.stdout:3/993: dwrite d4/d19/d1d/d2f/f66 [0,4194304] 0 2024-09-20T19:06:18.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/994: rename d4/d19/d1d/d2f/lf7 to d4/da/d10d/df4/l130 0 2024-09-20T19:06:18.121 INFO:tasks.workunit.client.1.smithi098.stdout:6/931: mknod d0/de/c127 0 2024-09-20T19:06:18.122 INFO:tasks.workunit.client.1.smithi098.stdout:6/932: write d0/de/f8b [4378071,37568] 0 2024-09-20T19:06:18.150 INFO:tasks.workunit.client.1.smithi098.stdout:6/933: dread d0/d55/d82/da3/d43/f48 [0,4194304] 0 2024-09-20T19:06:18.154 INFO:tasks.workunit.client.1.smithi098.stdout:6/934: creat d0/d55/d82/dd5/d24/f128 x:0 0 0 2024-09-20T19:06:18.155 INFO:tasks.workunit.client.1.smithi098.stdout:6/935: write d0/d55/d82/f95 [7390325,123749] 0 2024-09-20T19:06:18.159 INFO:tasks.workunit.client.1.smithi098.stdout:6/936: fsync d0/de/f18 0 2024-09-20T19:06:18.167 INFO:tasks.workunit.client.1.smithi098.stdout:6/937: rename d0/d55/d82/dd5/d24/d29/fe6 to d0/d55/d82/dd5/d24/d29/f129 0 2024-09-20T19:06:18.170 INFO:tasks.workunit.client.1.smithi098.stdout:6/938: creat d0/d83/f12a x:0 0 0 2024-09-20T19:06:18.172 INFO:tasks.workunit.client.1.smithi098.stdout:6/939: rename d0/d55/d82/da3/d43/d51/cb1 to d0/d55/d82/da3/d8c/d9a/c12b 0 2024-09-20T19:06:18.176 INFO:tasks.workunit.client.1.smithi098.stdout:6/940: rename d0/d55/d82/dd5/d24/d29/d50/dbe to d0/d55/d82/da3/d12c 0 2024-09-20T19:06:18.178 INFO:tasks.workunit.client.1.smithi098.stdout:6/941: readlink d0/d55/d82/da3/d8c/d4c/l112 0 2024-09-20T19:06:18.188 INFO:tasks.workunit.client.1.smithi098.stdout:6/942: dwrite d0/d55/d82/da3/d43/d51/f72 [0,4194304] 0 2024-09-20T19:06:18.192 INFO:tasks.workunit.client.1.smithi098.stdout:6/943: fdatasync d0/d55/d82/dd5/d24/f52 0 2024-09-20T19:06:18.201 INFO:tasks.workunit.client.1.smithi098.stdout:6/944: creat d0/de/f12d x:0 0 0 2024-09-20T19:06:18.208 INFO:tasks.workunit.client.1.smithi098.stdout:6/945: rmdir d0/d55/d82/da3/d43/dc0/d7c/d126 0 2024-09-20T19:06:18.209 INFO:tasks.workunit.client.1.smithi098.stdout:6/946: chown d0/d55/d82/dd5/de2/da7/lcb 318 1 2024-09-20T19:06:18.211 INFO:tasks.workunit.client.1.smithi098.stdout:6/947: rmdir d0/d55/d82/dd5 39 2024-09-20T19:06:18.215 INFO:tasks.workunit.client.1.smithi098.stdout:6/948: link d0/d55/d82/da3/d8c/l10f d0/d55/d82/da3/d43/dc0/d7c/l12e 0 2024-09-20T19:06:18.228 INFO:tasks.workunit.client.1.smithi098.stdout:6/949: write d0/de/d1b/f5d [4803673,34031] 0 2024-09-20T19:06:18.230 INFO:tasks.workunit.client.1.smithi098.stdout:6/950: truncate d0/d55/d82/da3/d43/f107 1599780 0 2024-09-20T19:06:18.231 INFO:tasks.workunit.client.1.smithi098.stdout:6/951: chown d0/d55/d82/da3/l73 10046 1 2024-09-20T19:06:18.235 INFO:tasks.workunit.client.1.smithi098.stdout:6/952: symlink d0/d55/d82/da3/d43/d51/l12f 0 2024-09-20T19:06:18.237 INFO:tasks.workunit.client.1.smithi098.stdout:6/953: truncate d0/d55/d82/da3/d8c/d4c/fff 869200 0 2024-09-20T19:06:18.238 INFO:tasks.workunit.client.1.smithi098.stdout:6/954: chown d0/d55/d82/fb5 172965 1 2024-09-20T19:06:18.267 INFO:tasks.workunit.client.1.smithi098.stdout:6/955: dread d0/d55/d82/da3/d8c/d4c/f9c [0,4194304] 0 2024-09-20T19:06:18.268 INFO:tasks.workunit.client.1.smithi098.stdout:6/956: write d0/d83/f12a [626037,93525] 0 2024-09-20T19:06:18.269 INFO:tasks.workunit.client.1.smithi098.stdout:6/957: stat d0/d55/d82/da3/d12c/cd4 0 2024-09-20T19:06:18.275 INFO:tasks.workunit.client.1.smithi098.stdout:6/958: rmdir d0/d55/d82/da3/d8c/d125 0 2024-09-20T19:06:18.281 INFO:tasks.workunit.client.1.smithi098.stdout:6/959: dwrite d0/de/d1b/fbd [0,4194304] 0 2024-09-20T19:06:18.287 INFO:tasks.workunit.client.1.smithi098.stdout:1/897: sync 2024-09-20T19:06:18.289 INFO:tasks.workunit.client.1.smithi098.stdout:6/960: creat d0/d55/d82/dd5/d24/dd6/de7/f130 x:0 0 0 2024-09-20T19:06:18.324 INFO:tasks.workunit.client.1.smithi098.stdout:6/961: symlink d0/d55/d82/da3/d43/da8/l131 0 2024-09-20T19:06:18.326 INFO:tasks.workunit.client.1.smithi098.stdout:6/962: chown d0/de/d1b/l91 1107 1 2024-09-20T19:06:18.327 INFO:tasks.workunit.client.1.smithi098.stdout:6/963: write d0/d55/d82/dd5/d24/d29/f8d [1756575,94314] 0 2024-09-20T19:06:18.331 INFO:tasks.workunit.client.1.smithi098.stdout:6/964: creat d0/f132 x:0 0 0 2024-09-20T19:06:18.337 INFO:tasks.workunit.client.1.smithi098.stdout:1/898: dread d1/d3/d2e/d71/f8f [0,4194304] 0 2024-09-20T19:06:18.338 INFO:tasks.workunit.client.1.smithi098.stdout:6/965: dwrite d0/d55/d82/da3/f9b [0,4194304] 0 2024-09-20T19:06:18.349 INFO:tasks.workunit.client.1.smithi098.stdout:6/966: getdents d0/dc2 0 2024-09-20T19:06:18.351 INFO:tasks.workunit.client.1.smithi098.stdout:6/967: mkdir d0/d55/d82/da3/d43/dc0/d65/d133 0 2024-09-20T19:06:18.353 INFO:tasks.workunit.client.1.smithi098.stdout:6/968: truncate d0/d55/d82/dd5/d24/d29/f104 701221 0 2024-09-20T19:06:18.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/969: write d0/de/d1b/f5d [4651177,35251] 0 2024-09-20T19:06:18.355 INFO:tasks.workunit.client.1.smithi098.stdout:6/970: read - d0/d55/d82/dd5/d24/faf zero size 2024-09-20T19:06:18.358 INFO:tasks.workunit.client.1.smithi098.stdout:6/971: mknod d0/d55/d82/dd5/de2/c134 0 2024-09-20T19:06:18.360 INFO:tasks.workunit.client.1.smithi098.stdout:6/972: write d0/d55/d82/da3/d43/dc0/f111 [2141089,120341] 0 2024-09-20T19:06:18.363 INFO:tasks.workunit.client.1.smithi098.stdout:6/973: creat d0/d55/d82/da3/d43/dc0/d7c/f135 x:0 0 0 2024-09-20T19:06:18.364 INFO:tasks.workunit.client.1.smithi098.stdout:6/974: readlink d0/d55/d82/da3/l4d 0 2024-09-20T19:06:18.364 INFO:tasks.workunit.client.1.smithi098.stdout:1/899: dread d1/d3/df/d4a/d6d/fe2 [0,4194304] 0 2024-09-20T19:06:18.365 INFO:tasks.workunit.client.1.smithi098.stdout:1/900: stat d1/d3/d2e/d68/d7a/f101 0 2024-09-20T19:06:18.370 INFO:tasks.workunit.client.1.smithi098.stdout:6/975: rename d0/d55/d82/fb5 to d0/d83/f136 0 2024-09-20T19:06:18.373 INFO:tasks.workunit.client.1.smithi098.stdout:1/901: symlink d1/d3/df/dbe/d109/l131 0 2024-09-20T19:06:18.376 INFO:tasks.workunit.client.1.smithi098.stdout:6/976: dwrite d0/dc2/fe8 [0,4194304] 0 2024-09-20T19:06:18.378 INFO:tasks.workunit.client.1.smithi098.stdout:6/977: fsync d0/d55/d82/dd5/d24/d29/f104 0 2024-09-20T19:06:18.378 INFO:tasks.workunit.client.1.smithi098.stdout:1/902: symlink d1/d3/df/d34/d43/d65/l132 0 2024-09-20T19:06:18.383 INFO:tasks.workunit.client.1.smithi098.stdout:6/978: symlink d0/d55/d82/dd5/l137 0 2024-09-20T19:06:18.385 INFO:tasks.workunit.client.1.smithi098.stdout:6/979: getdents d0/d55/d82/da3/d43/dc0/d65/d133 0 2024-09-20T19:06:18.386 INFO:tasks.workunit.client.1.smithi098.stdout:6/980: write d0/d83/f114 [74089,74666] 0 2024-09-20T19:06:18.390 INFO:tasks.workunit.client.1.smithi098.stdout:6/981: creat d0/de/f138 x:0 0 0 2024-09-20T19:06:18.397 INFO:tasks.workunit.client.1.smithi098.stdout:1/903: write d1/d3/df/d4a/d6d/fb5 [390392,32942] 0 2024-09-20T19:06:18.401 INFO:tasks.workunit.client.1.smithi098.stdout:6/982: write d0/d55/d82/dd5/f85 [1094939,33477] 0 2024-09-20T19:06:18.405 INFO:tasks.workunit.client.1.smithi098.stdout:1/904: link d1/d3/ffc d1/f133 0 2024-09-20T19:06:18.406 INFO:tasks.workunit.client.1.smithi098.stdout:6/983: link d0/d55/f8f d0/d55/d82/dd5/d24/dd6/f139 0 2024-09-20T19:06:18.411 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:18 smithi027 ceph-mon[28196]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 108 MiB/s rd, 246 MiB/s wr, 545 op/s 2024-09-20T19:06:18.415 INFO:tasks.workunit.client.1.smithi098.stdout:1/905: dread d1/d3/d2e/d61/fd9 [0,4194304] 0 2024-09-20T19:06:18.418 INFO:tasks.workunit.client.1.smithi098.stdout:1/906: symlink d1/d3/d62/d9e/d12f/dc7/d11c/l134 0 2024-09-20T19:06:18.420 INFO:tasks.workunit.client.1.smithi098.stdout:6/984: write d0/d55/d82/da3/d43/dc0/d66/d81/fdf [1695749,13655] 0 2024-09-20T19:06:18.424 INFO:tasks.workunit.client.1.smithi098.stdout:1/907: dwrite d1/d3/df/d34/d43/d65/f88 [0,4194304] 0 2024-09-20T19:06:18.425 INFO:tasks.workunit.client.1.smithi098.stdout:1/908: chown d1/d3/d2e/d61/ff0 22650244 1 2024-09-20T19:06:18.427 INFO:tasks.workunit.client.1.smithi098.stdout:1/909: symlink d1/d3/dd5/l135 0 2024-09-20T19:06:18.429 INFO:tasks.workunit.client.1.smithi098.stdout:6/985: getdents d0/de 0 2024-09-20T19:06:18.434 INFO:tasks.workunit.client.1.smithi098.stdout:6/986: dread d0/d55/d82/da3/d43/d6d/f92 [0,4194304] 0 2024-09-20T19:06:18.436 INFO:tasks.workunit.client.1.smithi098.stdout:6/987: rmdir d0/d55/d82/da3/d43/dc0/d66/d81 39 2024-09-20T19:06:18.442 INFO:tasks.workunit.client.1.smithi098.stdout:6/988: dwrite d0/d55/d82/dd5/f85 [0,4194304] 0 2024-09-20T19:06:18.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/989: mkdir d0/d55/d82/dd5/dcf/d13a 0 2024-09-20T19:06:18.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/990: creat d0/d55/d82/da3/d43/da8/f13b x:0 0 0 2024-09-20T19:06:18.449 INFO:tasks.workunit.client.1.smithi098.stdout:6/991: chown d0/d55/d82/dd5/de2/f1a 54 1 2024-09-20T19:06:18.451 INFO:tasks.workunit.client.1.smithi098.stdout:6/992: fdatasync d0/d55/d82/dd5/d24/d29/d50/f8e 0 2024-09-20T19:06:18.453 INFO:tasks.workunit.client.1.smithi098.stdout:1/910: dread d1/d3/df/d34/d52/d77/fa0 [0,4194304] 0 2024-09-20T19:06:18.455 INFO:tasks.workunit.client.1.smithi098.stdout:6/993: creat d0/d55/d82/da3/d8c/d4c/f13c x:0 0 0 2024-09-20T19:06:18.457 INFO:tasks.workunit.client.1.smithi098.stdout:1/911: creat d1/d3/df/d4a/d6d/f136 x:0 0 0 2024-09-20T19:06:18.461 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:18 smithi098 ceph-mon[35737]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 108 MiB/s rd, 246 MiB/s wr, 545 op/s 2024-09-20T19:06:18.463 INFO:tasks.workunit.client.1.smithi098.stdout:6/994: dwrite d0/d55/d82/da3/d8c/fb4 [0,4194304] 0 2024-09-20T19:06:18.468 INFO:tasks.workunit.client.1.smithi098.stdout:6/995: readlink d0/d55/d82/da3/d8c/l10f 0 2024-09-20T19:06:18.470 INFO:tasks.workunit.client.1.smithi098.stdout:6/996: dread d0/d55/d82/dd5/f62 [0,4194304] 0 2024-09-20T19:06:18.472 INFO:tasks.workunit.client.1.smithi098.stdout:6/997: truncate d0/d55/d82/dd5/f62 2276672 0 2024-09-20T19:06:18.472 INFO:tasks.workunit.client.1.smithi098.stdout:1/912: write d1/d3/d62/f7b [1385118,5841] 0 2024-09-20T19:06:18.478 INFO:tasks.workunit.client.1.smithi098.stdout:1/913: unlink d1/d3/d2e/d68/d7a/da1/ldc 0 2024-09-20T19:06:18.490 INFO:tasks.workunit.client.1.smithi098.stdout:6/998: truncate d0/de/f8b 4092209 0 2024-09-20T19:06:18.492 INFO:tasks.workunit.client.1.smithi098.stdout:1/914: write d1/d3/df/f29 [2743424,27980] 0 2024-09-20T19:06:18.496 INFO:tasks.workunit.client.1.smithi098.stdout:1/915: creat d1/d3/d2e/d71/f137 x:0 0 0 2024-09-20T19:06:18.499 INFO:tasks.workunit.client.1.smithi098.stdout:6/999: creat d0/d55/d82/dd5/d24/d29/f13d x:0 0 0 2024-09-20T19:06:18.501 INFO:tasks.workunit.client.1.smithi098.stdout:0/760: sync 2024-09-20T19:06:18.502 INFO:tasks.workunit.client.1.smithi098.stdout:1/916: creat d1/d3/df/d4a/d6d/d11b/f138 x:0 0 0 2024-09-20T19:06:18.509 INFO:tasks.workunit.client.1.smithi098.stdout:0/761: creat d0/d6/d28/d31/d69/dbf/fe7 x:0 0 0 2024-09-20T19:06:18.520 INFO:tasks.workunit.client.1.smithi098.stdout:1/917: getdents d1/d3/df/dbe 0 2024-09-20T19:06:18.522 INFO:tasks.workunit.client.1.smithi098.stdout:0/762: link d0/d6/f89 d0/db/d7f/fe8 0 2024-09-20T19:06:18.522 INFO:tasks.workunit.client.1.smithi098.stdout:0/763: dread - d0/d7d/fd1 zero size 2024-09-20T19:06:18.526 INFO:tasks.workunit.client.1.smithi098.stdout:0/764: symlink d0/d55/d67/le9 0 2024-09-20T19:06:18.532 INFO:tasks.workunit.client.1.smithi098.stdout:0/765: creat d0/db/d7f/d93/dd4/fea x:0 0 0 2024-09-20T19:06:18.533 INFO:tasks.workunit.client.1.smithi098.stdout:1/918: write d1/f81 [474445,94050] 0 2024-09-20T19:06:18.535 INFO:tasks.workunit.client.1.smithi098.stdout:0/766: unlink d0/d6/d28/d31/d45/d60/d78/fc9 0 2024-09-20T19:06:18.538 INFO:tasks.workunit.client.1.smithi098.stdout:1/919: read d1/d3/d2e/f3b [2097358,48729] 0 2024-09-20T19:06:18.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/767: creat d0/dd3/feb x:0 0 0 2024-09-20T19:06:18.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/920: creat d1/dbb/f139 x:0 0 0 2024-09-20T19:06:18.540 INFO:tasks.workunit.client.1.smithi098.stdout:1/921: readlink d1/d3/df/d34/d43/d65/ld4 0 2024-09-20T19:06:18.541 INFO:tasks.workunit.client.1.smithi098.stdout:0/768: creat d0/d6/d28/d31/d69/d9b/fec x:0 0 0 2024-09-20T19:06:18.543 INFO:tasks.workunit.client.1.smithi098.stdout:1/922: unlink d1/d3/df/d4a/d6d/fb5 0 2024-09-20T19:06:18.547 INFO:tasks.workunit.client.1.smithi098.stdout:1/923: rename d1/d3/cfd to d1/d3/df/d34/d43/daa/c13a 0 2024-09-20T19:06:18.551 INFO:tasks.workunit.client.1.smithi098.stdout:1/924: rmdir d1/d3/df/d34/d43/daa/dd1 39 2024-09-20T19:06:18.554 INFO:tasks.workunit.client.1.smithi098.stdout:1/925: creat d1/d3/df/d4a/d6d/d11b/f13b x:0 0 0 2024-09-20T19:06:18.560 INFO:tasks.workunit.client.1.smithi098.stdout:1/926: dwrite d1/d3/d2e/d68/de5/f118 [0,4194304] 0 2024-09-20T19:06:18.561 INFO:tasks.workunit.client.1.smithi098.stdout:1/927: dread - d1/d3/df/d4a/d6d/f119 zero size 2024-09-20T19:06:18.564 INFO:tasks.workunit.client.1.smithi098.stdout:1/928: mkdir d1/dbb/d13c 0 2024-09-20T19:06:18.566 INFO:tasks.workunit.client.1.smithi098.stdout:3/995: sync 2024-09-20T19:06:18.567 INFO:tasks.workunit.client.1.smithi098.stdout:1/929: mknod d1/d3/d62/d9e/d12f/dc7/d11c/d12e/c13d 0 2024-09-20T19:06:18.570 INFO:tasks.workunit.client.1.smithi098.stdout:1/930: mkdir d1/d3/df/d34/d43/d65/dbc/d125/d13e 0 2024-09-20T19:06:18.572 INFO:tasks.workunit.client.1.smithi098.stdout:3/996: getdents d4/d19 0 2024-09-20T19:06:18.572 INFO:tasks.workunit.client.1.smithi098.stdout:1/931: rmdir d1/d3/df/d34/d43/d65/dbc/d123 39 2024-09-20T19:06:18.573 INFO:tasks.workunit.client.1.smithi098.stdout:0/769: write d0/d6/d28/d31/d45/d60/f9a [1686038,16736] 0 2024-09-20T19:06:18.574 INFO:tasks.workunit.client.1.smithi098.stdout:1/932: fsync d1/d3/df/d4a/d6d/f119 0 2024-09-20T19:06:18.575 INFO:tasks.workunit.client.1.smithi098.stdout:0/770: dread - d0/d6/d19/dbe/fa3 zero size 2024-09-20T19:06:18.577 INFO:tasks.workunit.client.1.smithi098.stdout:0/771: write d0/d6/f12 [2560643,63414] 0 2024-09-20T19:06:18.579 INFO:tasks.workunit.client.1.smithi098.stdout:0/772: creat d0/d6/d28/d31/d69/d9b/fed x:0 0 0 2024-09-20T19:06:18.580 INFO:tasks.workunit.client.1.smithi098.stdout:1/933: truncate d1/d3/d2e/d61/fc8 930991 0 2024-09-20T19:06:18.583 INFO:tasks.workunit.client.1.smithi098.stdout:1/934: fsync d1/d3/d62/d9e/fa7 0 2024-09-20T19:06:18.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/773: dwrite d0/db/d1d/f34 [0,4194304] 0 2024-09-20T19:06:18.591 INFO:tasks.workunit.client.1.smithi098.stdout:0/774: unlink d0/d55/l41 0 2024-09-20T19:06:18.595 INFO:tasks.workunit.client.1.smithi098.stdout:3/997: dwrite d4/da/d7a/fb0 [0,4194304] 0 2024-09-20T19:06:18.598 INFO:tasks.workunit.client.1.smithi098.stdout:0/775: mkdir d0/db/d32/d65/dee 0 2024-09-20T19:06:18.604 INFO:tasks.workunit.client.1.smithi098.stdout:0/776: dwrite d0/db/d1d/fd0 [0,4194304] 0 2024-09-20T19:06:18.604 INFO:tasks.workunit.client.1.smithi098.stdout:1/935: truncate d1/d3/d62/d9e/d12f/fe7 5361985 0 2024-09-20T19:06:18.606 INFO:tasks.workunit.client.1.smithi098.stdout:3/998: mkdir d4/d38/d97/d120/d131 0 2024-09-20T19:06:18.612 INFO:tasks.workunit.client.1.smithi098.stdout:3/999: symlink d4/d38/d97/dcb/l132 0 2024-09-20T19:06:18.613 INFO:tasks.workunit.client.1.smithi098.stdout:0/777: symlink d0/lef 0 2024-09-20T19:06:18.614 INFO:tasks.workunit.client.1.smithi098.stdout:1/936: symlink d1/dda/d106/l13f 0 2024-09-20T19:06:18.615 INFO:tasks.workunit.client.1.smithi098.stdout:0/778: rmdir d0/d55 39 2024-09-20T19:06:18.615 INFO:tasks.workunit.client.1.smithi098.stdout:1/937: write d1/d3/df/f29 [2445328,79181] 0 2024-09-20T19:06:18.618 INFO:tasks.workunit.client.1.smithi098.stdout:0/779: mkdir d0/db/d32/d65/df0 0 2024-09-20T19:06:18.622 INFO:tasks.workunit.client.1.smithi098.stdout:1/938: readlink d1/d3/df/d34/d52/d77/df7/l107 0 2024-09-20T19:06:18.627 INFO:tasks.workunit.client.1.smithi098.stdout:1/939: dwrite d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:06:18.632 INFO:tasks.workunit.client.1.smithi098.stdout:0/780: rename d0/d55/d67/le9 to d0/d6/lf1 0 2024-09-20T19:06:18.635 INFO:tasks.workunit.client.1.smithi098.stdout:1/940: rename d1/d3/df/d4a/f63 to d1/d3/df/d34/d52/d77/f140 0 2024-09-20T19:06:18.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/941: symlink d1/d3/df/d4a/d6d/l141 0 2024-09-20T19:06:18.637 INFO:tasks.workunit.client.1.smithi098.stdout:0/781: read d0/db/d1d/f4d [1526046,78379] 0 2024-09-20T19:06:18.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/942: readlink d1/d3/d62/d9e/d12f/dc7/d11c/l134 0 2024-09-20T19:06:18.653 INFO:tasks.workunit.client.1.smithi098.stdout:0/782: dwrite d0/d6/d19/d4f/f50 [0,4194304] 0 2024-09-20T19:06:18.653 INFO:tasks.workunit.client.1.smithi098.stdout:1/943: dwrite d1/d3/d2e/d71/f8b [0,4194304] 0 2024-09-20T19:06:18.654 INFO:tasks.workunit.client.1.smithi098.stdout:1/944: dread - d1/d3/d62/d9e/d12f/dc7/d11c/f11e zero size 2024-09-20T19:06:18.657 INFO:tasks.workunit.client.1.smithi098.stdout:0/783: mkdir d0/db/d1d/d8f/df2 0 2024-09-20T19:06:18.661 INFO:tasks.workunit.client.1.smithi098.stdout:0/784: rename d0/db/d7f to d0/d6/d28/d31/d45/df3 0 2024-09-20T19:06:18.663 INFO:tasks.workunit.client.1.smithi098.stdout:1/945: creat d1/d3/df/d34/f142 x:0 0 0 2024-09-20T19:06:18.668 INFO:tasks.workunit.client.1.smithi098.stdout:0/785: rename d0/d6/d28/d31/d45/d60/f9a to d0/d6/d28/d31/ff4 0 2024-09-20T19:06:18.672 INFO:tasks.workunit.client.1.smithi098.stdout:0/786: mknod d0/d6/d28/d31/cf5 0 2024-09-20T19:06:18.674 INFO:tasks.workunit.client.1.smithi098.stdout:0/787: creat d0/db/d1d/d8f/ff6 x:0 0 0 2024-09-20T19:06:18.678 INFO:tasks.workunit.client.1.smithi098.stdout:0/788: creat d0/d6/ff7 x:0 0 0 2024-09-20T19:06:18.682 INFO:tasks.workunit.client.1.smithi098.stdout:1/946: write d1/d3/d2e/d71/f8f [1673928,95080] 0 2024-09-20T19:06:18.683 INFO:tasks.workunit.client.1.smithi098.stdout:0/789: link d0/d6/lf1 d0/db/d1d/d8f/df2/lf8 0 2024-09-20T19:06:18.685 INFO:tasks.workunit.client.1.smithi098.stdout:1/947: link d1/d3/c108 d1/d3/df/d34/d43/d65/c143 0 2024-09-20T19:06:18.687 INFO:tasks.workunit.client.1.smithi098.stdout:0/790: creat d0/d55/ff9 x:0 0 0 2024-09-20T19:06:18.688 INFO:tasks.workunit.client.1.smithi098.stdout:1/948: symlink d1/d3/d2e/d68/d7a/l144 0 2024-09-20T19:06:18.689 INFO:tasks.workunit.client.1.smithi098.stdout:0/791: rmdir d0/db/d1d/d8f 39 2024-09-20T19:06:18.690 INFO:tasks.workunit.client.1.smithi098.stdout:1/949: write d1/d3/df/d34/d43/d65/f88 [2505440,56950] 0 2024-09-20T19:06:18.693 INFO:tasks.workunit.client.1.smithi098.stdout:0/792: rename d0/db/d1d/l2f to d0/d6/d28/d31/d45/df3/lfa 0 2024-09-20T19:06:18.695 INFO:tasks.workunit.client.1.smithi098.stdout:1/950: creat d1/d3/d2e/d68/d7a/da1/f145 x:0 0 0 2024-09-20T19:06:18.696 INFO:tasks.workunit.client.1.smithi098.stdout:1/951: write d1/d3/df/d34/d43/d65/f120 [844552,20203] 0 2024-09-20T19:06:18.697 INFO:tasks.workunit.client.1.smithi098.stdout:0/793: creat d0/d6/d28/d31/d45/df3/db5/ffb x:0 0 0 2024-09-20T19:06:18.698 INFO:tasks.workunit.client.1.smithi098.stdout:0/794: chown d0/d6/d28/d31/d69/d9b/fed 646 1 2024-09-20T19:06:18.704 INFO:tasks.workunit.client.1.smithi098.stdout:0/795: dwrite d0/db/d1d/f34 [0,4194304] 0 2024-09-20T19:06:18.705 INFO:tasks.workunit.client.1.smithi098.stdout:0/796: dread - d0/d6/d28/d31/d69/d9b/fed zero size 2024-09-20T19:06:18.713 INFO:tasks.workunit.client.1.smithi098.stdout:1/952: write d1/d3/df/d34/d43/d65/fed [545061,127470] 0 2024-09-20T19:06:18.716 INFO:tasks.workunit.client.1.smithi098.stdout:0/797: write d0/db/fd [1818783,59640] 0 2024-09-20T19:06:18.720 INFO:tasks.workunit.client.1.smithi098.stdout:0/798: link d0/d55/f76 d0/d6/d28/d31/d69/d9b/ffc 0 2024-09-20T19:06:18.723 INFO:tasks.workunit.client.1.smithi098.stdout:1/953: write d1/d3/d62/ff3 [2096001,60126] 0 2024-09-20T19:06:18.726 INFO:tasks.workunit.client.1.smithi098.stdout:1/954: fsync d1/d3/d62/d9e/fa7 0 2024-09-20T19:06:18.729 INFO:tasks.workunit.client.1.smithi098.stdout:0/799: write d0/d6/d28/f6f [97766,72009] 0 2024-09-20T19:06:18.730 INFO:tasks.workunit.client.1.smithi098.stdout:1/955: dread d1/d3/df/f29 [0,4194304] 0 2024-09-20T19:06:18.737 INFO:tasks.workunit.client.1.smithi098.stdout:0/800: creat d0/db/d32/d65/dee/ffd x:0 0 0 2024-09-20T19:06:18.737 INFO:tasks.workunit.client.1.smithi098.stdout:0/801: readlink d0/d55/l24 0 2024-09-20T19:06:18.740 INFO:tasks.workunit.client.1.smithi098.stdout:1/956: creat d1/dbb/d13c/f146 x:0 0 0 2024-09-20T19:06:18.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/802: getdents d0/d7d/db4 0 2024-09-20T19:06:18.744 INFO:tasks.workunit.client.1.smithi098.stdout:0/803: rmdir d0/d55 39 2024-09-20T19:06:18.746 INFO:tasks.workunit.client.1.smithi098.stdout:0/804: chown d0/db/d1d/d8f/ff6 903 1 2024-09-20T19:06:18.751 INFO:tasks.workunit.client.1.smithi098.stdout:0/805: write d0/d6/d28/d31/d69/d9b/ffc [2474011,30880] 0 2024-09-20T19:06:18.752 INFO:tasks.workunit.client.1.smithi098.stdout:1/957: dread d1/d3/d2e/f3b [0,4194304] 0 2024-09-20T19:06:18.753 INFO:tasks.workunit.client.1.smithi098.stdout:1/958: chown d1/d3/d62/fa2 6531920 1 2024-09-20T19:06:18.758 INFO:tasks.workunit.client.1.smithi098.stdout:0/806: rename d0/d6/d28/d31/d45/df3/d93/cc4 to d0/d6/d19/dbe/dcc/cfe 0 2024-09-20T19:06:18.759 INFO:tasks.workunit.client.1.smithi098.stdout:1/959: symlink d1/d3/d2e/d68/d7a/l147 0 2024-09-20T19:06:18.760 INFO:tasks.workunit.client.1.smithi098.stdout:1/960: stat d1/d3/df/d4a/d6d/l141 0 2024-09-20T19:06:18.762 INFO:tasks.workunit.client.1.smithi098.stdout:0/807: creat d0/db/fff x:0 0 0 2024-09-20T19:06:18.765 INFO:tasks.workunit.client.1.smithi098.stdout:1/961: getdents d1/d3/df/d4a/d6d/d11b 0 2024-09-20T19:06:18.767 INFO:tasks.workunit.client.1.smithi098.stdout:1/962: symlink d1/d3/df/d4a/d6d/l148 0 2024-09-20T19:06:18.768 INFO:tasks.workunit.client.1.smithi098.stdout:1/963: symlink d1/dda/l149 0 2024-09-20T19:06:18.773 INFO:tasks.workunit.client.1.smithi098.stdout:0/808: write d0/d6/d28/f5c [4036619,111024] 0 2024-09-20T19:06:18.776 INFO:tasks.workunit.client.1.smithi098.stdout:1/964: write d1/f3d [889683,48160] 0 2024-09-20T19:06:18.776 INFO:tasks.workunit.client.1.smithi098.stdout:0/809: chown d0/db/d1d/d8f/c86 94711701 1 2024-09-20T19:06:18.776 INFO:tasks.workunit.client.1.smithi098.stdout:1/965: readlink d1/d3/df/l28 0 2024-09-20T19:06:18.782 INFO:tasks.workunit.client.1.smithi098.stdout:0/810: symlink d0/d55/dc1/l100 0 2024-09-20T19:06:18.784 INFO:tasks.workunit.client.1.smithi098.stdout:0/811: rename d0/d6/d19/dbe/fa3 to d0/db/d32/d65/dee/f101 0 2024-09-20T19:06:18.785 INFO:tasks.workunit.client.1.smithi098.stdout:1/966: write d1/f84 [1487452,78326] 0 2024-09-20T19:06:18.788 INFO:tasks.workunit.client.1.smithi098.stdout:1/967: creat d1/d3/d2e/d71/f14a x:0 0 0 2024-09-20T19:06:18.797 INFO:tasks.workunit.client.1.smithi098.stdout:0/812: dwrite d0/d55/f88 [0,4194304] 0 2024-09-20T19:06:18.799 INFO:tasks.workunit.client.1.smithi098.stdout:1/968: dwrite d1/d3/d62/fc9 [0,4194304] 0 2024-09-20T19:06:18.802 INFO:tasks.workunit.client.1.smithi098.stdout:0/813: read d0/d6/d28/d31/f53 [939307,69041] 0 2024-09-20T19:06:18.809 INFO:tasks.workunit.client.1.smithi098.stdout:0/814: fsync d0/f3 0 2024-09-20T19:06:18.813 INFO:tasks.workunit.client.1.smithi098.stdout:0/815: creat d0/d6/d28/d31/d45/d60/da1/f102 x:0 0 0 2024-09-20T19:06:18.823 INFO:tasks.workunit.client.1.smithi098.stdout:1/969: dwrite d1/d3/df/d4a/d6d/fd2 [0,4194304] 0 2024-09-20T19:06:18.824 INFO:tasks.workunit.client.1.smithi098.stdout:0/816: write d0/db/f5d [1934163,88212] 0 2024-09-20T19:06:18.832 INFO:tasks.workunit.client.1.smithi098.stdout:0/817: dwrite d0/d6/d28/d31/d45/df3/fce [0,4194304] 0 2024-09-20T19:06:18.834 INFO:tasks.workunit.client.1.smithi098.stdout:1/970: link d1/d3/d2e/d71/c10f d1/d3/d62/d9e/d12f/dc7/d11c/d12e/c14b 0 2024-09-20T19:06:18.840 INFO:tasks.workunit.client.1.smithi098.stdout:0/818: unlink d0/c27 0 2024-09-20T19:06:18.841 INFO:tasks.workunit.client.1.smithi098.stdout:1/971: symlink d1/d3/df/d34/d52/d77/df7/l14c 0 2024-09-20T19:06:18.841 INFO:tasks.workunit.client.1.smithi098.stdout:1/972: readlink d1/d3/d62/d9e/d12f/dc7/l11a 0 2024-09-20T19:06:18.842 INFO:tasks.workunit.client.1.smithi098.stdout:0/819: fdatasync d0/db/f17 0 2024-09-20T19:06:18.844 INFO:tasks.workunit.client.1.smithi098.stdout:0/820: chown d0/d6/f61 38 1 2024-09-20T19:06:18.845 INFO:tasks.workunit.client.1.smithi098.stdout:1/973: creat d1/d3/d62/d9e/d12f/dc7/f14d x:0 0 0 2024-09-20T19:06:18.847 INFO:tasks.workunit.client.1.smithi098.stdout:1/974: write d1/d3/df/d34/d43/d53/f74 [4799536,88021] 0 2024-09-20T19:06:18.847 INFO:tasks.workunit.client.1.smithi098.stdout:0/821: creat d0/d7d/db4/f103 x:0 0 0 2024-09-20T19:06:18.851 INFO:tasks.workunit.client.1.smithi098.stdout:0/822: unlink d0/d55/dc1/l100 0 2024-09-20T19:06:18.852 INFO:tasks.workunit.client.1.smithi098.stdout:0/823: readlink d0/db/d1d/l9c 0 2024-09-20T19:06:18.853 INFO:tasks.workunit.client.1.smithi098.stdout:1/975: fsync d1/d3/df/f23 0 2024-09-20T19:06:18.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/824: rmdir d0/d6/d19/dbe 39 2024-09-20T19:06:18.856 INFO:tasks.workunit.client.1.smithi098.stdout:0/825: stat d0/d55/d67/dad 0 2024-09-20T19:06:18.859 INFO:tasks.workunit.client.1.smithi098.stdout:1/976: chown d1/c3c 187790 1 2024-09-20T19:06:18.862 INFO:tasks.workunit.client.1.smithi098.stdout:0/826: dwrite d0/d6/d28/d31/d69/d9b/fec [0,4194304] 0 2024-09-20T19:06:18.866 INFO:tasks.workunit.client.1.smithi098.stdout:0/827: creat d0/d6/d28/d31/d45/f104 x:0 0 0 2024-09-20T19:06:18.867 INFO:tasks.workunit.client.1.smithi098.stdout:1/977: creat d1/d3/df/d34/d43/f14e x:0 0 0 2024-09-20T19:06:18.868 INFO:tasks.workunit.client.1.smithi098.stdout:1/978: dread - d1/d3/df/d34/f142 zero size 2024-09-20T19:06:18.869 INFO:tasks.workunit.client.1.smithi098.stdout:1/979: chown d1/d3/df/d34/d43/d65/dbc/d125/d12c 7109 1 2024-09-20T19:06:18.870 INFO:tasks.workunit.client.1.smithi098.stdout:0/828: creat d0/d6/d28/d31/d45/d60/da1/f105 x:0 0 0 2024-09-20T19:06:18.870 INFO:tasks.workunit.client.1.smithi098.stdout:0/829: chown d0/db/d1d/d8f/c71 8155 1 2024-09-20T19:06:18.876 INFO:tasks.workunit.client.1.smithi098.stdout:0/830: read d0/d6/d19/d4f/f72 [1906300,113419] 0 2024-09-20T19:06:18.880 INFO:tasks.workunit.client.1.smithi098.stdout:1/980: truncate d1/fef 856939 0 2024-09-20T19:06:18.883 INFO:tasks.workunit.client.1.smithi098.stdout:1/981: creat d1/d3/df/d34/d43/d65/dbc/d125/d12c/f14f x:0 0 0 2024-09-20T19:06:18.885 INFO:tasks.workunit.client.1.smithi098.stdout:1/982: symlink d1/d3/d2e/d68/d7a/l150 0 2024-09-20T19:06:18.887 INFO:tasks.workunit.client.1.smithi098.stdout:1/983: truncate d1/d3/df/d34/f110 1017731 0 2024-09-20T19:06:18.890 INFO:tasks.workunit.client.1.smithi098.stdout:1/984: mkdir d1/d3/df/d34/d43/d151 0 2024-09-20T19:06:18.896 INFO:tasks.workunit.client.1.smithi098.stdout:1/985: write d1/d3/df/d34/d43/d53/f7f [4798212,87200] 0 2024-09-20T19:06:18.899 INFO:tasks.workunit.client.1.smithi098.stdout:1/986: creat d1/d3/df/d34/d43/daa/f152 x:0 0 0 2024-09-20T19:06:18.901 INFO:tasks.workunit.client.1.smithi098.stdout:1/987: mkdir d1/d3/df/d34/d52/d153 0 2024-09-20T19:06:18.905 INFO:tasks.workunit.client.1.smithi098.stdout:1/988: mknod d1/d3/df/d34/d43/daa/dd1/c154 0 2024-09-20T19:06:18.915 INFO:tasks.workunit.client.1.smithi098.stdout:1/989: truncate d1/d3/df/d34/d52/d77/ff1 1929115 0 2024-09-20T19:06:18.916 INFO:tasks.workunit.client.1.smithi098.stdout:1/990: stat d1/d3/df/d34/d43/daa 0 2024-09-20T19:06:18.917 INFO:tasks.workunit.client.1.smithi098.stdout:1/991: fdatasync d1/d3/df/d4a/d6d/d11b/f138 0 2024-09-20T19:06:19.795 INFO:tasks.workunit.client.1.smithi098.stdout:1/992: sync 2024-09-20T19:06:19.795 INFO:tasks.workunit.client.1.smithi098.stdout:0/831: sync 2024-09-20T19:06:19.796 INFO:tasks.workunit.client.1.smithi098.stdout:0/832: chown d0/d6/d28/d31/ff4 1174789231 1 2024-09-20T19:06:19.798 INFO:tasks.workunit.client.1.smithi098.stdout:1/993: mkdir d1/d3/df/d34/d52/d155 0 2024-09-20T19:06:19.799 INFO:tasks.workunit.client.1.smithi098.stdout:0/833: rmdir d0/d6/d28/d31/d69/d77 39 2024-09-20T19:06:19.800 INFO:tasks.workunit.client.1.smithi098.stdout:0/834: write d0/d6/d28/d31/d45/d60/da1/f105 [104690,89577] 0 2024-09-20T19:06:19.803 INFO:tasks.workunit.client.1.smithi098.stdout:1/994: creat d1/d3/df/d4a/f156 x:0 0 0 2024-09-20T19:06:19.806 INFO:tasks.workunit.client.1.smithi098.stdout:1/995: creat d1/d3/df/dbe/d109/f157 x:0 0 0 2024-09-20T19:06:19.807 INFO:tasks.workunit.client.1.smithi098.stdout:1/996: fsync d1/d3/df/d34/d43/f6e 0 2024-09-20T19:06:19.808 INFO:tasks.workunit.client.1.smithi098.stdout:1/997: chown d1/d3/df/d34/d52/f11d 3815111 1 2024-09-20T19:06:19.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/835: rename d0/d55/d67 to d0/d7d/d106 0 2024-09-20T19:06:19.812 INFO:tasks.workunit.client.1.smithi098.stdout:0/836: readlink d0/lde 0 2024-09-20T19:06:19.816 INFO:tasks.workunit.client.1.smithi098.stdout:0/837: unlink d0/d6/d28/d31/d69/l8d 0 2024-09-20T19:06:19.817 INFO:tasks.workunit.client.1.smithi098.stdout:0/838: fdatasync d0/db/d1d/f34 0 2024-09-20T19:06:19.818 INFO:tasks.workunit.client.1.smithi098.stdout:0/839: dread - d0/db/d1d/d8f/ff6 zero size 2024-09-20T19:06:19.818 INFO:tasks.workunit.client.1.smithi098.stdout:0/840: read - d0/db/fff zero size 2024-09-20T19:06:19.821 INFO:tasks.workunit.client.1.smithi098.stdout:0/841: rmdir d0/d6/d28/d31/d45/df3/db5 39 2024-09-20T19:06:19.822 INFO:tasks.workunit.client.1.smithi098.stdout:0/842: chown d0/d6/d19/d4f/f50 362971 1 2024-09-20T19:06:19.823 INFO:tasks.workunit.client.1.smithi098.stdout:1/998: write d1/d3/d62/d9e/d12f/fe7 [5645945,98911] 0 2024-09-20T19:06:19.826 INFO:tasks.workunit.client.1.smithi098.stdout:1/999: fdatasync d1/d3/d2e/d61/fd9 0 2024-09-20T19:06:19.830 INFO:tasks.workunit.client.1.smithi098.stdout:0/843: link d0/d7d/db4/cda d0/d7d/c107 0 2024-09-20T19:06:19.836 INFO:tasks.workunit.client.1.smithi098.stdout:0/844: dwrite d0/d7d/dcb/fe3 [0,4194304] 0 2024-09-20T19:06:19.837 INFO:tasks.workunit.client.1.smithi098.stdout:0/845: chown d0/d55/f76 7 1 2024-09-20T19:06:19.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/846: link d0/d55/c79 d0/d6/d28/d31/d69/d9b/c108 0 2024-09-20T19:06:20.222 INFO:tasks.workunit.client.1.smithi098.stdout:0/847: sync 2024-09-20T19:06:20.224 INFO:tasks.workunit.client.1.smithi098.stdout:0/848: chown d0/db/d1d/f87 1013095 1 2024-09-20T19:06:20.225 INFO:tasks.workunit.client.1.smithi098.stdout:0/849: chown d0/d7d/db4/lcf 25783 1 2024-09-20T19:06:20.228 INFO:tasks.workunit.client.1.smithi098.stdout:0/850: creat d0/d7d/dcb/f109 x:0 0 0 2024-09-20T19:06:20.228 INFO:tasks.workunit.client.1.smithi098.stdout:0/851: stat d0/lef 0 2024-09-20T19:06:20.229 INFO:tasks.workunit.client.1.smithi098.stdout:0/852: truncate d0/d6/f12 3652517 0 2024-09-20T19:06:20.234 INFO:tasks.workunit.client.1.smithi098.stdout:0/853: symlink d0/d6/d28/d31/d69/d9b/l10a 0 2024-09-20T19:06:20.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/854: rename d0/d7d/f80 to d0/d6/d28/d31/d69/d77/f10b 0 2024-09-20T19:06:20.256 INFO:tasks.workunit.client.1.smithi098.stdout:0/855: getdents d0 0 2024-09-20T19:06:20.259 INFO:tasks.workunit.client.1.smithi098.stdout:0/856: symlink d0/d6/d19/l10c 0 2024-09-20T19:06:20.261 INFO:tasks.workunit.client.1.smithi098.stdout:0/857: write d0/db/d1d/d8f/fa7 [663477,13656] 0 2024-09-20T19:06:20.262 INFO:tasks.workunit.client.1.smithi098.stdout:0/858: write d0/db/fff [514865,2921] 0 2024-09-20T19:06:20.263 INFO:tasks.workunit.client.1.smithi098.stdout:0/859: stat d0/d55/fd5 0 2024-09-20T19:06:20.269 INFO:tasks.workunit.client.1.smithi098.stdout:0/860: creat d0/d7d/d83/f10d x:0 0 0 2024-09-20T19:06:20.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/861: dwrite d0/db/f17 [0,4194304] 0 2024-09-20T19:06:20.388 INFO:tasks.workunit.client.1.smithi098.stdout:0/862: write d0/d6/fe [1081342,97257] 0 2024-09-20T19:06:20.390 INFO:tasks.workunit.client.1.smithi098.stdout:0/863: dread - d0/d6/d28/d31/d69/d9b/fed zero size 2024-09-20T19:06:20.391 INFO:tasks.workunit.client.1.smithi098.stdout:0/864: dread - d0/d6/d28/d31/d69/d9b/dae/fdb zero size 2024-09-20T19:06:20.411 INFO:tasks.workunit.client.1.smithi098.stdout:0/865: write d0/f3 [2277217,89251] 0 2024-09-20T19:06:20.412 INFO:tasks.workunit.client.1.smithi098.stdout:0/866: fdatasync d0/db/d32/fa9 0 2024-09-20T19:06:20.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:20 smithi098 ceph-mon[35737]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 196 MiB/s wr, 438 op/s 2024-09-20T19:06:20.418 INFO:tasks.workunit.client.1.smithi098.stdout:0/867: unlink d0/d6/fe 0 2024-09-20T19:06:20.429 INFO:tasks.workunit.client.1.smithi098.stdout:0/868: dwrite d0/db/d1d/f6a [4194304,4194304] 0 2024-09-20T19:06:20.430 INFO:tasks.workunit.client.1.smithi098.stdout:0/869: dread - d0/d6/d28/d31/d45/f104 zero size 2024-09-20T19:06:20.438 INFO:tasks.workunit.client.1.smithi098.stdout:0/870: write d0/d7d/d106/f68 [290933,44404] 0 2024-09-20T19:06:20.441 INFO:tasks.workunit.client.1.smithi098.stdout:0/871: symlink d0/db/d32/l10e 0 2024-09-20T19:06:20.442 INFO:tasks.workunit.client.1.smithi098.stdout:0/872: mknod d0/d7d/db4/c10f 0 2024-09-20T19:06:20.444 INFO:tasks.workunit.client.1.smithi098.stdout:0/873: read - d0/d6/d28/d31/d45/df3/db5/ffb zero size 2024-09-20T19:06:20.446 INFO:tasks.workunit.client.1.smithi098.stdout:0/874: rmdir d0/d6/d28/d31/d45/df3 39 2024-09-20T19:06:20.447 INFO:tasks.workunit.client.1.smithi098.stdout:0/875: write d0/db/d1d/d8f/fa7 [67599,16283] 0 2024-09-20T19:06:20.451 INFO:tasks.workunit.client.1.smithi098.stdout:0/876: creat d0/db/d32/d65/df0/f110 x:0 0 0 2024-09-20T19:06:20.451 INFO:tasks.workunit.client.1.smithi098.stdout:0/877: fdatasync d0/d7d/d106/f68 0 2024-09-20T19:06:20.464 INFO:tasks.workunit.client.1.smithi098.stdout:0/878: dread d0/db/fd [0,4194304] 0 2024-09-20T19:06:20.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/879: mkdir d0/d6/d28/d31/d69/d77/d111 0 2024-09-20T19:06:20.468 INFO:tasks.workunit.client.1.smithi098.stdout:0/880: unlink d0/db/d1d/d8f/f6c 0 2024-09-20T19:06:20.469 INFO:tasks.workunit.client.1.smithi098.stdout:0/881: write d0/d6/d19/f33 [2296918,1531] 0 2024-09-20T19:06:20.477 INFO:tasks.workunit.client.1.smithi098.stdout:0/882: write d0/d7d/d106/f6d [559229,59035] 0 2024-09-20T19:06:20.486 INFO:tasks.workunit.client.1.smithi098.stdout:0/883: dwrite d0/d6/d28/d31/d45/f5e [0,4194304] 0 2024-09-20T19:06:20.489 INFO:tasks.workunit.client.1.smithi098.stdout:0/884: rename d0/db/d32/d65 to d0/d55/dc1/d112 0 2024-09-20T19:06:20.497 INFO:tasks.workunit.client.1.smithi098.stdout:0/885: link d0/d6/d28/d31/d69/l92 d0/d6/d28/d31/l113 0 2024-09-20T19:06:20.500 INFO:tasks.workunit.client.1.smithi098.stdout:0/886: creat d0/db/d1d/d8f/df2/f114 x:0 0 0 2024-09-20T19:06:20.500 INFO:tasks.workunit.client.1.smithi098.stdout:0/887: chown d0/db/d1d/f6a 3 1 2024-09-20T19:06:20.501 INFO:tasks.workunit.client.1.smithi098.stdout:0/888: write d0/d6/f12 [6507,74809] 0 2024-09-20T19:06:20.502 INFO:tasks.workunit.client.1.smithi098.stdout:0/889: chown d0/d55/cc2 4238 1 2024-09-20T19:06:20.504 INFO:tasks.workunit.client.1.smithi098.stdout:0/890: dread - d0/d6/d28/d31/d45/df3/db5/ffb zero size 2024-09-20T19:06:20.506 INFO:tasks.workunit.client.1.smithi098.stdout:0/891: mkdir d0/d6/d28/d31/d45/d60/da1/d115 0 2024-09-20T19:06:20.507 INFO:tasks.workunit.client.1.smithi098.stdout:0/892: write d0/db/d32/fa9 [107885,75776] 0 2024-09-20T19:06:20.507 INFO:tasks.workunit.client.1.smithi098.stdout:0/893: chown d0/db/cf 84693 1 2024-09-20T19:06:20.509 INFO:tasks.workunit.client.1.smithi098.stdout:0/894: fdatasync d0/d7d/f9d 0 2024-09-20T19:06:20.512 INFO:tasks.workunit.client.1.smithi098.stdout:0/895: mkdir d0/d6/d28/d31/d69/d9b/dae/d116 0 2024-09-20T19:06:20.514 INFO:tasks.workunit.client.1.smithi098.stdout:0/896: rmdir d0/db/d1d 39 2024-09-20T19:06:20.515 INFO:tasks.workunit.client.1.smithi098.stdout:0/897: chown d0/d6/d28/d31/d45/d60/da1/f105 590 1 2024-09-20T19:06:20.516 INFO:tasks.workunit.client.1.smithi098.stdout:0/898: mkdir d0/d6/d117 0 2024-09-20T19:06:20.517 INFO:tasks.workunit.client.1.smithi098.stdout:0/899: write d0/d55/f76 [2564297,18209] 0 2024-09-20T19:06:20.518 INFO:tasks.workunit.client.1.smithi098.stdout:0/900: readlink d0/d7d/d83/l8a 0 2024-09-20T19:06:20.523 INFO:tasks.workunit.client.1.smithi098.stdout:0/901: creat d0/db/d1d/f118 x:0 0 0 2024-09-20T19:06:20.524 INFO:tasks.workunit.client.1.smithi098.stdout:0/902: dread - d0/db/d1d/d8f/ff6 zero size 2024-09-20T19:06:20.524 INFO:tasks.workunit.client.1.smithi098.stdout:0/903: readlink d0/l9 0 2024-09-20T19:06:20.529 INFO:tasks.workunit.client.1.smithi098.stdout:0/904: dwrite d0/d6/d28/d31/d45/f104 [0,4194304] 0 2024-09-20T19:06:20.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:20 smithi027 ceph-mon[28196]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 196 MiB/s wr, 438 op/s 2024-09-20T19:06:21.220 INFO:tasks.workunit.client.1.smithi098.stdout:0/905: sync 2024-09-20T19:06:21.222 INFO:tasks.workunit.client.1.smithi098.stdout:0/906: rmdir d0/d6/d28/d31/d45/d60/da1 39 2024-09-20T19:06:21.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/907: dwrite d0/db/f14 [0,4194304] 0 2024-09-20T19:06:21.228 INFO:tasks.workunit.client.1.smithi098.stdout:0/908: rmdir d0/d55 39 2024-09-20T19:06:21.233 INFO:tasks.workunit.client.1.smithi098.stdout:0/909: creat d0/db/d1d/f119 x:0 0 0 2024-09-20T19:06:21.235 INFO:tasks.workunit.client.1.smithi098.stdout:0/910: symlink d0/db/d1d/d8f/df2/l11a 0 2024-09-20T19:06:21.238 INFO:tasks.workunit.client.1.smithi098.stdout:0/911: chown d0/d6/d28/d31/d45/d60/d78/cbc 155782427 1 2024-09-20T19:06:21.242 INFO:tasks.workunit.client.1.smithi098.stdout:0/912: mkdir d0/d6/d28/d31/d45/d60/da1/d115/d11b 0 2024-09-20T19:06:21.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/913: rmdir d0/d6/d28/d31/d45/d60 39 2024-09-20T19:06:21.246 INFO:tasks.workunit.client.1.smithi098.stdout:0/914: mkdir d0/d6/d28/d31/d69/d9b/d11c 0 2024-09-20T19:06:21.251 INFO:tasks.workunit.client.1.smithi098.stdout:0/915: dwrite d0/d6/d28/f6f [0,4194304] 0 2024-09-20T19:06:21.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/916: mknod d0/d6/d28/d31/d69/d9b/c11d 0 2024-09-20T19:06:21.258 INFO:tasks.workunit.client.1.smithi098.stdout:0/917: dread d0/d55/f88 [0,4194304] 0 2024-09-20T19:06:21.261 INFO:tasks.workunit.client.1.smithi098.stdout:0/918: symlink d0/d55/l11e 0 2024-09-20T19:06:21.262 INFO:tasks.workunit.client.1.smithi098.stdout:0/919: read - d0/d6/d28/d31/d69/dbf/fe7 zero size 2024-09-20T19:06:21.264 INFO:tasks.workunit.client.1.smithi098.stdout:0/920: chown d0/f3 33500139 1 2024-09-20T19:06:21.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/921: chown d0/d7d/db4/cda 1142720885 1 2024-09-20T19:06:21.269 INFO:tasks.workunit.client.1.smithi098.stdout:0/922: rename d0/c81 to d0/d6/d28/d31/de4/c11f 0 2024-09-20T19:06:21.270 INFO:tasks.workunit.client.1.smithi098.stdout:0/923: write d0/db/d1d/f34 [1132126,69755] 0 2024-09-20T19:06:21.280 INFO:tasks.workunit.client.1.smithi098.stdout:0/924: dread d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:06:21.285 INFO:tasks.workunit.client.1.smithi098.stdout:0/925: dread d0/db/d32/fa9 [0,4194304] 0 2024-09-20T19:06:21.287 INFO:tasks.workunit.client.1.smithi098.stdout:0/926: stat d0/lef 0 2024-09-20T19:06:21.300 INFO:tasks.workunit.client.1.smithi098.stdout:0/927: truncate d0/d6/f12 1823851 0 2024-09-20T19:06:21.348 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:21 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:21.362 INFO:tasks.workunit.client.1.smithi098.stdout:0/928: creat d0/dd3/f120 x:0 0 0 2024-09-20T19:06:21.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/929: creat d0/d7d/db4/f121 x:0 0 0 2024-09-20T19:06:21.364 INFO:tasks.workunit.client.1.smithi098.stdout:0/930: truncate d0/d7d/db4/f103 768949 0 2024-09-20T19:06:21.365 INFO:tasks.workunit.client.1.smithi098.stdout:0/931: rmdir d0/d6/d28 39 2024-09-20T19:06:21.380 INFO:tasks.workunit.client.1.smithi098.stdout:0/932: dread d0/d6/d28/d31/d45/d60/f91 [0,4194304] 0 2024-09-20T19:06:21.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/933: dread - d0/d6/d28/d31/d69/d9b/f96 zero size 2024-09-20T19:06:21.383 INFO:tasks.workunit.client.1.smithi098.stdout:0/934: read d0/d7d/db4/f103 [604133,6842] 0 2024-09-20T19:06:21.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/935: creat d0/d6/d28/f122 x:0 0 0 2024-09-20T19:06:21.388 INFO:tasks.workunit.client.1.smithi098.stdout:0/936: dread - d0/db/d1d/d8f/df2/f114 zero size 2024-09-20T19:06:21.391 INFO:tasks.workunit.client.1.smithi098.stdout:0/937: dread d0/db/f17 [0,4194304] 0 2024-09-20T19:06:21.394 INFO:tasks.workunit.client.1.smithi098.stdout:0/938: creat d0/d6/d19/d4f/f123 x:0 0 0 2024-09-20T19:06:21.397 INFO:tasks.workunit.client.1.smithi098.stdout:0/939: mkdir d0/d55/dc1/d112/dee/d124 0 2024-09-20T19:06:21.415 INFO:tasks.workunit.client.1.smithi098.stdout:0/940: truncate d0/db/d1d/f6a 4983059 0 2024-09-20T19:06:21.419 INFO:tasks.workunit.client.1.smithi098.stdout:0/941: dread d0/d6/d28/d31/d69/d77/f10b [0,4194304] 0 2024-09-20T19:06:21.421 INFO:tasks.workunit.client.1.smithi098.stdout:0/942: fsync d0/d6/d19/d4f/f50 0 2024-09-20T19:06:21.423 INFO:tasks.workunit.client.1.smithi098.stdout:0/943: read d0/d6/d19/d4f/f72 [2729820,92333] 0 2024-09-20T19:06:21.424 INFO:tasks.workunit.client.1.smithi098.stdout:0/944: write d0/d6/d28/f5c [3742600,113135] 0 2024-09-20T19:06:21.429 INFO:tasks.workunit.client.1.smithi098.stdout:0/945: creat d0/d7d/dcb/f125 x:0 0 0 2024-09-20T19:06:21.441 INFO:tasks.workunit.client.1.smithi098.stdout:0/946: dwrite d0/d6/d28/d31/d45/d60/fd2 [0,4194304] 0 2024-09-20T19:06:21.445 INFO:tasks.workunit.client.1.smithi098.stdout:0/947: rmdir d0/d6/d28/d31/d45/df3/db5 39 2024-09-20T19:06:21.450 INFO:tasks.workunit.client.1.smithi098.stdout:0/948: creat d0/db/f126 x:0 0 0 2024-09-20T19:06:21.455 INFO:tasks.workunit.client.1.smithi098.stdout:0/949: mkdir d0/d6/d28/d31/d69/d127 0 2024-09-20T19:06:21.461 INFO:tasks.workunit.client.1.smithi098.stdout:0/950: dwrite d0/dd3/feb [0,4194304] 0 2024-09-20T19:06:21.463 INFO:tasks.workunit.client.1.smithi098.stdout:0/951: readlink d0/d55/l30 0 2024-09-20T19:06:21.468 INFO:tasks.workunit.client.1.smithi098.stdout:0/952: creat d0/d6/d28/d31/d45/d60/da1/d115/d11b/f128 x:0 0 0 2024-09-20T19:06:21.479 INFO:tasks.workunit.client.1.smithi098.stdout:0/953: link d0/db/d1d/caf d0/d6/d28/d31/d45/df3/d93/c129 0 2024-09-20T19:06:21.482 INFO:tasks.workunit.client.1.smithi098.stdout:0/954: dread - d0/d6/d28/d31/d45/df3/db5/ffb zero size 2024-09-20T19:06:21.483 INFO:tasks.workunit.client.1.smithi098.stdout:0/955: fsync d0/d6/d28/d31/d69/d9b/fed 0 2024-09-20T19:06:21.486 INFO:tasks.workunit.client.1.smithi098.stdout:0/956: unlink d0/d6/d28/d31/d45/ld7 0 2024-09-20T19:06:21.487 INFO:tasks.workunit.client.1.smithi098.stdout:0/957: write d0/db/d1d/d8f/fa7 [1334701,98084] 0 2024-09-20T19:06:21.488 INFO:tasks.workunit.client.1.smithi098.stdout:0/958: chown d0/d55/f5b 124 1 2024-09-20T19:06:21.490 INFO:tasks.workunit.client.1.smithi098.stdout:0/959: read d0/d6/d19/d4f/f72 [1889961,71168] 0 2024-09-20T19:06:21.490 INFO:tasks.workunit.client.1.smithi098.stdout:0/960: dread - d0/d6/ff7 zero size 2024-09-20T19:06:21.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/961: link d0/d6/d19/d4f/f50 d0/db/d1d/d8f/df2/f12a 0 2024-09-20T19:06:21.497 INFO:tasks.workunit.client.1.smithi098.stdout:0/962: unlink d0/db/d1d/d8f/df2/f12a 0 2024-09-20T19:06:21.498 INFO:tasks.workunit.client.1.smithi098.stdout:0/963: fsync d0/d55/f76 0 2024-09-20T19:06:21.499 INFO:tasks.workunit.client.1.smithi098.stdout:0/964: stat d0/d55/lc6 0 2024-09-20T19:06:21.503 INFO:tasks.workunit.client.1.smithi098.stdout:0/965: dread d0/d6/d28/d31/d45/df3/fce [0,4194304] 0 2024-09-20T19:06:21.505 INFO:tasks.workunit.client.1.smithi098.stdout:0/966: creat d0/d6/d19/dbe/f12b x:0 0 0 2024-09-20T19:06:21.506 INFO:tasks.workunit.client.1.smithi098.stdout:0/967: rmdir d0/d6/d28 39 2024-09-20T19:06:21.508 INFO:tasks.workunit.client.1.smithi098.stdout:0/968: chown d0/lde 10 1 2024-09-20T19:06:21.509 INFO:tasks.workunit.client.1.smithi098.stdout:0/969: dread - d0/d6/d28/d31/d69/d9b/f96 zero size 2024-09-20T19:06:21.511 INFO:tasks.workunit.client.1.smithi098.stdout:0/970: unlink d0/d7d/f9d 0 2024-09-20T19:06:21.513 INFO:tasks.workunit.client.1.smithi098.stdout:0/971: truncate d0/d55/f5b 5909 0 2024-09-20T19:06:21.513 INFO:tasks.workunit.client.1.smithi098.stdout:0/972: chown d0/d7d/d83/cac 18 1 2024-09-20T19:06:21.537 INFO:tasks.workunit.client.1.smithi098.stdout:0/973: dwrite d0/d6/f16 [4194304,4194304] 0 2024-09-20T19:06:21.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/974: dread - d0/db/d1d/f118 zero size 2024-09-20T19:06:21.541 INFO:tasks.workunit.client.1.smithi098.stdout:0/975: symlink d0/d6/d28/d31/d45/d60/da1/d115/d11b/l12c 0 2024-09-20T19:06:21.543 INFO:tasks.workunit.client.1.smithi098.stdout:0/976: rmdir d0/d6/d28/d31/d69/d77 39 2024-09-20T19:06:21.563 INFO:tasks.workunit.client.1.smithi098.stdout:0/977: dwrite d0/d6/f89 [0,4194304] 0 2024-09-20T19:06:21.564 INFO:tasks.workunit.client.1.smithi098.stdout:0/978: stat d0/db/fff 0 2024-09-20T19:06:21.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:21 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:21.570 INFO:tasks.workunit.client.1.smithi098.stdout:0/979: write d0/d6/d19/f10 [851611,69053] 0 2024-09-20T19:06:21.573 INFO:tasks.workunit.client.1.smithi098.stdout:0/980: creat d0/d6/d28/d31/d45/d60/d78/f12d x:0 0 0 2024-09-20T19:06:21.576 INFO:tasks.workunit.client.1.smithi098.stdout:0/981: mknod d0/d6/d28/d31/d69/dbf/c12e 0 2024-09-20T19:06:21.578 INFO:tasks.workunit.client.1.smithi098.stdout:0/982: mknod d0/d55/dc1/c12f 0 2024-09-20T19:06:21.579 INFO:tasks.workunit.client.1.smithi098.stdout:0/983: chown d0/d6/d28/d31/d45/d60/da1/d115/d11b/l12c 48263683 1 2024-09-20T19:06:21.580 INFO:tasks.workunit.client.1.smithi098.stdout:0/984: chown d0/db/d32/f7c 7026878 1 2024-09-20T19:06:21.582 INFO:tasks.workunit.client.1.smithi098.stdout:0/985: dread d0/d6/fe2 [0,4194304] 0 2024-09-20T19:06:21.588 INFO:tasks.workunit.client.1.smithi098.stdout:0/986: dwrite d0/db/fff [0,4194304] 0 2024-09-20T19:06:21.593 INFO:tasks.workunit.client.1.smithi098.stdout:0/987: creat d0/d6/d117/f130 x:0 0 0 2024-09-20T19:06:21.596 INFO:tasks.workunit.client.1.smithi098.stdout:0/988: creat d0/d6/d28/d31/d69/d9b/dae/f131 x:0 0 0 2024-09-20T19:06:21.597 INFO:tasks.workunit.client.1.smithi098.stdout:0/989: symlink d0/d7d/d106/l132 0 2024-09-20T19:06:21.607 INFO:tasks.workunit.client.1.smithi098.stdout:0/990: truncate d0/f5 5842502 0 2024-09-20T19:06:21.607 INFO:tasks.workunit.client.1.smithi098.stdout:0/991: readlink d0/d7d/d106/l132 0 2024-09-20T19:06:21.609 INFO:tasks.workunit.client.1.smithi098.stdout:0/992: rmdir d0/d6/d19 39 2024-09-20T19:06:21.610 INFO:tasks.workunit.client.1.smithi098.stdout:0/993: dread - d0/d6/d28/d31/d69/d9b/dae/f131 zero size 2024-09-20T19:06:21.617 INFO:tasks.workunit.client.1.smithi098.stdout:0/994: dwrite d0/db/fff [0,4194304] 0 2024-09-20T19:06:21.620 INFO:tasks.workunit.client.1.smithi098.stdout:0/995: write d0/d7d/d106/f68 [2281652,17227] 0 2024-09-20T19:06:21.624 INFO:tasks.workunit.client.1.smithi098.stdout:0/996: unlink d0/db/d1d/f119 0 2024-09-20T19:06:21.631 INFO:tasks.workunit.client.1.smithi098.stdout:0/997: dwrite d0/db/d1d/f2a [0,4194304] 0 2024-09-20T19:06:21.637 INFO:tasks.workunit.client.1.smithi098.stdout:0/998: rename d0/db/d1d/fd0 to d0/d7d/db4/f133 0 2024-09-20T19:06:21.641 INFO:tasks.workunit.client.1.smithi098.stdout:0/999: rename d0/d6/f16 to d0/db/d32/f134 0 2024-09-20T19:06:21.645 INFO:tasks.workunit.client.1.smithi098.stderr:+ rm -rf -- ./tmp.xImaChM8Rj 2024-09-20T19:06:22.424 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:22 smithi098 ceph-mon[35737]: pgmap v19: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 111 MiB/s rd, 236 MiB/s wr, 565 op/s 2024-09-20T19:06:22.425 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:22 smithi027 ceph-mon[28196]: pgmap v19: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 111 MiB/s rd, 236 MiB/s wr, 565 op/s 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Adjusting osd_memory_target on smithi098 to 2240M 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: pgmap v20: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 59 MiB/s rd, 127 MiB/s wr, 325 op/s 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:06:24.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:24.227 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:24 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:24.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Adjusting osd_memory_target on smithi098 to 2240M 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:24.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: pgmap v20: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 59 MiB/s rd, 127 MiB/s wr, 325 op/s 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:24.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:24.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:24.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:24 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:25.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:25 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:06:25.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:25 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:06:25.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:25 smithi027 ceph-mon[28196]: Reconfiguring ceph-exporter.smithi027 (dependencies changed)... 2024-09-20T19:06:25.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:25 smithi027 ceph-mon[28196]: Deploying daemon ceph-exporter.smithi027 on smithi027 2024-09-20T19:06:25.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:25 smithi098 ceph-mon[35737]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:06:25.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:25 smithi098 ceph-mon[35737]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:06:25.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:25 smithi098 ceph-mon[35737]: Reconfiguring ceph-exporter.smithi027 (dependencies changed)... 2024-09-20T19:06:25.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:25 smithi098 ceph-mon[35737]: Deploying daemon ceph-exporter.smithi027 on smithi027 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/1548520399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0100860 msgr2=0x7ff0a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/1548520399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0100860 0x7ff0a0100c60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009880 tx=0x7ff09c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/1548520399 shutdown_connections 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/1548520399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0101a60 0x7ff0a0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/1548520399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0100860 0x7ff0a0100c60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/1548520399 >> 172.21.15.27:0/1548520399 conn(0x7ff0a00fc010 msgr2=0x7ff0a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/1548520399 shutdown_connections 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.171+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/1548520399 wait complete. 2024-09-20T19:06:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 Processor -- start 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 -- start start 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 0x7ff0a0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a01096a0 con 0x7ff0a0101a60 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a7ad3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0109520 con 0x7ff0a0100860 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a506e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a506e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40080/0 (socket says 172.21.15.27:40080) 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a506e640 1 -- 172.21.15.27:0/3222869944 learned_addr learned my addr 172.21.15.27:0/3222869944 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.172+0000 7ff0a586f640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 0x7ff0a0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a506e640 1 -- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 msgr2=0x7ff0a0197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a506e640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 0x7ff0a0197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a506e640 1 -- 172.21.15.27:0/3222869944 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a01980e0 con 0x7ff0a0101a60 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a586f640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 0x7ff0a0197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a506e640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff09000e970 tx=0x7ff09000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff09000cac0 con 0x7ff0a0101a60 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0900054e0 con 0x7ff0a0101a60 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a019cb20 con 0x7ff0a0101a60 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff090010430 con 0x7ff0a0101a60 2024-09-20T19:06:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.173+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a019d0b0 con 0x7ff0a0101a60 2024-09-20T19:06:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.175+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a0100c60 con 0x7ff0a0101a60 2024-09-20T19:06:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.175+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 98034+0+0 (secure 0 0 0) 0x7ff090004f00 con 0x7ff0a0101a60 2024-09-20T19:06:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.176+0000 7ff096ffd640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 0x7ff08c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.176+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7ff0900969c0 con 0x7ff0a0101a60 2024-09-20T19:06:26.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.176+0000 7ff0a586f640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 0x7ff08c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.177+0000 7ff0a586f640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 0x7ff08c076ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009230 tx=0x7ff09c0058d0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.180+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff090061ef0 con 0x7ff0a0101a60 2024-09-20T19:06:26.301 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:26 smithi027 ceph-mon[28196]: pgmap v21: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 129 MiB/s wr, 378 op/s 2024-09-20T19:06:26.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.429+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff0a006a460 con 0x7ff08c074a30 2024-09-20T19:06:26.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.431+0000 7ff096ffd640 1 -- 172.21.15.27:0/3222869944 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff0a006a460 con 0x7ff08c074a30 2024-09-20T19:06:26.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 msgr2=0x7ff08c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 0x7ff08c076ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009230 tx=0x7ff09c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 msgr2=0x7ff0a0197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff09000e970 tx=0x7ff09000ed70 comp rx=0 tx=0).stop 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 shutdown_connections 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7ff08c074a30 0x7ff08c076ef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0a0101a60 0x7ff0a0197a60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 --2- 172.21.15.27:0/3222869944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a0100860 0x7ff0a0197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 >> 172.21.15.27:0/3222869944 conn(0x7ff0a00fc010 msgr2=0x7ff0a0069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 shutdown_connections 2024-09-20T19:06:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.435+0000 7ff0a7ad3640 1 -- 172.21.15.27:0/3222869944 wait complete. 2024-09-20T19:06:26.455 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:06:26.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:26 smithi098 ceph-mon[35737]: pgmap v21: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 129 MiB/s wr, 378 op/s 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1376469373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 msgr2=0x7f0c081047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1376469373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c081047e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0c040098b0 tx=0x7f0c0402a4d0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1376469373 shutdown_connections 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1376469373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 0x7f0c08107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1376469373 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c081047e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.556+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1376469373 >> 172.21.15.27:0/1376469373 conn(0x7f0c080fc010 msgr2=0x7f0c080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.557+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1376469373 shutdown_connections 2024-09-20T19:06:26.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.557+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1376469373 wait complete. 2024-09-20T19:06:26.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.557+0000 7f0c0fe8a640 1 Processor -- start 2024-09-20T19:06:26.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.557+0000 7f0c0fe8a640 1 -- start start 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0fe8a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0fe8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 0x7f0c08197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0fe8a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0810a7e0 con 0x7f0c081023f0 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0fe8a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0810a660 con 0x7f0c08104d20 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40104/0 (socket says 172.21.15.27:40104) 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 -- 172.21.15.27:0/1215582539 learned_addr learned my addr 172.21.15.27:0/1215582539 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0d425640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 0x7f0c08197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 -- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 msgr2=0x7f0c08197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 0x7f0c08197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 -- 172.21.15.27:0/1215582539 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c081980c0 con 0x7f0c081023f0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.558+0000 7f0c0dc26640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009880 tx=0x7f0c040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.559+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c0403f070 con 0x7f0c081023f0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.559+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c040049d0 con 0x7f0c081023f0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.559+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c04035030 con 0x7f0c081023f0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.559+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c081001e0 con 0x7f0c081023f0 2024-09-20T19:06:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.559+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c08100770 con 0x7f0c081023f0 2024-09-20T19:06:26.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.560+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c081027d0 con 0x7f0c081023f0 2024-09-20T19:06:26.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.562+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 98034+0+0 (secure 0 0 0) 0x7f0c04042070 con 0x7f0c081023f0 2024-09-20T19:06:26.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.563+0000 7f0bfeffd640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 0x7f0bf407b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.563+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f0c040b7170 con 0x7f0c081023f0 2024-09-20T19:06:26.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.563+0000 7f0c0d425640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 0x7f0bf407b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.564+0000 7f0c0d425640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 0x7f0bf407b380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c081989b0 tx=0x7f0bf8005f90 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.568+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0c04082700 con 0x7f0c081023f0 2024-09-20T19:06:26.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.795+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0c08105680 con 0x7f0bf4078ec0 2024-09-20T19:06:26.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.796+0000 7f0bfeffd640 1 -- 172.21.15.27:0/1215582539 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f0c08105680 con 0x7f0bf4078ec0 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 msgr2=0x7f0bf407b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 0x7f0bf407b380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c081989b0 tx=0x7f0bf8005f90 comp rx=0 tx=0).stop 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 msgr2=0x7f0c08197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009880 tx=0x7f0c040045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 shutdown_connections 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f0bf4078ec0 0x7f0bf407b380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c08104d20 0x7f0c08197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 --2- 172.21.15.27:0/1215582539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c081023f0 0x7f0c08197500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 >> 172.21.15.27:0/1215582539 conn(0x7f0c080fc010 msgr2=0x7f0c080fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 shutdown_connections 2024-09-20T19:06:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.798+0000 7f0c0fe8a640 1 -- 172.21.15.27:0/1215582539 wait complete. 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 -- 172.21.15.27:0/3416743317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a01001e0 msgr2=0x7f37a01005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 --2- 172.21.15.27:0/3416743317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a01001e0 0x7f37a01005e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f379c009880 tx=0x7f379c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 -- 172.21.15.27:0/3416743317 shutdown_connections 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 --2- 172.21.15.27:0/3416743317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a0100b20 0x7f37a0100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 --2- 172.21.15.27:0/3416743317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a01001e0 0x7f37a01005e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.890+0000 7f37a7704640 1 -- 172.21.15.27:0/3416743317 >> 172.21.15.27:0/3416743317 conn(0x7f37a00fc010 msgr2=0x7f37a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:26.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 -- 172.21.15.27:0/3416743317 shutdown_connections 2024-09-20T19:06:26.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 -- 172.21.15.27:0/3416743317 wait complete. 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 Processor -- start 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 -- start start 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a01001e0 0x7f37a0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f37a010c990 con 0x7f37a0100b20 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.891+0000 7f37a7704640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f37a010c810 con 0x7f37a01001e0 2024-09-20T19:06:26.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a54a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a01001e0 0x7f37a0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40122/0 (socket says 172.21.15.27:40122) 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 -- 172.21.15.27:0/1214255370 learned_addr learned my addr 172.21.15.27:0/1214255370 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 -- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a01001e0 msgr2=0x7f37a0199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a01001e0 0x7f37a0199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 -- 172.21.15.27:0/1214255370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a019a230 con 0x7f37a0100b20 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a4c9f640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f379000e970 tx=0x7f379000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f379000cac0 con 0x7f37a0100b20 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a019ec70 con 0x7f37a0100b20 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37900054e0 con 0x7f37a0100b20 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.892+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3790010430 con 0x7f37a0100b20 2024-09-20T19:06:26.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.893+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a019f1b0 con 0x7f37a0100b20 2024-09-20T19:06:26.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.894+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a01005e0 con 0x7f37a0100b20 2024-09-20T19:06:26.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.894+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 98034+0+0 (secure 0 0 0) 0x7f3790004f00 con 0x7f37a0100b20 2024-09-20T19:06:26.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.895+0000 7f37967fc640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 0x7f378c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:26.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.895+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f37900969c0 con 0x7f37a0100b20 2024-09-20T19:06:26.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.895+0000 7f37a54a0640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 0x7f378c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:26.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.895+0000 7f37a54a0640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 0x7f378c076ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f379c000c00 tx=0x7f379c0058d0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:26.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:26.901+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3790061ef0 con 0x7f37a0100b20 2024-09-20T19:06:27.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.137+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f37a0062630 con 0x7f378c074a30 2024-09-20T19:06:27.143 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:27 smithi027 ceph-mon[28196]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.149+0000 7f37967fc640 1 -- 172.21.15.27:0/1214255370 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f37a0062630 con 0x7f378c074a30 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (7m) 14s ago 8m 25.0M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (8m) 14s ago 8m 8560k - 19.1.1-369-ged8ee0f2 6acb0a031eab 6dcbcd2efc60 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (7m) 16s ago 7m 5276k - 19.1.1-369-ged8ee0f2 6acb0a031eab 3700ce4868fe 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (8m) 14s ago 8m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (7m) 16s ago 7m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (6m) 14s ago 8m 79.1M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:06:27.155 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (3m) 14s ago 3m 243M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (3m) 14s ago 3m 13.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (3m) 16s ago 3m 211M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (3m) 16s ago 3m 13.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:9283,8765,8443 running (10m) 14s ago 10m 314M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4d9c23a742fd 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (80s) 16s ago 7m 496M - 19.3.0-5099-g88deadb8 441f9a3fe515 c9edfbf21dc4 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (10m) 14s ago 10m 55.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (7m) 16s ago 7m 43.1M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (8m) 14s ago 8m 16.1M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 16s ago 7m 14.9M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (6m) 14s ago 6m 174M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (6m) 14s ago 6m 179M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (5m) 14s ago 5m 154M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (5m) 16s ago 5m 179M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (4m) 16s ago 4m 175M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (4m) 16s ago 4m 171M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:06:27.156 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (6m) 14s ago 8m 63.7M - 2.43.0 a07b618ecd1d 9a56397b08b3 2024-09-20T19:06:27.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 msgr2=0x7f378c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 0x7f378c076ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f379c000c00 tx=0x7f379c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 msgr2=0x7f37a0199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f379000e970 tx=0x7f379000ed70 comp rx=0 tx=0).stop 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 shutdown_connections 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f378c074a30 0x7f378c076ef0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f37a0100b20 0x7f37a0199bb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 --2- 172.21.15.27:0/1214255370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f37a01001e0 0x7f37a0199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 >> 172.21.15.27:0/1214255370 conn(0x7f37a00fc010 msgr2=0x7f37a0108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 shutdown_connections 2024-09-20T19:06:27.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.152+0000 7f37a7704640 1 -- 172.21.15.27:0/1214255370 wait complete. 2024-09-20T19:06:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- 172.21.15.27:0/4088032769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109e20 msgr2=0x7f9a18073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/4088032769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109e20 0x7f9a18073400 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009880 tx=0x7f9a0c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- 172.21.15.27:0/4088032769 shutdown_connections 2024-09-20T19:06:27.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/4088032769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109e20 0x7f9a18073400 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/4088032769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109450 0x7f9a18109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- 172.21.15.27:0/4088032769 >> 172.21.15.27:0/4088032769 conn(0x7f9a1806ed60 msgr2=0x7f9a180711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:27.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- 172.21.15.27:0/4088032769 shutdown_connections 2024-09-20T19:06:27.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- 172.21.15.27:0/4088032769 wait complete. 2024-09-20T19:06:27.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 Processor -- start 2024-09-20T19:06:27.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.249+0000 7f9a1f94a640 1 -- start start 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1f94a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1f94a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109e20 0x7f9a181a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1f94a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18112fa0 con 0x7f9a18109450 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1f94a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18112e20 con 0x7f9a18109e20 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40130/0 (socket says 172.21.15.27:40130) 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 -- 172.21.15.27:0/2737744412 learned_addr learned my addr 172.21.15.27:0/2737744412 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1cee5640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109e20 0x7f9a181a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 -- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109e20 msgr2=0x7f9a181a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109e20 0x7f9a181a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 -- 172.21.15.27:0/2737744412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a181a08d0 con 0x7f9a18109450 2024-09-20T19:06:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a1d6e6640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800eaf0 tx=0x7f9a0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.250+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a0800cd10 con 0x7f9a18109450 2024-09-20T19:06:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.251+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a08003e30 con 0x7f9a18109450 2024-09-20T19:06:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.251+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a181a5330 con 0x7f9a18109450 2024-09-20T19:06:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.251+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a08010660 con 0x7f9a18109450 2024-09-20T19:06:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.251+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a181a5890 con 0x7f9a18109450 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.252+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a18109850 con 0x7f9a18109450 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.253+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 25) ==== 98034+0+0 (secure 0 0 0) 0x7f9a08003970 con 0x7f9a18109450 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.253+0000 7f9a167fc640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 0x7f9a00076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.254+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7f9a08096b50 con 0x7f9a18109450 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.254+0000 7f9a1cee5640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 0x7f9a00076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.254+0000 7f9a1cee5640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 0x7f9a00076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c000c00 tx=0x7f9a0c0058d0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:27.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.259+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9a08062080 con 0x7f9a18109450 2024-09-20T19:06:27.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:27 smithi098 ceph-mon[35737]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:27.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.640+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9a18199db0 con 0x7f9a18109450 2024-09-20T19:06:27.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.640+0000 7f9a167fc640 1 -- 172.21.15.27:0/2737744412 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f9a08066f30 con 0x7f9a18109450 2024-09-20T19:06:27.646 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:06:27.646 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:27.647 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 13, 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.642+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 msgr2=0x7f9a00076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.642+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 0x7f9a00076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c000c00 tx=0x7f9a0c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.642+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 msgr2=0x7f9a1819fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.642+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800eaf0 tx=0x7f9a0800c2d0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 shutdown_connections 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7f9a00074a30 0x7f9a00076ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a18109e20 0x7f9a181a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 --2- 172.21.15.27:0/2737744412 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a18109450 0x7f9a1819fce0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 >> 172.21.15.27:0/2737744412 conn(0x7f9a1806ed60 msgr2=0x7f9a1810e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 shutdown_connections 2024-09-20T19:06:27.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.643+0000 7f9a1f94a640 1 -- 172.21.15.27:0/2737744412 wait complete. 2024-09-20T19:06:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.737+0000 7fc7b505a640 1 -- 172.21.15.27:0/3878639033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0100860 msgr2=0x7fc7b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.737+0000 7fc7b505a640 1 --2- 172.21.15.27:0/3878639033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0100860 0x7fc7b0100c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009880 tx=0x7fc7a002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 -- 172.21.15.27:0/3878639033 shutdown_connections 2024-09-20T19:06:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 --2- 172.21.15.27:0/3878639033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0101a60 0x7fc7b0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 --2- 172.21.15.27:0/3878639033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0100860 0x7fc7b0100c60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 -- 172.21.15.27:0/3878639033 >> 172.21.15.27:0/3878639033 conn(0x7fc7b00fc010 msgr2=0x7fc7b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 -- 172.21.15.27:0/3878639033 shutdown_connections 2024-09-20T19:06:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.738+0000 7fc7b505a640 1 -- 172.21.15.27:0/3878639033 wait complete. 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 Processor -- start 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 -- start start 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0101a60 0x7fc7b0102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01096a0 con 0x7fc7b0101a60 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7b505a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0109520 con 0x7fc7b0100860 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7aed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7aed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:34334/0 (socket says 172.21.15.27:34334) 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7a7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0101a60 0x7fc7b0102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.739+0000 7fc7aed9d640 1 -- 172.21.15.27:0/1877152569 learned_addr learned my addr 172.21.15.27:0/1877152569 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7aed9d640 1 -- 172.21.15.27:0/1877152569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0101a60 msgr2=0x7fc7b0102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7aed9d640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0101a60 0x7fc7b0102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7aed9d640 1 -- 172.21.15.27:0/1877152569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0103380 con 0x7fc7b0100860 2024-09-20T19:06:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7aed9d640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006010 tx=0x7fc7a00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7a003f070 con 0x7fc7b0100860 2024-09-20T19:06:27.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b0103610 con 0x7fc7b0100860 2024-09-20T19:06:27.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7a00049d0 con 0x7fc7b0100860 2024-09-20T19:06:27.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7a0035030 con 0x7fc7b0100860 2024-09-20T19:06:27.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.740+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b0103b40 con 0x7fc7b0100860 2024-09-20T19:06:27.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.742+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b0100c60 con 0x7fc7b0100860 2024-09-20T19:06:27.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.743+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 98034+0+0 (secure 0 0 0) 0x7fc7a0042070 con 0x7fc7b0100860 2024-09-20T19:06:27.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.743+0000 7fc7acd99640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 0x7fc79c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:27.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.744+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5812+0+0 (secure 0 0 0) 0x7fc7a00b6e50 con 0x7fc7b0100860 2024-09-20T19:06:27.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.744+0000 7fc7a7fff640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 0x7fc79c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:27.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.744+0000 7fc7a7fff640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 0x7fc79c076ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0104500 tx=0x7fc798005f90 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:27.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.750+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc7a0082380 con 0x7fc7b0100860 2024-09-20T19:06:27.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.970+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 --> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc7b006a460 con 0x7fc79c074a30 2024-09-20T19:06:27.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.972+0000 7fc7acd99640 1 -- 172.21.15.27:0/1877152569 <== mgr.14676 v2:172.21.15.98:6828/3289268106 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fc7b006a460 con 0x7fc79c074a30 2024-09-20T19:06:27.977 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:06:27.977 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:06:27.977 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:06:27.977 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:06:27.978 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:06:27.978 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "1/2 daemons upgraded", 2024-09-20T19:06:27.978 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "", 2024-09-20T19:06:27.978 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:06:27.978 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 msgr2=0x7fc79c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 0x7fc79c076ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0104500 tx=0x7fc798005f90 comp rx=0 tx=0).stop 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 msgr2=0x7fc7b0104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006010 tx=0x7fc7a00045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 shutdown_connections 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:6828/3289268106,v1:172.21.15.98:6829/3289268106] conn(0x7fc79c074a30 0x7fc79c076ef0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7b0101a60 0x7fc7b0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 --2- 172.21.15.27:0/1877152569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7b0100860 0x7fc7b0104780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:27.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 >> 172.21.15.27:0/1877152569 conn(0x7fc7b00fc010 msgr2=0x7fc7b0069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:27.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.974+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 shutdown_connections 2024-09-20T19:06:27.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:27.975+0000 7fc7b505a640 1 -- 172.21.15.27:0/1877152569 wait complete. 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 36 MiB/s rd, 82 MiB/s wr, 313 op/s 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2737744412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:28.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:28 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 36 MiB/s rd, 82 MiB/s wr, 313 op/s 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2737744412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:28.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:28 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:29.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:29 smithi027 ceph-mon[28196]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T19:06:29.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:29 smithi027 ceph-mon[28196]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:29.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:29 smithi027 ceph-mon[28196]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T19:06:29.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:29 smithi098 ceph-mon[35737]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T19:06:29.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:29 smithi098 ceph-mon[35737]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:29.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:29 smithi098 ceph-mon[35737]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T19:06:30.285 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-20T19:06:30.285 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-20T19:06:30.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:30 smithi027 ceph-mon[28196]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 21 MiB/s rd, 46 MiB/s wr, 207 op/s 2024-09-20T19:06:30.376 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:30 smithi098 ceph-mon[35737]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 21 MiB/s rd, 46 MiB/s wr, 207 op/s 2024-09-20T19:06:32.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:32 smithi027 ceph-mon[28196]: pgmap v24: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 22 MiB/s rd, 46 MiB/s wr, 290 op/s 2024-09-20T19:06:32.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:32 smithi098 ceph-mon[35737]: pgmap v24: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 22 MiB/s rd, 46 MiB/s wr, 290 op/s 2024-09-20T19:06:34.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: pgmap v25: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 162 op/s 2024-09-20T19:06:34.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:34.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:34.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: Reconfiguring ceph-exporter.smithi098 (dependencies changed)... 2024-09-20T19:06:34.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:34.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:34.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:34.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:34 smithi098 ceph-mon[35737]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: pgmap v25: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 162 op/s 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: Reconfiguring ceph-exporter.smithi098 (dependencies changed)... 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:34.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T19:06:34.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:34.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:34 smithi027 ceph-mon[28196]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-20T19:06:36.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:36 smithi098 ceph-mon[35737]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.0 MiB/s wr, 206 op/s 2024-09-20T19:06:36.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:36 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:36.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:36 smithi027 ceph-mon[28196]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.0 MiB/s wr, 206 op/s 2024-09-20T19:06:36.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:36 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:37.056 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-20T19:06:37.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-20T19:06:38.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:38 smithi098 ceph-mon[35737]: pgmap v27: 65 pgs: 65 active+clean; 829 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 183 op/s 2024-09-20T19:06:38.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:38 smithi027 ceph-mon[28196]: pgmap v27: 65 pgs: 65 active+clean; 829 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 183 op/s 2024-09-20T19:06:40.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: pgmap v28: 65 pgs: 65 active+clean; 829 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 156 op/s 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: Upgrade: Need to upgrade myself (mgr.smithi098.wrcvbg) 2024-09-20T19:06:40.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:40 smithi027 ceph-mon[28196]: Upgrade: Need to upgrade myself (mgr.smithi098.wrcvbg) 2024-09-20T19:06:40.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: pgmap v28: 65 pgs: 65 active+clean; 829 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 156 op/s 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: Upgrade: Need to upgrade myself (mgr.smithi098.wrcvbg) 2024-09-20T19:06:40.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:40 smithi098 ceph-mon[35737]: Upgrade: Need to upgrade myself (mgr.smithi098.wrcvbg) 2024-09-20T19:06:42.356 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 207 op/s 2024-09-20T19:06:42.356 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:42.356 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:06:42.356 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:06:42.356 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:06:42.357 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:42 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:42.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 207 op/s 2024-09-20T19:06:42.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:42.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:06:42.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi027.tlgpqo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:06:42.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:06:42.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:42 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:43.223 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:43 smithi027 ceph-mon[28196]: Upgrade: Updating mgr.smithi027.tlgpqo 2024-09-20T19:06:43.223 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:43 smithi027 ceph-mon[28196]: Deploying daemon mgr.smithi027.tlgpqo on smithi027 2024-09-20T19:06:43.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:43 smithi098 ceph-mon[35737]: Upgrade: Updating mgr.smithi027.tlgpqo 2024-09-20T19:06:43.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:43 smithi098 ceph-mon[35737]: Deploying daemon mgr.smithi027.tlgpqo on smithi027 2024-09-20T19:06:44.223 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:44 smithi027 ceph-mon[28196]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 125 op/s 2024-09-20T19:06:44.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:44 smithi098 ceph-mon[35737]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 125 op/s 2024-09-20T19:06:46.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:46 smithi027 ceph-mon[28196]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 147 op/s 2024-09-20T19:06:46.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:46 smithi098 ceph-mon[35737]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 147 op/s 2024-09-20T19:06:48.035 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:47 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:48.035 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:47 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:48.035 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:47 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:48.035 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:47 smithi027 ceph-mon[28196]: pgmap v32: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 125 op/s 2024-09-20T19:06:48.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:47 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:48.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:47 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:48.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:47 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:48.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:47 smithi098 ceph-mon[35737]: pgmap v32: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 125 op/s 2024-09-20T19:06:50.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:50 smithi027 ceph-mon[28196]: pgmap v33: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 94 op/s 2024-09-20T19:06:50.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:50 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:50.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:50 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:50.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:50 smithi098 ceph-mon[35737]: pgmap v33: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 94 op/s 2024-09-20T19:06:50.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:50 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:50.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:50 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:51.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:51 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:51.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:51 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:52 smithi098 ceph-mon[35737]: pgmap v34: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 139 op/s 2024-09-20T19:06:52.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:52 smithi027 ceph-mon[28196]: pgmap v34: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 139 op/s 2024-09-20T19:06:53.692 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.692 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.692 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: Standby manager daemon smithi027.tlgpqo restarted 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: Standby manager daemon smithi027.tlgpqo started 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/crt"}]: dispatch 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/key"}]: dispatch 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.693 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:53 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: Standby manager daemon smithi027.tlgpqo restarted 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: Standby manager daemon smithi027.tlgpqo started 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/crt"}]: dispatch 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi027.tlgpqo/key"}]: dispatch 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:53.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:53 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:54.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:54 smithi098 ceph-mon[35737]: pgmap v35: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 88 op/s 2024-09-20T19:06:54.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:54 smithi098 ceph-mon[35737]: mgrmap e26: smithi098.wrcvbg(active, since 64s), standbys: smithi027.tlgpqo 2024-09-20T19:06:54.794 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:54 smithi027 ceph-mon[28196]: pgmap v35: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 88 op/s 2024-09-20T19:06:54.794 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:54 smithi027 ceph-mon[28196]: mgrmap e26: smithi098.wrcvbg(active, since 64s), standbys: smithi027.tlgpqo 2024-09-20T19:06:56.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:56 smithi027 ceph-mon[28196]: pgmap v36: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 117 op/s 2024-09-20T19:06:56.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:56 smithi098 ceph-mon[35737]: pgmap v36: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 117 op/s 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.885 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: Activating manager daemon smithi027.tlgpqo 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd='[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]': finished 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: mgrmap e27: smithi027.tlgpqo(active, starting, since 0.00605753s) 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:06:57.886 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:57.887 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:06:57.888 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:06:57.888 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 172.21.15.98:0/3888185908' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:06:57.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: Activating manager daemon smithi027.tlgpqo 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14676 ' entity='mgr.smithi098.wrcvbg' cmd='[{"prefix": "mgr fail", "who": "smithi098.wrcvbg"}]': finished 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: mgrmap e27: smithi027.tlgpqo(active, starting, since 0.00605753s) 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi027.tlgpqo", "id": "smithi027.tlgpqo"}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T19:06:57.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: Manager daemon smithi027.tlgpqo is now available 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/mirror_snapshot_schedule"}]: dispatch 2024-09-20T19:06:57.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi027.tlgpqo/trash_purge_schedule"}]: dispatch 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 -- 172.21.15.27:0/1468872990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 msgr2=0x7f0844102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 --2- 172.21.15.27:0/1468872990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f0844102ff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0834009880 tx=0x7f083402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 -- 172.21.15.27:0/1468872990 shutdown_connections 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 --2- 172.21.15.27:0/1468872990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f0844102ff0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 --2- 172.21.15.27:0/1468872990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f0844101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 -- 172.21.15.27:0/1468872990 >> 172.21.15.27:0/1468872990 conn(0x7f08440fd140 msgr2=0x7f08440ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 -- 172.21.15.27:0/1468872990 shutdown_connections 2024-09-20T19:06:58.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.074+0000 7f084c441640 1 -- 172.21.15.27:0/1468872990 wait complete. 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 Processor -- start 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 -- start start 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f08441979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f084410a790 con 0x7f0844102b70 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084c441640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f084410a610 con 0x7f0844101970 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f08499dc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f08441979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.075+0000 7f084a1dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:56934/0 (socket says 172.21.15.27:56934) 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 -- 172.21.15.27:0/2778966924 learned_addr learned my addr 172.21.15.27:0/2778966924 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 -- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 msgr2=0x7f08441979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f08441979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 -- 172.21.15.27:0/2778966924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844198070 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084a1dd640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f084000e940 tx=0x7f084000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f084000cac0 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.076+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084419cab0 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.077+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f084000cc60 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.077+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0840003de0 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.077+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084419d010 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.078+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0844101d70 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.078+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 28) ==== 51778+0+0 (secure 0 0 0) 0x7f08400104c0 con 0x7f0844101970 2024-09-20T19:06:58.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.078+0000 7f083b7fe640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 0x7f0830041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.078+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f0840055a30 con 0x7f0844101970 2024-09-20T19:06:58.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.078+0000 7f08499dc640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 0x7f0830041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.079+0000 7f08499dc640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 0x7f0830041ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0834000c00 tx=0x7f08340058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.083+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0840057e20 con 0x7f0844101970 2024-09-20T19:06:58.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.324+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08440626f0 con 0x7f083003f7e0 2024-09-20T19:06:58.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.325+0000 7f083b7fe640 1 -- 172.21.15.27:0/2778966924 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f08440626f0 con 0x7f083003f7e0 2024-09-20T19:06:58.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 msgr2=0x7f0830041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 0x7f0830041ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0834000c00 tx=0x7f08340058d0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 msgr2=0x7f08441974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f084000e940 tx=0x7f084000ee00 comp rx=0 tx=0).stop 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 shutdown_connections 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f083003f7e0 0x7f0830041ca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0844102b70 0x7f08441979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 --2- 172.21.15.27:0/2778966924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0844101970 0x7f08441974b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 >> 172.21.15.27:0/2778966924 conn(0x7f08440fd140 msgr2=0x7f0844106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 shutdown_connections 2024-09-20T19:06:58.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.328+0000 7f084c441640 1 -- 172.21.15.27:0/2778966924 wait complete. 2024-09-20T19:06:58.344 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:06:58.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 -- 172.21.15.27:0/573592734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 msgr2=0x7fdbe4107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/573592734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4107190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009880 tx=0x7fdbd402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 -- 172.21.15.27:0/573592734 shutdown_connections 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/573592734 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4107190 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/573592734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 0x7fdbe4104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 -- 172.21.15.27:0/573592734 >> 172.21.15.27:0/573592734 conn(0x7fdbe40fc010 msgr2=0x7fdbe40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 -- 172.21.15.27:0/573592734 shutdown_connections 2024-09-20T19:06:58.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.432+0000 7fdbec6e8640 1 -- 172.21.15.27:0/573592734 wait complete. 2024-09-20T19:06:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 Processor -- start 2024-09-20T19:06:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 -- start start 2024-09-20T19:06:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 0x7fdbe4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe410a7a0 con 0x7fdbe4104da0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbec6e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe410a620 con 0x7fdbe4102470 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbe9c83640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbe9c83640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48610/0 (socket says 172.21.15.27:48610) 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbe9c83640 1 -- 172.21.15.27:0/3923870680 learned_addr learned my addr 172.21.15.27:0/3923870680 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.433+0000 7fdbea484640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 0x7fdbe4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbe9c83640 1 -- 172.21.15.27:0/3923870680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 msgr2=0x7fdbe4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbe9c83640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 0x7fdbe4197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbe9c83640 1 -- 172.21.15.27:0/3923870680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe41980c0 con 0x7fdbe4104da0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbe9c83640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006010 tx=0x7fdbd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd403f070 con 0x7fdbe4104da0 2024-09-20T19:06:58.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe419caa0 con 0x7fdbe4104da0 2024-09-20T19:06:58.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdbd40049d0 con 0x7fdbe4104da0 2024-09-20T19:06:58.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd4035030 con 0x7fdbe4104da0 2024-09-20T19:06:58.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.434+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe419d030 con 0x7fdbe4104da0 2024-09-20T19:06:58.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.435+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe4102850 con 0x7fdbe4104da0 2024-09-20T19:06:58.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.435+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) ==== 51778+0+0 (secure 0 0 0) 0x7fdbd4042070 con 0x7fdbe4104da0 2024-09-20T19:06:58.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.436+0000 7fdbdb7fe640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 0x7fdbd0041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.436+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fdbd4075dd0 con 0x7fdbe4104da0 2024-09-20T19:06:58.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.436+0000 7fdbea484640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 0x7fdbd0041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.437+0000 7fdbea484640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 0x7fdbd0041ca0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009bd0 tx=0x7fdbe0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.442+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdbd4036260 con 0x7fdbe4104da0 2024-09-20T19:06:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.667+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdbe4105780 con 0x7fdbd003f7e0 2024-09-20T19:06:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.669+0000 7fdbdb7fe640 1 -- 172.21.15.27:0/3923870680 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fdbe4105780 con 0x7fdbd003f7e0 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 msgr2=0x7fdbd0041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 0x7fdbd0041ca0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009bd0 tx=0x7fdbe0005f90 comp rx=0 tx=0).stop 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 msgr2=0x7fdbe4197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006010 tx=0x7fdbd40045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 shutdown_connections 2024-09-20T19:06:58.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdbd003f7e0 0x7fdbd0041ca0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdbe4104da0 0x7fdbe4197a40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 --2- 172.21.15.27:0/3923870680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe4102470 0x7fdbe4197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 >> 172.21.15.27:0/3923870680 conn(0x7fdbe40fc010 msgr2=0x7fdbe40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:58.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 shutdown_connections 2024-09-20T19:06:58.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.671+0000 7fdbec6e8640 1 -- 172.21.15.27:0/3923870680 wait complete. 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.758+0000 7faee2dde640 1 -- 172.21.15.27:0/3953431753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc104d80 msgr2=0x7faedc107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.758+0000 7faee2dde640 1 --2- 172.21.15.27:0/3953431753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc104d80 0x7faedc107170 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faec8009880 tx=0x7faec802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 -- 172.21.15.27:0/3953431753 shutdown_connections 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 --2- 172.21.15.27:0/3953431753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc104d80 0x7faedc107170 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 --2- 172.21.15.27:0/3953431753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc102450 0x7faedc104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 -- 172.21.15.27:0/3953431753 >> 172.21.15.27:0/3953431753 conn(0x7faedc0fc010 msgr2=0x7faedc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 -- 172.21.15.27:0/3953431753 shutdown_connections 2024-09-20T19:06:58.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 -- 172.21.15.27:0/3953431753 wait complete. 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 Processor -- start 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.759+0000 7faee2dde640 1 -- start start 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee2dde640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee2dde640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc104d80 0x7faedc100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee2dde640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faedc10a720 con 0x7faedc102450 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee2dde640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faedc10a5a0 con 0x7faedc104d80 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48618/0 (socket says 172.21.15.27:48618) 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 -- 172.21.15.27:0/2603615125 learned_addr learned my addr 172.21.15.27:0/2603615125 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faedbfff640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc104d80 0x7faedc100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 -- 172.21.15.27:0/2603615125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc104d80 msgr2=0x7faedc100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc104d80 0x7faedc100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 -- 172.21.15.27:0/2603615125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc100940 con 0x7faedc102450 2024-09-20T19:06:58.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee0b7a640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faed000d8d0 tx=0x7faed000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faed0017030 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faed0004020 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.760+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc100c30 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.761+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faed00047a0 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.761+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc101190 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.761+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) ==== 51778+0+0 (secure 0 0 0) 0x7faed0004a50 con 0x7faedc102450 2024-09-20T19:06:58.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.762+0000 7faed9ffb640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 0x7faecc041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.762+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7faed0018070 con 0x7faedc102450 2024-09-20T19:06:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.762+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faedc102830 con 0x7faedc102450 2024-09-20T19:06:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.762+0000 7faedbfff640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 0x7faecc041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.762+0000 7faedbfff640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 0x7faecc041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faec8009230 tx=0x7faec80058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:58.767+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7faed0005000 con 0x7faedc102450 2024-09-20T19:06:58.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:58 smithi027 ceph-mon[28196]: mgrmap e28: smithi027.tlgpqo(active, since 1.01132s) 2024-09-20T19:06:58.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:58 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:06:58.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:58 smithi027 ceph-mon[28196]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:58.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:58 smithi027 ceph-mon[28196]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:58.941 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:58 smithi027 ceph-mon[28196]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:59.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.007+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faedc105760 con 0x7faecc03f7e0 2024-09-20T19:06:59.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.025+0000 7faed9ffb640 1 -- 172.21.15.27:0/2603615125 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7faedc105760 con 0x7faecc03f7e0 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (7m) 6s ago 9m 25.0M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (31s) 6s ago 9m 8098k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (21s) 9s ago 8m 8124k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (9m) 6s ago 9m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (8m) 9s ago 8m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (7m) 6s ago 8m 79.7M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (3m) 6s ago 3m 282M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (3m) 6s ago 3m 14.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:06:59.030 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (3m) 9s ago 3m 247M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (3m) 9s ago 3m 14.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (13s) 6s ago 10m 63.4M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (112s) 9s ago 8m 508M - 19.3.0-5099-g88deadb8 441f9a3fe515 c9edfbf21dc4 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (10m) 6s ago 10m 54.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (8m) 9s ago 8m 41.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (9m) 6s ago 9m 15.9M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 9s ago 8m 15.1M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (7m) 6s ago 7m 177M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (6m) 6s ago 6m 184M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (6m) 6s ago 6m 175M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (5m) 9s ago 5m 208M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (5m) 9s ago 5m 179M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (4m) 9s ago 4m 164M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:06:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (26s) 6s ago 8m 39.8M - 2.43.0 a07b618ecd1d ce72b250b939 2024-09-20T19:06:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 msgr2=0x7faecc041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 0x7faecc041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faec8009230 tx=0x7faec80058d0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 msgr2=0x7faedc101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faed000d8d0 tx=0x7faed000dd90 comp rx=0 tx=0).stop 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 shutdown_connections 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faecc03f7e0 0x7faecc041ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faedc104d80 0x7faedc100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 --2- 172.21.15.27:0/2603615125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faedc102450 0x7faedc101d40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.030+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 >> 172.21.15.27:0/2603615125 conn(0x7faedc0fc010 msgr2=0x7faedc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:59.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.031+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 shutdown_connections 2024-09-20T19:06:59.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.031+0000 7faee2dde640 1 -- 172.21.15.27:0/2603615125 wait complete. 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 -- 172.21.15.27:0/265306167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 msgr2=0x7ffbf0101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/265306167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf0101000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009880 tx=0x7ffbe002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 -- 172.21.15.27:0/265306167 shutdown_connections 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/265306167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf0101000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/265306167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf0100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 -- 172.21.15.27:0/265306167 >> 172.21.15.27:0/265306167 conn(0x7ffbf00fc010 msgr2=0x7ffbf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.158+0000 7ffbf76c7640 1 -- 172.21.15.27:0/265306167 shutdown_connections 2024-09-20T19:06:59.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.159+0000 7ffbf76c7640 1 -- 172.21.15.27:0/265306167 wait complete. 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.159+0000 7ffbf76c7640 1 Processor -- start 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.159+0000 7ffbf76c7640 1 -- start start 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf76c7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf76c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf76c7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0102910 con 0x7ffbf0100260 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf76c7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0102790 con 0x7ffbf0100ba0 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf5463640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf5463640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48648/0 (socket says 172.21.15.27:48648) 2024-09-20T19:06:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf5463640 1 -- 172.21.15.27:0/3725943259 learned_addr learned my addr 172.21.15.27:0/3725943259 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.160+0000 7ffbf4c62640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.161+0000 7ffbf5463640 1 -- 172.21.15.27:0/3725943259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 msgr2=0x7ffbf019e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.161+0000 7ffbf5463640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf019e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.161+0000 7ffbf5463640 1 -- 172.21.15.27:0/3725943259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf019e7f0 con 0x7ffbf0100260 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.161+0000 7ffbf5463640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00e9e0 tx=0x7ffbec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.162+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbec00cb50 con 0x7ffbf0100260 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.162+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbec00ccf0 con 0x7ffbf0100260 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.162+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbec0049d0 con 0x7ffbf0100260 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.162+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf01a3230 con 0x7ffbf0100260 2024-09-20T19:06:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.162+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a37c0 con 0x7ffbf0100260 2024-09-20T19:06:59.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.165+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) ==== 51778+0+0 (secure 0 0 0) 0x7ffbec004b70 con 0x7ffbf0100260 2024-09-20T19:06:59.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.165+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0100660 con 0x7ffbf0100260 2024-09-20T19:06:59.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.165+0000 7ffbe67fc640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 0x7ffbdc041d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.166+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7ffbec055390 con 0x7ffbf0100260 2024-09-20T19:06:59.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.167+0000 7ffbf4c62640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 0x7ffbdc041d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.170+0000 7ffbf4c62640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 0x7ffbdc041d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffbf019f0e0 tx=0x7ffbe0009600 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:59.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.174+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ffbec004020 con 0x7ffbf0100260 2024-09-20T19:06:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:58 smithi098 ceph-mon[35737]: mgrmap e28: smithi027.tlgpqo(active, since 1.01132s) 2024-09-20T19:06:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:58 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:06:59.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:58 smithi098 ceph-mon[35737]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:59.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:58 smithi098 ceph-mon[35737]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:59.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:58 smithi098 ceph-mon[35737]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:59.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.452+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ffbf0062df0 con 0x7ffbf0100260 2024-09-20T19:06:59.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.452+0000 7ffbe67fc640 1 -- 172.21.15.27:0/3725943259 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7ffbec007d50 con 0x7ffbf0100260 2024-09-20T19:06:59.456 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:06:59.456 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:06:59.457 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:06:59.458 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:06:59.458 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:06:59.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 msgr2=0x7ffbdc041d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 0x7ffbdc041d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffbf019f0e0 tx=0x7ffbe0009600 comp rx=0 tx=0).stop 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 msgr2=0x7ffbf019dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffbec00e9e0 tx=0x7ffbec00eea0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 shutdown_connections 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffbdc03f860 0x7ffbdc041d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbf0100ba0 0x7ffbf019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 --2- 172.21.15.27:0/3725943259 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffbf0100260 0x7ffbf019dc30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.454+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 >> 172.21.15.27:0/3725943259 conn(0x7ffbf00fc010 msgr2=0x7ffbf0105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:59.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.455+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 shutdown_connections 2024-09-20T19:06:59.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.455+0000 7ffbf76c7640 1 -- 172.21.15.27:0/3725943259 wait complete. 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 -- 172.21.15.27:0/3519705481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 msgr2=0x7f5ad0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3519705481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0101ee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009880 tx=0x7f5ac402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 -- 172.21.15.27:0/3519705481 shutdown_connections 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3519705481 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0101ee0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3519705481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 0x7f5ad0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.542+0000 7f5ad661a640 1 -- 172.21.15.27:0/3519705481 >> 172.21.15.27:0/3519705481 conn(0x7f5ad00fc010 msgr2=0x7f5ad00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:59.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.543+0000 7f5ad661a640 1 -- 172.21.15.27:0/3519705481 shutdown_connections 2024-09-20T19:06:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.543+0000 7f5ad661a640 1 -- 172.21.15.27:0/3519705481 wait complete. 2024-09-20T19:06:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.543+0000 7f5ad661a640 1 Processor -- start 2024-09-20T19:06:59.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.543+0000 7f5ad661a640 1 -- start start 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5ad661a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 0x7f5ad01974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5ad661a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5ad661a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad006aa60 con 0x7f5ad0101a60 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5ad661a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad006a8e0 con 0x7f5ad0100860 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48664/0 (socket says 172.21.15.27:48664) 2024-09-20T19:06:59.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 -- 172.21.15.27:0/3202797397 learned_addr learned my addr 172.21.15.27:0/3202797397 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acffff640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 0x7f5ad01974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 -- 172.21.15.27:0/3202797397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 msgr2=0x7f5ad01974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 0x7f5ad01974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 -- 172.21.15.27:0/3202797397 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0198090 con 0x7f5ad0101a60 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acf7fe640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006010 tx=0x7f5ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.544+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ac403f070 con 0x7f5ad0101a60 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.545+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ac4004ac0 con 0x7f5ad0101a60 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.545+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ac4035030 con 0x7f5ad0101a60 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.545+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad019ca70 con 0x7f5ad0101a60 2024-09-20T19:06:59.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.545+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad019d000 con 0x7f5ad0101a60 2024-09-20T19:06:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 28) ==== 51778+0+0 (secure 0 0 0) 0x7f5ac4042070 con 0x7f5ad0101a60 2024-09-20T19:06:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad0100c60 con 0x7f5ad0101a60 2024-09-20T19:06:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5acd7fa640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 0x7f5ab8041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f5ac4075f00 con 0x7f5ad0101a60 2024-09-20T19:06:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5acffff640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 0x7f5ab8041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.546+0000 7f5acffff640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 0x7f5ab8041ca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0005fd0 tx=0x7f5ac000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:59.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.551+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5ac4003cd0 con 0x7f5ad0101a60 2024-09-20T19:06:59.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.778+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ad0062630 con 0x7f5ab803f7e0 2024-09-20T19:06:59.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.779+0000 7f5acd7fa640 1 -- 172.21.15.27:0/3202797397 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f5ad0062630 con 0x7f5ab803f7e0 2024-09-20T19:06:59.783 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:06:59.783 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "", 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:06:59.784 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:06:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 msgr2=0x7f5ab8041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 0x7f5ab8041ca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0005fd0 tx=0x7f5ac000b390 comp rx=0 tx=0).stop 2024-09-20T19:06:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 msgr2=0x7f5ad0197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006010 tx=0x7f5ac40046c0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 shutdown_connections 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5ab803f7e0 0x7f5ab8041ca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ad0101a60 0x7f5ad0197a10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 --2- 172.21.15.27:0/3202797397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ad0100860 0x7f5ad01974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 >> 172.21.15.27:0/3202797397 conn(0x7f5ad00fc010 msgr2=0x7f5ad0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 shutdown_connections 2024-09-20T19:06:59.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:06:59.782+0000 7f5ad661a640 1 -- 172.21.15.27:0/3202797397 wait complete. 2024-09-20T19:07:00.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: [20/Sep/2024:19:06:59] ENGINE Bus STARTING 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: [20/Sep/2024:19:06:59] ENGINE Serving on http://172.21.15.27:8765 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: [20/Sep/2024:19:06:59] ENGINE Serving on https://172.21.15.27:7150 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: [20/Sep/2024:19:06:59] ENGINE Bus STARTED 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: [20/Sep/2024:19:06:59] ENGINE Error in HTTPServer.serve 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Traceback (most recent call last): 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._run(expiration_interval) 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T19:07:00.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s = self.context.wrap_socket( 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: return self.sslsocket_class._create( 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self.do_handshake() 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._sslobj.do_handshake() 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3725943259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:00.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:06:59 smithi098 ceph-mon[35737]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:00.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: [20/Sep/2024:19:06:59] ENGINE Bus STARTING 2024-09-20T19:07:00.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:00.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: [20/Sep/2024:19:06:59] ENGINE Serving on http://172.21.15.27:8765 2024-09-20T19:07:00.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: [20/Sep/2024:19:06:59] ENGINE Serving on https://172.21.15.27:7150 2024-09-20T19:07:00.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: [20/Sep/2024:19:06:59] ENGINE Bus STARTED 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: [20/Sep/2024:19:06:59] ENGINE Error in HTTPServer.serve 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Traceback (most recent call last): 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._run(expiration_interval) 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T19:07:00.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: s = self.context.wrap_socket( 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: return self.sslsocket_class._create( 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self.do_handshake() 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: self._sslobj.do_handshake() 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3725943259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:00.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:06:59 smithi027 ceph-mon[28196]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:01.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:00 smithi098 ceph-mon[35737]: mgrmap e29: smithi027.tlgpqo(active, since 3s) 2024-09-20T19:07:01.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:00 smithi027 ceph-mon[28196]: mgrmap e29: smithi027.tlgpqo(active, since 3s) 2024-09-20T19:07:02.210 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:01 smithi027 ceph-mon[28196]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:01 smithi098 ceph-mon[35737]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:03.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:02 smithi098 ceph-mon[35737]: mgrmap e30: smithi027.tlgpqo(active, since 5s) 2024-09-20T19:07:03.259 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:02 smithi027 ceph-mon[28196]: mgrmap e30: smithi027.tlgpqo(active, since 5s) 2024-09-20T19:07:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 707 KiB/s rd, 677 KiB/s wr, 18 op/s 2024-09-20T19:07:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:07:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:07:04.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:07:04.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:07:04.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:03 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 707 KiB/s rd, 677 KiB/s wr, 18 op/s 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:07:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:03 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/4238604117' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:07:05.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:04 smithi098 ceph-mon[35737]: mgrmap e31: smithi027.tlgpqo(active, since 7s), standbys: smithi098.wrcvbg 2024-09-20T19:07:05.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:04 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:07:05.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:04 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:05.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:04 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:05.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:04 smithi027 ceph-mon[28196]: mgrmap e31: smithi027.tlgpqo(active, since 7s), standbys: smithi098.wrcvbg 2024-09-20T19:07:05.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:04 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.wrcvbg", "id": "smithi098.wrcvbg"}]: dispatch 2024-09-20T19:07:05.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:04 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:05.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:04 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:06.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:06 smithi027 ceph-mon[28196]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-20T19:07:06.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:06 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:06.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:06 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:06.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:06 smithi098 ceph-mon[35737]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 66 op/s 2024-09-20T19:07:06.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:06 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:06.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:06 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:08.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:08 smithi027 ceph-mon[28196]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 805 KiB/s rd, 924 KiB/s wr, 51 op/s 2024-09-20T19:07:08.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:08 smithi098 ceph-mon[35737]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 805 KiB/s rd, 924 KiB/s wr, 51 op/s 2024-09-20T19:07:10.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:10 smithi027 ceph-mon[28196]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 432 op/s 2024-09-20T19:07:10.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:10 smithi098 ceph-mon[35737]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 432 op/s 2024-09-20T19:07:11.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:11 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:11.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:11 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:11 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:12.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:11 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:12 smithi098 ceph-mon[35737]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 396 op/s 2024-09-20T19:07:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:12 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:13.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:12 smithi027 ceph-mon[28196]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 396 op/s 2024-09-20T19:07:13.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:12 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:14.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:14 smithi098 ceph-mon[35737]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 504 op/s 2024-09-20T19:07:15.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:14 smithi027 ceph-mon[28196]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 504 op/s 2024-09-20T19:07:16.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: pgmap v12: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 576 op/s 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:07:16.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:15 smithi098 ceph-mon[35737]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: pgmap v12: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 576 op/s 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:16.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:07:16.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-20T19:07:16.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-20T19:07:16.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:07:16.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:15 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T19:07:17.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:07:17.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:07:17.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T19:07:17.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:17 smithi098 ceph-mon[35737]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T19:07:17.494 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:07:17.494 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-20T19:07:17.494 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Updating smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Updating smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Reconfiguring prometheus.smithi027 (dependencies changed)... 2024-09-20T19:07:17.495 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:17 smithi027 ceph-mon[28196]: Reconfiguring daemon prometheus.smithi027 on smithi027 2024-09-20T19:07:18.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:18 smithi027 ceph-mon[28196]: pgmap v13: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 545 op/s 2024-09-20T19:07:18.696 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:18 smithi098 ceph-mon[35737]: pgmap v13: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 545 op/s 2024-09-20T19:07:20.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:20 smithi027 ceph-mon[28196]: pgmap v14: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 690 op/s 2024-09-20T19:07:20.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:20 smithi098 ceph-mon[35737]: pgmap v14: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 690 op/s 2024-09-20T19:07:22.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:22 smithi027 ceph-mon[28196]: pgmap v15: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 332 op/s 2024-09-20T19:07:22.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:22 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:22.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:22 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:22.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:22 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:07:22.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:22 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:22.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:22 smithi098 ceph-mon[35737]: pgmap v15: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 332 op/s 2024-09-20T19:07:22.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:22 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:22.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:22 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:22.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:22 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:07:22.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:22 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:23.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:23 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:07:23.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:23 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:07:24.558 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:24 smithi098 ceph-mon[35737]: pgmap v16: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 400 op/s 2024-09-20T19:07:24.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:24 smithi027 ceph-mon[28196]: pgmap v16: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 400 op/s 2024-09-20T19:07:26.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:26 smithi027 ceph-mon[28196]: pgmap v17: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-09-20T19:07:26.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:26 smithi098 ceph-mon[35737]: pgmap v17: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-09-20T19:07:28.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:28 smithi027 ceph-mon[28196]: pgmap v18: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 251 op/s 2024-09-20T19:07:28.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:28 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:28.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:28 smithi098 ceph-mon[35737]: pgmap v18: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 251 op/s 2024-09-20T19:07:28.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:28 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:29.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1219968603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50101a60 msgr2=0x7f9c50101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:29.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1219968603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50101a60 0x7f9c50101ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009880 tx=0x7f9c3c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:29.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1219968603 shutdown_connections 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1219968603 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50101a60 0x7f9c50101ee0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1219968603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50100860 0x7f9c50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1219968603 >> 172.21.15.27:0/1219968603 conn(0x7f9c500fc010 msgr2=0x7f9c500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1219968603 shutdown_connections 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.876+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1219968603 wait complete. 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 Processor -- start 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 -- start start 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 0x7f9c50197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c501096a0 con 0x7f9c50100860 2024-09-20T19:07:29.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c56fc4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c50109520 con 0x7f9c50101a60 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c54d60640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c54d60640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49788/0 (socket says 172.21.15.27:49788) 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c54d60640 1 -- 172.21.15.27:0/1678443932 learned_addr learned my addr 172.21.15.27:0/1678443932 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.877+0000 7f9c4ffff640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 0x7f9c50197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c54d60640 1 -- 172.21.15.27:0/1678443932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 msgr2=0x7f9c50197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c54d60640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 0x7f9c50197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c54d60640 1 -- 172.21.15.27:0/1678443932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c50198100 con 0x7f9c50100860 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c4ffff640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 0x7f9c50197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c54d60640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e940 tx=0x7f9c4400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c4400cac0 con 0x7f9c50100860 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c4400cc60 con 0x7f9c50100860 2024-09-20T19:07:29.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5019cad0 con 0x7f9c50100860 2024-09-20T19:07:29.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c44003e30 con 0x7f9c50100860 2024-09-20T19:07:29.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.878+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5019d030 con 0x7f9c50100860 2024-09-20T19:07:29.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.879+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c50109e80 con 0x7f9c50100860 2024-09-20T19:07:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.880+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f9c44004000 con 0x7f9c50100860 2024-09-20T19:07:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.881+0000 7f9c4dffb640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 0x7f9c4007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.881+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f9c4409e820 con 0x7f9c50100860 2024-09-20T19:07:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.881+0000 7f9c4ffff640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 0x7f9c4007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.881+0000 7f9c4ffff640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 0x7f9c4007d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c00 tx=0x7f9c3c0058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:29.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:29.886+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9c44069c00 con 0x7f9c50100860 2024-09-20T19:07:30.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.105+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9c5006a8c0 con 0x7f9c4007b050 2024-09-20T19:07:30.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.106+0000 7f9c4dffb640 1 -- 172.21.15.27:0/1678443932 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f9c5006a8c0 con 0x7f9c4007b050 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 msgr2=0x7f9c4007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 0x7f9c4007d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c00 tx=0x7f9c3c0058d0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 msgr2=0x7f9c50197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e940 tx=0x7f9c4400ee00 comp rx=0 tx=0).stop 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 shutdown_connections 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9c4007b050 0x7f9c4007d510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c50101a60 0x7f9c50197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 --2- 172.21.15.27:0/1678443932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c50100860 0x7f9c50197540 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 >> 172.21.15.27:0/1678443932 conn(0x7f9c500fc010 msgr2=0x7f9c5006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 shutdown_connections 2024-09-20T19:07:30.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.109+0000 7f9c56fc4640 1 -- 172.21.15.27:0/1678443932 wait complete. 2024-09-20T19:07:30.126 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:07:30.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.209+0000 7f16eb7fe640 1 -- 172.21.15.27:0/3740314295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16e0031740 con 0x7f16ec102b70 2024-09-20T19:07:30.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 -- 172.21.15.27:0/3740314295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec102b70 msgr2=0x7f16ec102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 --2- 172.21.15.27:0/3740314295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec102b70 0x7f16ec102ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009880 tx=0x7f16e002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 -- 172.21.15.27:0/3740314295 shutdown_connections 2024-09-20T19:07:30.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 --2- 172.21.15.27:0/3740314295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec102b70 0x7f16ec102ff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 --2- 172.21.15.27:0/3740314295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec101970 0x7f16ec101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 -- 172.21.15.27:0/3740314295 >> 172.21.15.27:0/3740314295 conn(0x7f16ec0fd140 msgr2=0x7f16ec0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 -- 172.21.15.27:0/3740314295 shutdown_connections 2024-09-20T19:07:30.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.210+0000 7f16f2b17640 1 -- 172.21.15.27:0/3740314295 wait complete. 2024-09-20T19:07:30.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 Processor -- start 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 -- start start 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec102b70 0x7f16ec199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec074f30 con 0x7f16ec101970 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.211+0000 7f16f2b17640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec074db0 con 0x7f16ec102b70 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49804/0 (socket says 172.21.15.27:49804) 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 -- 172.21.15.27:0/919359946 learned_addr learned my addr 172.21.15.27:0/919359946 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:07:30.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16ebfff640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec102b70 0x7f16ec199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 -- 172.21.15.27:0/919359946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec102b70 msgr2=0x7f16ec199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec102b70 0x7f16ec199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.212+0000 7f16f08b3640 1 -- 172.21.15.27:0/919359946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec19a2b0 con 0x7f16ec101970 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16f08b3640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00d8d0 tx=0x7f16dc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16dc017070 con 0x7f16ec101970 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec19ecf0 con 0x7f16ec101970 2024-09-20T19:07:30.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16dc00be10 con 0x7f16ec101970 2024-09-20T19:07:30.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16dc00f3c0 con 0x7f16ec101970 2024-09-20T19:07:30.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.213+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec19f1a0 con 0x7f16ec101970 2024-09-20T19:07:30.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.215+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ec0762c0 con 0x7f16ec101970 2024-09-20T19:07:30.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.215+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f16dc01a070 con 0x7f16ec101970 2024-09-20T19:07:30.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.216+0000 7f16e9ffb640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 0x7f16d407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.216+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f16dc09dd30 con 0x7f16ec101970 2024-09-20T19:07:30.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.216+0000 7f16ebfff640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 0x7f16d407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.217+0000 7f16ebfff640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 0x7f16d407d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16e0000c00 tx=0x7f16e00058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.223+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f16dc069190 con 0x7f16ec101970 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: pgmap v19: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 317 op/s 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: Upgrade: Updating mgr.smithi098.wrcvbg 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:30.319 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:30 smithi098 ceph-mon[35737]: Deploying daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T19:07:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.494+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f16ec0fe430 con 0x7f16d407b0b0 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: pgmap v19: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 317 op/s 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: Upgrade: Updating mgr.smithi098.wrcvbg 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.wrcvbg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:30.500 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:30 smithi027 ceph-mon[28196]: Deploying daemon mgr.smithi098.wrcvbg on smithi098 2024-09-20T19:07:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.496+0000 7f16e9ffb640 1 -- 172.21.15.27:0/919359946 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f16ec0fe430 con 0x7f16d407b0b0 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 msgr2=0x7f16d407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 0x7f16d407d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16e0000c00 tx=0x7f16e00058d0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 msgr2=0x7f16ec1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00d8d0 tx=0x7f16dc00dd90 comp rx=0 tx=0).stop 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 shutdown_connections 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f16d407b0b0 0x7f16d407d570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16ec102b70 0x7f16ec199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 --2- 172.21.15.27:0/919359946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f16ec101970 0x7f16ec1996f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 >> 172.21.15.27:0/919359946 conn(0x7f16ec0fd140 msgr2=0x7f16ec0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 shutdown_connections 2024-09-20T19:07:30.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.498+0000 7f16f2b17640 1 -- 172.21.15.27:0/919359946 wait complete. 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 -- 172.21.15.27:0/4262218211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 msgr2=0x7fc850104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 --2- 172.21.15.27:0/4262218211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850104840 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc840009880 tx=0x7fc84002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 -- 172.21.15.27:0/4262218211 shutdown_connections 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 --2- 172.21.15.27:0/4262218211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 0x7fc850107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 --2- 172.21.15.27:0/4262218211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850104840 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 -- 172.21.15.27:0/4262218211 >> 172.21.15.27:0/4262218211 conn(0x7fc8500fc010 msgr2=0x7fc8500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 -- 172.21.15.27:0/4262218211 shutdown_connections 2024-09-20T19:07:30.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.587+0000 7fc854a19640 1 -- 172.21.15.27:0/4262218211 wait complete. 2024-09-20T19:07:30.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 Processor -- start 2024-09-20T19:07:30.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 -- start start 2024-09-20T19:07:30.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 0x7fc850197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc85010a750 con 0x7fc850102450 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc854a19640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc85010a5d0 con 0x7fc850104d80 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc84e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc84e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49826/0 (socket says 172.21.15.27:49826) 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc84e59c640 1 -- 172.21.15.27:0/3314320052 learned_addr learned my addr 172.21.15.27:0/3314320052 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.588+0000 7fc84dd9b640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 0x7fc850197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc84e59c640 1 -- 172.21.15.27:0/3314320052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 msgr2=0x7fc850197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc84e59c640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 0x7fc850197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc84e59c640 1 -- 172.21.15.27:0/3314320052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850198010 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc84e59c640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc840006010 tx=0x7fc8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc84003f070 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc840004ac0 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85019ca50 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc840035030 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.589+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85019cfe0 con 0x7fc850102450 2024-09-20T19:07:30.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.590+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc850102830 con 0x7fc850102450 2024-09-20T19:07:30.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.591+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fc840042070 con 0x7fc850102450 2024-09-20T19:07:30.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.592+0000 7fc83f7fe640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 0x7fc83807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.592+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fc8400bed00 con 0x7fc850102450 2024-09-20T19:07:30.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.592+0000 7fc84dd9b640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 0x7fc83807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.592+0000 7fc84dd9b640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 0x7fc83807d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc850198900 tx=0x7fc84400b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.597+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc8400c2030 con 0x7fc850102450 2024-09-20T19:07:30.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.811+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc850105640 con 0x7fc83807b0b0 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.821+0000 7fc83f7fe640 1 -- 172.21.15.27:0/3314320052 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc850105640 con 0x7fc83807b0b0 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (8m) 26s ago 9m 25.0M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (63s) 26s ago 9m 8124k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (53s) 15s ago 9m 8238k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:07:30.826 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (9m) 26s ago 9m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (8m) 15s ago 8m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (8m) 26s ago 9m 78.0M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (4m) 26s ago 4m 275M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (4m) 26s ago 4m 14.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (4m) 15s ago 4m 241M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (4m) 15s ago 4m 15.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (45s) 26s ago 11m 488M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (2m) 15s ago 8m 121M - 19.3.0-5099-g88deadb8 441f9a3fe515 c9edfbf21dc4 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (11m) 26s ago 11m 57.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (8m) 15s ago 8m 45.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (9m) 26s ago 9m 16.2M - 1.5.0 0da6a335fe13 38e0412cb7bf 2024-09-20T19:07:30.827 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 15s ago 8m 14.7M - 1.5.0 0da6a335fe13 8e79e9324ae3 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (7m) 26s ago 7m 184M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (7m) 26s ago 7m 191M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (6m) 26s ago 6m 182M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (6m) 15s ago 6m 211M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (5m) 15s ago 5m 183M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (5m) 15s ago 5m 167M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:07:30.828 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 starting - - - - 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 msgr2=0x7fc83807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 0x7fc83807d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc850198900 tx=0x7fc84400b410 comp rx=0 tx=0).stop 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 msgr2=0x7fc850197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc840006010 tx=0x7fc8400046c0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 shutdown_connections 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc83807b0b0 0x7fc83807d570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc850104d80 0x7fc850197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 --2- 172.21.15.27:0/3314320052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc850102450 0x7fc850197450 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 >> 172.21.15.27:0/3314320052 conn(0x7fc8500fc010 msgr2=0x7fc8500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 shutdown_connections 2024-09-20T19:07:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.824+0000 7fc854a19640 1 -- 172.21.15.27:0/3314320052 wait complete. 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 -- 172.21.15.27:0/3019187386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0100860 msgr2=0x7f65e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 --2- 172.21.15.27:0/3019187386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0100860 0x7f65e0100c60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009880 tx=0x7f65dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 -- 172.21.15.27:0/3019187386 shutdown_connections 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 --2- 172.21.15.27:0/3019187386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0101a60 0x7f65e0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 --2- 172.21.15.27:0/3019187386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0100860 0x7f65e0100c60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.915+0000 7f65e8593640 1 -- 172.21.15.27:0/3019187386 >> 172.21.15.27:0/3019187386 conn(0x7f65e00fc010 msgr2=0x7f65e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 -- 172.21.15.27:0/3019187386 shutdown_connections 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 -- 172.21.15.27:0/3019187386 wait complete. 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 Processor -- start 2024-09-20T19:07:30.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 -- start start 2024-09-20T19:07:30.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0100860 0x7f65e006ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0109680 con 0x7f65e0101a60 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.916+0000 7f65e8593640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0109500 con 0x7f65e0100860 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49848/0 (socket says 172.21.15.27:49848) 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 -- 172.21.15.27:0/1584455634 learned_addr learned my addr 172.21.15.27:0/1584455634 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e632f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0100860 0x7f65e006ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 -- 172.21.15.27:0/1584455634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0100860 msgr2=0x7f65e006ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0100860 0x7f65e006ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 -- 172.21.15.27:0/1584455634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e019c7d0 con 0x7f65e0101a60 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65e5b2e640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65d000e970 tx=0x7f65d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.917+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65d000cac0 con 0x7f65e0101a60 2024-09-20T19:07:30.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.918+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e019cac0 con 0x7f65e0101a60 2024-09-20T19:07:30.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.918+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e019d050 con 0x7f65e0101a60 2024-09-20T19:07:30.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.918+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65d000cc60 con 0x7f65e0101a60 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.918+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65d0018720 con 0x7f65e0101a60 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.919+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e0100c60 con 0x7f65e0101a60 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.919+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f65d0010430 con 0x7f65e0101a60 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.920+0000 7f65d77fe640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 0x7f65cc07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.920+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f65d009e810 con 0x7f65e0101a60 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.920+0000 7f65e632f640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 0x7f65cc07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.921+0000 7f65e632f640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 0x7f65cc07d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009230 tx=0x7f65dc0058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:30.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:30.925+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f65d0069be0 con 0x7f65e0101a60 2024-09-20T19:07:31.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.206+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f65e002d7c0 con 0x7f65e0101a60 2024-09-20T19:07:31.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.206+0000 7f65d77fe640 1 -- 172.21.15.27:0/1584455634 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f65d006ea90 con 0x7f65e0101a60 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:07:31.212 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:07:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:07:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:31.213 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:07:31.213 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:07:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 msgr2=0x7f65cc07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 0x7f65cc07d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009230 tx=0x7f65dc0058d0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 msgr2=0x7f65e019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65d000e970 tx=0x7f65d000ee30 comp rx=0 tx=0).stop 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 shutdown_connections 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f65cc07b0b0 0x7f65cc07d570 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65e0101a60 0x7f65e019c1e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 --2- 172.21.15.27:0/1584455634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65e0100860 0x7f65e006ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.209+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 >> 172.21.15.27:0/1584455634 conn(0x7f65e00fc010 msgr2=0x7f65e0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.210+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 shutdown_connections 2024-09-20T19:07:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.210+0000 7f65e8593640 1 -- 172.21.15.27:0/1584455634 wait complete. 2024-09-20T19:07:31.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1474889469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 msgr2=0x7f77f4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1474889469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f4101d60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097e0 tx=0x7f77f002a3f0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1474889469 shutdown_connections 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1474889469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 0x7f77f4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1474889469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f4101d60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1474889469 >> 172.21.15.27:0/1474889469 conn(0x7f77f40fd110 msgr2=0x7f77f40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1474889469 shutdown_connections 2024-09-20T19:07:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.335+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1474889469 wait complete. 2024-09-20T19:07:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 Processor -- start 2024-09-20T19:07:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 -- start start 2024-09-20T19:07:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 0x7f77f4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410a7a0 con 0x7f77f4101960 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77fb3ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410a620 con 0x7f77f4102b60 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49874/0 (socket says 172.21.15.27:49874) 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 -- 172.21.15.27:0/1819631534 learned_addr learned my addr 172.21.15.27:0/1819631534 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:07:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f8948640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 0x7f77f4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:31.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 -- 172.21.15.27:0/1819631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 msgr2=0x7f77f4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 0x7f77f4197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.337+0000 7f77f9149640 1 -- 172.21.15.27:0/1819631534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f4198090 con 0x7f77f4101960 2024-09-20T19:07:31.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77f9149640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77f0030750 tx=0x7f77f00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:31.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77f0040070 con 0x7f77f4101960 2024-09-20T19:07:31.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77f0030c00 con 0x7f77f4101960 2024-09-20T19:07:31.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f419ca70 con 0x7f77f4101960 2024-09-20T19:07:31.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f419cf40 con 0x7f77f4101960 2024-09-20T19:07:31.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.339+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77f0003cd0 con 0x7f77f4101960 2024-09-20T19:07:31.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.341+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d80052c0 con 0x7f77f4101960 2024-09-20T19:07:31.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.341+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f77f0039040 con 0x7f77f4101960 2024-09-20T19:07:31.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.341+0000 7f77ea7fc640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 0x7f77e007d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:31.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.343+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f77f00bf5b0 con 0x7f77f4101960 2024-09-20T19:07:31.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.344+0000 7f77f8948640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 0x7f77e007d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.344+0000 7f77f8948640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 0x7f77e007d5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77f4198980 tx=0x7f77e4009260 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:31.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.350+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f77f008b910 con 0x7f77f4101960 2024-09-20T19:07:31.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:31 smithi027 ceph-mon[28196]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:31.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:31 smithi027 ceph-mon[28196]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:31.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:31 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/1584455634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:31.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.584+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f77d8000bf0 con 0x7f77e007b0f0 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.585+0000 7f77ea7fc640 1 -- 172.21.15.27:0/1819631534 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f77d8000bf0 con 0x7f77e007b0f0 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T19:07:31.589 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:07:31.590 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 msgr2=0x7f77e007d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 0x7f77e007d5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77f4198980 tx=0x7f77e4009260 comp rx=0 tx=0).stop 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 msgr2=0x7f77f41974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77f0030750 tx=0x7f77f00043b0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 shutdown_connections 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f77e007b0f0 0x7f77e007d5b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77f4102b60 0x7f77f4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 --2- 172.21.15.27:0/1819631534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77f4101960 0x7f77f41974d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 >> 172.21.15.27:0/1819631534 conn(0x7f77f40fd110 msgr2=0x7f77f40ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 shutdown_connections 2024-09-20T19:07:31.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:07:31.587+0000 7f77fb3ad640 1 -- 172.21.15.27:0/1819631534 wait complete. 2024-09-20T19:07:31.715 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:31 smithi098 ceph-mon[35737]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:31.715 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:31 smithi098 ceph-mon[35737]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:31.715 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:31 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/1584455634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:32 smithi098 ceph-mon[35737]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:32 smithi098 ceph-mon[35737]: pgmap v20: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 173 op/s 2024-09-20T19:07:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:32 smithi098 ceph-mon[35737]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:32.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:32 smithi027 ceph-mon[28196]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:32.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:32 smithi027 ceph-mon[28196]: pgmap v20: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 173 op/s 2024-09-20T19:07:32.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:32 smithi027 ceph-mon[28196]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: pgmap v21: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 229 op/s 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:34 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: pgmap v21: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 229 op/s 2024-09-20T19:07:35.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:35.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:35.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:34 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:36.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:36 smithi098 ceph-mon[35737]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 194 op/s 2024-09-20T19:07:36.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:36 smithi027 ceph-mon[28196]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 194 op/s 2024-09-20T19:07:37.928 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-20T19:07:37.929 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-20T19:07:38.265 DEBUG:teuthology.parallel:result is None 2024-09-20T19:07:38.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:38 smithi098 ceph-mon[35737]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-09-20T19:07:38.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:38 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:38.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:38 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:38.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:38 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:38.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:38 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:39.010 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:38 smithi027 ceph-mon[28196]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-09-20T19:07:39.010 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:38 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:39.010 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:38 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:39.010 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:38 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:39.010 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:38 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:40.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:40 smithi098 ceph-mon[35737]: pgmap v24: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 254 op/s 2024-09-20T19:07:40.852 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:40 smithi027 ceph-mon[28196]: pgmap v24: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 254 op/s 2024-09-20T19:07:41.021 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-20T19:07:41.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-20T19:07:41.357 DEBUG:teuthology.parallel:result is None 2024-09-20T19:07:41.358 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T19:07:41.391 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T19:07:41.391 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-20T19:07:41.422 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-20T19:07:41.423 DEBUG:teuthology.parallel:result is None 2024-09-20T19:07:41.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg restarted 2024-09-20T19:07:41.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:07:41.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:07:41.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:07:41.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:07:41.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:41 smithi098 ceph-mon[35737]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:07:42.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg restarted 2024-09-20T19:07:42.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: Standby manager daemon smithi098.wrcvbg started 2024-09-20T19:07:42.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/crt"}]: dispatch 2024-09-20T19:07:42.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T19:07:42.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.wrcvbg/key"}]: dispatch 2024-09-20T19:07:42.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:41 smithi027 ceph-mon[28196]: from='mgr.? 172.21.15.98:0/591308417' entity='mgr.smithi098.wrcvbg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T19:07:42.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: pgmap v25: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: mgrmap e32: smithi027.tlgpqo(active, since 44s), standbys: smithi098.wrcvbg 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi027.tlgpqo"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi027.tlgpqo"}]': finished 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.wrcvbg"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.wrcvbg"}]': finished 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:42.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:42.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: pgmap v25: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: mgrmap e32: smithi027.tlgpqo(active, since 44s), standbys: smithi098.wrcvbg 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi027.tlgpqo"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi027.tlgpqo"}]': finished 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.wrcvbg"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.wrcvbg"}]': finished 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.071 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:43.072 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:43.727 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all mgr 2024-09-20T19:07:43.727 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all rgw 2024-09-20T19:07:43.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:07:43.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-20T19:07:43.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:07:43.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all nfs 2024-09-20T19:07:43.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:43 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:07:43.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all mgr 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all rgw 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all nfs 2024-09-20T19:07:43.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:43 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:07:44.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:44 smithi027 ceph-mon[28196]: pgmap v26: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2024-09-20T19:07:44.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:44 smithi027 ceph-mon[28196]: Upgrade: Updating node-exporter.smithi027 (1/2) 2024-09-20T19:07:44.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:44 smithi027 ceph-mon[28196]: Deploying daemon node-exporter.smithi027 on smithi027 2024-09-20T19:07:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:44 smithi098 ceph-mon[35737]: pgmap v26: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2024-09-20T19:07:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:44 smithi098 ceph-mon[35737]: Upgrade: Updating node-exporter.smithi027 (1/2) 2024-09-20T19:07:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:44 smithi098 ceph-mon[35737]: Deploying daemon node-exporter.smithi027 on smithi027 2024-09-20T19:07:46.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:46 smithi098 ceph-mon[35737]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 202 op/s 2024-09-20T19:07:47.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:46 smithi027 ceph-mon[28196]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 202 op/s 2024-09-20T19:07:48.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:48 smithi027 ceph-mon[28196]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1010 KiB/s wr, 169 op/s 2024-09-20T19:07:48.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:48 smithi098 ceph-mon[35737]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1010 KiB/s wr, 169 op/s 2024-09-20T19:07:50.062 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:50.062 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:50.062 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:49 smithi098 ceph-mon[35737]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 175 op/s 2024-09-20T19:07:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:50.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:49 smithi027 ceph-mon[28196]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 175 op/s 2024-09-20T19:07:51.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:50 smithi027 ceph-mon[28196]: Upgrade: Updating node-exporter.smithi098 (2/2) 2024-09-20T19:07:51.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:50 smithi027 ceph-mon[28196]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-20T19:07:51.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:50 smithi098 ceph-mon[35737]: Upgrade: Updating node-exporter.smithi098 (2/2) 2024-09-20T19:07:51.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:50 smithi098 ceph-mon[35737]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-20T19:07:52.109 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:51 smithi098 ceph-mon[35737]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 399 KiB/s rd, 381 KiB/s wr, 76 op/s 2024-09-20T19:07:52.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:51 smithi027 ceph-mon[28196]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 399 KiB/s rd, 381 KiB/s wr, 76 op/s 2024-09-20T19:07:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:53 smithi098 ceph-mon[35737]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 404 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-09-20T19:07:54.274 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:53 smithi027 ceph-mon[28196]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 404 KiB/s rd, 381 KiB/s wr, 78 op/s 2024-09-20T19:07:56.812 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:56 smithi027 ceph-mon[28196]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 5.9 KiB/s wr, 36 op/s 2024-09-20T19:07:56.813 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:56.813 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:56.813 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:56.871 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:56 smithi098 ceph-mon[35737]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 5.9 KiB/s wr, 36 op/s 2024-09-20T19:07:56.871 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:56.871 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:56.871 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:07:58.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:58 smithi027 ceph-mon[28196]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2024-09-20T19:07:58.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:58 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:58.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:58 smithi098 ceph-mon[35737]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2024-09-20T19:07:58.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:58 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:07:59.776 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.776 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.776 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.776 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:07:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:07:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:07:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:00.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:00 smithi098 ceph-mon[35737]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-09-20T19:08:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:00 smithi027 ceph-mon[28196]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 -- 172.21.15.27:0/3366720555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0101960 msgr2=0x7fb4a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 --2- 172.21.15.27:0/3366720555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0101960 0x7fb4a0101d60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb490009880 tx=0x7fb49002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 -- 172.21.15.27:0/3366720555 shutdown_connections 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 --2- 172.21.15.27:0/3366720555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0102b60 0x7fb4a0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 --2- 172.21.15.27:0/3366720555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0101960 0x7fb4a0101d60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 -- 172.21.15.27:0/3366720555 >> 172.21.15.27:0/3366720555 conn(0x7fb4a00fd0f0 msgr2=0x7fb4a00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 -- 172.21.15.27:0/3366720555 shutdown_connections 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.682+0000 7fb4a4997640 1 -- 172.21.15.27:0/3366720555 wait complete. 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.683+0000 7fb4a4997640 1 Processor -- start 2024-09-20T19:08:01.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.683+0000 7fb4a4997640 1 -- start start 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb4a4997640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 0x7fb4a0073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb4a4997640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb4a4997640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a010a7a0 con 0x7fb4a0102b60 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb4a4997640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a010a620 con 0x7fb4a0101960 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39514/0 (socket says 172.21.15.27:39514) 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 -- 172.21.15.27:0/885147302 learned_addr learned my addr 172.21.15.27:0/885147302 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:01.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 -- 172.21.15.27:0/885147302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 msgr2=0x7fb4a0073270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49e59c640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 0x7fb4a0073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 0x7fb4a0073270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 -- 172.21.15.27:0/885147302 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a0073e60 con 0x7fb4a0102b60 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49e59c640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 0x7fb4a0073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.684+0000 7fb49dd9b640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d6f0 tx=0x7fb49400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.685+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb494017070 con 0x7fb4a0102b60 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.685+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a01a5320 con 0x7fb4a0102b60 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.685+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a01a5880 con 0x7fb4a0102b60 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.685+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb49400de00 con 0x7fb4a0102b60 2024-09-20T19:08:01.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.685+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb494004bb0 con 0x7fb4a0102b60 2024-09-20T19:08:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.686+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4800052c0 con 0x7fb4a0102b60 2024-09-20T19:08:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.687+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fb494009a30 con 0x7fb4a0102b60 2024-09-20T19:08:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.687+0000 7fb48f7fe640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 0x7fb48807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.687+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fb49409dd70 con 0x7fb4a0102b60 2024-09-20T19:08:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.688+0000 7fb49e59c640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 0x7fb48807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:01.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.688+0000 7fb49e59c640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 0x7fb48807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4900096c0 tx=0x7fb490009650 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:01.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.694+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb4940691d0 con 0x7fb4a0102b60 2024-09-20T19:08:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.906+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb480000bf0 con 0x7fb48807b0b0 2024-09-20T19:08:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.907+0000 7fb48f7fe640 1 -- 172.21.15.27:0/885147302 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fb480000bf0 con 0x7fb48807b0b0 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 msgr2=0x7fb48807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 0x7fb48807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4900096c0 tx=0x7fb490009650 comp rx=0 tx=0).stop 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 msgr2=0x7fb4a00737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d6f0 tx=0x7fb49400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 shutdown_connections 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb48807b0b0 0x7fb48807d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb4a0102b60 0x7fb4a00737b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 --2- 172.21.15.27:0/885147302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4a0101960 0x7fb4a0073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:01.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.909+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 >> 172.21.15.27:0/885147302 conn(0x7fb4a00fd0f0 msgr2=0x7fb4a0106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:01.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.910+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 shutdown_connections 2024-09-20T19:08:01.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.910+0000 7fb4a4997640 1 -- 172.21.15.27:0/885147302 wait complete. 2024-09-20T19:08:01.923 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:08:01.943 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:01 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:01.943 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:01 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:01.943 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:01 smithi027 ceph-mon[28196]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 3 op/s 2024-09-20T19:08:01.944 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:01 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:01.944 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:01 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 -- 172.21.15.27:0/3709574571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 msgr2=0x7f5b30102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 --2- 172.21.15.27:0/3709574571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b30102fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009880 tx=0x7f5b2002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 -- 172.21.15.27:0/3709574571 shutdown_connections 2024-09-20T19:08:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 --2- 172.21.15.27:0/3709574571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b30102fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 --2- 172.21.15.27:0/3709574571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 0x7f5b30101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 -- 172.21.15.27:0/3709574571 >> 172.21.15.27:0/3709574571 conn(0x7f5b300fd0f0 msgr2=0x7f5b300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 -- 172.21.15.27:0/3709574571 shutdown_connections 2024-09-20T19:08:02.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.997+0000 7f5b38596640 1 -- 172.21.15.27:0/3709574571 wait complete. 2024-09-20T19:08:02.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 Processor -- start 2024-09-20T19:08:02.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 -- start start 2024-09-20T19:08:02.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 0x7f5b30075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010a780 con 0x7f5b30102b60 2024-09-20T19:08:02.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b38596640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010a600 con 0x7f5b30101960 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39534/0 (socket says 172.21.15.27:39534) 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 -- 172.21.15.27:0/2222718250 learned_addr learned my addr 172.21.15.27:0/2222718250 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b36332640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 0x7f5b30075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 -- 172.21.15.27:0/2222718250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 msgr2=0x7f5b30075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 0x7f5b30075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.998+0000 7f5b35b31640 1 -- 172.21.15.27:0/2222718250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b30074b20 con 0x7f5b30102b60 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b35b31640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b20006010 tx=0x7f5b200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b2003f070 con 0x7f5b30102b60 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b30074db0 con 0x7f5b30102b60 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b200044d0 con 0x7f5b30102b60 2024-09-20T19:08:02.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b20035030 con 0x7f5b30102b60 2024-09-20T19:08:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:01.999+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b300752e0 con 0x7f5b30102b60 2024-09-20T19:08:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.000+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b30101d60 con 0x7f5b30102b60 2024-09-20T19:08:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.001+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f5b20042070 con 0x7f5b30102b60 2024-09-20T19:08:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.001+0000 7f5b277fe640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 0x7f5b1c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.001+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f5b200bef80 con 0x7f5b30102b60 2024-09-20T19:08:02.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.001+0000 7f5b36332640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 0x7f5b1c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.002+0000 7f5b36332640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 0x7f5b1c07d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b301029c0 tx=0x7f5b2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.006+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5b2008a360 con 0x7f5b30102b60 2024-09-20T19:08:02.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.209+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5b30062630 con 0x7f5b1c07b050 2024-09-20T19:08:02.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.210+0000 7f5b277fe640 1 -- 172.21.15.27:0/2222718250 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f5b30062630 con 0x7f5b1c07b050 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.212+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 msgr2=0x7f5b1c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.212+0000 7f5b38596640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 0x7f5b1c07d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b301029c0 tx=0x7f5b2c00a2d0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.212+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 msgr2=0x7f5b300745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.212+0000 7f5b38596640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b20006010 tx=0x7f5b200048f0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.212+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 shutdown_connections 2024-09-20T19:08:02.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07b050 0x7f5b1c07d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b30102b60 0x7f5b300745e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 --2- 172.21.15.27:0/2222718250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b30101960 0x7f5b30075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 >> 172.21.15.27:0/2222718250 conn(0x7f5b300fd0f0 msgr2=0x7f5b30106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 shutdown_connections 2024-09-20T19:08:02.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.213+0000 7f5b38596640 1 -- 172.21.15.27:0/2222718250 wait complete. 2024-09-20T19:08:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:01 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:01 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:01 smithi098 ceph-mon[35737]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s rd, 3 op/s 2024-09-20T19:08:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:01 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:01 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 -- 172.21.15.27:0/2079718464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 msgr2=0x7f6cf01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/2079718464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf01047e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00098b0 tx=0x7f6ce002a4d0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 -- 172.21.15.27:0/2079718464 shutdown_connections 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/2079718464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 0x7f6cf0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/2079718464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf01047e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 -- 172.21.15.27:0/2079718464 >> 172.21.15.27:0/2079718464 conn(0x7f6cf00fc010 msgr2=0x7f6cf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 -- 172.21.15.27:0/2079718464 shutdown_connections 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.297+0000 7f6cf4ead640 1 -- 172.21.15.27:0/2079718464 wait complete. 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 Processor -- start 2024-09-20T19:08:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 -- start start 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 0x7f6cf0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010a7e0 con 0x7f6cf01023f0 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cf4ead640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010a660 con 0x7f6cf0104d20 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cee59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39550/0 (socket says 172.21.15.27:39550) 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.298+0000 7f6cee59c640 1 -- 172.21.15.27:0/3718582223 learned_addr learned my addr 172.21.15.27:0/3718582223 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6ce7fff640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 0x7f6cf0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cee59c640 1 -- 172.21.15.27:0/3718582223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 msgr2=0x7f6cf0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cee59c640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 0x7f6cf0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cee59c640 1 -- 172.21.15.27:0/3718582223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf01980c0 con 0x7f6cf01023f0 2024-09-20T19:08:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cee59c640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00099d0 tx=0x7f6ce00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce003f070 con 0x7f6cf01023f0 2024-09-20T19:08:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf019caa0 con 0x7f6cf01023f0 2024-09-20T19:08:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ce00049d0 con 0x7f6cf01023f0 2024-09-20T19:08:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce0035030 con 0x7f6cf01023f0 2024-09-20T19:08:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.299+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf019d030 con 0x7f6cf01023f0 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.300+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf01027d0 con 0x7f6cf01023f0 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.301+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f6ce0042070 con 0x7f6cf01023f0 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.302+0000 7f6ce77fe640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 0x7f6cdc07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.302+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f6ce00bee00 con 0x7f6cf01023f0 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.302+0000 7f6ce7fff640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 0x7f6cdc07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.302+0000 7f6ce7fff640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 0x7f6cdc07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf01989b0 tx=0x7f6cd8005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.306+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6ce008a1e0 con 0x7f6cf01023f0 2024-09-20T19:08:02.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.503+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6cf0105680 con 0x7f6cdc07b050 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.512+0000 7f6ce77fe640 1 -- 172.21.15.27:0/3718582223 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6cf0105680 con 0x7f6cdc07b050 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (8m) 1s ago 10m 25.0M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (95s) 1s ago 10m 8288k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (85s) 3s ago 9m 8456k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (10m) 1s ago 10m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (9m) 3s ago 9m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (8m) 1s ago 10m 78.7M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (4m) 1s ago 4m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:08:02.517 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (4m) 1s ago 4m 14.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (4m) 3s ago 4m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (4m) 3s ago 4m 15.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (77s) 1s ago 11m 511M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (29s) 3s ago 9m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (11m) 1s ago 11m 57.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (9m) 3s ago 9m 43.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (14s) 1s ago 10m 3468k - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (7s) 3s ago 9m 3481k - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (8m) 1s ago 8m 210M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (7m) 1s ago 7m 225M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (7m) 1s ago 7m 216M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (6m) 3s ago 6m 240M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:08:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (6m) 3s ago 6m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:08:02.519 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (5m) 3s ago 5m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:08:02.519 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (41s) 1s ago 9m 48.7M - 2.43.0 a07b618ecd1d b89c6427e516 2024-09-20T19:08:02.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 msgr2=0x7f6cdc07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 0x7f6cdc07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf01989b0 tx=0x7f6cd8005f90 comp rx=0 tx=0).stop 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 msgr2=0x7f6cf0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00099d0 tx=0x7f6ce00045e0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 shutdown_connections 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6cdc07b050 0x7f6cdc07d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cf0104d20 0x7f6cf0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 --2- 172.21.15.27:0/3718582223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6cf01023f0 0x7f6cf0197500 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 >> 172.21.15.27:0/3718582223 conn(0x7f6cf00fc010 msgr2=0x7f6cf00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 shutdown_connections 2024-09-20T19:08:02.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.515+0000 7f6cf4ead640 1 -- 172.21.15.27:0/3718582223 wait complete. 2024-09-20T19:08:02.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 -- 172.21.15.27:0/1946679059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 msgr2=0x7f31d4103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 --2- 172.21.15.27:0/1946679059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d4103f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009880 tx=0x7f31c402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 -- 172.21.15.27:0/1946679059 shutdown_connections 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 --2- 172.21.15.27:0/1946679059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d41051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 --2- 172.21.15.27:0/1946679059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d4103f60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.599+0000 7f31d9f64640 1 -- 172.21.15.27:0/1946679059 >> 172.21.15.27:0/1946679059 conn(0x7f31d40ff330 msgr2=0x7f31d4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 -- 172.21.15.27:0/1946679059 shutdown_connections 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 -- 172.21.15.27:0/1946679059 wait complete. 2024-09-20T19:08:02.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 Processor -- start 2024-09-20T19:08:02.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 -- start start 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d4199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f31d410c9a0 con 0x7f31d4103b60 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.600+0000 7f31d9f64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31d410c820 con 0x7f31d4104d60 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d4199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39564/0 (socket says 172.21.15.27:39564) 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d37fe640 1 -- 172.21.15.27:0/160649931 learned_addr learned my addr 172.21.15.27:0/160649931 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d2ffd640 1 -- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 msgr2=0x7f31d41996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d2ffd640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d2ffd640 1 -- 172.21.15.27:0/160649931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d419a2a0 con 0x7f31d4104d60 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d37fe640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d2ffd640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d4199c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e970 tx=0x7f31bc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31bc00cac0 con 0x7f31d4104d60 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d419ece0 con 0x7f31d4104d60 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31bc00cc60 con 0x7f31d4104d60 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31bc0047a0 con 0x7f31d4104d60 2024-09-20T19:08:02.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.601+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d419f210 con 0x7f31d4104d60 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.602+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d4103f60 con 0x7f31d4104d60 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.603+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f31bc004ab0 con 0x7f31d4104d60 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.604+0000 7f31d0ff9640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 0x7f31c007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.604+0000 7f31d37fe640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 0x7f31c007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.604+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f31bc09e7c0 con 0x7f31d4104d60 2024-09-20T19:08:02.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.604+0000 7f31d37fe640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 0x7f31c007d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31c40096c0 tx=0x7f31c40058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.609+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f31bc069b00 con 0x7f31d4104d60 2024-09-20T19:08:02.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.868+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f31d4062df0 con 0x7f31d4104d60 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.868+0000 7f31d0ff9640 1 -- 172.21.15.27:0/160649931 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f31bc06e9b0 con 0x7f31d4104d60 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:02.873 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:02.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:08:02.875 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:08:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 msgr2=0x7f31c007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 0x7f31c007d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31c40096c0 tx=0x7f31c40058d0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 msgr2=0x7f31d4199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d4199c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e970 tx=0x7f31bc00ee30 comp rx=0 tx=0).stop 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 shutdown_connections 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f31c007b050 0x7f31c007d510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31d4104d60 0x7f31d4199c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 --2- 172.21.15.27:0/160649931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31d4103b60 0x7f31d41996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 >> 172.21.15.27:0/160649931 conn(0x7f31d40ff330 msgr2=0x7f31d4108210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 shutdown_connections 2024-09-20T19:08:02.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.871+0000 7f31d9f64640 1 -- 172.21.15.27:0/160649931 wait complete. 2024-09-20T19:08:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 -- 172.21.15.27:0/1611170852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d41023f0 msgr2=0x7f73d41047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 --2- 172.21.15.27:0/1611170852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d41023f0 0x7f73d41047e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0098b0 tx=0x7f73cc02a4d0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 -- 172.21.15.27:0/1611170852 shutdown_connections 2024-09-20T19:08:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 --2- 172.21.15.27:0/1611170852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d4104d20 0x7f73d4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 --2- 172.21.15.27:0/1611170852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d41023f0 0x7f73d41047e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 -- 172.21.15.27:0/1611170852 >> 172.21.15.27:0/1611170852 conn(0x7f73d40fc010 msgr2=0x7f73d40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:02.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.956+0000 7f73d9136640 1 -- 172.21.15.27:0/1611170852 shutdown_connections 2024-09-20T19:08:02.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.957+0000 7f73d9136640 1 -- 172.21.15.27:0/1611170852 wait complete. 2024-09-20T19:08:02.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.957+0000 7f73d9136640 1 Processor -- start 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.957+0000 7f73d9136640 1 -- start start 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d9136640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 0x7f73d41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d9136640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d9136640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f73d410a7c0 con 0x7f73d4104d20 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d9136640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73d410a640 con 0x7f73d41023f0 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39586/0 (socket says 172.21.15.27:39586) 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 -- 172.21.15.27:0/960932232 learned_addr learned my addr 172.21.15.27:0/960932232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d2d9d640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 0x7f73d41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 -- 172.21.15.27:0/960932232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 msgr2=0x7f73d41974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 0x7f73d41974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 -- 172.21.15.27:0/960932232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d41980a0 con 0x7f73d4104d20 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d2d9d640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 0x7f73d41974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73d259c640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00d6f0 tx=0x7f73bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.958+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73bc017070 con 0x7f73d4104d20 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.959+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d419cae0 con 0x7f73d4104d20 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.959+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d419d070 con 0x7f73d4104d20 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.959+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73bc00de00 con 0x7f73d4104d20 2024-09-20T19:08:02.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.959+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73bc00f3c0 con 0x7f73d4104d20 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.960+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d41027d0 con 0x7f73d4104d20 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.960+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f73bc01a070 con 0x7f73d4104d20 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.961+0000 7f73cbfff640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 0x7f73c007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.961+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f73bc09de20 con 0x7f73d4104d20 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.961+0000 7f73d2d9d640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 0x7f73c007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:02.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.962+0000 7f73d2d9d640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 0x7f73c007d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:02.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:02.966+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f73bc021030 con 0x7f73d4104d20 2024-09-20T19:08:03.180 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:02 smithi027 ceph-mon[28196]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:03.180 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:02 smithi027 ceph-mon[28196]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:03.180 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:02 smithi027 ceph-mon[28196]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:03.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.182+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f73d4105680 con 0x7f73c007b0b0 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.183+0000 7f73cbfff640 1 -- 172.21.15.27:0/960932232 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f73d4105680 con 0x7f73c007b0b0 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:08:03.188 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T19:08:03.189 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-20T19:08:03.189 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:08:03.189 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.185+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 msgr2=0x7f73c007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.185+0000 7f73d9136640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 0x7f73c007d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc005a20 comp rx=0 tx=0).stop 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.185+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 msgr2=0x7f73d4197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.185+0000 7f73d9136640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00d6f0 tx=0x7f73bc00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 shutdown_connections 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f73c007b0b0 0x7f73c007d570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:03.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73d4104d20 0x7f73d4197a20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:03.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 --2- 172.21.15.27:0/960932232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d41023f0 0x7f73d41974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:03.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 >> 172.21.15.27:0/960932232 conn(0x7f73d40fc010 msgr2=0x7f73d40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:03.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 shutdown_connections 2024-09-20T19:08:03.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:03.186+0000 7f73d9136640 1 -- 172.21.15.27:0/960932232 wait complete. 2024-09-20T19:08:03.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:02 smithi098 ceph-mon[35737]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:03.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:02 smithi098 ceph-mon[35737]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:03.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:02 smithi098 ceph-mon[35737]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:04.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:03 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/160649931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:04.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:03 smithi027 ceph-mon[28196]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.9 KiB/s rd, 5 op/s 2024-09-20T19:08:04.132 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:03 smithi027 ceph-mon[28196]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:03 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/160649931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:03 smithi098 ceph-mon[35737]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.9 KiB/s rd, 5 op/s 2024-09-20T19:08:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:03 smithi098 ceph-mon[35737]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:06.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:05 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:06.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:05 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:06.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:05 smithi027 ceph-mon[28196]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:05 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:05 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:05 smithi098 ceph-mon[35737]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:08.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:08.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:08.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:08.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:08.301 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:08.301 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.301 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.301 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:08.302 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:07 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:08 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:08 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:08 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:08 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:08 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:08 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:08 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:08 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:08 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:09.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:08 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:10.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:09 smithi098 ceph-mon[35737]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:10.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:09 smithi098 ceph-mon[35737]: Upgrade: Updating prometheus.smithi027 2024-09-20T19:08:10.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:09 smithi027 ceph-mon[28196]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:10.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:09 smithi027 ceph-mon[28196]: Upgrade: Updating prometheus.smithi027 2024-09-20T19:08:11.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:10 smithi098 ceph-mon[35737]: Deploying daemon prometheus.smithi027 on smithi027 2024-09-20T19:08:11.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:10 smithi027 ceph-mon[28196]: Deploying daemon prometheus.smithi027 on smithi027 2024-09-20T19:08:12.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:11 smithi098 ceph-mon[35737]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:12.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:11 smithi027 ceph-mon[28196]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:13.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:12 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:13.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:12 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:14.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:13 smithi098 ceph-mon[35737]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:14.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:13 smithi027 ceph-mon[28196]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:16.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:15 smithi098 ceph-mon[35737]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:16.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:15 smithi027 ceph-mon[28196]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:18.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:18 smithi027 ceph-mon[28196]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:18.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:18 smithi098 ceph-mon[35737]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:20.738 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:20 smithi027 ceph-mon[28196]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:20.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:20 smithi098 ceph-mon[35737]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:22.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:22 smithi027 ceph-mon[28196]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:22.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:22 smithi098 ceph-mon[35737]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:23.864 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:23 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.864 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:23 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.864 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:23 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:23.864 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:23 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.865 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:23 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:23 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:23 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:23 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:23 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:23 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:24.905 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:24 smithi027 ceph-mon[28196]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:24.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:24 smithi098 ceph-mon[35737]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4 op/s 2024-09-20T19:08:26.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:26 smithi027 ceph-mon[28196]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:26.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:26 smithi098 ceph-mon[35737]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:27.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:27 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:28.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:27 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:28.924 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:28 smithi027 ceph-mon[28196]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:28.924 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:28 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.924 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:28 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.924 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:28 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.924 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:28 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:28 smithi098 ceph-mon[35737]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3 op/s 2024-09-20T19:08:28.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:28 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:28 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:28 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:28.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:28 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:30.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:30 smithi098 ceph-mon[35737]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T19:08:30.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:30 smithi098 ceph-mon[35737]: mgrmap e33: smithi027.tlgpqo(active, since 92s), standbys: smithi098.wrcvbg 2024-09-20T19:08:31.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:30 smithi027 ceph-mon[28196]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T19:08:31.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:30 smithi027 ceph-mon[28196]: mgrmap e33: smithi027.tlgpqo(active, since 92s), standbys: smithi098.wrcvbg 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:32.799 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.800 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:32 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:32.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:32 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.273+0000 7ffa2f548640 1 -- 172.21.15.27:0/1840239451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28101a60 msgr2=0x7ffa28101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.273+0000 7ffa2f548640 1 --2- 172.21.15.27:0/1840239451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28101a60 0x7ffa28101ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009880 tx=0x7ffa1802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- 172.21.15.27:0/1840239451 shutdown_connections 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 --2- 172.21.15.27:0/1840239451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28101a60 0x7ffa28101ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 --2- 172.21.15.27:0/1840239451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28100860 0x7ffa28100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- 172.21.15.27:0/1840239451 >> 172.21.15.27:0/1840239451 conn(0x7ffa280fc010 msgr2=0x7ffa280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:33.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- 172.21.15.27:0/1840239451 shutdown_connections 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- 172.21.15.27:0/1840239451 wait complete. 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 Processor -- start 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- start start 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28101a60 0x7ffa28199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281096a0 con 0x7ffa28100860 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.274+0000 7ffa2f548640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28109520 con 0x7ffa28101a60 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60152/0 (socket says 172.21.15.27:60152) 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 -- 172.21.15.27:0/3817485949 learned_addr learned my addr 172.21.15.27:0/3817485949 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:33.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2cae3640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28101a60 0x7ffa28199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 -- 172.21.15.27:0/3817485949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28101a60 msgr2=0x7ffa28199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28101a60 0x7ffa28199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 -- 172.21.15.27:0/3817485949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2819a2b0 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2d2e4640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400d8d0 tx=0x7ffa2400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa24017070 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa2400be10 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2819ecf0 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.275+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa2400f3c0 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.276+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2819f1a0 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.277+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa28100c60 con 0x7ffa28100860 2024-09-20T19:08:33.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.277+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffa2401a070 con 0x7ffa28100860 2024-09-20T19:08:33.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.278+0000 7ffa1e7fc640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 0x7ffa1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.278+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7ffa2409db90 con 0x7ffa28100860 2024-09-20T19:08:33.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.278+0000 7ffa2cae3640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 0x7ffa1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.278+0000 7ffa2cae3640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 0x7ffa1407d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa180058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.283+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ffa24069190 con 0x7ffa28100860 2024-09-20T19:08:33.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.492+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffa2806a400 con 0x7ffa1407af30 2024-09-20T19:08:33.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.494+0000 7ffa1e7fc640 1 -- 172.21.15.27:0/3817485949 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7ffa2806a400 con 0x7ffa1407af30 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 msgr2=0x7ffa1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 0x7ffa1407d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa180058d0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 msgr2=0x7ffa281996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400d8d0 tx=0x7ffa2400dd90 comp rx=0 tx=0).stop 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 shutdown_connections 2024-09-20T19:08:33.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ffa1407af30 0x7ffa1407d3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa28101a60 0x7ffa28199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 --2- 172.21.15.27:0/3817485949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa28100860 0x7ffa281996f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 >> 172.21.15.27:0/3817485949 conn(0x7ffa280fc010 msgr2=0x7ffa28069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:33.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 shutdown_connections 2024-09-20T19:08:33.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.496+0000 7ffa2f548640 1 -- 172.21.15.27:0/3817485949 wait complete. 2024-09-20T19:08:33.509 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 -- 172.21.15.27:0/3624785156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1480104d20 msgr2=0x7f1480107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 --2- 172.21.15.27:0/3624785156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1480104d20 0x7f1480107110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14700098b0 tx=0x7f147002a4d0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 -- 172.21.15.27:0/3624785156 shutdown_connections 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 --2- 172.21.15.27:0/3624785156 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1480104d20 0x7f1480107110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 --2- 172.21.15.27:0/3624785156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14801023f0 0x7f14801047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 -- 172.21.15.27:0/3624785156 >> 172.21.15.27:0/3624785156 conn(0x7f14800fc010 msgr2=0x7f14800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 -- 172.21.15.27:0/3624785156 shutdown_connections 2024-09-20T19:08:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.584+0000 7f14878b0640 1 -- 172.21.15.27:0/3624785156 wait complete. 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 Processor -- start 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 -- start start 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 0x7f14801003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f148010a7b0 con 0x7f14801023f0 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f14878b0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f148010a630 con 0x7f1480104d20 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f148564c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f148564c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60168/0 (socket says 172.21.15.27:60168) 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f148564c640 1 -- 172.21.15.27:0/3430537748 learned_addr learned my addr 172.21.15.27:0/3430537748 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f1484e4b640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 0x7f14801003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.585+0000 7f148564c640 1 -- 172.21.15.27:0/3430537748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 msgr2=0x7f14801003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f148564c640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 0x7f14801003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f148564c640 1 -- 172.21.15.27:0/3430537748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14801008e0 con 0x7f14801023f0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f1484e4b640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 0x7f14801003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f148564c640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e970 tx=0x7f147c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f147c00cac0 con 0x7f14801023f0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1480100bd0 con 0x7f14801023f0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f147c0054e0 con 0x7f14801023f0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f147c010430 con 0x7f14801023f0 2024-09-20T19:08:33.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.586+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1480101160 con 0x7f14801023f0 2024-09-20T19:08:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.587+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14801027d0 con 0x7f14801023f0 2024-09-20T19:08:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.588+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f147c004e80 con 0x7f14801023f0 2024-09-20T19:08:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.588+0000 7f14767fc640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.588+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f147c09e6f0 con 0x7f14801023f0 2024-09-20T19:08:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.588+0000 7f1484e4b640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.589+0000 7f1484e4b640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 0x7f146c07d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1470000c00 tx=0x7f1470009650 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.593+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f147c069cf0 con 0x7f14801023f0 2024-09-20T19:08:33.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.801+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f148019f630 con 0x7f146c07af30 2024-09-20T19:08:33.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.802+0000 7f14767fc640 1 -- 172.21.15.27:0/3430537748 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f148019f630 con 0x7f146c07af30 2024-09-20T19:08:33.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 msgr2=0x7f146c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 0x7f146c07d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1470000c00 tx=0x7f1470009650 comp rx=0 tx=0).stop 2024-09-20T19:08:33.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 msgr2=0x7f1480101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e970 tx=0x7f147c00ed70 comp rx=0 tx=0).stop 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 shutdown_connections 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1480104d20 0x7f14801003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 --2- 172.21.15.27:0/3430537748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f14801023f0 0x7f1480101ce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 >> 172.21.15.27:0/3430537748 conn(0x7f14800fc010 msgr2=0x7f14800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 shutdown_connections 2024-09-20T19:08:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.804+0000 7f14878b0640 1 -- 172.21.15.27:0/3430537748 wait complete. 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- 172.21.15.27:0/211635133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 msgr2=0x7f34641047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 --2- 172.21.15.27:0/211635133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f34641047e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f34580098b0 tx=0x7f345802a4d0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- 172.21.15.27:0/211635133 shutdown_connections 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 --2- 172.21.15.27:0/211635133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 0x7f3464107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 --2- 172.21.15.27:0/211635133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f34641047e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- 172.21.15.27:0/211635133 >> 172.21.15.27:0/211635133 conn(0x7f34640fc010 msgr2=0x7f34640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- 172.21.15.27:0/211635133 shutdown_connections 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- 172.21.15.27:0/211635133 wait complete. 2024-09-20T19:08:33.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 Processor -- start 2024-09-20T19:08:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.890+0000 7f346ab73640 1 -- start start 2024-09-20T19:08:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346ab73640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346ab73640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 0x7f3464199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346ab73640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f346410a7c0 con 0x7f34641023f0 2024-09-20T19:08:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346ab73640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f346410a640 con 0x7f3464104d20 2024-09-20T19:08:33.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60190/0 (socket says 172.21.15.27:60190) 2024-09-20T19:08:33.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 -- 172.21.15.27:0/124137036 learned_addr learned my addr 172.21.15.27:0/124137036 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:33.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f3463fff640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 0x7f3464199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 -- 172.21.15.27:0/124137036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 msgr2=0x7f3464199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 0x7f3464199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 -- 172.21.15.27:0/124137036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346419a330 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346890f640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34580099d0 tx=0x7f34580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f345803f070 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3458004c70 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346419ed10 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.891+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3458035030 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.892+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346419f1e0 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.893+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34641027d0 con 0x7f34641023f0 2024-09-20T19:08:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.893+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3458042070 con 0x7f34641023f0 2024-09-20T19:08:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.894+0000 7f3461ffb640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 0x7f345407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.894+0000 7f3463fff640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 0x7f345407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.894+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f34580bece0 con 0x7f34641023f0 2024-09-20T19:08:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.895+0000 7f3463fff640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 0x7f345407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f346419ac20 tx=0x7f345000a4c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:33.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:33.899+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f345808a2e0 con 0x7f34641023f0 2024-09-20T19:08:34.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.099+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f34640626f0 con 0x7f345407af30 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.109+0000 7f3461ffb640 1 -- 172.21.15.27:0/124137036 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f34640626f0 con 0x7f345407af30 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (9m) 6s ago 10m 25.0M - 0.25.0 c8568f914cd2 d76bca70ccea 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (2m) 6s ago 10m 8321k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (116s) 35s ago 10m 8456k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (10m) 6s ago 10m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (10m) 35s ago 10m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:08:34.113 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (9m) 6s ago 10m 79.4M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (5m) 6s ago 5m 92.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (5m) 6s ago 5m 15.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (5m) 35s ago 5m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (5m) 35s ago 5m 15.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (108s) 6s ago 12m 514M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (60s) 35s ago 9m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (12m) 6s ago 12m 57.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (9m) 35s ago 9m 43.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (45s) 6s ago 10m 8056k - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (39s) 35s ago 9m 3481k - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (8m) 6s ago 8m 211M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:08:34.114 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (8m) 6s ago 8m 225M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (7m) 6s ago 7m 217M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (7m) 35s ago 7m 240M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (6m) 35s ago 6m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (6m) 35s ago 6m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (11s) 6s ago 10m 39.0M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:08:34.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 msgr2=0x7f345407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 0x7f345407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f346419ac20 tx=0x7f345000a4c0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 msgr2=0x7f3464199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34580099d0 tx=0x7f34580048f0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 shutdown_connections 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f345407af30 0x7f345407d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3464104d20 0x7f3464199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 --2- 172.21.15.27:0/124137036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34641023f0 0x7f3464199770 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 >> 172.21.15.27:0/124137036 conn(0x7f34640fc010 msgr2=0x7f3464101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 shutdown_connections 2024-09-20T19:08:34.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.111+0000 7f346ab73640 1 -- 172.21.15.27:0/124137036 wait complete. 2024-09-20T19:08:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 -- 172.21.15.27:0/1695293622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 msgr2=0x7f1740102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 --2- 172.21.15.27:0/1695293622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740102fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f172c009880 tx=0x7f172c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 -- 172.21.15.27:0/1695293622 shutdown_connections 2024-09-20T19:08:34.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 --2- 172.21.15.27:0/1695293622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740102fe0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 --2- 172.21.15.27:0/1695293622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 0x7f1740101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 -- 172.21.15.27:0/1695293622 >> 172.21.15.27:0/1695293622 conn(0x7f17400fd0f0 msgr2=0x7f17400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 -- 172.21.15.27:0/1695293622 shutdown_connections 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.193+0000 7f1746c1c640 1 -- 172.21.15.27:0/1695293622 wait complete. 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 Processor -- start 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 -- start start 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 0x7f1740197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f174010a820 con 0x7f1740102b60 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f1746c1c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f174010a6a0 con 0x7f1740101960 2024-09-20T19:08:34.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f173ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f173ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60222/0 (socket says 172.21.15.27:60222) 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f173ffff640 1 -- 172.21.15.27:0/2051457263 learned_addr learned my addr 172.21.15.27:0/2051457263 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.194+0000 7f17449b8640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 0x7f1740197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173ffff640 1 -- 172.21.15.27:0/2051457263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 msgr2=0x7f1740197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173ffff640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 0x7f1740197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173ffff640 1 -- 172.21.15.27:0/2051457263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1740198100 con 0x7f1740102b60 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173ffff640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f172c006010 tx=0x7f172c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f172c03f070 con 0x7f1740102b60 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f172c0044d0 con 0x7f1740102b60 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174019cae0 con 0x7f1740102b60 2024-09-20T19:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f172c035030 con 0x7f1740102b60 2024-09-20T19:08:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.195+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174019d0f0 con 0x7f1740102b60 2024-09-20T19:08:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.196+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1740101d40 con 0x7f1740102b60 2024-09-20T19:08:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.197+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f172c042070 con 0x7f1740102b60 2024-09-20T19:08:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.197+0000 7f173dffb640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 0x7f173007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.198+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f172c0becc0 con 0x7f1740102b60 2024-09-20T19:08:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.198+0000 7f17449b8640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 0x7f173007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.198+0000 7f17449b8640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 0x7f173007d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17401029c0 tx=0x7f1734009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:34.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.202+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f172c08a2c0 con 0x7f1740102b60 2024-09-20T19:08:34.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.481+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1740062df0 con 0x7f1740102b60 2024-09-20T19:08:34.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.482+0000 7f173dffb640 1 -- 172.21.15.27:0/2051457263 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f172c08f170 con 0x7f1740102b60 2024-09-20T19:08:34.486 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:08:34.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:08:34.488 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 msgr2=0x7f173007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 0x7f173007d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17401029c0 tx=0x7f1734009110 comp rx=0 tx=0).stop 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 msgr2=0x7f1740197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f172c006010 tx=0x7f172c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 shutdown_connections 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f173007af30 0x7f173007d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1740102b60 0x7f1740197a80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 --2- 172.21.15.27:0/2051457263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1740101960 0x7f1740197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 >> 172.21.15.27:0/2051457263 conn(0x7f17400fd0f0 msgr2=0x7f1740106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 shutdown_connections 2024-09-20T19:08:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.485+0000 7f1746c1c640 1 -- 172.21.15.27:0/2051457263 wait complete. 2024-09-20T19:08:34.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 -- 172.21.15.27:0/2879470320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 msgr2=0x7f29c0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/2879470320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0101ee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009880 tx=0x7f29ac02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 -- 172.21.15.27:0/2879470320 shutdown_connections 2024-09-20T19:08:34.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/2879470320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0101ee0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/2879470320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 0x7f29c0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 -- 172.21.15.27:0/2879470320 >> 172.21.15.27:0/2879470320 conn(0x7f29c00fc010 msgr2=0x7f29c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 -- 172.21.15.27:0/2879470320 shutdown_connections 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.594+0000 7f29c6bb7640 1 -- 172.21.15.27:0/2879470320 wait complete. 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 Processor -- start 2024-09-20T19:08:34.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 -- start start 2024-09-20T19:08:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 0x7f29c0199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0109680 con 0x7f29c0101a60 2024-09-20T19:08:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29c6bb7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0109500 con 0x7f29c0100860 2024-09-20T19:08:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29bffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29bffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60230/0 (socket says 172.21.15.27:60230) 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.595+0000 7f29bffff640 1 -- 172.21.15.27:0/823398470 learned_addr learned my addr 172.21.15.27:0/823398470 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29c4953640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 0x7f29c0199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bffff640 1 -- 172.21.15.27:0/823398470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 msgr2=0x7f29c0199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bffff640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 0x7f29c0199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bffff640 1 -- 172.21.15.27:0/823398470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c019a2d0 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bffff640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006010 tx=0x7f29ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29ac03f070 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c019ecb0 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29ac004ac0 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29ac035030 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.596+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c019f1e0 con 0x7f29c0101a60 2024-09-20T19:08:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.598+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c0100c60 con 0x7f29c0101a60 2024-09-20T19:08:34.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.598+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f29ac042070 con 0x7f29c0101a60 2024-09-20T19:08:34.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.599+0000 7f29bdffb640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:34.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.599+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f29ac0bebc0 con 0x7f29c0101a60 2024-09-20T19:08:34.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.599+0000 7f29c4953640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:34.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.600+0000 7f29c4953640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 0x7f29b007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29c01018c0 tx=0x7f29b400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:34.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.604+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f29ac08a1c0 con 0x7f29c0101a60 2024-09-20T19:08:34.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:34 smithi027 ceph-mon[28196]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T19:08:34.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:34 smithi027 ceph-mon[28196]: Upgrade: Updating alertmanager.smithi027 2024-09-20T19:08:34.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:34 smithi027 ceph-mon[28196]: Deploying daemon alertmanager.smithi027 on smithi027 2024-09-20T19:08:34.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:34 smithi027 ceph-mon[28196]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:34.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:34 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2051457263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:34.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.826+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f29c006a460 con 0x7f29b007af30 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.828+0000 7f29bdffb640 1 -- 172.21.15.27:0/823398470 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f29c006a460 con 0x7f29b007af30 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:08:34.832 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T19:08:34.833 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-20T19:08:34.833 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:08:34.833 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:08:34.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 msgr2=0x7f29b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 0x7f29b007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29c01018c0 tx=0x7f29b400b390 comp rx=0 tx=0).stop 2024-09-20T19:08:34.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 msgr2=0x7f29c0199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:34.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006010 tx=0x7f29ac0046c0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 shutdown_connections 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c0101a60 0x7f29c0199c50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 --2- 172.21.15.27:0/823398470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29c0100860 0x7f29c0199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 >> 172.21.15.27:0/823398470 conn(0x7f29c00fc010 msgr2=0x7f29c0069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 shutdown_connections 2024-09-20T19:08:34.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:08:34.830+0000 7f29c6bb7640 1 -- 172.21.15.27:0/823398470 wait complete. 2024-09-20T19:08:34.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:34 smithi098 ceph-mon[35737]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T19:08:34.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:34 smithi098 ceph-mon[35737]: Upgrade: Updating alertmanager.smithi027 2024-09-20T19:08:34.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:34 smithi098 ceph-mon[35737]: Deploying daemon alertmanager.smithi027 on smithi027 2024-09-20T19:08:34.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:34 smithi098 ceph-mon[35737]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:34.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:34 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2051457263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:35.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:35 smithi027 ceph-mon[28196]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:35.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:35 smithi027 ceph-mon[28196]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:35.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:35 smithi098 ceph-mon[35737]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:35.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:35 smithi098 ceph-mon[35737]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:36.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:36 smithi098 ceph-mon[35737]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:36.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:36 smithi098 ceph-mon[35737]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-20T19:08:36.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:36 smithi027 ceph-mon[28196]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:36.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:36 smithi027 ceph-mon[28196]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-20T19:08:38.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:38 smithi027 ceph-mon[28196]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-20T19:08:38.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:38 smithi098 ceph-mon[35737]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-20T19:08:40.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:40 smithi027 ceph-mon[28196]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:08:40.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:40 smithi098 ceph-mon[35737]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T19:08:42.734 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:42 smithi027 ceph-mon[28196]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-20T19:08:42.734 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:42.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:42 smithi098 ceph-mon[35737]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-20T19:08:42.861 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:44.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:44 smithi027 ceph-mon[28196]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T19:08:44.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:44 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:44.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:44 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:44.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:44 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:44 smithi098 ceph-mon[35737]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T19:08:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:44 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:44 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:44.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:44 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:46.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:46 smithi027 ceph-mon[28196]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:46.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:46 smithi098 ceph-mon[35737]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:48.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:48 smithi027 ceph-mon[28196]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:48.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:48 smithi098 ceph-mon[35737]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:50.204 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:49 smithi027 ceph-mon[28196]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:08:50.204 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.205 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:49 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:49 smithi098 ceph-mon[35737]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:08:50.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:50.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:49 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:52.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:51 smithi098 ceph-mon[35737]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:52.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:51 smithi027 ceph-mon[28196]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:53.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:53.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:53.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:53.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:53.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:53.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:53 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:08:54.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:54.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:53 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:08:55.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:54 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T19:08:55.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:54 smithi027 ceph-mon[28196]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:08:55.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:54 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T19:08:55.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:54 smithi098 ceph-mon[35737]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:08:56.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:55 smithi027 ceph-mon[28196]: Upgrade: Updating grafana.smithi027 2024-09-20T19:08:56.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:55 smithi027 ceph-mon[28196]: Deploying daemon grafana.smithi027 on smithi027 2024-09-20T19:08:56.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:55 smithi098 ceph-mon[35737]: Upgrade: Updating grafana.smithi027 2024-09-20T19:08:56.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:55 smithi098 ceph-mon[35737]: Deploying daemon grafana.smithi027 on smithi027 2024-09-20T19:08:56.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:56 smithi098 ceph-mon[35737]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:57.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:56 smithi027 ceph-mon[28196]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:58.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:58.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:08:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:58 smithi027 ceph-mon[28196]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:08:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:58 smithi098 ceph-mon[35737]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:00.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:08:59 smithi027 ceph-mon[28196]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:00.125 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:08:59 smithi098 ceph-mon[35737]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:02.210 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:01 smithi027 ceph-mon[28196]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:02.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:01 smithi098 ceph-mon[35737]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:03 smithi098 ceph-mon[35737]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:04.224 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:03 smithi027 ceph-mon[28196]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 -- 172.21.15.27:0/3427965333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78100860 msgr2=0x7fda78100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/3427965333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78100860 0x7fda78100c60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda68009880 tx=0x7fda6802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 -- 172.21.15.27:0/3427965333 shutdown_connections 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/3427965333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78101a60 0x7fda78101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/3427965333 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78100860 0x7fda78100c60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 -- 172.21.15.27:0/3427965333 >> 172.21.15.27:0/3427965333 conn(0x7fda780fc010 msgr2=0x7fda780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 -- 172.21.15.27:0/3427965333 shutdown_connections 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.919+0000 7fda7cc4c640 1 -- 172.21.15.27:0/3427965333 wait complete. 2024-09-20T19:09:04.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 Processor -- start 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 -- start start 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78100860 0x7fda78197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fda78109700 con 0x7fda78101a60 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda7cc4c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fda78109580 con 0x7fda78100860 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.920+0000 7fda75d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59708/0 (socket says 172.21.15.27:59708) 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 -- 172.21.15.27:0/4064001317 learned_addr learned my addr 172.21.15.27:0/4064001317 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda7659c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78100860 0x7fda78197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 -- 172.21.15.27:0/4064001317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78100860 msgr2=0x7fda78197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78100860 0x7fda78197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:04.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 -- 172.21.15.27:0/4064001317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda78198110 con 0x7fda78101a60 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda75d9b640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00b420 tx=0x7fda6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda6c011630 con 0x7fda78101a60 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda6c016070 con 0x7fda78101a60 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7819cb50 con 0x7fda78101a60 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda6c010d40 con 0x7fda78101a60 2024-09-20T19:09:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.921+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7819d160 con 0x7fda78101a60 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.922+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda78100c60 con 0x7fda78101a60 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.923+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fda6c01b460 con 0x7fda78101a60 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.924+0000 7fda677fe640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 0x7fda6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.924+0000 7fda7659c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 0x7fda6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.924+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fda6c09d660 con 0x7fda78101a60 2024-09-20T19:09:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.924+0000 7fda7659c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 0x7fda6007d440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda68009230 tx=0x7fda680058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:04.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:04.929+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fda6c068ce0 con 0x7fda78101a60 2024-09-20T19:09:05.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.135+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda78062630 con 0x7fda6007af80 2024-09-20T19:09:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.136+0000 7fda677fe640 1 -- 172.21.15.27:0/4064001317 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fda78062630 con 0x7fda6007af80 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 msgr2=0x7fda6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 0x7fda6007d440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda68009230 tx=0x7fda680058d0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 msgr2=0x7fda78197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00b420 tx=0x7fda6c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 shutdown_connections 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fda6007af80 0x7fda6007d440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda78101a60 0x7fda78197a90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 --2- 172.21.15.27:0/4064001317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda78100860 0x7fda78197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 >> 172.21.15.27:0/4064001317 conn(0x7fda780fc010 msgr2=0x7fda780fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 shutdown_connections 2024-09-20T19:09:05.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.138+0000 7fda7cc4c640 1 -- 172.21.15.27:0/4064001317 wait complete. 2024-09-20T19:09:05.150 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:09:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 -- 172.21.15.27:0/1491406678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 msgr2=0x7f9500102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 --2- 172.21.15.27:0/1491406678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500102ff0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009880 tx=0x7f94f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 -- 172.21.15.27:0/1491406678 shutdown_connections 2024-09-20T19:09:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 --2- 172.21.15.27:0/1491406678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500102ff0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 --2- 172.21.15.27:0/1491406678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 0x7f9500101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 -- 172.21.15.27:0/1491406678 >> 172.21.15.27:0/1491406678 conn(0x7f95000fd140 msgr2=0x7f95000ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 -- 172.21.15.27:0/1491406678 shutdown_connections 2024-09-20T19:09:05.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 -- 172.21.15.27:0/1491406678 wait complete. 2024-09-20T19:09:05.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.225+0000 7f95057c5640 1 Processor -- start 2024-09-20T19:09:05.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f95057c5640 1 -- start start 2024-09-20T19:09:05.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f95057c5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 0x7f95001974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f95057c5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f95057c5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f950010a7b0 con 0x7f9500102b70 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f95057c5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f950010a630 con 0x7f9500101970 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59732/0 (socket says 172.21.15.27:59732) 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 -- 172.21.15.27:0/305706400 learned_addr learned my addr 172.21.15.27:0/305706400 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94feffd640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 0x7f95001974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 -- 172.21.15.27:0/305706400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 msgr2=0x7f95001974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 0x7f95001974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.226+0000 7f94fe7fc640 1 -- 172.21.15.27:0/305706400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9500198090 con 0x7f9500102b70 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f94fe7fc640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009230 tx=0x7f94f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94f403f070 con 0x7f9500102b70 2024-09-20T19:09:05.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950019ca70 con 0x7f9500102b70 2024-09-20T19:09:05.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94f4004b80 con 0x7f9500102b70 2024-09-20T19:09:05.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94f4035030 con 0x7f9500102b70 2024-09-20T19:09:05.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.227+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950019d000 con 0x7f9500102b70 2024-09-20T19:09:05.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.228+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9500101d70 con 0x7f9500102b70 2024-09-20T19:09:05.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.229+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f94f4042070 con 0x7f9500102b70 2024-09-20T19:09:05.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.229+0000 7f94e7fff640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 0x7f94e807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.229+0000 7f94feffd640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 0x7f94e807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.230+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f94f40bec30 con 0x7f9500102b70 2024-09-20T19:09:05.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.230+0000 7f94feffd640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 0x7f94e807d400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94f0005fd0 tx=0x7f94f000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.234+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f94f408a230 con 0x7f9500102b70 2024-09-20T19:09:05.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.449+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f95000626f0 con 0x7f94e807af40 2024-09-20T19:09:05.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.450+0000 7f94e7fff640 1 -- 172.21.15.27:0/305706400 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f95000626f0 con 0x7f94e807af40 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 msgr2=0x7f94e807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 0x7f94e807d400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94f0005fd0 tx=0x7f94f000b390 comp rx=0 tx=0).stop 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 msgr2=0x7f9500197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009230 tx=0x7f94f40046c0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 shutdown_connections 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f94e807af40 0x7f94e807d400 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9500102b70 0x7f9500197a10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 --2- 172.21.15.27:0/305706400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9500101970 0x7f95001974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.452+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 >> 172.21.15.27:0/305706400 conn(0x7f95000fd140 msgr2=0x7f9500106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.453+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 shutdown_connections 2024-09-20T19:09:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.453+0000 7f95057c5640 1 -- 172.21.15.27:0/305706400 wait complete. 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 -- 172.21.15.27:0/3018678227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138100680 msgr2=0x7f8138100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 --2- 172.21.15.27:0/3018678227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138100680 0x7f8138100a80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f812c009880 tx=0x7f812c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 -- 172.21.15.27:0/3018678227 shutdown_connections 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 --2- 172.21.15.27:0/3018678227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138101880 0x7f8138101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 --2- 172.21.15.27:0/3018678227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138100680 0x7f8138100a80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 -- 172.21.15.27:0/3018678227 >> 172.21.15.27:0/3018678227 conn(0x7f81380fbe30 msgr2=0x7f81380fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 -- 172.21.15.27:0/3018678227 shutdown_connections 2024-09-20T19:09:05.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 -- 172.21.15.27:0/3018678227 wait complete. 2024-09-20T19:09:05.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.542+0000 7f813d99f640 1 Processor -- start 2024-09-20T19:09:05.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813d99f640 1 -- start start 2024-09-20T19:09:05.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813d99f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138100680 0x7f81381045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813d99f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813d99f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81381094c0 con 0x7f8138101880 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813d99f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8138109340 con 0x7f8138100680 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58850/0 (socket says 172.21.15.27:58850) 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 -- 172.21.15.27:0/2203810859 learned_addr learned my addr 172.21.15.27:0/2203810859 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f813c99d640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138100680 0x7f81381045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 -- 172.21.15.27:0/2203810859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138100680 msgr2=0x7f81381045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138100680 0x7f81381045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 -- 172.21.15.27:0/2203810859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381031a0 con 0x7f8138101880 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.543+0000 7f8137fff640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f812400c8f0 tx=0x7f812400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.544+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81240079b0 con 0x7f8138101880 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.544+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81240054e0 con 0x7f8138101880 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.544+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8138103490 con 0x7f8138101880 2024-09-20T19:09:05.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.544+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8124004dd0 con 0x7f8138101880 2024-09-20T19:09:05.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.544+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8138103a20 con 0x7f8138101880 2024-09-20T19:09:05.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.545+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8138100a80 con 0x7f8138101880 2024-09-20T19:09:05.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.546+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8124005020 con 0x7f8138101880 2024-09-20T19:09:05.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.546+0000 7f8135ffb640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 0x7f812807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.546+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f812409dfd0 con 0x7f8138101880 2024-09-20T19:09:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.546+0000 7f813c99d640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 0x7f812807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.547+0000 7f813c99d640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 0x7f812807d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.551+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8124014030 con 0x7f8138101880 2024-09-20T19:09:05.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.771+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f813819f420 con 0x7f812807aed0 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.781+0000 7f8135ffb640 1 -- 172.21.15.27:0/2203810859 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f813819f420 con 0x7f812807aed0 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (22s) 16s ago 11m 16.8M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (2m) 16s ago 11m 8346k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (2m) 67s ago 10m 8456k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (11m) 16s ago 11m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (10m) 67s ago 10m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (9m) 16s ago 11m 79.4M - 9.4.12 2bacad6d85d8 3195882f79b6 2024-09-20T19:09:05.785 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (5m) 16s ago 5m 92.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (5m) 16s ago 5m 15.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (5m) 67s ago 5m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (5m) 67s ago 5m 15.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (2m) 16s ago 12m 514M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (92s) 67s ago 10m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (12m) 16s ago 12m 58.9M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (10m) 67s ago 10m 43.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (77s) 16s ago 11m 8170k - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (70s) 67s ago 10m 3481k - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (9m) 16s ago 9m 211M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (8m) 16s ago 8m 226M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (8m) 16s ago 8m 217M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (7m) 67s ago 7m 240M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (7m) 67s ago 7m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:09:05.786 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (6m) 67s ago 6m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:09:05.787 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (43s) 16s ago 10m 41.5M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 msgr2=0x7f812807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 0x7f812807d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c005a20 comp rx=0 tx=0).stop 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 msgr2=0x7f8138102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f812400c8f0 tx=0x7f812400cdb0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 shutdown_connections 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f812807aed0 0x7f812807d390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8138101880 0x7f8138102c60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 --2- 172.21.15.27:0/2203810859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8138100680 0x7f81381045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 >> 172.21.15.27:0/2203810859 conn(0x7f81380fbe30 msgr2=0x7f8138069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 shutdown_connections 2024-09-20T19:09:05.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.784+0000 7f813d99f640 1 -- 172.21.15.27:0/2203810859 wait complete. 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 -- 172.21.15.27:0/2541305621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530101970 msgr2=0x7fb530101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2541305621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530101970 0x7fb530101d70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb524009880 tx=0x7fb52402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 -- 172.21.15.27:0/2541305621 shutdown_connections 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2541305621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530102b70 0x7fb530102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2541305621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530101970 0x7fb530101d70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 -- 172.21.15.27:0/2541305621 >> 172.21.15.27:0/2541305621 conn(0x7fb5300fd140 msgr2=0x7fb5300ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 -- 172.21.15.27:0/2541305621 shutdown_connections 2024-09-20T19:09:05.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.875+0000 7fb536c6e640 1 -- 172.21.15.27:0/2541305621 wait complete. 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.876+0000 7fb536c6e640 1 Processor -- start 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.876+0000 7fb536c6e640 1 -- start start 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.876+0000 7fb536c6e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 0x7fb530197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.876+0000 7fb536c6e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.876+0000 7fb536c6e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010a810 con 0x7fb530102b70 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb536c6e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010a690 con 0x7fb530101970 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58872/0 (socket says 172.21.15.27:58872) 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 -- 172.21.15.27:0/2711234066 learned_addr learned my addr 172.21.15.27:0/2711234066 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb534a0a640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 0x7fb530197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 -- 172.21.15.27:0/2711234066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 msgr2=0x7fb530197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 0x7fb530197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 -- 172.21.15.27:0/2711234066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb530198110 con 0x7fb530102b70 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb534a0a640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 0x7fb530197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.877+0000 7fb52ffff640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00b420 tx=0x7fb51c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.878+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb51c011630 con 0x7fb530102b70 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.878+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb51c016070 con 0x7fb530102b70 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.878+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53019cb50 con 0x7fb530102b70 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.878+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb51c010d40 con 0x7fb530102b70 2024-09-20T19:09:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.878+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53019d160 con 0x7fb530102b70 2024-09-20T19:09:05.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.879+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb530101d70 con 0x7fb530102b70 2024-09-20T19:09:05.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.880+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb51c01b480 con 0x7fb530102b70 2024-09-20T19:09:05.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.881+0000 7fb52dffb640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 0x7fb52007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:05.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.881+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fb51c09d700 con 0x7fb530102b70 2024-09-20T19:09:05.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.881+0000 7fb534a0a640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 0x7fb52007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:05.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.882+0000 7fb534a0a640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 0x7fb52007d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb524009230 tx=0x7fb5240058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:05.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:05.886+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb51c068d00 con 0x7fb530102b70 2024-09-20T19:09:06.051 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:05 smithi027 ceph-mon[28196]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:06.051 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:05 smithi027 ceph-mon[28196]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.051 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:05 smithi027 ceph-mon[28196]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.051 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:05 smithi027 ceph-mon[28196]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.153+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb530062df0 con 0x7fb530102b70 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.154+0000 7fb52dffb640 1 -- 172.21.15.27:0/2711234066 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fb51c06dbb0 con 0x7fb530102b70 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:06.157 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 msgr2=0x7fb52007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 0x7fb52007d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb524009230 tx=0x7fb5240058d0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 msgr2=0x7fb530197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00b420 tx=0x7fb51c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 shutdown_connections 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb52007af30 0x7fb52007d3f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb530102b70 0x7fb530197a90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 --2- 172.21.15.27:0/2711234066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb530101970 0x7fb530197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.156+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 >> 172.21.15.27:0/2711234066 conn(0x7fb5300fd140 msgr2=0x7fb530106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:06.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.157+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 shutdown_connections 2024-09-20T19:09:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.157+0000 7fb536c6e640 1 -- 172.21.15.27:0/2711234066 wait complete. 2024-09-20T19:09:06.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:05 smithi098 ceph-mon[35737]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:05 smithi098 ceph-mon[35737]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:05 smithi098 ceph-mon[35737]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:05 smithi098 ceph-mon[35737]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:06.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 -- 172.21.15.27:0/3482891521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00104d20 msgr2=0x7f1b00107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 --2- 172.21.15.27:0/3482891521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00104d20 0x7f1b00107110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098b0 tx=0x7f1af002a4d0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 -- 172.21.15.27:0/3482891521 shutdown_connections 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 --2- 172.21.15.27:0/3482891521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b00104d20 0x7f1b00107110 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 --2- 172.21.15.27:0/3482891521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b001023f0 0x7f1b001047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.241+0000 7f1b07528640 1 -- 172.21.15.27:0/3482891521 >> 172.21.15.27:0/3482891521 conn(0x7f1b000fc010 msgr2=0x7f1b000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 -- 172.21.15.27:0/3482891521 shutdown_connections 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 -- 172.21.15.27:0/3482891521 wait complete. 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 Processor -- start 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 -- start start 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b00104d20 0x7f1b00197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0010a790 con 0x7f1b001023f0 2024-09-20T19:09:06.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.242+0000 7f1b07528640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0010a610 con 0x7f1b00104d20 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58880/0 (socket says 172.21.15.27:58880) 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 -- 172.21.15.27:0/3690169782 learned_addr learned my addr 172.21.15.27:0/3690169782 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b04ac3640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b00104d20 0x7f1b00197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 -- 172.21.15.27:0/3690169782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b00104d20 msgr2=0x7f1b00197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b00104d20 0x7f1b00197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 -- 172.21.15.27:0/3690169782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b001980f0 con 0x7f1b001023f0 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b052c4640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d8d0 tx=0x7f1afc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1afc017030 con 0x7f1b001023f0 2024-09-20T19:09:06.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1afc004020 con 0x7f1b001023f0 2024-09-20T19:09:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0019cb30 con 0x7f1b001023f0 2024-09-20T19:09:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1afc0047a0 con 0x7f1b001023f0 2024-09-20T19:09:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.243+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0019d090 con 0x7f1b001023f0 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.244+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0010af70 con 0x7f1b001023f0 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.245+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1afc0041d0 con 0x7f1b001023f0 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.245+0000 7f1af67fc640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 0x7f1aec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.246+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f1afc018070 con 0x7f1b001023f0 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.246+0000 7f1b04ac3640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 0x7f1aec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:06.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.246+0000 7f1b04ac3640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 0x7f1aec07d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009880 tx=0x7f1af00058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:06.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.251+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1afc069400 con 0x7f1b001023f0 2024-09-20T19:09:06.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.517+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b00105740 con 0x7f1aec07af80 2024-09-20T19:09:06.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.518+0000 7f1af67fc640 1 -- 172.21.15.27:0/3690169782 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1b00105740 con 0x7f1aec07af80 2024-09-20T19:09:06.521 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:09:06.521 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading grafana daemons", 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:09:06.522 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 msgr2=0x7f1aec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 0x7f1aec07d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009880 tx=0x7f1af00058d0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 msgr2=0x7f1b00197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d8d0 tx=0x7f1afc00dd90 comp rx=0 tx=0).stop 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 shutdown_connections 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1aec07af80 0x7f1aec07d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b00104d20 0x7f1b00197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 --2- 172.21.15.27:0/3690169782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b001023f0 0x7f1b00197530 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 >> 172.21.15.27:0/3690169782 conn(0x7f1b000fc010 msgr2=0x7f1b000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 shutdown_connections 2024-09-20T19:09:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:06.521+0000 7f1b07528640 1 -- 172.21.15.27:0/3690169782 wait complete. 2024-09-20T19:09:07.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:06 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2711234066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:07.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:06 smithi098 ceph-mon[35737]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:07.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:06 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:07.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:06 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:07.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:06 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:07.232 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:06 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2711234066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:07.232 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:06 smithi027 ceph-mon[28196]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:07.232 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:06 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:07.232 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:06 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:07.232 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:06 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:08.948 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:08 smithi027 ceph-mon[28196]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:08.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:08 smithi098 ceph-mon[35737]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:10.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:10 smithi098 ceph-mon[35737]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:11.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:10 smithi027 ceph-mon[28196]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:12.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:12 smithi027 ceph-mon[28196]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:12.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:12 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:12.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:12 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:12.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:12 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:12 smithi098 ceph-mon[35737]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:12 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:12 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:12.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:12 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:14.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:14 smithi027 ceph-mon[28196]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:14.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:14 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:14.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:14 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:14.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:14 smithi098 ceph-mon[35737]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:14.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:14 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:14.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:14 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:16.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:16 smithi027 ceph-mon[28196]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:16.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:16 smithi098 ceph-mon[35737]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:17.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.480 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: Upgrade: Finalizing container_image settings 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:09:17.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: Upgrade: Complete! 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:17 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.570 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: Upgrade: Finalizing container_image settings 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T19:09:17.571 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T19:09:17.572 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: Upgrade: Complete! 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:09:17.573 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:17.574 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:17 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:18.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:18 smithi027 ceph-mon[28196]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:18.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:18 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:18.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:18 smithi098 ceph-mon[35737]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:18.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:18 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:20.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:20 smithi027 ceph-mon[28196]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:20 smithi098 ceph-mon[35737]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:22.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:22 smithi027 ceph-mon[28196]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:22 smithi098 ceph-mon[35737]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:24.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:24 smithi027 ceph-mon[28196]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:24.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:24 smithi098 ceph-mon[35737]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:26.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:26 smithi027 ceph-mon[28196]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:26.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:26 smithi098 ceph-mon[35737]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:27.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:27 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:27.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:27 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:28.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:28 smithi027 ceph-mon[28196]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:28 smithi098 ceph-mon[35737]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:30.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:30 smithi098 ceph-mon[35737]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:30.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:30 smithi027 ceph-mon[28196]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:32 smithi098 ceph-mon[35737]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:32 smithi027 ceph-mon[28196]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:34.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:34 smithi098 ceph-mon[35737]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:35.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:34 smithi027 ceph-mon[28196]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 -- 172.21.15.27:0/788951353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 msgr2=0x7f84b4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/788951353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4101ee0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009880 tx=0x7f84a802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 -- 172.21.15.27:0/788951353 shutdown_connections 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/788951353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4101ee0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/788951353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 0x7f84b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 -- 172.21.15.27:0/788951353 >> 172.21.15.27:0/788951353 conn(0x7f84b40fc010 msgr2=0x7f84b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 -- 172.21.15.27:0/788951353 shutdown_connections 2024-09-20T19:09:36.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.624+0000 7f84bb9a2640 1 -- 172.21.15.27:0/788951353 wait complete. 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.625+0000 7f84bb9a2640 1 Processor -- start 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.625+0000 7f84bb9a2640 1 -- start start 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84bb9a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 0x7f84b4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84bb9a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84bb9a2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4109680 con 0x7f84b4101a60 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84bb9a2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4109500 con 0x7f84b4100860 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:36.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52628/0 (socket says 172.21.15.27:52628) 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 -- 172.21.15.27:0/1077490875 learned_addr learned my addr 172.21.15.27:0/1077490875 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b973e640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 0x7f84b4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 -- 172.21.15.27:0/1077490875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 msgr2=0x7f84b4197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 0x7f84b4197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 -- 172.21.15.27:0/1077490875 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b41980e0 con 0x7f84b4101a60 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.626+0000 7f84b8f3d640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f84a8006010 tx=0x7f84a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.627+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a803f070 con 0x7f84b4101a60 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.627+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a8004ac0 con 0x7f84b4101a60 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.627+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b419cac0 con 0x7f84b4101a60 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.627+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a8035030 con 0x7f84b4101a60 2024-09-20T19:09:36.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.627+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b419d050 con 0x7f84b4101a60 2024-09-20T19:09:36.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.628+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b4100c60 con 0x7f84b4101a60 2024-09-20T19:09:36.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.629+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f84a8042070 con 0x7f84b4101a60 2024-09-20T19:09:36.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.629+0000 7f84b27fc640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 0x7f849c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:36.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.629+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f84a80beb70 con 0x7f84b4101a60 2024-09-20T19:09:36.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.629+0000 7f84b973e640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 0x7f849c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:36.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.630+0000 7f84b973e640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 0x7f849c07d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84ac005fd0 tx=0x7f84ac005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:36.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.634+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f84a808a1f0 con 0x7f84b4101a60 2024-09-20T19:09:36.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.840+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f84b406a420 con 0x7f849c07af80 2024-09-20T19:09:36.843 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:36 smithi027 ceph-mon[28196]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:36.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.841+0000 7f84b27fc640 1 -- 172.21.15.27:0/1077490875 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f84b406a420 con 0x7f849c07af80 2024-09-20T19:09:36.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 msgr2=0x7f849c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 0x7f849c07d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84ac005fd0 tx=0x7f84ac005850 comp rx=0 tx=0).stop 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 msgr2=0x7f84b4197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f84a8006010 tx=0x7f84a80046c0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 shutdown_connections 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f849c07af80 0x7f849c07d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84b4101a60 0x7f84b4197a60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 --2- 172.21.15.27:0/1077490875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84b4100860 0x7f84b4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.843+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 >> 172.21.15.27:0/1077490875 conn(0x7f84b40fc010 msgr2=0x7f84b4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.844+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 shutdown_connections 2024-09-20T19:09:36.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:36.844+0000 7f84bb9a2640 1 -- 172.21.15.27:0/1077490875 wait complete. 2024-09-20T19:09:36.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:36 smithi098 ceph-mon[35737]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:37.731 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-20T19:09:38.037 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:38.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 -- 172.21.15.27:0/3547913537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028107900 msgr2=0x7f6028107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:38.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 --2- 172.21.15.27:0/3547913537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028107900 0x7f6028107ce0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6020009880 tx=0x7f602002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 -- 172.21.15.27:0/3547913537 shutdown_connections 2024-09-20T19:09:38.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 --2- 172.21.15.27:0/3547913537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028101900 0x7f6028101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 --2- 172.21.15.27:0/3547913537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028107900 0x7f6028107ce0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 -- 172.21.15.27:0/3547913537 >> 172.21.15.27:0/3547913537 conn(0x7f60280fd600 msgr2=0x7f60280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 -- 172.21.15.27:0/3547913537 shutdown_connections 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.613+0000 7f602f9a3640 1 -- 172.21.15.27:0/3547913537 wait complete. 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 Processor -- start 2024-09-20T19:09:38.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 -- start start 2024-09-20T19:09:38.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:38.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028107900 0x7f602819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:38.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f602810edb0 con 0x7f6028101900 2024-09-20T19:09:38.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602f9a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f602810ec30 con 0x7f6028107900 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52658/0 (socket says 172.21.15.27:52658) 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 -- 172.21.15.27:0/2100644837 learned_addr learned my addr 172.21.15.27:0/2100644837 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 -- 172.21.15.27:0/2100644837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028107900 msgr2=0x7f602819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028107900 0x7f602819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.614+0000 7f602d73f640 1 -- 172.21.15.27:0/2100644837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60281977c0 con 0x7f6028101900 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f602d73f640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6020031460 tx=0x7f60200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f602003f070 con 0x7f6028101900 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6028197a50 con 0x7f6028101900 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6020004cf0 con 0x7f6028101900 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6020035030 con 0x7f6028101900 2024-09-20T19:09:38.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.615+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6028197f80 con 0x7f6028101900 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.616+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6028103040 con 0x7f6028101900 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.617+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6020042070 con 0x7f6028101900 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.617+0000 7f60267fc640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 0x7f601007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.617+0000 7f602cf3e640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 0x7f601007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.618+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f60200beac0 con 0x7f6028101900 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.618+0000 7f602cf3e640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 0x7f601007d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6028100e00 tx=0x7f601c005c70 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:38.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.622+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f602008a0c0 con 0x7f6028101900 2024-09-20T19:09:38.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:38 smithi027 ceph-mon[28196]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:38.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:38 smithi027 ceph-mon[28196]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:38.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.888+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6028104b10 con 0x7f6028101900 2024-09-20T19:09:38.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.889+0000 7f60267fc640 1 -- 172.21.15.27:0/2100644837 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f602008ef70 con 0x7f6028101900 2024-09-20T19:09:38.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 msgr2=0x7f601007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:38.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 0x7f601007d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6028100e00 tx=0x7f601c005c70 comp rx=0 tx=0).stop 2024-09-20T19:09:38.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 msgr2=0x7f602819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:38.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6020031460 tx=0x7f60200048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 shutdown_connections 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f601007af30 0x7f601007d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6028107900 0x7f602819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 --2- 172.21.15.27:0/2100644837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6028101900 0x7f602819d640 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 >> 172.21.15.27:0/2100644837 conn(0x7f60280fd600 msgr2=0x7f60280ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 shutdown_connections 2024-09-20T19:09:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:38.891+0000 7f602f9a3640 1 -- 172.21.15.27:0/2100644837 wait complete. 2024-09-20T19:09:38.902 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:09:38.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:38 smithi098 ceph-mon[35737]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:38.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:38 smithi098 ceph-mon[35737]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:39.557 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-20T19:09:39.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:39 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2100644837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:39.821 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:39.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:39 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2100644837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:40.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 -- 172.21.15.27:0/3051155421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40107900 msgr2=0x7f5b40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:40.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3051155421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40107900 0x7f5b40107ce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009880 tx=0x7f5b3002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 -- 172.21.15.27:0/3051155421 shutdown_connections 2024-09-20T19:09:40.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3051155421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40101900 0x7f5b40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3051155421 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40107900 0x7f5b40107ce0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 -- 172.21.15.27:0/3051155421 >> 172.21.15.27:0/3051155421 conn(0x7f5b400fd600 msgr2=0x7f5b400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:40.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 -- 172.21.15.27:0/3051155421 shutdown_connections 2024-09-20T19:09:40.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.419+0000 7f5b46a16640 1 -- 172.21.15.27:0/3051155421 wait complete. 2024-09-20T19:09:40.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.420+0000 7f5b46a16640 1 Processor -- start 2024-09-20T19:09:40.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.420+0000 7f5b46a16640 1 -- start start 2024-09-20T19:09:40.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b46a16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b46a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 0x7f5b4019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b46a16640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4010edd0 con 0x7f5b40101900 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b46a16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4010ec50 con 0x7f5b40107900 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52680/0 (socket says 172.21.15.27:52680) 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 -- 172.21.15.27:0/3998919706 learned_addr learned my addr 172.21.15.27:0/3998919706 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3f7fe640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 0x7f5b4019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 -- 172.21.15.27:0/3998919706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 msgr2=0x7f5b4019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 0x7f5b4019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 -- 172.21.15.27:0/3998919706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b401977a0 con 0x7f5b40101900 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3f7fe640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 0x7f5b4019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.421+0000 7f5b3ffff640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5b30031460 tx=0x7f5b300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:40.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.422+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b3003f070 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.422+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b300035f0 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.422+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b40197a30 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.422+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b30035030 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.422+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b40197f60 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.423+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b40103040 con 0x7f5b40101900 2024-09-20T19:09:40.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.423+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5b30042070 con 0x7f5b40101900 2024-09-20T19:09:40.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.424+0000 7f5b3d7fa640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 0x7f5b2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:40.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.424+0000 7f5b3f7fe640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 0x7f5b2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:40.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.424+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f5b300bea00 con 0x7f5b40101900 2024-09-20T19:09:40.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.425+0000 7f5b3f7fe640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 0x7f5b2807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b400ffc20 tx=0x7f5b34005e50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:40.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.429+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5b3008a000 con 0x7f5b40101900 2024-09-20T19:09:40.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.691+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5b40109e70 con 0x7f5b40101900 2024-09-20T19:09:40.694 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:40 smithi027 ceph-mon[28196]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:40.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.691+0000 7f5b3d7fa640 1 -- 172.21.15.27:0/3998919706 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f5b3008eeb0 con 0x7f5b40101900 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.693+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 msgr2=0x7f5b2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 0x7f5b2807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b400ffc20 tx=0x7f5b34005e50 comp rx=0 tx=0).stop 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 msgr2=0x7f5b4019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5b30031460 tx=0x7f5b300045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 shutdown_connections 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b2807af30 0x7f5b2807d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b40107900 0x7f5b4019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 --2- 172.21.15.27:0/3998919706 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b40101900 0x7f5b4019d620 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 >> 172.21.15.27:0/3998919706 conn(0x7f5b400fd600 msgr2=0x7f5b400fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 shutdown_connections 2024-09-20T19:09:40.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:40.694+0000 7f5b46a16640 1 -- 172.21.15.27:0/3998919706 wait complete. 2024-09-20T19:09:40.705 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)" 2024-09-20T19:09:40.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:40 smithi098 ceph-mon[35737]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:41.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-20T19:09:41.547 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:41 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3998919706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:42.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:41 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3998919706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 -- 172.21.15.27:0/1214179208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 msgr2=0x7f9764102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 --2- 172.21.15.27:0/1214179208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764102f00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9754009880 tx=0x7f975402a530 comp rx=0 tx=0).stop 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 -- 172.21.15.27:0/1214179208 shutdown_connections 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 --2- 172.21.15.27:0/1214179208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 0x7f976410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 --2- 172.21.15.27:0/1214179208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764102f00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 -- 172.21.15.27:0/1214179208 >> 172.21.15.27:0/1214179208 conn(0x7f97640fc580 msgr2=0x7f97640fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 -- 172.21.15.27:0/1214179208 shutdown_connections 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.169+0000 7f976aa2b640 1 -- 172.21.15.27:0/1214179208 wait complete. 2024-09-20T19:09:42.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 Processor -- start 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 -- start start 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 0x7f9764100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f976410ee50 con 0x7f9764102b20 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f976aa2b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f976410ecd0 con 0x7f9764103440 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f9763fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f9763fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52702/0 (socket says 172.21.15.27:52702) 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f9763fff640 1 -- 172.21.15.27:0/2474201005 learned_addr learned my addr 172.21.15.27:0/2474201005 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.170+0000 7f97637fe640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 0x7f9764100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f9763fff640 1 -- 172.21.15.27:0/2474201005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 msgr2=0x7f9764100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f9763fff640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 0x7f9764100cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f9763fff640 1 -- 172.21.15.27:0/2474201005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9764101200 con 0x7f9764102b20 2024-09-20T19:09:42.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f9763fff640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9754031460 tx=0x7f97540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f975403f070 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97540035f0 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9764101490 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9754035030 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.171+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97641a3f20 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.172+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976406ada0 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.173+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9754042070 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.173+0000 7f97617fa640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 0x7f974c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.173+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f97540be910 con 0x7f9764102b20 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.173+0000 7f97637fe640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 0x7f974c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:42.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.174+0000 7f97637fe640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 0x7f974c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f97580058c0 tx=0x7f9758005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:42.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.178+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9754089f90 con 0x7f9764102b20 2024-09-20T19:09:42.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.437+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9764105ff0 con 0x7f9764102b20 2024-09-20T19:09:42.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.437+0000 7f97617fa640 1 -- 172.21.15.27:0/2474201005 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f975408ee40 con 0x7f9764102b20 2024-09-20T19:09:42.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 msgr2=0x7f974c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 0x7f974c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f97580058c0 tx=0x7f9758005850 comp rx=0 tx=0).stop 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 msgr2=0x7f9764100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9754031460 tx=0x7f97540045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 shutdown_connections 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f974c07af80 0x7f974c07d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9764103440 0x7f9764100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 --2- 172.21.15.27:0/2474201005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9764102b20 0x7f9764100780 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.439+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 >> 172.21.15.27:0/2474201005 conn(0x7f97640fc580 msgr2=0x7f9764108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.440+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 shutdown_connections 2024-09-20T19:09:42.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:42.440+0000 7f976aa2b640 1 -- 172.21.15.27:0/2474201005 wait complete. 2024-09-20T19:09:42.451 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:09:42.801 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:42 smithi027 ceph-mon[28196]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:42.801 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:42 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2474201005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:42.801 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:42 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:42 smithi098 ceph-mon[35737]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:42 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2474201005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:42.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:42 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:43.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-20T19:09:43.416 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 -- 172.21.15.27:0/454034748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660101900 msgr2=0x7f9660101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 --2- 172.21.15.27:0/454034748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660101900 0x7f9660101d60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9654009880 tx=0x7f965402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 -- 172.21.15.27:0/454034748 shutdown_connections 2024-09-20T19:09:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 --2- 172.21.15.27:0/454034748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660101900 0x7f9660101d60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:43.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 --2- 172.21.15.27:0/454034748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660107900 0x7f9660107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:43.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 -- 172.21.15.27:0/454034748 >> 172.21.15.27:0/454034748 conn(0x7f96600fd600 msgr2=0x7f96600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:43.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 -- 172.21.15.27:0/454034748 shutdown_connections 2024-09-20T19:09:43.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.904+0000 7f9667d1a640 1 -- 172.21.15.27:0/454034748 wait complete. 2024-09-20T19:09:43.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 Processor -- start 2024-09-20T19:09:43.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 -- start start 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660101900 0x7f966019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f966010edd0 con 0x7f9660107900 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f9667d1a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f966010ec50 con 0x7f9660101900 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.905+0000 7f96652b5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52716/0 (socket says 172.21.15.27:52716) 2024-09-20T19:09:43.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 -- 172.21.15.27:0/3305127830 learned_addr learned my addr 172.21.15.27:0/3305127830 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9665ab6640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660101900 0x7f966019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 -- 172.21.15.27:0/3305127830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660101900 msgr2=0x7f966019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660101900 0x7f966019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 -- 172.21.15.27:0/3305127830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9660197800 con 0x7f9660107900 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f96652b5640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9654031460 tx=0x7f96540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f965403f070 con 0x7f9660107900 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9654004cf0 con 0x7f9660107900 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9660197a90 con 0x7f9660107900 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9654035030 con 0x7f9660107900 2024-09-20T19:09:43.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.906+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9660197fc0 con 0x7f9660107900 2024-09-20T19:09:43.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.907+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660103040 con 0x7f9660107900 2024-09-20T19:09:43.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.908+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9654042070 con 0x7f9660107900 2024-09-20T19:09:43.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.908+0000 7f9652ffd640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 0x7f964c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:43.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.909+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f96540beac0 con 0x7f9660107900 2024-09-20T19:09:43.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.909+0000 7f9665ab6640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 0x7f964c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:43.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.909+0000 7f9665ab6640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 0x7f964c07d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f965c005c40 tx=0x7f965c008230 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:43.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:43.913+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f965408a0c0 con 0x7f9660107900 2024-09-20T19:09:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:44.121+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}) -- 0x7f9660198330 con 0x7f964c07af30 2024-09-20T19:09:44.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:44 smithi098 ceph-mon[35737]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:45.017 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:44 smithi027 ceph-mon[28196]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:45.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:45 smithi098 ceph-mon[35737]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:45.982 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:45 smithi027 ceph-mon[28196]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.287+0000 7f9652ffd640 1 -- 172.21.15.27:0/3305127830 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f9660198330 con 0x7f964c07af30 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.289+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 msgr2=0x7f964c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.289+0000 7f9667d1a640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 0x7f964c07d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f965c005c40 tx=0x7f965c008230 comp rx=0 tx=0).stop 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.289+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 msgr2=0x7f966019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.289+0000 7f9667d1a640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9654031460 tx=0x7f96540048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 shutdown_connections 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f964c07af30 0x7f964c07d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107900 0x7f966019dbc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:46.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 --2- 172.21.15.27:0/3305127830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9660101900 0x7f966019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:46.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 >> 172.21.15.27:0/3305127830 conn(0x7f96600fd600 msgr2=0x7f96600fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:46.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 shutdown_connections 2024-09-20T19:09:46.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:46.290+0000 7f9667d1a640 1 -- 172.21.15.27:0/3305127830 wait complete. 2024-09-20T19:09:46.303 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:09:46.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:46 smithi098 ceph-mon[35737]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:46.984 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:46 smithi027 ceph-mon[28196]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:47.013 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T19:09:47.273 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:47.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 -- 172.21.15.27:0/453203726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 msgr2=0x7effe4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 --2- 172.21.15.27:0/453203726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe4106d50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7effe0009c20 tx=0x7effe002a970 comp rx=0 tx=0).stop 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 -- 172.21.15.27:0/453203726 shutdown_connections 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 --2- 172.21.15.27:0/453203726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effe40ffea0 0x7effe4100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 --2- 172.21.15.27:0/453203726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe4106d50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.744+0000 7effebac8640 1 -- 172.21.15.27:0/453203726 >> 172.21.15.27:0/453203726 conn(0x7effe40fbc90 msgr2=0x7effe40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.745+0000 7effebac8640 1 -- 172.21.15.27:0/453203726 shutdown_connections 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.745+0000 7effebac8640 1 -- 172.21.15.27:0/453203726 wait complete. 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.745+0000 7effebac8640 1 Processor -- start 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.745+0000 7effebac8640 1 -- start start 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effebac8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effe40ffea0 0x7effe4101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:47.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effebac8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effebac8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7effe410efb0 con 0x7effe4106970 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effebac8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effe410ee30 con 0x7effe40ffea0 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58156/0 (socket says 172.21.15.27:58156) 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 -- 172.21.15.27:0/3968906993 learned_addr learned my addr 172.21.15.27:0/3968906993 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 -- 172.21.15.27:0/3968906993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effe40ffea0 msgr2=0x7effe4101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effe40ffea0 0x7effe4101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 -- 172.21.15.27:0/3968906993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe4101b00 con 0x7effe4106970 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effe9063640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7effd800b420 tx=0x7effd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effd8011630 con 0x7effe4106970 2024-09-20T19:09:47.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effd8016070 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.746+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe4101df0 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.747+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effd8010d40 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.747+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe41a3fe0 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.748+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe41031c0 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.748+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7effd801b460 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.749+0000 7effd6ffd640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 0x7effd007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.749+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7effd809d6a0 con 0x7effe4106970 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.749+0000 7effe9864640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 0x7effd007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.750+0000 7effe9864640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 0x7effd007d440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effe0009430 tx=0x7effe00093a0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:47.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.754+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7effd8021250 con 0x7effe4106970 2024-09-20T19:09:47.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.948+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7effe4062630 con 0x7effd007af80 2024-09-20T19:09:47.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.958+0000 7effd6ffd640 1 -- 172.21.15.27:0/3968906993 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7effe4062630 con 0x7effd007af80 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (64s) 35s ago 11m 16.8M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (3m) 35s ago 12m 8380k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (3m) 109s ago 11m 8456k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (12m) 35s ago 12m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (11m) 109s ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (41s) 35s ago 11m 45.9M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (6m) 35s ago 6m 92.6M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (6m) 35s ago 6m 15.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:09:47.961 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (6m) 109s ago 6m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (6m) 109s ago 6m 15.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (3m) 35s ago 13m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (2m) 109s ago 11m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (13m) 35s ago 13m 60.1M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (11m) 109s ago 11m 43.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (119s) 35s ago 12m 8124k - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (113s) 109s ago 11m 3481k - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (9m) 35s ago 9m 211M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (9m) 35s ago 9m 227M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:09:47.962 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (8m) 35s ago 8m 217M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:09:47.963 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (8m) 109s ago 8m 240M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:09:47.963 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (8m) 109s ago 8m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:09:47.963 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (7m) 109s ago 7m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:09:47.963 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (85s) 35s ago 11m 43.7M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 msgr2=0x7effd007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 0x7effd007d440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effe0009430 tx=0x7effe00093a0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 msgr2=0x7effe41015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7effd800b420 tx=0x7effd800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 shutdown_connections 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7effd007af80 0x7effd007d440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7effe4106970 0x7effe41015c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 --2- 172.21.15.27:0/3968906993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effe40ffea0 0x7effe4101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:47.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 >> 172.21.15.27:0/3968906993 conn(0x7effe40fbc90 msgr2=0x7effe40fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:47.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 shutdown_connections 2024-09-20T19:09:47.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:47.960+0000 7effebac8640 1 -- 172.21.15.27:0/3968906993 wait complete. 2024-09-20T19:09:48.701 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:48 smithi027 ceph-mon[28196]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:48.702 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T19:09:48.702 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:09:48.702 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-20T19:09:48.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:48 smithi098 ceph-mon[35737]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:48.978 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.471+0000 7efef1dec640 1 -- 172.21.15.27:0/1673209518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1007f0 msgr2=0x7efeec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.471+0000 7efef1dec640 1 --2- 172.21.15.27:0/1673209518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1007f0 0x7efeec100c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efed4009880 tx=0x7efed402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 -- 172.21.15.27:0/1673209518 shutdown_connections 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 --2- 172.21.15.27:0/1673209518 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1007f0 0x7efeec100c50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 --2- 172.21.15.27:0/1673209518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1067f0 0x7efeec106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 -- 172.21.15.27:0/1673209518 >> 172.21.15.27:0/1673209518 conn(0x7efeec0fc550 msgr2=0x7efeec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 -- 172.21.15.27:0/1673209518 shutdown_connections 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 -- 172.21.15.27:0/1673209518 wait complete. 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 Processor -- start 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.472+0000 7efef1dec640 1 -- start start 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efef1dec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1007f0 0x7efeec19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efef1dec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efef1dec640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7efeec10dcc0 con 0x7efeec1067f0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efef1dec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efeec10db40 con 0x7efeec1007f0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58174/0 (socket says 172.21.15.27:58174) 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 -- 172.21.15.27:0/317265701 learned_addr learned my addr 172.21.15.27:0/317265701 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeb7fe640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1007f0 0x7efeec19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 -- 172.21.15.27:0/317265701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1007f0 msgr2=0x7efeec19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1007f0 0x7efeec19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 -- 172.21.15.27:0/317265701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec1966b0 con 0x7efeec1067f0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.473+0000 7efeeaffd640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efed4031460 tx=0x7efed40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:49.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.474+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed403f070 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.474+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed40035f0 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.474+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec196940 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.474+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed4035030 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.474+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec196e40 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.475+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeec101f30 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.475+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efed4042070 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.476+0000 7efee8ff9640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 0x7efed807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.476+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7efed40be970 con 0x7efeec1067f0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.476+0000 7efeeb7fe640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 0x7efed807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:49.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.477+0000 7efeeb7fe640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 0x7efed807d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efedc005fd0 tx=0x7efedc009680 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:49.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.481+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efed40c0e20 con 0x7efeec1067f0 2024-09-20T19:09:49.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.669+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7efeec108d60 con 0x7efeec1067f0 2024-09-20T19:09:49.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.673+0000 7efee8ff9640 1 -- 172.21.15.27:0/317265701 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v65)=0 v65) ==== 125+0+0 (secure 0 0 0) 0x7efed4089f70 con 0x7efeec1067f0 2024-09-20T19:09:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 msgr2=0x7efed807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 0x7efed807d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efedc005fd0 tx=0x7efedc009680 comp rx=0 tx=0).stop 2024-09-20T19:09:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 msgr2=0x7efeec19cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:49.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efed4031460 tx=0x7efed40045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 shutdown_connections 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7efed807af30 0x7efed807d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efeec1067f0 0x7efeec19cb20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 --2- 172.21.15.27:0/317265701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeec1007f0 0x7efeec19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.675+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 >> 172.21.15.27:0/317265701 conn(0x7efeec0fc550 msgr2=0x7efeec0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.676+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 shutdown_connections 2024-09-20T19:09:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:49.676+0000 7efef1dec640 1 -- 172.21.15.27:0/317265701 wait complete. 2024-09-20T19:09:49.948 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:49 smithi027 ceph-mon[28196]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:49.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:49 smithi098 ceph-mon[35737]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:50.387 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T19:09:50.388 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:09:50.388 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-20T19:09:50.645 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/317265701' entity='client.admin' 2024-09-20T19:09:50.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:50.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:50.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:50.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:50.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:50 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/317265701' entity='client.admin' 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:51.012 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:51.013 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:50 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:09:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 -- 172.21.15.27:0/2458162428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 msgr2=0x7fa428106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:51.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 --2- 172.21.15.27:0/2458162428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa428106be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa418009880 tx=0x7fa41802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 -- 172.21.15.27:0/2458162428 shutdown_connections 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 --2- 172.21.15.27:0/2458162428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa428100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 --2- 172.21.15.27:0/2458162428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa428106be0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 -- 172.21.15.27:0/2458162428 >> 172.21.15.27:0/2458162428 conn(0x7fa4280fc520 msgr2=0x7fa4280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 -- 172.21.15.27:0/2458162428 shutdown_connections 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.097+0000 7fa42d527640 1 -- 172.21.15.27:0/2458162428 wait complete. 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 Processor -- start 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 -- start start 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa42819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa42810dcd0 con 0x7fa428106800 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa42d527640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa42810db50 con 0x7fa428100800 2024-09-20T19:09:51.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.098+0000 7fa4267fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58190/0 (socket says 172.21.15.27:58190) 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 -- 172.21.15.27:0/2469282361 learned_addr learned my addr 172.21.15.27:0/2469282361 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 -- 172.21.15.27:0/2469282361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 msgr2=0x7fa42819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa426ffd640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa42819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa42819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 -- 172.21.15.27:0/2469282361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4281977c0 con 0x7fa428106800 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa426ffd640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa42819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa4267fc640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d6f0 tx=0x7fa41c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa41c017070 con 0x7fa428106800 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa428197ab0 con 0x7fa428106800 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa41c00de00 con 0x7fa428106800 2024-09-20T19:09:51.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa41c004bb0 con 0x7fa428106800 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.099+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa428198040 con 0x7fa428106800 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.100+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa428101f40 con 0x7fa428106800 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.101+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa41c004e60 con 0x7fa428106800 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.102+0000 7fa40ffff640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 0x7fa41007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.102+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fa41c09dc50 con 0x7fa428106800 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.102+0000 7fa426ffd640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 0x7fa41007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.102+0000 7fa426ffd640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 0x7fa41007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa418006010 tx=0x7fa4180095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:51.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.106+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa41c069250 con 0x7fa428106800 2024-09-20T19:09:51.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.295+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fa428109d80 con 0x7fa428106800 2024-09-20T19:09:51.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.296+0000 7fa40ffff640 1 -- 172.21.15.27:0/2469282361 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v65)=0 v65) ==== 155+0+0 (secure 0 0 0) 0x7fa41c06e100 con 0x7fa428106800 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 msgr2=0x7fa41007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 0x7fa41007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa418006010 tx=0x7fa4180095f0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 msgr2=0x7fa42819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d6f0 tx=0x7fa41c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 shutdown_connections 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa41007af30 0x7fa41007d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa428106800 0x7fa42819db80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 --2- 172.21.15.27:0/2469282361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa428100800 0x7fa42819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 >> 172.21.15.27:0/2469282361 conn(0x7fa4280fc520 msgr2=0x7fa42806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 shutdown_connections 2024-09-20T19:09:51.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:51.298+0000 7fa42d527640 1 -- 172.21.15.27:0/2469282361 wait complete. 2024-09-20T19:09:51.966 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:51 smithi027 ceph-mon[28196]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:09:51.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:51 smithi098 ceph-mon[35737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:09:51.998 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-20T19:09:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 -- 172.21.15.27:0/1675264891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d641033e0 msgr2=0x7f9d6410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 --2- 172.21.15.27:0/1675264891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d641033e0 0x7f9d6410b8d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009880 tx=0x7f9d5802a530 comp rx=0 tx=0).stop 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 -- 172.21.15.27:0/1675264891 shutdown_connections 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 --2- 172.21.15.27:0/1675264891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d641033e0 0x7f9d6410b8d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 --2- 172.21.15.27:0/1675264891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d64102ac0 0x7f9d64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.782+0000 7f9d69543640 1 -- 172.21.15.27:0/1675264891 >> 172.21.15.27:0/1675264891 conn(0x7f9d640fc520 msgr2=0x7f9d640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:52.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 -- 172.21.15.27:0/1675264891 shutdown_connections 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 -- 172.21.15.27:0/1675264891 wait complete. 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 Processor -- start 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 -- start start 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d641033e0 0x7f9d6419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6410edd0 con 0x7f9d64102ac0 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.783+0000 7f9d69543640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6410ec50 con 0x7f9d641033e0 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58210/0 (socket says 172.21.15.27:58210) 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 -- 172.21.15.27:0/841818725 learned_addr learned my addr 172.21.15.27:0/841818725 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d627fc640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d641033e0 0x7f9d6419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:52.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 -- 172.21.15.27:0/841818725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d641033e0 msgr2=0x7f9d6419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d641033e0 0x7f9d6419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 -- 172.21.15.27:0/841818725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d641977e0 con 0x7f9d64102ac0 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d62ffd640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c8a0 tx=0x7f9d5400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d540079b0 con 0x7f9d64102ac0 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d54007b50 con 0x7f9d64102ac0 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d64197ad0 con 0x7f9d64102ac0 2024-09-20T19:09:52.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d54018700 con 0x7f9d64102ac0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.784+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d64198030 con 0x7f9d64102ac0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.785+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6406aa90 con 0x7f9d64102ac0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.786+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9d54007d00 con 0x7f9d64102ac0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.787+0000 7f9d4bfff640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 0x7f9d4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.787+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f9d5409e250 con 0x7f9d64102ac0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.787+0000 7f9d627fc640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 0x7f9d4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.787+0000 7f9d627fc640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 0x7f9d4c07d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d64198b30 tx=0x7f9d58031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:52.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.791+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9d54014030 con 0x7f9d64102ac0 2024-09-20T19:09:52.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:52 smithi098 ceph-mon[35737]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:52.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.981+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f9d64105f60 con 0x7f9d64102ac0 2024-09-20T19:09:52.984 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:52 smithi027 ceph-mon[28196]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:52.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.981+0000 7f9d4bfff640 1 -- 172.21.15.27:0/841818725 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v65)=0 v65) ==== 163+0+0 (secure 0 0 0) 0x7f9d540698d0 con 0x7f9d64102ac0 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 msgr2=0x7f9d4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 0x7f9d4c07d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d64198b30 tx=0x7f9d58031420 comp rx=0 tx=0).stop 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 msgr2=0x7f9d6419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c8a0 tx=0x7f9d5400cd60 comp rx=0 tx=0).stop 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 shutdown_connections 2024-09-20T19:09:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9d4c07af80 0x7f9d4c07d440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d641033e0 0x7f9d6419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 --2- 172.21.15.27:0/841818725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d64102ac0 0x7f9d6419d660 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 >> 172.21.15.27:0/841818725 conn(0x7f9d640fc520 msgr2=0x7f9d64108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 shutdown_connections 2024-09-20T19:09:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:52.983+0000 7f9d69543640 1 -- 172.21.15.27:0/841818725 wait complete. 2024-09-20T19:09:53.661 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-20T19:09:53.920 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 -- 172.21.15.27:0/2395931263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 msgr2=0x7eff5c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 --2- 172.21.15.27:0/2395931263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c100c70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff50009880 tx=0x7eff5002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 -- 172.21.15.27:0/2395931263 shutdown_connections 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 --2- 172.21.15.27:0/2395931263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c100c70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 --2- 172.21.15.27:0/2395931263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 -- 172.21.15.27:0/2395931263 >> 172.21.15.27:0/2395931263 conn(0x7eff5c0fc510 msgr2=0x7eff5c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 -- 172.21.15.27:0/2395931263 shutdown_connections 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 -- 172.21.15.27:0/2395931263 wait complete. 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.405+0000 7eff63c35640 1 Processor -- start 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff63c35640 1 -- start start 2024-09-20T19:09:54.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff63c35640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff63c35640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff63c35640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c10dcc0 con 0x7eff5c100810 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff63c35640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c10db40 con 0x7eff5c106810 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58228/0 (socket says 172.21.15.27:58228) 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 -- 172.21.15.27:0/3348395436 learned_addr learned my addr 172.21.15.27:0/3348395436 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff611d0640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 -- 172.21.15.27:0/3348395436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 msgr2=0x7eff5c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 -- 172.21.15.27:0/3348395436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c1977f0 con 0x7eff5c100810 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff611d0640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:09:54.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.406+0000 7eff619d1640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00cc60 tx=0x7eff4c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.407+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff4c00ce10 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.407+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff4c00f910 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.407+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c197ae0 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.407+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff4c018ae0 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.407+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c198070 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.408+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c101f50 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.409+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7eff4c018c80 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.409+0000 7eff5affd640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 0x7eff4407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.410+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7eff4c09e6f0 con 0x7eff5c100810 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.410+0000 7eff611d0640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 0x7eff4407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.410+0000 7eff611d0640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 0x7eff4407d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff50031460 tx=0x7eff500095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.414+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7eff4c014030 con 0x7eff5c100810 2024-09-20T19:09:54.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.603+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7eff5c109db0 con 0x7eff5c100810 2024-09-20T19:09:54.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.603+0000 7eff5affd640 1 -- 172.21.15.27:0/3348395436 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v65)=0 v65) ==== 135+0+0 (secure 0 0 0) 0x7eff4c069cd0 con 0x7eff5c100810 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 msgr2=0x7eff4407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 0x7eff4407d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff50031460 tx=0x7eff500095f0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 msgr2=0x7eff5c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00cc60 tx=0x7eff4c00a620 comp rx=0 tx=0).stop 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 shutdown_connections 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff4407af80 0x7eff4407d440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff5c106810 0x7eff5c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 --2- 172.21.15.27:0/3348395436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff5c100810 0x7eff5c19d670 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 >> 172.21.15.27:0/3348395436 conn(0x7eff5c0fc510 msgr2=0x7eff5c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 shutdown_connections 2024-09-20T19:09:54.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:54.606+0000 7eff63c35640 1 -- 172.21.15.27:0/3348395436 wait complete. 2024-09-20T19:09:54.907 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:54 smithi027 ceph-mon[28196]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:54.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:54 smithi098 ceph-mon[35737]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:09:55.270 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-20T19:09:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:56.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 -- 172.21.15.27:0/4124604267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0520102ac0 msgr2=0x7f0520102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 --2- 172.21.15.27:0/4124604267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0520102ac0 0x7f0520102ea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0508009880 tx=0x7f050802a530 comp rx=0 tx=0).stop 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 -- 172.21.15.27:0/4124604267 shutdown_connections 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 --2- 172.21.15.27:0/4124604267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05201033e0 0x7f052010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 --2- 172.21.15.27:0/4124604267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0520102ac0 0x7f0520102ea0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 -- 172.21.15.27:0/4124604267 >> 172.21.15.27:0/4124604267 conn(0x7f05200fc520 msgr2=0x7f05200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 -- 172.21.15.27:0/4124604267 shutdown_connections 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.045+0000 7f0524ed2640 1 -- 172.21.15.27:0/4124604267 wait complete. 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 Processor -- start 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 -- start start 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 0x7f052019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f052010edf0 con 0x7f05201033e0 2024-09-20T19:09:56.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.046+0000 7f0524ed2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f052010ec70 con 0x7f0520102ac0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50932/0 (socket says 172.21.15.27:50932) 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 -- 172.21.15.27:0/3398034704 learned_addr learned my addr 172.21.15.27:0/3398034704 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051e59c640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 0x7f052019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 -- 172.21.15.27:0/3398034704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 msgr2=0x7f052019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 0x7f052019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 -- 172.21.15.27:0/3398034704 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05201977e0 con 0x7f05201033e0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051e59c640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 0x7f052019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f051dd9b640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f051000d6d0 tx=0x7f051000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f05201033e0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05100054e0 con 0x7f05201033e0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0520197ad0 con 0x7f05201033e0 2024-09-20T19:09:56.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0510004ae0 con 0x7f05201033e0 2024-09-20T19:09:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.047+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0520198060 con 0x7f05201033e0 2024-09-20T19:09:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.048+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052006aa90 con 0x7f05201033e0 2024-09-20T19:09:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.049+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0510004d90 con 0x7f05201033e0 2024-09-20T19:09:56.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.050+0000 7f05177fe640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 0x7f050c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.050+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f051009db50 con 0x7f05201033e0 2024-09-20T19:09:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.050+0000 7f051e59c640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 0x7f050c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.050+0000 7f051e59c640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 0x7f050c07d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0508000c00 tx=0x7f0508031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.054+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f05100691d0 con 0x7f05201033e0 2024-09-20T19:09:56.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.259+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}) -- 0x7f0520198310 con 0x7f050c07af80 2024-09-20T19:09:56.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.265+0000 7f05177fe640 1 -- 172.21.15.27:0/3398034704 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f0520198310 con 0x7f050c07af80 2024-09-20T19:09:56.269 INFO:teuthology.orchestra.run.smithi027.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:09:56.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.267+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 msgr2=0x7f050c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.267+0000 7f0524ed2640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 0x7f050c07d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0508000c00 tx=0x7f0508031400 comp rx=0 tx=0).stop 2024-09-20T19:09:56.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.267+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 msgr2=0x7f052019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.267+0000 7f0524ed2640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f051000d6d0 tx=0x7f051000db90 comp rx=0 tx=0).stop 2024-09-20T19:09:56.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 shutdown_connections 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050c07af80 0x7f050c07d440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f05201033e0 0x7f052019dba0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 --2- 172.21.15.27:0/3398034704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0520102ac0 0x7f052019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 >> 172.21.15.27:0/3398034704 conn(0x7f05200fc520 msgr2=0x7f0520108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 shutdown_connections 2024-09-20T19:09:56.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:56.268+0000 7f0524ed2640 1 -- 172.21.15.27:0/3398034704 wait complete. 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:56.960 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:56 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:56.961 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T19:09:56.962 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:09:56.962 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-20T19:09:56.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:56.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:56.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:56.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:09:56.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:09:56.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:56 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:57.229 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:09:57.926 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:57 smithi027 ceph-mon[28196]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.926 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:57 smithi027 ceph-mon[28196]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:09:57.926 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:57 smithi027 ceph-mon[28196]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:09:57.926 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:57 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:57.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:57 smithi098 ceph-mon[35737]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:57 smithi098 ceph-mon[35737]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:09:57.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:57 smithi098 ceph-mon[35737]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T19:09:57.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:57 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- 172.21.15.27:0/1621827835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 msgr2=0x7eff3c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 --2- 172.21.15.27:0/1621827835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c100c50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7eff24009880 tx=0x7eff2402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- 172.21.15.27:0/1621827835 shutdown_connections 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 --2- 172.21.15.27:0/1621827835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c100c50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 --2- 172.21.15.27:0/1621827835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 0x7eff3c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- 172.21.15.27:0/1621827835 >> 172.21.15.27:0/1621827835 conn(0x7eff3c0fc550 msgr2=0x7eff3c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- 172.21.15.27:0/1621827835 shutdown_connections 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- 172.21.15.27:0/1621827835 wait complete. 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 Processor -- start 2024-09-20T19:09:57.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.922+0000 7eff4208a640 1 -- start start 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff4208a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff4208a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 0x7eff3c0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff4208a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c10dd20 con 0x7eff3c1007f0 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff4208a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c10dba0 con 0x7eff3c1067f0 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50954/0 (socket says 172.21.15.27:50954) 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 -- 172.21.15.27:0/312619802 learned_addr learned my addr 172.21.15.27:0/312619802 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3affd640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 0x7eff3c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 -- 172.21.15.27:0/312619802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 msgr2=0x7eff3c0fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 0x7eff3c0fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 -- 172.21.15.27:0/312619802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c0fd790 con 0x7eff3c1007f0 2024-09-20T19:09:57.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff3b7fe640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00ba50 tx=0x7eff2c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.923+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff2c019070 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.924+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff2c00ce20 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.924+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c0fda80 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.924+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff2c0075a0 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.924+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c1a3eb0 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.925+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3c101f30 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.925+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7eff2c01c070 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.926+0000 7eff38ff9640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 0x7eff2807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.926+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7eff2c09d800 con 0x7eff3c1007f0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.926+0000 7eff3affd640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 0x7eff2807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.927+0000 7eff3affd640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 0x7eff2807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff24031460 tx=0x7eff24009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:57.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:57.931+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7eff2c068e80 con 0x7eff3c1007f0 2024-09-20T19:09:58.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.150+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7eff3c062630 con 0x7eff2807af80 2024-09-20T19:09:58.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.151+0000 7eff38ff9640 1 -- 172.21.15.27:0/312619802 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7eff3c062630 con 0x7eff2807af80 2024-09-20T19:09:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 msgr2=0x7eff2807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 0x7eff2807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff24031460 tx=0x7eff24009560 comp rx=0 tx=0).stop 2024-09-20T19:09:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 msgr2=0x7eff3c0fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00ba50 tx=0x7eff2c00bf10 comp rx=0 tx=0).stop 2024-09-20T19:09:58.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 shutdown_connections 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7eff2807af80 0x7eff2807d440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff3c1067f0 0x7eff3c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 --2- 172.21.15.27:0/312619802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff3c1007f0 0x7eff3c0fcd10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 >> 172.21.15.27:0/312619802 conn(0x7eff3c0fc550 msgr2=0x7eff3c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 shutdown_connections 2024-09-20T19:09:58.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.153+0000 7eff4208a640 1 -- 172.21.15.27:0/312619802 wait complete. 2024-09-20T19:09:58.166 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:09:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 -- 172.21.15.27:0/4063588676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 msgr2=0x7f22a8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 --2- 172.21.15.27:0/4063588676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a8100c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2290009880 tx=0x7f229002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 -- 172.21.15.27:0/4063588676 shutdown_connections 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 --2- 172.21.15.27:0/4063588676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a8100c50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 --2- 172.21.15.27:0/4063588676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 0x7f22a8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.239+0000 7f22ac98e640 1 -- 172.21.15.27:0/4063588676 >> 172.21.15.27:0/4063588676 conn(0x7f22a80fc550 msgr2=0x7f22a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.240+0000 7f22ac98e640 1 -- 172.21.15.27:0/4063588676 shutdown_connections 2024-09-20T19:09:58.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.240+0000 7f22ac98e640 1 -- 172.21.15.27:0/4063588676 wait complete. 2024-09-20T19:09:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.240+0000 7f22ac98e640 1 Processor -- start 2024-09-20T19:09:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.240+0000 7f22ac98e640 1 -- start start 2024-09-20T19:09:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22ac98e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22ac98e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 0x7f22a8196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22ac98e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22a810dcc0 con 0x7f22a81007f0 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22ac98e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22a810db40 con 0x7f22a81067f0 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50968/0 (socket says 172.21.15.27:50968) 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 -- 172.21.15.27:0/3811025849 learned_addr learned my addr 172.21.15.27:0/3811025849 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a5d9b640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 0x7f22a8196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 -- 172.21.15.27:0/3811025849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 msgr2=0x7f22a8196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 0x7f22a8196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.241+0000 7f22a659c640 1 -- 172.21.15.27:0/3811025849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a8197060 con 0x7f22a81007f0 2024-09-20T19:09:58.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f22a659c640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f229800ea00 tx=0x7f229800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f229800cb80 con 0x7f22a81007f0 2024-09-20T19:09:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f229800cd20 con 0x7f22a81007f0 2024-09-20T19:09:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2298011470 con 0x7f22a81007f0 2024-09-20T19:09:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a8197350 con 0x7f22a81007f0 2024-09-20T19:09:58.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.242+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a81a3e20 con 0x7f22a81007f0 2024-09-20T19:09:58.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.243+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8101f30 con 0x7f22a81007f0 2024-09-20T19:09:58.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.244+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2298005020 con 0x7f22a81007f0 2024-09-20T19:09:58.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.245+0000 7f229f7fe640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 0x7f229407d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.245+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f229809e2e0 con 0x7f22a81007f0 2024-09-20T19:09:58.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.245+0000 7f22a5d9b640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 0x7f229407d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.246+0000 7f22a5d9b640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 0x7f229407d490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22a8198740 tx=0x7f2290031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.249+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2298016030 con 0x7f22a81007f0 2024-09-20T19:09:58.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.455+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f22a8062630 con 0x7f229407afd0 2024-09-20T19:09:58.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.457+0000 7f229f7fe640 1 -- 172.21.15.27:0/3811025849 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f22a8062630 con 0x7f229407afd0 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 msgr2=0x7f229407d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 0x7f229407d490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22a8198740 tx=0x7f2290031400 comp rx=0 tx=0).stop 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 msgr2=0x7f22a81965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f229800ea00 tx=0x7f229800eec0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 shutdown_connections 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f229407afd0 0x7f229407d490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a81067f0 0x7f22a8196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 --2- 172.21.15.27:0/3811025849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22a81007f0 0x7f22a81965e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 >> 172.21.15.27:0/3811025849 conn(0x7f22a80fc550 msgr2=0x7f22a80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 shutdown_connections 2024-09-20T19:09:58.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.459+0000 7f22ac98e640 1 -- 172.21.15.27:0/3811025849 wait complete. 2024-09-20T19:09:58.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 -- 172.21.15.27:0/1772489033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 msgr2=0x7f5264106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 --2- 172.21.15.27:0/1772489033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f5264106be0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5254009880 tx=0x7f525402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 -- 172.21.15.27:0/1772489033 shutdown_connections 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 --2- 172.21.15.27:0/1772489033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 0x7f5264100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 --2- 172.21.15.27:0/1772489033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f5264106be0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 -- 172.21.15.27:0/1772489033 >> 172.21.15.27:0/1772489033 conn(0x7f52640fc520 msgr2=0x7f52640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 -- 172.21.15.27:0/1772489033 shutdown_connections 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.543+0000 7f5269adb640 1 -- 172.21.15.27:0/1772489033 wait complete. 2024-09-20T19:09:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 Processor -- start 2024-09-20T19:09:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 -- start start 2024-09-20T19:09:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 0x7f526419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f526410dd30 con 0x7f5264106800 2024-09-20T19:09:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.544+0000 7f5269adb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f526410dbb0 con 0x7f5264100800 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50988/0 (socket says 172.21.15.27:50988) 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 -- 172.21.15.27:0/3340344973 learned_addr learned my addr 172.21.15.27:0/3340344973 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f52637fe640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 0x7f526419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 -- 172.21.15.27:0/3340344973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 msgr2=0x7f526419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 0x7f526419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 -- 172.21.15.27:0/3340344973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5264197880 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5262ffd640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f525800b420 tx=0x7f525800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5258011630 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5264197b70 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5258016070 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5258010d40 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.545+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5264198100 con 0x7f5264106800 2024-09-20T19:09:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.546+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5264101f40 con 0x7f5264106800 2024-09-20T19:09:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.547+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f525801b460 con 0x7f5264106800 2024-09-20T19:09:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.548+0000 7f5260ff9640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 0x7f524c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.548+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f525809d6f0 con 0x7f5264106800 2024-09-20T19:09:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.548+0000 7f52637fe640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 0x7f524c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.548+0000 7f52637fe640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 0x7f524c07d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5254000c00 tx=0x7f5254031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.552+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5258021250 con 0x7f5264106800 2024-09-20T19:09:58.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.752+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5264198db0 con 0x7f524c07af80 2024-09-20T19:09:58.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.761+0000 7f5260ff9640 1 -- 172.21.15.27:0/3340344973 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5264198db0 con 0x7f524c07af80 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (75s) 46s ago 12m 16.8M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (3m) 46s ago 12m 8380k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (3m) 2m ago 11m 8456k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (12m) 46s ago 12m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (11m) 2m ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (52s) 46s ago 11m 45.9M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (6m) 46s ago 6m 92.6M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (6m) 46s ago 6m 15.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (6m) 2m ago 6m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (6m) 2m ago 6m 15.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:09:58.766 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (3m) 46s ago 13m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (2m) 2m ago 11m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (13m) 46s ago 13m 60.1M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 632c3f8c9aaa 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (11m) 2m ago 11m 43.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab d6acc04be961 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (2m) 46s ago 12m 8124k - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 2m ago 11m 3481k - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (10m) 46s ago 10m 211M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (9m) 46s ago 9m 227M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (9m) 46s ago 9m 217M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (8m) 2m ago 8m 240M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (8m) 2m ago 8m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (7m) 2m ago 7m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:09:58.767 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (96s) 46s ago 11m 43.7M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.763+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 msgr2=0x7f524c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.763+0000 7f5269adb640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 0x7f524c07d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5254000c00 tx=0x7f5254031400 comp rx=0 tx=0).stop 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.763+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 msgr2=0x7f526419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.763+0000 7f5269adb640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f525800b420 tx=0x7f525800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 shutdown_connections 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f524c07af80 0x7f524c07d440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5264106800 0x7f526419dc00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 --2- 172.21.15.27:0/3340344973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5264100800 0x7f526419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 >> 172.21.15.27:0/3340344973 conn(0x7f52640fc520 msgr2=0x7f526406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 shutdown_connections 2024-09-20T19:09:58.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.764+0000 7f5269adb640 1 -- 172.21.15.27:0/3340344973 wait complete. 2024-09-20T19:09:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:58 smithi027 ceph-mon[28196]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 -- 172.21.15.27:0/489208667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 msgr2=0x7f7efc104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 --2- 172.21.15.27:0/489208667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc104c50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00a990 tx=0x7f7eec02b7d0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 -- 172.21.15.27:0/489208667 shutdown_connections 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 --2- 172.21.15.27:0/489208667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc104c50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 --2- 172.21.15.27:0/489208667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.847+0000 7f7f03400640 1 -- 172.21.15.27:0/489208667 >> 172.21.15.27:0/489208667 conn(0x7f7efc0fbc90 msgr2=0x7f7efc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.848+0000 7f7f03400640 1 -- 172.21.15.27:0/489208667 shutdown_connections 2024-09-20T19:09:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.848+0000 7f7f03400640 1 -- 172.21.15.27:0/489208667 wait complete. 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.848+0000 7f7f03400640 1 Processor -- start 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.848+0000 7f7f03400640 1 -- start start 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f03400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f03400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f03400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10cc30 con 0x7f7efc100c00 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f03400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10cab0 con 0x7f7efc100250 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51000/0 (socket says 172.21.15.27:51000) 2024-09-20T19:09:58.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 -- 172.21.15.27:0/3540534433 learned_addr learned my addr 172.21.15.27:0/3540534433 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0119c640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 -- 172.21.15.27:0/3540534433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 msgr2=0x7f7efc19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 -- 172.21.15.27:0/3540534433 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc197810 con 0x7f7efc100c00 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0119c640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.849+0000 7f7f0099b640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7eec006010 tx=0x7f7eec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.850+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7eec044020 con 0x7f7efc100c00 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.850+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc197aa0 con 0x7f7efc100c00 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.850+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7eec004b80 con 0x7f7efc100c00 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.850+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7eec003820 con 0x7f7efc100c00 2024-09-20T19:09:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.850+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc198030 con 0x7f7efc100c00 2024-09-20T19:09:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.851+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc101730 con 0x7f7efc100c00 2024-09-20T19:09:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.851+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7eec047020 con 0x7f7efc100c00 2024-09-20T19:09:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.852+0000 7f7ef27fc640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 0x7f7ee807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.852+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f7eec0bf540 con 0x7f7efc100c00 2024-09-20T19:09:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.852+0000 7f7f0119c640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 0x7f7ee807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.852+0000 7f7f0119c640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 0x7f7ee807d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:58.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:58.856+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7eec04e020 con 0x7f7efc100c00 2024-09-20T19:09:58.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:58 smithi098 ceph-mon[35737]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:09:59.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.120+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7efc10a570 con 0x7f7efc100c00 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.121+0000 7f7ef27fc640 1 -- 172.21.15.27:0/3540534433 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f7eec08ac00 con 0x7f7efc100c00 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:09:59.125 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:09:59.126 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 msgr2=0x7f7ee807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 0x7f7ee807d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8008040 comp rx=0 tx=0).stop 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 msgr2=0x7f7efc19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7eec006010 tx=0x7f7eec004270 comp rx=0 tx=0).stop 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 shutdown_connections 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7ee807af30 0x7f7ee807d3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7efc100c00 0x7f7efc19dbd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 --2- 172.21.15.27:0/3540534433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7efc100250 0x7f7efc19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 >> 172.21.15.27:0/3540534433 conn(0x7f7efc0fbc90 msgr2=0x7f7efc0fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 shutdown_connections 2024-09-20T19:09:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.124+0000 7f7f03400640 1 -- 172.21.15.27:0/3540534433 wait complete. 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 -- 172.21.15.27:0/533676736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 msgr2=0x7f0430100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 --2- 172.21.15.27:0/533676736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f0430100aa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0420009880 tx=0x7f042002a490 comp rx=0 tx=0).stop 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 -- 172.21.15.27:0/533676736 shutdown_connections 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 --2- 172.21.15.27:0/533676736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 --2- 172.21.15.27:0/533676736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f0430100aa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.213+0000 7f0437bed640 1 -- 172.21.15.27:0/533676736 >> 172.21.15.27:0/533676736 conn(0x7f04300fc550 msgr2=0x7f04300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.214+0000 7f0437bed640 1 -- 172.21.15.27:0/533676736 shutdown_connections 2024-09-20T19:09:59.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.214+0000 7f0437bed640 1 -- 172.21.15.27:0/533676736 wait complete. 2024-09-20T19:09:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.214+0000 7f0437bed640 1 Processor -- start 2024-09-20T19:09:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0437bed640 1 -- start start 2024-09-20T19:09:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0437bed640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0437bed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0437bed640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0430110fe0 con 0x7f04301006c0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0437bed640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0430110e60 con 0x7f0430101070 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51016/0 (socket says 172.21.15.27:51016) 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 -- 172.21.15.27:0/2786721606 learned_addr learned my addr 172.21.15.27:0/2786721606 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435188640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 -- 172.21.15.27:0/2786721606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 msgr2=0x7f043019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435989640 1 -- 172.21.15.27:0/2786721606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04301999f0 con 0x7f04301006c0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.215+0000 7f0435188640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f0435989640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0420031460 tx=0x7f04200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f042003f070 con 0x7f04301006c0 2024-09-20T19:09:59.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04200044d0 con 0x7f04301006c0 2024-09-20T19:09:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0430199c80 con 0x7f04301006c0 2024-09-20T19:09:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0420035030 con 0x7f04301006c0 2024-09-20T19:09:59.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.216+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043019a210 con 0x7f04301006c0 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.217+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043006a500 con 0x7f04301006c0 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.218+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0420042070 con 0x7f04301006c0 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.218+0000 7f042effd640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 0x7f041807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.219+0000 7f0435188640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 0x7f041807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.219+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f04200beb20 con 0x7f04301006c0 2024-09-20T19:09:59.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.219+0000 7f0435188640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 0x7f041807d450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04300fef40 tx=0x7f04240073c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.223+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0420004cf0 con 0x7f04301006c0 2024-09-20T19:09:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.470+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f043019af20 con 0x7f04301006c0 2024-09-20T19:09:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.470+0000 7f042effd640 1 -- 172.21.15.27:0/2786721606 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7f042008a1a0 con 0x7f04301006c0 2024-09-20T19:09:59.474 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:09:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:09:59.476 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:59.478 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 msgr2=0x7f041807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 0x7f041807d450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04300fef40 tx=0x7f04240073c0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 msgr2=0x7f043019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0420031460 tx=0x7f04200048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 shutdown_connections 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f041807af90 0x7f041807d450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0430101070 0x7f043019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 --2- 172.21.15.27:0/2786721606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04301006c0 0x7f043019f830 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 >> 172.21.15.27:0/2786721606 conn(0x7f04300fc550 msgr2=0x7f04300fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 shutdown_connections 2024-09-20T19:09:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.473+0000 7f0437bed640 1 -- 172.21.15.27:0/2786721606 wait complete. 2024-09-20T19:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 -- 172.21.15.27:0/1367048712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 msgr2=0x7f7844101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 --2- 172.21.15.27:0/1367048712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f7844101d60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7838009c20 tx=0x7f783802a970 comp rx=0 tx=0).stop 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 -- 172.21.15.27:0/1367048712 shutdown_connections 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 --2- 172.21.15.27:0/1367048712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f7844101d60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 --2- 172.21.15.27:0/1367048712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7844107900 0x7f7844107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 -- 172.21.15.27:0/1367048712 >> 172.21.15.27:0/1367048712 conn(0x7f78440fd600 msgr2=0x7f78440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 -- 172.21.15.27:0/1367048712 shutdown_connections 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.560+0000 7f784b407640 1 -- 172.21.15.27:0/1367048712 wait complete. 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 Processor -- start 2024-09-20T19:09:59.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 -- start start 2024-09-20T19:09:59.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7844107900 0x7f784419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f784410edd0 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f784b407640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f784410ec50 con 0x7f7844107900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51030/0 (socket says 172.21.15.27:51030) 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 -- 172.21.15.27:0/1951183619 learned_addr learned my addr 172.21.15.27:0/1951183619 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 -- 172.21.15.27:0/1951183619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7844107900 msgr2=0x7f784419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7844107900 0x7f784419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.561+0000 7f78491a3640 1 -- 172.21.15.27:0/1951183619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441977a0 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f78491a3640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f783400d6f0 tx=0x7f783400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7834017070 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f783400de00 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7844197a90 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7834004bb0 con 0x7f7844101900 2024-09-20T19:09:59.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.562+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7844198020 con 0x7f7844101900 2024-09-20T19:09:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.563+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844103040 con 0x7f7844101900 2024-09-20T19:09:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.564+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7834004e60 con 0x7f7844101900 2024-09-20T19:09:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.564+0000 7f78427fc640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 0x7f782c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.564+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f783409dc50 con 0x7f7844101900 2024-09-20T19:09:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.564+0000 7f78489a2640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 0x7f782c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.565+0000 7f78489a2640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 0x7f782c07d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7838009430 tx=0x7f78380093a0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.569+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7834069250 con 0x7f7844101900 2024-09-20T19:09:59.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.778+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f78441982d0 con 0x7f782c07af30 2024-09-20T19:09:59.782 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.782 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.782 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/3540534433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T19:09:59.783 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:09:59 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2786721606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:09:59.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.779+0000 7f78427fc640 1 -- 172.21.15.27:0/1951183619 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f78441982d0 con 0x7f782c07af30 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "2/23 daemons upgraded", 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T19:09:59.784 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:09:59.785 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:09:59.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 msgr2=0x7f782c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 0x7f782c07d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7838009430 tx=0x7f78380093a0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 msgr2=0x7f784419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f783400d6f0 tx=0x7f783400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 shutdown_connections 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f782c07af30 0x7f782c07d3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7844107900 0x7f784419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 --2- 172.21.15.27:0/1951183619 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7844101900 0x7f784419d620 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 >> 172.21.15.27:0/1951183619 conn(0x7f78440fd600 msgr2=0x7f78440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 shutdown_connections 2024-09-20T19:09:59.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.782+0000 7f784b407640 1 -- 172.21.15.27:0/1951183619 wait complete. 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- 172.21.15.27:0/3920772388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c1033d0 msgr2=0x7f419c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 --2- 172.21.15.27:0/3920772388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c1033d0 0x7f419c10b8c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4190009880 tx=0x7f419002a530 comp rx=0 tx=0).stop 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- 172.21.15.27:0/3920772388 shutdown_connections 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 --2- 172.21.15.27:0/3920772388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c1033d0 0x7f419c10b8c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 --2- 172.21.15.27:0/3920772388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c102ab0 0x7f419c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- 172.21.15.27:0/3920772388 >> 172.21.15.27:0/3920772388 conn(0x7f419c0fc550 msgr2=0x7f419c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:59.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- 172.21.15.27:0/3920772388 shutdown_connections 2024-09-20T19:09:59.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- 172.21.15.27:0/3920772388 wait complete. 2024-09-20T19:09:59.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 Processor -- start 2024-09-20T19:09:59.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.869+0000 7f41a2892640 1 -- start start 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f41a2892640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f41a2892640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c1033d0 0x7f419c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f41a2892640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10ee40 con 0x7f419c102ab0 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f41a2892640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10ecc0 con 0x7f419c1033d0 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51046/0 (socket says 172.21.15.27:51046) 2024-09-20T19:09:59.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 -- 172.21.15.27:0/2097917977 learned_addr learned my addr 172.21.15.27:0/2097917977 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419b7fe640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c1033d0 0x7f419c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 -- 172.21.15.27:0/2097917977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c1033d0 msgr2=0x7f419c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c1033d0 0x7f419c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.870+0000 7f419bfff640 1 -- 172.21.15.27:0/2097917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c197830 con 0x7f419c102ab0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f419bfff640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f418c00b420 tx=0x7f418c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418c011630 con 0x7f419c102ab0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f418c016070 con 0x7f419c102ab0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c197b20 con 0x7f419c102ab0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418c010d40 con 0x7f419c102ab0 2024-09-20T19:09:59.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.871+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c198080 con 0x7f419c102ab0 2024-09-20T19:09:59.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.872+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c06a580 con 0x7f419c102ab0 2024-09-20T19:09:59.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.873+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f418c01b460 con 0x7f419c102ab0 2024-09-20T19:09:59.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.873+0000 7f41997fa640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 0x7f418407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:59.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.873+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f418c09d5f0 con 0x7f419c102ab0 2024-09-20T19:09:59.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.873+0000 7f419b7fe640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 0x7f418407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:59.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.874+0000 7f419b7fe640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 0x7f418407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f419c198b80 tx=0x7f4190031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:59.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:09:59.878+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f418c068c70 con 0x7f419c102ab0 2024-09-20T19:09:59.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/3540534433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T19:09:59.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:09:59 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2786721606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T19:10:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.145+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f419c105f50 con 0x7f419c102ab0 2024-09-20T19:10:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.145+0000 7f41997fa640 1 -- 172.21.15.27:0/2097917977 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f418c06db20 con 0x7f419c102ab0 2024-09-20T19:10:00.149 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.149 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.149 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:00.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.147+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 msgr2=0x7f418407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:00.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.147+0000 7f41a2892640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 0x7f418407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f419c198b80 tx=0x7f4190031400 comp rx=0 tx=0).stop 2024-09-20T19:10:00.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.147+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 msgr2=0x7f419c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:00.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.147+0000 7f41a2892640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f418c00b420 tx=0x7f418c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 shutdown_connections 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f418407af80 0x7f418407d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f419c1033d0 0x7f419c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 --2- 172.21.15.27:0/2097917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f419c102ab0 0x7f419c19d6b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 >> 172.21.15.27:0/2097917977 conn(0x7f419c0fc550 msgr2=0x7f419c108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 shutdown_connections 2024-09-20T19:10:00.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:00.148+0000 7f41a2892640 1 -- 172.21.15.27:0/2097917977 wait complete. 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: Upgrade: Setting container_image for all mgr 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:00.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='client.? 172.21.15.27:0/2097917977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T19:10:00.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:00.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T19:10:00.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T19:10:00.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:00 smithi027 ceph-mon[28196]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:00.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: Upgrade: Setting container_image for all mgr 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='client.? 172.21.15.27:0/2097917977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T19:10:00.991 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T19:10:00.992 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:00 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:01.883 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:01 smithi027 ceph-mon[28196]: Upgrade: Updating mon.smithi027 2024-09-20T19:10:01.883 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:01 smithi027 ceph-mon[28196]: Deploying daemon mon.smithi027 on smithi027 2024-09-20T19:10:01.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:01 smithi098 ceph-mon[35737]: Upgrade: Updating mon.smithi027 2024-09-20T19:10:01.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:01 smithi098 ceph-mon[35737]: Deploying daemon mon.smithi027 on smithi027 2024-09-20T19:10:02.475 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 systemd[1]: Stopping Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:02.777 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[28192]: 2024-09-20T19:10:02.471+0000 7f2ef65a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi027 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:10:02.777 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[28192]: 2024-09-20T19:10:02.471+0000 7f2ef65a1640 -1 mon.smithi027@0(leader) e2 *** Got Signal Terminated *** 2024-09-20T19:10:02.777 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 podman[109915]: 2024-09-20 19:10:02.513318685 +0000 UTC m=+0.148569519 container died 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-20T19:10:03.045 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 podman[109915]: 2024-09-20 19:10:02.863694646 +0000 UTC m=+0.498945478 container cleanup 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T19:10:03.046 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:02 smithi027 bash[109915]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027 2024-09-20T19:10:03.310 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 podman[109927]: 2024-09-20 19:10:03.131782314 +0000 UTC m=+0.620761507 container remove 632c3f8c9aaad34f103a3238df2f4a350b8cc22107756860b7547fbdf88dd781 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T19:10:03.311 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service: Deactivated successfully. 2024-09-20T19:10:03.311 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 systemd[1]: Stopped Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:10:03.311 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service: Consumed 14.550s CPU time. 2024-09-20T19:10:03.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 systemd[1]: Starting Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:03.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 podman[110063]: 2024-09-20 19:10:03.618419756 +0000 UTC m=+0.016681919 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:10:03.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:03 smithi027 podman[110063]: 2024-09-20 19:10:03.749699788 +0000 UTC m=+0.147961979 container create 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-20T19:10:04.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 podman[110063]: 2024-09-20 19:10:04.015129036 +0000 UTC m=+0.413391192 container init 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:10:04.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 podman[110063]: 2024-09-20 19:10:04.018593778 +0000 UTC m=+0.416855929 container start 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD) 2024-09-20T19:10:04.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T19:10:04.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev), process ceph-mon, pid 2 2024-09-20T19:10:04.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: pidfile_write: ignore empty --pid-file 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: load: jerasure load: lrc 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: RocksDB version: 7.9.2 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Git sha 0 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Compile date 2024-09-20 10:48:39 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: DB SUMMARY 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: DB Session ID: 9WFPUMU0T6982O68Y7X1 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: CURRENT file: CURRENT 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1507 Bytes 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi027/store.db dir, Total Num: 1, files: 000032.sst 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi027/store.db: 000030.log size: 2682924 ; 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.error_if_exists: 0 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.create_if_missing: 0 2024-09-20T19:10:04.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.paranoid_checks: 1 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.env: 0x55c0ba4a9120 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.info_log: 0x55c0bb6cd8e0 2024-09-20T19:10:04.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T19:10:04.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.statistics: (nil) 2024-09-20T19:10:04.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.use_fsync: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_log_file_size: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_fallocate: 1 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T19:10:04.323 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.use_direct_reads: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.db_log_dir: 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.wal_dir: 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T19:10:04.324 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.write_buffer_manager: 0x55c0bb6d1b80 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.unordered_write: 0 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T19:10:04.325 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.row_cache: None 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.wal_filter: None 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.two_write_queues: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.wal_compression: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.atomic_flush: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T19:10:04.326 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.log_readahead_size: 0 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_background_jobs: 2 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_background_compactions: -1 2024-09-20T19:10:04.327 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_subcompactions: 1 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_open_files: -1 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T19:10:04.328 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_background_flushes: -1 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Compression algorithms supported: 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kZSTD supported: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kXpressCompression supported: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kBZip2Compression supported: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kLZ4Compression supported: 1 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kZlibCompression supported: 1 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: kSnappyCompression supported: 1 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T19:10:04.329 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi027/store.db/MANIFEST-000015 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.merge_operator: 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_filter: None 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c0bb6cd540) 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: cache_index_and_filter_blocks: 1 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T19:10:04.330 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: pin_top_level_index_and_filter: 1 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_type: 0 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: data_block_index_type: 0 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_shortening: 1 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: checksum: 4 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: no_block_cache: 0 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache: 0x55c0bb6c1610 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_name: BinnedLRUCache 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_options: 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: capacity : 536870912 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: num_shard_bits : 4 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: strict_capacity_limit : 0 2024-09-20T19:10:04.331 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: high_pri_pool_ratio: 0.000 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_cache_compressed: (nil) 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: persistent_cache: (nil) 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_size: 4096 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_size_deviation: 10 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_restart_interval: 16 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: index_block_restart_interval: 1 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: metadata_block_size: 4096 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: partition_filters: 0 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: use_delta_encoding: 1 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: filter_policy: bloomfilter 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: whole_key_filtering: 1 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: verify_compression: 0 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: read_amp_bytes_per_bit: 0 2024-09-20T19:10:04.332 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: format_version: 5 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: enable_index_compression: 1 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: block_align: 0 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: max_auto_readahead_size: 262144 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: prepopulate_block_cache: 0 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: initial_auto_readahead_size: 8192 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression: NoCompression 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T19:10:04.333 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.num_levels: 7 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T19:10:04.334 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T19:10:04.335 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T19:10:04.336 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T19:10:04.337 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.inplace_update_support: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.bloom_locality: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.max_successive_merges: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T19:10:04.338 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.ttl: 2592000 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enable_blob_files: false 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.min_blob_size: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T19:10:04.339 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi027/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11969, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8e79b0a7-001f-4ea5-8360-aa624a12b024 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859404045925, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859404054459, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2340685, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11970, "largest_seqno": 13989, "table_properties": {"data_size": 2331549, "index_size": 5850, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2245, "raw_key_size": 21243, "raw_average_key_size": 23, "raw_value_size": 2312382, "raw_average_value_size": 2580, "num_data_blocks": 266, "num_entries": 896, "num_filter_entries": 896, "num_deletions": 8, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726859404, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8e79b0a7-001f-4ea5-8360-aa624a12b024", "db_session_id": "9WFPUMU0T6982O68Y7X1", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859404054583, "job": 1, "event": "recovery_finished"} 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-20T19:10:04.340 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi027/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c0bb6f0e00 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: DB pointer 0x55c0bb7f2000 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** DB Stats ** 2024-09-20T19:10:04.341 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.342 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: L0 1/0 2.23 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 564.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: L6 1/0 7.17 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Sum 2/0 9.40 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 564.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 564.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 564.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.343 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Cumulative compaction: 0.00 GB write, 197.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Interval compaction: 0.00 GB write, 197.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Block cache BinnedLRUCache@0x55c0bb6c1610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-20T19:10:04.344 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: starting mon.smithi027 rank 0 at public addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] at bind addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi027 fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???) e2 preinit fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).mds e16 new map 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).mds e16 print_map 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: e16 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: legacy client fscid: 1 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Filesystem 'cephfs' (1) 2024-09-20T19:10:04.345 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: fs_name cephfs 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: epoch 16 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: tableserver 0 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: root 0 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: session_timeout 60 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: session_autoclose 300 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: max_file_size 1099511627776 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: max_xattr_size 65536 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: required_client_features {} 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: last_failure 0 2024-09-20T19:10:04.346 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: last_failure_osd_epoch 47 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: max_mds 1 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: in 0 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: up {0=24337} 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: failed 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: damaged 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: stopped 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: data_pools [3] 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: metadata_pool 2 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: inline_data enabled 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: balancer 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: bal_rank_mask -1 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: standby_count_wanted 1 2024-09-20T19:10:04.347 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: qdb_cluster leader: 24337 members: 24337 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: [mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: [mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: Standby daemons: 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: [mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout: [mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 ceph-mon[110082]: mon.smithi027@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-20T19:10:04.348 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 bash[110063]: 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 2024-09-20T19:10:04.349 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:04 smithi027 systemd[1]: Started Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:07.262 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: mon.smithi027 calling monitor election 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: monmap epoch 2 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: min_mon_release 19 (squid) 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: election_strategy: 1 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: mgrmap e33: smithi027.tlgpqo(active, since 3m), standbys: smithi098.wrcvbg 2024-09-20T19:10:07.263 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:07.264 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:07.264 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:07.264 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='' 2024-09-20T19:10:07.264 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:07.264 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:10:07.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi027"}]: dispatch 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: mon.smithi027 calling monitor election 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: monmap epoch 2 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T19:10:07.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: min_mon_release 19 (squid) 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: election_strategy: 1 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: mgrmap e33: smithi027.tlgpqo(active, since 3m), standbys: smithi098.wrcvbg 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='' 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:07.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:07 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:10:08.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:08 smithi098 ceph-mon[35737]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:08.461 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:08 smithi027 ceph-mon[110082]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:10.226 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:10 smithi027 ceph-mon[110082]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:10.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:10 smithi098 ceph-mon[35737]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:12.439 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:12 smithi027 ceph-mon[110082]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:12.439 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:12 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:12.439 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:12 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:12.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:12 smithi098 ceph-mon[35737]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:12.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:12 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:12.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:12 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:13.237 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:10:13.237 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:13 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:13.237 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:13 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:13.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:13 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T19:10:13.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:13 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:13.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:13 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:14 smithi098 ceph-mon[35737]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:15.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:14 smithi027 ceph-mon[110082]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:10:16.874 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:16 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T19:10:17.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T19:10:17.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T19:10:19.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: Upgrade: Updating mon.smithi098 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:19.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:18 smithi027 ceph-mon[110082]: Deploying daemon mon.smithi098 on smithi098 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: Upgrade: Updating mon.smithi098 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: from='mgr.14764 ' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T19:10:19.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:18 smithi098 ceph-mon[35737]: Deploying daemon mon.smithi098 on smithi098 2024-09-20T19:10:19.631 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:19 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:19 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098[35729]: 2024-09-20T19:10:19.626+0000 7f3583997640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:10:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:19 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098[35729]: 2024-09-20T19:10:19.626+0000 7f3583997640 -1 mon.smithi098@1(peon) e2 *** Got Signal Terminated *** 2024-09-20T19:10:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:19 smithi098 podman[80793]: 2024-09-20 19:10:19.760642758 +0000 UTC m=+0.240477448 container died d6acc04be9616ac4c1b415084b741d702e196af9c4841814ab55b730baf9cab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T19:10:20.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 podman[80793]: 2024-09-20 19:10:20.144290343 +0000 UTC m=+0.624125032 container cleanup d6acc04be9616ac4c1b415084b741d702e196af9c4841814ab55b730baf9cab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ed8ee0f) 2024-09-20T19:10:20.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 bash[80793]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098 2024-09-20T19:10:20.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 podman[80805]: 2024-09-20 19:10:20.328988254 +0000 UTC m=+0.568398321 container remove d6acc04be9616ac4c1b415084b741d702e196af9c4841814ab55b730baf9cab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-20T19:10:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi098.service: Deactivated successfully. 2024-09-20T19:10:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 systemd[1]: Stopped Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:10:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi098.service: Consumed 7.043s CPU time. 2024-09-20T19:10:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:20 smithi098 systemd[1]: Starting Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:21.285 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 podman[80934]: 2024-09-20 19:10:20.911158715 +0000 UTC m=+0.015729708 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:10:21.285 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 podman[80934]: 2024-09-20 19:10:21.030256674 +0000 UTC m=+0.134827661 container create 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T19:10:21.285 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 podman[80934]: 2024-09-20 19:10:21.283202867 +0000 UTC m=+0.387773864 container init 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 podman[80934]: 2024-09-20 19:10:21.286540607 +0000 UTC m=+0.391111599 container start 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev), process ceph-mon, pid 2 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: pidfile_write: ignore empty --pid-file 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: load: jerasure load: lrc 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: RocksDB version: 7.9.2 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Git sha 0 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Compile date 2024-09-20 10:48:39 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: DB SUMMARY 2024-09-20T19:10:21.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: DB Session ID: 7E3T4XCBVSDO8SBQAF37 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: CURRENT file: CURRENT 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1400 Bytes 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi098/store.db dir, Total Num: 1, files: 000027.sst 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi098/store.db: 000025.log size: 4608267 ; 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.error_if_exists: 0 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.create_if_missing: 0 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.paranoid_checks: 1 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T19:10:21.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.env: 0x55742faba120 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.info_log: 0x5574308ad8e0 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.statistics: (nil) 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.use_fsync: 0 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_log_file_size: 0 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T19:10:21.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_fallocate: 1 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.use_direct_reads: 0 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.db_log_dir: 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.wal_dir: 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T19:10:21.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.write_buffer_manager: 0x5574308b1b80 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T19:10:21.729 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.unordered_write: 0 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.row_cache: None 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.wal_filter: None 2024-09-20T19:10:21.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.two_write_queues: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.wal_compression: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.atomic_flush: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.log_readahead_size: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T19:10:21.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_background_jobs: 2 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_background_compactions: -1 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_subcompactions: 1 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T19:10:21.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_open_files: -1 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_background_flushes: -1 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Compression algorithms supported: 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kZSTD supported: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kXpressCompression supported: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kBZip2Compression supported: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kLZ4Compression supported: 1 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kZlibCompression supported: 1 2024-09-20T19:10:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: kSnappyCompression supported: 1 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000010 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.merge_operator: 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_filter: None 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T19:10:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5574308ad540) 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_type: 0 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_index_type: 0 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_shortening: 1 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: checksum: 4 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: no_block_cache: 0 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache: 0x5574308a1610 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-09-20T19:10:21.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_options: 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: capacity : 536870912 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_shard_bits : 4 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: strict_capacity_limit : 0 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_compressed: (nil) 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: persistent_cache: (nil) 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size: 4096 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size_deviation: 10 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_restart_interval: 16 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_block_restart_interval: 1 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: metadata_block_size: 4096 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: partition_filters: 0 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: use_delta_encoding: 1 2024-09-20T19:10:21.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: filter_policy: bloomfilter 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: whole_key_filtering: 1 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: verify_compression: 0 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: format_version: 5 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_index_compression: 1 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_align: 0 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_auto_readahead_size: 262144 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: prepopulate_block_cache: 0 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: initial_auto_readahead_size: 8192 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression: NoCompression 2024-09-20T19:10:21.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.num_levels: 7 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T19:10:21.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T19:10:21.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T19:10:21.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T19:10:21.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.inplace_update_support: 0 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T19:10:21.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.bloom_locality: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.max_successive_merges: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.ttl: 2592000 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enable_blob_files: false 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.min_blob_size: 0 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T19:10:21.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12103, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a3d0c580-f338-425f-9d93-d46521af5ff5 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859421312945, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-20T19:10:21.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859421324080, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2661843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12108, "largest_seqno": 14879, "table_properties": {"data_size": 2651000, "index_size": 6596, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3205, "raw_key_size": 28153, "raw_average_key_size": 22, "raw_value_size": 2626207, "raw_average_value_size": 2087, "num_data_blocks": 300, "num_entries": 1258, "num_filter_entries": 1258, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726859421, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a3d0c580-f338-425f-9d93-d46521af5ff5", "db_session_id": "7E3T4XCBVSDO8SBQAF37", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726859421324207, "job": 1, "event": "recovery_finished"} 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi098/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5574308d0e00 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: DB pointer 0x5574309d2000 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** DB Stats ** 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:21.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: L0 1/0 2.54 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 600.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: L6 1/0 7.17 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Sum 2/0 9.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 600.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 600.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:21.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 600.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T19:10:21.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative compaction: 0.00 GB write, 158.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval compaction: 0.00 GB write, 158.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache BinnedLRUCache@0x5574308a1610#2 capacity: 512.00 MB usage: 9.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.28 KB,0.000625849%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: starting mon.smithi098 rank 1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi098 fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???) e2 preinit fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).mds e16 new map 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).mds e16 print_map 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: e16 2024-09-20T19:10:21.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: legacy client fscid: 1 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Filesystem 'cephfs' (1) 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: fs_name cephfs 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: epoch 16 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: tableserver 0 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: root 0 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: session_timeout 60 2024-09-20T19:10:21.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: session_autoclose 300 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_file_size 1099511627776 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_xattr_size 65536 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: required_client_features {} 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: last_failure 0 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: last_failure_osd_epoch 47 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_mds 1 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: in 0 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: up {0=24337} 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: failed 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: damaged 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: stopped 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_pools [3] 2024-09-20T19:10:21.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: metadata_pool 2 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: inline_data enabled 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: balancer 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: bal_rank_mask -1 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: standby_count_wanted 1 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: qdb_cluster leader: 24337 members: 24337 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Standby daemons: 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:21.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 ceph-mon[80954]: mon.smithi098@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 bash[80934]: 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 2024-09-20T19:10:21.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:21 smithi098 systemd[1]: Started Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:10:23.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-20T19:10:23.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:23.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: mon.smithi098 calling monitor election 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: mon.smithi027 calling monitor election 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: monmap epoch 2 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: min_mon_release 19 (squid) 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: election_strategy: 1 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:10:23.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: mgrmap e33: smithi027.tlgpqo(active, since 3m), standbys: smithi098.wrcvbg 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:23.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:23 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: mon.smithi098 calling monitor election 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: mon.smithi027 calling monitor election 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: mon.smithi027 is new leader, mons smithi027,smithi098 in quorum (ranks 0,1) 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: monmap epoch 2 2024-09-20T19:10:24.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: fsid e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: last_changed 2024-09-20T18:58:44.714160+0000 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: created 2024-09-20T18:56:13.766810+0000 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: min_mon_release 19 (squid) 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: election_strategy: 1 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.smithi027 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: osdmap e49: 6 total, 6 up, 6 in 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: mgrmap e33: smithi027.tlgpqo(active, since 3m), standbys: smithi098.wrcvbg 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:24.070 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:23 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:25.048 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:24 smithi098 ceph-mon[80954]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:25.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:24 smithi027 ceph-mon[110082]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:26.893 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:26 smithi098 ceph-mon[80954]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:26.893 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:26 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:26.894 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:26 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:26.894 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:26 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:26.894 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:26 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:27.015 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:26 smithi027 ceph-mon[110082]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:27.016 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:26 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:27.016 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:26 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:27.016 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:26 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:27.016 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:26 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:27.803 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:27.985 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:28.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:28 smithi098 ceph-mon[80954]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:28 smithi027 ceph-mon[110082]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:30.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 -- 172.21.15.27:0/1364777065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0102b40 msgr2=0x7f4ee0102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 --2- 172.21.15.27:0/1364777065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0102b40 0x7f4ee0102f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009880 tx=0x7f4ed002a530 comp rx=0 tx=0).stop 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 -- 172.21.15.27:0/1364777065 shutdown_connections 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 --2- 172.21.15.27:0/1364777065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0103460 0x7f4ee010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 --2- 172.21.15.27:0/1364777065 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0102b40 0x7f4ee0102f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 -- 172.21.15.27:0/1364777065 >> 172.21.15.27:0/1364777065 conn(0x7f4ee00fc520 msgr2=0x7f4ee00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 -- 172.21.15.27:0/1364777065 shutdown_connections 2024-09-20T19:10:30.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.236+0000 7f4ee5091640 1 -- 172.21.15.27:0/1364777065 wait complete. 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.237+0000 7f4ee5091640 1 Processor -- start 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ee5091640 1 -- start start 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ee5091640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 0x7f4ee019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ee5091640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ee5091640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee010edd0 con 0x7f4ee0103460 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ee5091640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee010ec50 con 0x7f4ee0102b40 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37254/0 (socket says 172.21.15.27:37254) 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 -- 172.21.15.27:0/789551542 learned_addr learned my addr 172.21.15.27:0/789551542 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4eded9d640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 0x7f4ee019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 -- 172.21.15.27:0/789551542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 msgr2=0x7f4ee019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 0x7f4ee019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 -- 172.21.15.27:0/789551542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee01977c0 con 0x7f4ee0103460 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4eded9d640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 0x7f4ee019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.238+0000 7f4ede59c640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c8a0 tx=0x7f4ed400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.239+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ed40079b0 con 0x7f4ee0103460 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.239+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ed4007b50 con 0x7f4ee0103460 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.239+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee0197ab0 con 0x7f4ee0103460 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.239+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ed4018700 con 0x7f4ee0103460 2024-09-20T19:10:30.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.239+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee0198040 con 0x7f4ee0103460 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.240+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee006aa10 con 0x7f4ee0103460 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.240+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4ed4007d00 con 0x7f4ee0103460 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.241+0000 7f4ec7fff640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 0x7f4ec807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.241+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f4ed409e310 con 0x7f4ee0103460 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.241+0000 7f4eded9d640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 0x7f4ec807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.242+0000 7f4eded9d640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 0x7f4ec807d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004f90 tx=0x7f4ed0009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.246+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ed4014030 con 0x7f4ee0103460 2024-09-20T19:10:30.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all mon 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi027"} : dispatch 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi027"}]': finished 2024-09-20T19:10:30.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"} : dispatch 2024-09-20T19:10:30.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:30 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2024-09-20T19:10:30.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.456+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ee0198350 con 0x7f4ec807af30 2024-09-20T19:10:30.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.457+0000 7f4ec7fff640 1 -- 172.21.15.27:0/789551542 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f4ee0198350 con 0x7f4ec807af30 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 msgr2=0x7f4ec807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 0x7f4ec807d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004f90 tx=0x7f4ed0009560 comp rx=0 tx=0).stop 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 msgr2=0x7f4ee019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c8a0 tx=0x7f4ed400cd60 comp rx=0 tx=0).stop 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 shutdown_connections 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4ec807af30 0x7f4ec807d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee0103460 0x7f4ee019db80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 --2- 172.21.15.27:0/789551542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ee0102b40 0x7f4ee019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 >> 172.21.15.27:0/789551542 conn(0x7f4ee00fc520 msgr2=0x7f4ee0108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 shutdown_connections 2024-09-20T19:10:30.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.460+0000 7f4ee5091640 1 -- 172.21.15.27:0/789551542 wait complete. 2024-09-20T19:10:30.471 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:10:30.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.545+0000 7f709b6df640 1 -- 172.21.15.27:0/2522373394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074eb0 msgr2=0x7f70941123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 --2- 172.21.15.27:0/2522373394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074eb0 0x7f70941123d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7084009880 tx=0x7f708402a530 comp rx=0 tx=0).stop 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 -- 172.21.15.27:0/2522373394 shutdown_connections 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 --2- 172.21.15.27:0/2522373394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074eb0 0x7f70941123d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 --2- 172.21.15.27:0/2522373394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074590 0x7f7094074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 -- 172.21.15.27:0/2522373394 >> 172.21.15.27:0/2522373394 conn(0x7f70940fd600 msgr2=0x7f70940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 -- 172.21.15.27:0/2522373394 shutdown_connections 2024-09-20T19:10:30.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 -- 172.21.15.27:0/2522373394 wait complete. 2024-09-20T19:10:30.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 Processor -- start 2024-09-20T19:10:30.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.546+0000 7f709b6df640 1 -- start start 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709b6df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709b6df640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074eb0 0x7f709419e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709b6df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f70941153e0 con 0x7f7094074590 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709b6df640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7094115260 con 0x7f7094074eb0 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37280/0 (socket says 172.21.15.27:37280) 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 -- 172.21.15.27:0/3298357847 learned_addr learned my addr 172.21.15.27:0/3298357847 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f7098c7a640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074eb0 0x7f709419e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 -- 172.21.15.27:0/3298357847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074eb0 msgr2=0x7f709419e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074eb0 0x7f709419e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 -- 172.21.15.27:0/3298357847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70941a28b0 con 0x7f7094074590 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709947b640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f709000d6f0 tx=0x7f709000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7090017070 con 0x7f7094074590 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f709000de00 con 0x7f7094074590 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70941a2ba0 con 0x7f7094074590 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.547+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7090004bb0 con 0x7f7094074590 2024-09-20T19:10:30.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.548+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a3130 con 0x7f7094074590 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.549+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094075cd0 con 0x7f7094074590 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.549+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7090004e60 con 0x7f7094074590 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.550+0000 7f708a7fc640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 0x7f708007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.550+0000 7f7098c7a640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 0x7f708007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.550+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f709009dc50 con 0x7f7094074590 2024-09-20T19:10:30.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.550+0000 7f7098c7a640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 0x7f708007d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70941047f0 tx=0x7f7084031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.554+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7090069250 con 0x7f7094074590 2024-09-20T19:10:30.624 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:30.624 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all mon 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi027"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi027"}]': finished 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"} : dispatch 2024-09-20T19:10:30.625 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:30 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2024-09-20T19:10:30.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.763+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f70941a33e0 con 0x7f708007af30 2024-09-20T19:10:30.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.764+0000 7f708a7fc640 1 -- 172.21.15.27:0/3298357847 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f70941a33e0 con 0x7f708007af30 2024-09-20T19:10:30.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 msgr2=0x7f708007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 0x7f708007d3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70941047f0 tx=0x7f7084031400 comp rx=0 tx=0).stop 2024-09-20T19:10:30.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 msgr2=0x7f709419dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f709000d6f0 tx=0x7f709000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 shutdown_connections 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f708007af30 0x7f708007d3f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7094074eb0 0x7f709419e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 --2- 172.21.15.27:0/3298357847 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7094074590 0x7f709419dfe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.766+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 >> 172.21.15.27:0/3298357847 conn(0x7f70940fd600 msgr2=0x7f7094104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.767+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 shutdown_connections 2024-09-20T19:10:30.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.767+0000 7f709b6df640 1 -- 172.21.15.27:0/3298357847 wait complete. 2024-09-20T19:10:30.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 -- 172.21.15.27:0/3633886934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81007f0 msgr2=0x7f06b8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 --2- 172.21.15.27:0/3633886934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81007f0 0x7f06b8100c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009880 tx=0x7f06a802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 -- 172.21.15.27:0/3633886934 shutdown_connections 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 --2- 172.21.15.27:0/3633886934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81007f0 0x7f06b8100c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 --2- 172.21.15.27:0/3633886934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81067f0 0x7f06b8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 -- 172.21.15.27:0/3633886934 >> 172.21.15.27:0/3633886934 conn(0x7f06b80fc550 msgr2=0x7f06b80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 -- 172.21.15.27:0/3633886934 shutdown_connections 2024-09-20T19:10:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.861+0000 7f06c038c640 1 -- 172.21.15.27:0/3633886934 wait complete. 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 Processor -- start 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 -- start start 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81007f0 0x7f06b819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f06b810dca0 con 0x7f06b81067f0 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06c038c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f06b810db20 con 0x7f06b81007f0 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37306/0 (socket says 172.21.15.27:37306) 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 -- 172.21.15.27:0/587836940 learned_addr learned my addr 172.21.15.27:0/587836940 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:30.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06be128640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81007f0 0x7f06b819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 -- 172.21.15.27:0/587836940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81007f0 msgr2=0x7f06b819f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81007f0 0x7f06b819f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.862+0000 7f06bd927640 1 -- 172.21.15.27:0/587836940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b8199930 con 0x7f06b81067f0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06bd927640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06a8031460 tx=0x7f06a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06a803f070 con 0x7f06b81067f0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06a8004cf0 con 0x7f06b81067f0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06a8035030 con 0x7f06b81067f0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b8199bc0 con 0x7f06b81067f0 2024-09-20T19:10:30.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.863+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b819a0f0 con 0x7f06b81067f0 2024-09-20T19:10:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.864+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b8101f30 con 0x7f06b81067f0 2024-09-20T19:10:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.865+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06a8042070 con 0x7f06b81067f0 2024-09-20T19:10:30.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.866+0000 7f06af7fe640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 0x7f06a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.866+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f06a80bea10 con 0x7f06b81067f0 2024-09-20T19:10:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.866+0000 7f06be128640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 0x7f06a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.866+0000 7f06be128640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 0x7f06a407d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06b40058c0 tx=0x7f06b400a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:30.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:30.870+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06a808a010 con 0x7f06b81067f0 2024-09-20T19:10:31.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.082+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f06b819a3a0 con 0x7f06a407af30 2024-09-20T19:10:31.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.093+0000 7f06af7fe640 1 -- 172.21.15.27:0/587836940 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f06b819a3a0 con 0x7f06a407af30 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (107s) 19s ago 12m 17.1M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (4m) 19s ago 12m 8460k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (3m) 5s ago 12m 8644k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (12m) 19s ago 12m 6899k - 19.1.1-369-ged8ee0f2 6acb0a031eab 266093d1601b 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (11m) 5s ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab c38266d8465a 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (85s) 19s ago 12m 73.1M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (7m) 19s ago 7m 93.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (7m) 19s ago 7m 16.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (7m) 5s ago 7m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:10:31.096 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (7m) 5s ago 7m 17.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (3m) 19s ago 14m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (2m) 5s ago 11m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (27s) 19s ago 14m 26.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (10s) 5s ago 11m 21.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (2m) 19s ago 12m 11.7M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 5s ago 11m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (10m) 19s ago 10m 214M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab e5e85e946967 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (10m) 19s ago 10m 228M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (9m) 19s ago 9m 218M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (9m) 5s ago 9m 242M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (8m) 5s ago 8m 212M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:10:31.097 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (8m) 5s ago 8m 193M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:10:31.098 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (2m) 19s ago 12m 50.7M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 msgr2=0x7f06a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 0x7f06a407d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06b40058c0 tx=0x7f06b400a2d0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 msgr2=0x7f06b819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06a8031460 tx=0x7f06a80048f0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 shutdown_connections 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f06a407af30 0x7f06a407d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06b81067f0 0x7f06b819fcb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 --2- 172.21.15.27:0/587836940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06b81007f0 0x7f06b819f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 >> 172.21.15.27:0/587836940 conn(0x7f06b80fc550 msgr2=0x7f06b8069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 shutdown_connections 2024-09-20T19:10:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.095+0000 7f06c038c640 1 -- 172.21.15.27:0/587836940 wait complete. 2024-09-20T19:10:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 -- 172.21.15.27:0/3098267967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840106800 msgr2=0x7fb840106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 --2- 172.21.15.27:0/3098267967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840106800 0x7fb840106be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb834009880 tx=0x7fb83402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 -- 172.21.15.27:0/3098267967 shutdown_connections 2024-09-20T19:10:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 --2- 172.21.15.27:0/3098267967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840100800 0x7fb840100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 --2- 172.21.15.27:0/3098267967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840106800 0x7fb840106be0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 -- 172.21.15.27:0/3098267967 >> 172.21.15.27:0/3098267967 conn(0x7fb8400fc520 msgr2=0x7fb8400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 -- 172.21.15.27:0/3098267967 shutdown_connections 2024-09-20T19:10:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.179+0000 7fb8472d3640 1 -- 172.21.15.27:0/3098267967 wait complete. 2024-09-20T19:10:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 Processor -- start 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 -- start start 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106800 0x7fb84019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010dcd0 con 0x7fb840100800 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb8472d3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010db50 con 0x7fb840106800 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb84506f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb84506f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37316/0 (socket says 172.21.15.27:37316) 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb84506f640 1 -- 172.21.15.27:0/2399825308 learned_addr learned my addr 172.21.15.27:0/2399825308 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.180+0000 7fb84486e640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106800 0x7fb84019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb84506f640 1 -- 172.21.15.27:0/2399825308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106800 msgr2=0x7fb84019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb84506f640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106800 0x7fb84019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb84506f640 1 -- 172.21.15.27:0/2399825308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8401966d0 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb84506f640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb834031460 tx=0x7fb8340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb83403f070 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb834004b10 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb840196960 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb834035030 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.181+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb840196e60 con 0x7fb840100800 2024-09-20T19:10:31.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.182+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb840101f40 con 0x7fb840100800 2024-09-20T19:10:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.183+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb834042070 con 0x7fb840100800 2024-09-20T19:10:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.183+0000 7fb8327fc640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.183+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fb8340be9d0 con 0x7fb840100800 2024-09-20T19:10:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.183+0000 7fb84486e640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.184+0000 7fb84486e640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb840197f20 tx=0x7fb83c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.188+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb83408a050 con 0x7fb840100800 2024-09-20T19:10:31.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.454+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb840108d70 con 0x7fb840100800 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.455+0000 7fb8327fc640 1 -- 172.21.15.27:0/2399825308 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7fb83408ef00 con 0x7fb840100800 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:10:31.458 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 10, 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:10:31.459 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:10:31.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 msgr2=0x7fb82c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb840197f20 tx=0x7fb83c00b390 comp rx=0 tx=0).stop 2024-09-20T19:10:31.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 msgr2=0x7fb84019c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb834031460 tx=0x7fb8340045e0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 shutdown_connections 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106800 0x7fb84019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 --2- 172.21.15.27:0/2399825308 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100800 0x7fb84019c600 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.457+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 >> 172.21.15.27:0/2399825308 conn(0x7fb8400fc520 msgr2=0x7fb8400fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.458+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 shutdown_connections 2024-09-20T19:10:31.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.458+0000 7fb8472d3640 1 -- 172.21.15.27:0/2399825308 wait complete. 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 -- 172.21.15.27:0/310286907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 msgr2=0x7fe730100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 --2- 172.21.15.27:0/310286907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe730100a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe720009880 tx=0x7fe72002a490 comp rx=0 tx=0).stop 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 -- 172.21.15.27:0/310286907 shutdown_connections 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 --2- 172.21.15.27:0/310286907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 0x7fe73010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 --2- 172.21.15.27:0/310286907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe730100a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 -- 172.21.15.27:0/310286907 >> 172.21.15.27:0/310286907 conn(0x7fe7300fc520 msgr2=0x7fe7300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 -- 172.21.15.27:0/310286907 shutdown_connections 2024-09-20T19:10:31.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.550+0000 7fe73486a640 1 -- 172.21.15.27:0/310286907 wait complete. 2024-09-20T19:10:31.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 Processor -- start 2024-09-20T19:10:31.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 -- start start 2024-09-20T19:10:31.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 0x7fe73019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe730110fb0 con 0x7fe730100650 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe73486a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe730110e30 con 0x7fe730101000 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe72e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe72e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37338/0 (socket says 172.21.15.27:37338) 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.551+0000 7fe72e59c640 1 -- 172.21.15.27:0/1151453699 learned_addr learned my addr 172.21.15.27:0/1151453699 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe727fff640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 0x7fe73019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe72e59c640 1 -- 172.21.15.27:0/1151453699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 msgr2=0x7fe73019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe72e59c640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 0x7fe73019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe72e59c640 1 -- 172.21.15.27:0/1151453699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe730199a40 con 0x7fe730100650 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe72e59c640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe720031460 tx=0x7fe7200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe72003f070 con 0x7fe730100650 2024-09-20T19:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7200035f0 con 0x7fe730100650 2024-09-20T19:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe730199cd0 con 0x7fe730100650 2024-09-20T19:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe720035030 con 0x7fe730100650 2024-09-20T19:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.552+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73019a260 con 0x7fe730100650 2024-09-20T19:10:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.553+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73006aa90 con 0x7fe730100650 2024-09-20T19:10:31.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.554+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe720042070 con 0x7fe730100650 2024-09-20T19:10:31.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.554+0000 7fe7277fe640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 0x7fe71c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.554+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fe7200bea20 con 0x7fe730100650 2024-09-20T19:10:31.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.554+0000 7fe727fff640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 0x7fe71c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.555+0000 7fe727fff640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 0x7fe71c07d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe718005fd0 tx=0x7fe718005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.559+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe72008a020 con 0x7fe730100650 2024-09-20T19:10:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.788+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe73010b3a0 con 0x7fe730100650 2024-09-20T19:10:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.788+0000 7fe7277fe640 1 -- 172.21.15.27:0/1151453699 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7fe7200be810 con 0x7fe730100650 2024-09-20T19:10:31.791 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:10:31.791 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:10:31.791 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:10:31.792 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:10:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:10:31.794 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 msgr2=0x7fe71c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 0x7fe71c07d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe718005fd0 tx=0x7fe718005850 comp rx=0 tx=0).stop 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 msgr2=0x7fe73019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe720031460 tx=0x7fe7200045e0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 shutdown_connections 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe71c07af30 0x7fe71c07d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe730101000 0x7fe73019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 --2- 172.21.15.27:0/1151453699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe730100650 0x7fe73019f880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 >> 172.21.15.27:0/1151453699 conn(0x7fe7300fc520 msgr2=0x7fe7300fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 shutdown_connections 2024-09-20T19:10:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.791+0000 7fe73486a640 1 -- 172.21.15.27:0/1151453699 wait complete. 2024-09-20T19:10:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 -- 172.21.15.27:0/2324113027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 msgr2=0x7fb500107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2324113027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500107ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009880 tx=0x7fb4f002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 -- 172.21.15.27:0/2324113027 shutdown_connections 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2324113027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 0x7fb500101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2324113027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500107ce0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.879+0000 7fb5061e8640 1 -- 172.21.15.27:0/2324113027 >> 172.21.15.27:0/2324113027 conn(0x7fb5000fd600 msgr2=0x7fb5000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 -- 172.21.15.27:0/2324113027 shutdown_connections 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 -- 172.21.15.27:0/2324113027 wait complete. 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 Processor -- start 2024-09-20T19:10:31.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 -- start start 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 0x7fb5000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.880+0000 7fb5061e8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb5061e8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010edb0 con 0x7fb500107900 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb5061e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010ec30 con 0x7fb500101900 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37362/0 (socket says 172.21.15.27:37362) 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 -- 172.21.15.27:0/2303816841 learned_addr learned my addr 172.21.15.27:0/2303816841 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4ff7fe640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 0x7fb5000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 -- 172.21.15.27:0/2303816841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 msgr2=0x7fb5000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 0x7fb5000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 -- 172.21.15.27:0/2303816841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500074f70 con 0x7fb500107900 2024-09-20T19:10:31.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4f6ffd640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e970 tx=0x7fb4e800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4e800cac0 con 0x7fb500107900 2024-09-20T19:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb500075260 con 0x7fb500107900 2024-09-20T19:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4e800cc60 con 0x7fb500107900 2024-09-20T19:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4e8018720 con 0x7fb500107900 2024-09-20T19:10:31.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.881+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5001a3e60 con 0x7fb500107900 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.883+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb500103040 con 0x7fb500107900 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.883+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb4e8010430 con 0x7fb500107900 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.884+0000 7fb4fd7fa640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 0x7fb4ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.884+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fb4e809e560 con 0x7fb500107900 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.884+0000 7fb4ff7fe640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 0x7fb4ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.884+0000 7fb4ff7fe640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 0x7fb4ec07d440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00096c0 tx=0x7fb4f0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:31.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:31.888+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4e8069be0 con 0x7fb500107900 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: Upgrade: Updating crash.smithi027 (1/2) 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: Deploying daemon crash.smithi027 on smithi027 2024-09-20T19:10:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2399825308' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:31.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:31 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1151453699' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:10:32.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:32.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:32.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: Upgrade: Updating crash.smithi027 (1/2) 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi027", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: Deploying daemon crash.smithi027 on smithi027 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2399825308' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:32.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:31 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1151453699' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:10:32.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.092+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb500062630 con 0x7fb4ec07af80 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.093+0000 7fb4fd7fa640 1 -- 172.21.15.27:0/2303816841 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fb500062630 con 0x7fb4ec07af80 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:10:32.096 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "4/23 daemons upgraded", 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading crash daemons", 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:10:32.097 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:10:32.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 msgr2=0x7fb4ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 0x7fb4ec07d440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00096c0 tx=0x7fb4f0031400 comp rx=0 tx=0).stop 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 msgr2=0x7fb500074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e970 tx=0x7fb4e800ee30 comp rx=0 tx=0).stop 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 shutdown_connections 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb4ec07af80 0x7fb4ec07d440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb500107900 0x7fb500074a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 --2- 172.21.15.27:0/2303816841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb500101900 0x7fb5000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 >> 172.21.15.27:0/2303816841 conn(0x7fb5000fd600 msgr2=0x7fb5000fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 shutdown_connections 2024-09-20T19:10:32.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.096+0000 7fb5061e8640 1 -- 172.21.15.27:0/2303816841 wait complete. 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 -- 172.21.15.27:0/3848799844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc102b10 msgr2=0x7f46cc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 --2- 172.21.15.27:0/3848799844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc102b10 0x7f46cc102ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098b0 tx=0x7f46bc02a560 comp rx=0 tx=0).stop 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 -- 172.21.15.27:0/3848799844 shutdown_connections 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 --2- 172.21.15.27:0/3848799844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc103430 0x7f46cc10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 --2- 172.21.15.27:0/3848799844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc102b10 0x7f46cc102ef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 -- 172.21.15.27:0/3848799844 >> 172.21.15.27:0/3848799844 conn(0x7f46cc0fc550 msgr2=0x7f46cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 -- 172.21.15.27:0/3848799844 shutdown_connections 2024-09-20T19:10:32.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.184+0000 7f46d202f640 1 -- 172.21.15.27:0/3848799844 wait complete. 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 Processor -- start 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 -- start start 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc102b10 0x7f46cc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10edc0 con 0x7f46cc103430 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46d202f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10ec40 con 0x7f46cc102b10 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46caffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46caffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37372/0 (socket says 172.21.15.27:37372) 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46caffd640 1 -- 172.21.15.27:0/1982122383 learned_addr learned my addr 172.21.15.27:0/1982122383 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.185+0000 7f46cb7fe640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc102b10 0x7f46cc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46caffd640 1 -- 172.21.15.27:0/1982122383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc102b10 msgr2=0x7f46cc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46caffd640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc102b10 0x7f46cc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46caffd640 1 -- 172.21.15.27:0/1982122383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc1977d0 con 0x7f46cc103430 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46caffd640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c8a0 tx=0x7f46c000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46c00079b0 con 0x7f46cc103430 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46c0007b50 con 0x7f46cc103430 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc197ac0 con 0x7f46cc103430 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46c0018700 con 0x7f46cc103430 2024-09-20T19:10:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.186+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc198050 con 0x7f46cc103430 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.187+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46cc06a520 con 0x7f46cc103430 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.188+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f46c0007d00 con 0x7f46cc103430 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.189+0000 7f46c8ff9640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 0x7f46b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.189+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f46c009e180 con 0x7f46cc103430 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.189+0000 7f46cb7fe640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 0x7f46b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.189+0000 7f46cb7fe640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 0x7f46b407d440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46bc000c00 tx=0x7f46bc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.193+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46c0014030 con 0x7f46cc103430 2024-09-20T19:10:32.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.470+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f46cc104f60 con 0x7f46cc103430 2024-09-20T19:10:32.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.470+0000 7f46c8ff9640 1 -- 172.21.15.27:0/1982122383 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f46c0069800 con 0x7f46cc103430 2024-09-20T19:10:32.473 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:32.474 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:32.474 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 msgr2=0x7f46b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 0x7f46b407d440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46bc000c00 tx=0x7f46bc031400 comp rx=0 tx=0).stop 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 msgr2=0x7f46cc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c8a0 tx=0x7f46c000cd60 comp rx=0 tx=0).stop 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 shutdown_connections 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f46b407af80 0x7f46b407d440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46cc103430 0x7f46cc19db90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 --2- 172.21.15.27:0/1982122383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46cc102b10 0x7f46cc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 >> 172.21.15.27:0/1982122383 conn(0x7f46cc0fc550 msgr2=0x7f46cc107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:32.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 shutdown_connections 2024-09-20T19:10:32.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:10:32.473+0000 7f46d202f640 1 -- 172.21.15.27:0/1982122383 wait complete. 2024-09-20T19:10:33.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:32 smithi027 ceph-mon[110082]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:33.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:32 smithi027 ceph-mon[110082]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:33.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:32 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1982122383' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:10:33.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:32 smithi098 ceph-mon[80954]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:33.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:32 smithi098 ceph-mon[80954]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:33.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:32 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1982122383' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:10:34.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:33 smithi027 ceph-mon[110082]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:34.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:33 smithi098 ceph-mon[80954]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:35.052 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:34 smithi098 ceph-mon[80954]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:35.052 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:35.052 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:35.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:34 smithi027 ceph-mon[110082]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:35.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:35.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:37.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:37.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: Upgrade: Updating crash.smithi098 (2/2) 2024-09-20T19:10:37.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:37.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T19:10:37.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:37.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:36 smithi027 ceph-mon[110082]: Deploying daemon crash.smithi098 on smithi098 2024-09-20T19:10:37.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:37.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: Upgrade: Updating crash.smithi098 (2/2) 2024-09-20T19:10:37.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:37.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T19:10:37.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:37.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:36 smithi098 ceph-mon[80954]: Deploying daemon crash.smithi098 on smithi098 2024-09-20T19:10:39.010 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:38 smithi098 ceph-mon[80954]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:39.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:38 smithi027 ceph-mon[110082]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:40.776 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:40 smithi098 ceph-mon[80954]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:40.776 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:40.776 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:40.776 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:40.780 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:40 smithi027 ceph-mon[110082]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:40.780 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:40.780 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:40.780 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:42.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:42 smithi027 ceph-mon[110082]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:42.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:42.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:42 smithi098 ceph-mon[80954]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:43.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:43.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:43.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:43.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:43.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:43.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:44.789 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:44 smithi098 ceph-mon[80954]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:44.789 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:44 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:44.789 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:44 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:44.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:44 smithi027 ceph-mon[110082]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:44.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:44 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:44.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:44 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:45 smithi098 ceph-mon[80954]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:46.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:45 smithi027 ceph-mon[110082]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:46.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:46.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:48.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:48 smithi027 ceph-mon[110082]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:48.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:48 smithi098 ceph-mon[80954]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:49.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all crash 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi027"} : dispatch 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi027"}]': finished 2024-09-20T19:10:49.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"} : dispatch 2024-09-20T19:10:49.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2024-09-20T19:10:49.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-20T19:10:49.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T19:10:49.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:49 smithi027 ceph-mon[110082]: Upgrade: osd.0 is safe to restart 2024-09-20T19:10:49.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all crash 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi027"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi027"}]': finished 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-20T19:10:49.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T19:10:49.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:49 smithi098 ceph-mon[80954]: Upgrade: osd.0 is safe to restart 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: Upgrade: Updating osd.0 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:50.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:50 smithi098 ceph-mon[80954]: Deploying daemon osd.0 on smithi027 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: Upgrade: Updating osd.0 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:10:51.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:50 smithi027 ceph-mon[110082]: Deploying daemon osd.0 on smithi027 2024-09-20T19:10:52.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:52 smithi098 ceph-mon[80954]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:53.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:52 smithi027 ceph-mon[110082]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:10:53.069 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:52 smithi027 systemd[1]: Stopping Ceph osd.0 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:53.568 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:53 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T19:10:53.125+0000 7fd1a8c81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:10:53.569 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:53 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T19:10:53.125+0000 7fd1a8c81640 -1 osd.0 49 *** Got signal Terminated *** 2024-09-20T19:10:53.569 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:53 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[49644]: 2024-09-20T19:10:53.125+0000 7fd1a8c81640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:10:53.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:53 smithi098 ceph-mon[80954]: osd.0 marked itself down and dead 2024-09-20T19:10:54.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:53 smithi027 ceph-mon[110082]: osd.0 marked itself down and dead 2024-09-20T19:10:54.397 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:54 smithi027 podman[117775]: 2024-09-20 19:10:54.098024773 +0000 UTC m=+1.081715450 container died e5e85e946967b377ef6611fbd77a1495e140d0e9fee13596bba3c7c6dff1100d (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T19:10:54.724 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:54 smithi027 podman[117775]: 2024-09-20 19:10:54.518132644 +0000 UTC m=+1.501823321 container cleanup e5e85e946967b377ef6611fbd77a1495e140d0e9fee13596bba3c7c6dff1100d (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T19:10:54.724 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:54 smithi027 bash[117775]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0 2024-09-20T19:10:54.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:54 smithi027 ceph-mon[110082]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:54.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:54 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:10:54.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:54 smithi027 ceph-mon[110082]: osdmap e50: 6 total, 5 up, 6 in 2024-09-20T19:10:54.986 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:54 smithi027 podman[117794]: 2024-09-20 19:10:54.752824513 +0000 UTC m=+0.644222533 container remove e5e85e946967b377ef6611fbd77a1495e140d0e9fee13596bba3c7c6dff1100d (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T19:10:55.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:54 smithi098 ceph-mon[80954]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:55.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:54 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:10:55.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:54 smithi098 ceph-mon[80954]: osdmap e50: 6 total, 5 up, 6 in 2024-09-20T19:10:55.319 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117879]: 2024-09-20 19:10:55.111884088 +0000 UTC m=+0.017204844 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:10:55.319 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117879]: 2024-09-20 19:10:55.220471406 +0000 UTC m=+0.125792161 container create a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T19:10:55.653 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117879]: 2024-09-20 19:10:55.456207566 +0000 UTC m=+0.361528326 container init a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T19:10:55.653 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117879]: 2024-09-20 19:10:55.459710469 +0000 UTC m=+0.365031233 container start a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-20T19:10:55.653 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117879]: 2024-09-20 19:10:55.531167403 +0000 UTC m=+0.436488159 container attach a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T19:10:55.970 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:55 smithi027 ceph-mon[110082]: osdmap e51: 6 total, 5 up, 6 in 2024-09-20T19:10:55.970 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:55 smithi027 podman[117902]: 2024-09-20 19:10:55.678684066 +0000 UTC m=+0.017024126 container died a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:10:56.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:55 smithi098 ceph-mon[80954]: osdmap e51: 6 total, 5 up, 6 in 2024-09-20T19:10:56.548 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 podman[117902]: 2024-09-20 19:10:56.287037128 +0000 UTC m=+0.625377188 container remove a5c23a17b32c339736942a3bcd24eb1600e84d0989dd0e3da7295f5ee99762f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:10:56.548 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-20T19:10:56.548 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 systemd[1]: Stopped Ceph osd.0 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:10:56.548 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.0.service: Consumed 54.090s CPU time. 2024-09-20T19:10:56.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:56 smithi027 ceph-mon[110082]: pgmap v124: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:56.819 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 systemd[1]: Starting Ceph osd.0 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:10:56.819 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 podman[118002]: 2024-09-20 19:10:56.660146837 +0000 UTC m=+0.016945467 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:10:56.819 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:56 smithi027 podman[118002]: 2024-09-20 19:10:56.780212855 +0000 UTC m=+0.137011472 container create 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T19:10:57.170 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 podman[118002]: 2024-09-20 19:10:57.007868268 +0000 UTC m=+0.364666895 container init 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:10:57.170 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 podman[118002]: 2024-09-20 19:10:57.011470476 +0000 UTC m=+0.368269093 container start 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:10:57.170 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 podman[118002]: 2024-09-20 19:10:57.107666977 +0000 UTC m=+0.464465605 container attach 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:10:57.170 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:10:57.170 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 bash[118002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:10:57.171 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:10:57.171 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:10:57 smithi027 bash[118002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:10:57.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:56 smithi098 ceph-mon[80954]: pgmap v124: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:10:57.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]} : dispatch 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:57.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]} : dispatch 2024-09-20T19:10:58.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]} : dispatch 2024-09-20T19:10:58.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]} : dispatch 2024-09-20T19:10:58.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]} : dispatch 2024-09-20T19:10:58.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:10:58.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:59.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 638 B/s rd, 1 op/s 2024-09-20T19:10:59.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-09-20T19:10:59.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:58 smithi027 ceph-mon[110082]: osdmap e52: 6 total, 5 up, 6 in 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 638 B/s rd, 1 op/s 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 0]}]': finished 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2024-09-20T19:10:59.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2024-09-20T19:10:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]': finished 2024-09-20T19:10:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2024-09-20T19:10:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-09-20T19:10:59.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:58 smithi098 ceph-mon[80954]: osdmap e52: 6 total, 5 up, 6 in 2024-09-20T19:11:00.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:59 smithi027 ceph-mon[110082]: osdmap e53: 6 total, 5 up, 6 in 2024-09-20T19:11:00.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:10:59 smithi027 ceph-mon[110082]: osdmap e54: 6 total, 5 up, 6 in 2024-09-20T19:11:00.123 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:59 smithi098 ceph-mon[80954]: osdmap e53: 6 total, 5 up, 6 in 2024-09-20T19:11:00.124 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:10:59 smithi098 ceph-mon[80954]: osdmap e54: 6 total, 5 up, 6 in 2024-09-20T19:11:00.469 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:11:00.469 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:00.469 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:11:00.469 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T19:11:00.470 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate[118016]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-20T19:11:00.764 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 bash[118002]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-20T19:11:00.765 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:00 smithi027 podman[118002]: 2024-09-20 19:11:00.502594432 +0000 UTC m=+3.859393063 container died 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-20T19:11:01.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-mon[110082]: pgmap v128: 65 pgs: 11 active+undersized, 2 peering, 7 unknown, 18 active+undersized+degraded, 27 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/270 objects degraded (19.259%) 2024-09-20T19:11:01.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:00 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 52/270 objects degraded (19.259%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:01.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:00 smithi098 ceph-mon[80954]: pgmap v128: 65 pgs: 11 active+undersized, 2 peering, 7 unknown, 18 active+undersized+degraded, 27 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/270 objects degraded (19.259%) 2024-09-20T19:11:01.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:00 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 52/270 objects degraded (19.259%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:01.515 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 podman[118244]: 2024-09-20 19:11:01.162149009 +0000 UTC m=+0.649087725 container remove 0b82320dbbc15db8a9ae7647d2648753f44cd11a3f1bc28ba8d8aee3a675ee41 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:11:01.515 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 podman[118301]: 2024-09-20 19:11:01.274045886 +0000 UTC m=+0.017010197 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:11:01.515 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 podman[118301]: 2024-09-20 19:11:01.513178974 +0000 UTC m=+0.256143314 container create 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:11:01.777 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 podman[118301]: 2024-09-20 19:11:01.723617229 +0000 UTC m=+0.466581534 container init 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-20T19:11:01.777 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 podman[118301]: 2024-09-20 19:11:01.726800992 +0000 UTC m=+0.469765291 container start 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:11:01.777 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 ceph-osd[118319]: -- 172.21.15.27:0/3107798064 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619553dc1e0 con 0x5619545e7c00 2024-09-20T19:11:01.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:01 smithi098 ceph-mon[80954]: osdmap e55: 6 total, 5 up, 6 in 2024-09-20T19:11:02.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:01 smithi027 ceph-mon[110082]: osdmap e55: 6 total, 5 up, 6 in 2024-09-20T19:11:02.069 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 bash[118301]: 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 2024-09-20T19:11:02.069 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:01 smithi027 systemd[1]: Started Ceph osd.0 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:11:02.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 -- 172.21.15.27:0/2110965442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48107900 msgr2=0x7f1a48107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/2110965442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48107900 0x7f1a48107ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009880 tx=0x7f1a3802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 -- 172.21.15.27:0/2110965442 shutdown_connections 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/2110965442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48101900 0x7f1a48101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/2110965442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48107900 0x7f1a48107ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 -- 172.21.15.27:0/2110965442 >> 172.21.15.27:0/2110965442 conn(0x7f1a480fd5e0 msgr2=0x7f1a480ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 -- 172.21.15.27:0/2110965442 shutdown_connections 2024-09-20T19:11:02.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.563+0000 7f1a4ce64640 1 -- 172.21.15.27:0/2110965442 wait complete. 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 Processor -- start 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 -- start start 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48107900 0x7f1a4806f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4810edd0 con 0x7f1a48101900 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4ce64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4810ec50 con 0x7f1a48107900 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41984/0 (socket says 172.21.15.27:41984) 2024-09-20T19:11:02.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a4659c640 1 -- 172.21.15.27:0/883386291 learned_addr learned my addr 172.21.15.27:0/883386291 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.564+0000 7f1a45d9b640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48107900 0x7f1a4806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.565+0000 7f1a4659c640 1 -- 172.21.15.27:0/883386291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48107900 msgr2=0x7f1a4806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.565+0000 7f1a4659c640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48107900 0x7f1a4806f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.565+0000 7f1a4659c640 1 -- 172.21.15.27:0/883386291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4806fb80 con 0x7f1a48101900 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.565+0000 7f1a4659c640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a38031460 tx=0x7f1a38004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.566+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a3803f070 con 0x7f1a48101900 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.566+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a38004a90 con 0x7f1a48101900 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.566+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4806fe10 con 0x7f1a48101900 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.566+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a38035030 con 0x7f1a48101900 2024-09-20T19:11:02.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.566+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a481aa4d0 con 0x7f1a48101900 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.567+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a48103040 con 0x7f1a48101900 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.568+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1a38042070 con 0x7f1a48101900 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.569+0000 7f1a377fe640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 0x7f1a3007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.569+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6714+0+0 (secure 0 0 0) 0x7f1a380bebb0 con 0x7f1a48101900 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.569+0000 7f1a45d9b640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 0x7f1a3007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.570+0000 7f1a45d9b640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 0x7f1a3007d450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a480708c0 tx=0x7f1a3c005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:02.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.575+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a380c5080 con 0x7f1a48101900 2024-09-20T19:11:02.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.804+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1a48062630 con 0x7f1a3007af90 2024-09-20T19:11:02.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.806+0000 7f1a377fe640 1 -- 172.21.15.27:0/883386291 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1a48062630 con 0x7f1a3007af90 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 msgr2=0x7f1a3007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 0x7f1a3007d450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a480708c0 tx=0x7f1a3c005f90 comp rx=0 tx=0).stop 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 msgr2=0x7f1a4806f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a38031460 tx=0x7f1a38004530 comp rx=0 tx=0).stop 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 shutdown_connections 2024-09-20T19:11:02.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1a3007af90 0x7f1a3007d450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a48107900 0x7f1a4806f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 --2- 172.21.15.27:0/883386291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a48101900 0x7f1a4806f100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 >> 172.21.15.27:0/883386291 conn(0x7f1a480fd5e0 msgr2=0x7f1a480fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:02.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 shutdown_connections 2024-09-20T19:11:02.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.808+0000 7f1a4ce64640 1 -- 172.21.15.27:0/883386291 wait complete. 2024-09-20T19:11:02.819 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:11:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 -- 172.21.15.27:0/628745439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201067f0 msgr2=0x7f8c20106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/628745439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201067f0 0x7f8c20106bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009880 tx=0x7f8c1802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 -- 172.21.15.27:0/628745439 shutdown_connections 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/628745439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201007f0 0x7f8c20100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/628745439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201067f0 0x7f8c20106bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 -- 172.21.15.27:0/628745439 >> 172.21.15.27:0/628745439 conn(0x7f8c200fc550 msgr2=0x7f8c200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 -- 172.21.15.27:0/628745439 shutdown_connections 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.896+0000 7f8c26c0b640 1 -- 172.21.15.27:0/628745439 wait complete. 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 Processor -- start 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 -- start start 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201067f0 0x7f8c2019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2010dca0 con 0x7f8c201007f0 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c26c0b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2010db20 con 0x7f8c201067f0 2024-09-20T19:11:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42004/0 (socket says 172.21.15.27:42004) 2024-09-20T19:11:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 -- 172.21.15.27:0/83245756 learned_addr learned my addr 172.21.15.27:0/83245756 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c1ffff640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201067f0 0x7f8c2019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 -- 172.21.15.27:0/83245756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201067f0 msgr2=0x7f8c2019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201067f0 0x7f8c2019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.897+0000 7f8c249a7640 1 -- 172.21.15.27:0/83245756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c201a0380 con 0x7f8c201007f0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c249a7640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c18031460 tx=0x7f8c180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c1803f070 con 0x7f8c201007f0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c18004cf0 con 0x7f8c201007f0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c20199a10 con 0x7f8c201007f0 2024-09-20T19:11:02.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c18035030 con 0x7f8c201007f0 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.898+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c20199f10 con 0x7f8c201007f0 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.899+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c20101f30 con 0x7f8c201007f0 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.900+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8c18042070 con 0x7f8c201007f0 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.900+0000 7f8c1dffb640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 0x7f8c0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.900+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7f8c180beb60 con 0x7f8c201007f0 2024-09-20T19:11:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.900+0000 7f8c1ffff640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 0x7f8c0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:02.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.901+0000 7f8c1ffff640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 0x7f8c0c07d440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c200ffb60 tx=0x7f8c100075b0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:02.905+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c18089fb0 con 0x7f8c201007f0 2024-09-20T19:11:03.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:02 smithi027 ceph-mon[110082]: pgmap v131: 65 pgs: 11 active+undersized, 2 peering, 7 unknown, 18 active+undersized+degraded, 27 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/270 objects degraded (19.259%) 2024-09-20T19:11:03.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:02 smithi027 ceph-mon[110082]: osdmap e56: 6 total, 5 up, 6 in 2024-09-20T19:11:03.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:02 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:03.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:02 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:03.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:02 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:03.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.129+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8c2019a230 con 0x7f8c0c07af80 2024-09-20T19:11:03.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.130+0000 7f8c1dffb640 1 -- 172.21.15.27:0/83245756 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8c2019a230 con 0x7f8c0c07af80 2024-09-20T19:11:03.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 msgr2=0x7f8c0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 0x7f8c0c07d440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c200ffb60 tx=0x7f8c100075b0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 msgr2=0x7f8c2019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c18031460 tx=0x7f8c180048f0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 shutdown_connections 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c0c07af80 0x7f8c0c07d440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c201067f0 0x7f8c2019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 --2- 172.21.15.27:0/83245756 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c201007f0 0x7f8c2019f790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 >> 172.21.15.27:0/83245756 conn(0x7f8c200fc550 msgr2=0x7f8c20069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 shutdown_connections 2024-09-20T19:11:03.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.133+0000 7f8c26c0b640 1 -- 172.21.15.27:0/83245756 wait complete. 2024-09-20T19:11:03.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- 172.21.15.27:0/3329371203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 msgr2=0x7feec010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 --2- 172.21.15.27:0/3329371203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec010b920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feeb40098b0 tx=0x7feeb402a560 comp rx=0 tx=0).stop 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- 172.21.15.27:0/3329371203 shutdown_connections 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 --2- 172.21.15.27:0/3329371203 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec010b920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 --2- 172.21.15.27:0/3329371203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 0x7feec0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- 172.21.15.27:0/3329371203 >> 172.21.15.27:0/3329371203 conn(0x7feec00fc550 msgr2=0x7feec00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- 172.21.15.27:0/3329371203 shutdown_connections 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- 172.21.15.27:0/3329371203 wait complete. 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 Processor -- start 2024-09-20T19:11:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.218+0000 7feec7fb1640 1 -- start start 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec7fb1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 0x7feec019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec7fb1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec7fb1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feec010ede0 con 0x7feec0103430 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec7fb1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feec010ec60 con 0x7feec0102b10 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42026/0 (socket says 172.21.15.27:42026) 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 -- 172.21.15.27:0/2181947431 learned_addr learned my addr 172.21.15.27:0/2181947431 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec5d4d640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 0x7feec019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 -- 172.21.15.27:0/2181947431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 msgr2=0x7feec019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 0x7feec019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 -- 172.21.15.27:0/2181947431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec0199aa0 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feec554c640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feeb4031460 tx=0x7feeb40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.219+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feeb403f070 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.220+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feeb40035f0 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.220+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec0199d30 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.220+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec019a260 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.220+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feeb4035030 con 0x7feec0103430 2024-09-20T19:11:03.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.221+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec006a520 con 0x7feec0103430 2024-09-20T19:11:03.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:02 smithi098 ceph-mon[80954]: pgmap v131: 65 pgs: 11 active+undersized, 2 peering, 7 unknown, 18 active+undersized+degraded, 27 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/270 objects degraded (19.259%) 2024-09-20T19:11:03.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:02 smithi098 ceph-mon[80954]: osdmap e56: 6 total, 5 up, 6 in 2024-09-20T19:11:03.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:02 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:03.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:02 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:03.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:02 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:03.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.221+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feeb4042070 con 0x7feec0103430 2024-09-20T19:11:03.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.222+0000 7feebeffd640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 0x7feea807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.222+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7feeb40bea10 con 0x7feec0103430 2024-09-20T19:11:03.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.222+0000 7feec5d4d640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 0x7feea807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.222+0000 7feec5d4d640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 0x7feea807d440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feec019abe0 tx=0x7feeb8005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.226+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feeb4089e60 con 0x7feec0103430 2024-09-20T19:11:03.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.427+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7feec019afd0 con 0x7feea807af80 2024-09-20T19:11:03.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.437+0000 7feebeffd640 1 -- 172.21.15.27:0/2181947431 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7feec019afd0 con 0x7feea807af80 2024-09-20T19:11:03.440 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:11:03.440 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (2m) 19s ago 13m 19.2M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:11:03.440 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (4m) 19s ago 13m 8510k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (4m) 21s ago 12m 8669k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (29s) 19s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (24s) 21s ago 12m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (117s) 19s ago 13m 73.2M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (7m) 19s ago 7m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (7m) 19s ago 7m 16.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (7m) 21s ago 7m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (7m) 21s ago 7m 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (4m) 19s ago 14m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (3m) 21s ago 12m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (59s) 19s ago 14m 39.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:11:03.441 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (42s) 21s ago 12m 26.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (3m) 19s ago 13m 11.1M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (3m) 21s ago 12m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 starting - - - 1216M 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (10m) 19s ago 10m 228M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (10m) 19s ago 10m 218M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (9m) 21s ago 9m 242M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (9m) 21s ago 9m 213M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (8m) 21s ago 8m 193M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:11:03.442 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (2m) 19s ago 12m 52.2M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 msgr2=0x7feea807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 0x7feea807d440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feec019abe0 tx=0x7feeb8005f90 comp rx=0 tx=0).stop 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 msgr2=0x7feec019fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feeb4031460 tx=0x7feeb40045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 shutdown_connections 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7feea807af80 0x7feea807d440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feec0103430 0x7feec019fe20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 --2- 172.21.15.27:0/2181947431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec0102b10 0x7feec019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 >> 172.21.15.27:0/2181947431 conn(0x7feec00fc550 msgr2=0x7feec0100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 shutdown_connections 2024-09-20T19:11:03.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.440+0000 7feec7fb1640 1 -- 172.21.15.27:0/2181947431 wait complete. 2024-09-20T19:11:03.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 -- 172.21.15.27:0/29977083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750107900 msgr2=0x7fe750107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 --2- 172.21.15.27:0/29977083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750107900 0x7fe750107ce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe740009880 tx=0x7fe74002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 -- 172.21.15.27:0/29977083 shutdown_connections 2024-09-20T19:11:03.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 --2- 172.21.15.27:0/29977083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750101900 0x7fe750101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 --2- 172.21.15.27:0/29977083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750107900 0x7fe750107ce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 -- 172.21.15.27:0/29977083 >> 172.21.15.27:0/29977083 conn(0x7fe7500fd600 msgr2=0x7fe7500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 -- 172.21.15.27:0/29977083 shutdown_connections 2024-09-20T19:11:03.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.523+0000 7fe754d2e640 1 -- 172.21.15.27:0/29977083 wait complete. 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 Processor -- start 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 -- start start 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750107900 0x7fe750074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010edb0 con 0x7fe750101900 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.524+0000 7fe754d2e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010ec30 con 0x7fe750107900 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42044/0 (socket says 172.21.15.27:42044) 2024-09-20T19:11:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 -- 172.21.15.27:0/4134014094 learned_addr learned my addr 172.21.15.27:0/4134014094 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe747fff640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750107900 0x7fe750074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 -- 172.21.15.27:0/4134014094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750107900 msgr2=0x7fe750074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750107900 0x7fe750074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 -- 172.21.15.27:0/4134014094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe750074f70 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe74e59c640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe740031460 tx=0x7fe7400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe74003f070 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7400044d0 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe750075200 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe740035030 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.525+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a3d30 con 0x7fe750101900 2024-09-20T19:11:03.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.526+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750103040 con 0x7fe750101900 2024-09-20T19:11:03.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.527+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe740042070 con 0x7fe750101900 2024-09-20T19:11:03.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.528+0000 7fe7477fe640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 0x7fe73c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.528+0000 7fe747fff640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 0x7fe73c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.528+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7fe7400bebe0 con 0x7fe750101900 2024-09-20T19:11:03.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.528+0000 7fe747fff640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 0x7fe73c07d450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe750075f80 tx=0x7fe73800a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.532+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe740004cf0 con 0x7fe750101900 2024-09-20T19:11:03.784 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:03 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:11:03.612+0000 7feed2748640 -1 Falling back to public interface 2024-09-20T19:11:03.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.815+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe750104b10 con 0x7fe750101900 2024-09-20T19:11:03.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.816+0000 7fe7477fe640 1 -- 172.21.15.27:0/4134014094 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7fe74008a030 con 0x7fe750101900 2024-09-20T19:11:03.818 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:11:03.818 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:11:03.818 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:03.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 5 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 9, 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:11:03.819 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:11:03.820 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 msgr2=0x7fe73c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 0x7fe73c07d450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe750075f80 tx=0x7fe73800a2d0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 msgr2=0x7fe7500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe740031460 tx=0x7fe7400048f0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 shutdown_connections 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe73c07af90 0x7fe73c07d450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe750107900 0x7fe750074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 --2- 172.21.15.27:0/4134014094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe750101900 0x7fe7500744f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 >> 172.21.15.27:0/4134014094 conn(0x7fe7500fd600 msgr2=0x7fe7500ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 shutdown_connections 2024-09-20T19:11:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.819+0000 7fe754d2e640 1 -- 172.21.15.27:0/4134014094 wait complete. 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 -- 172.21.15.27:0/822011133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 msgr2=0x7fa1e0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/822011133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e0102e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009880 tx=0x7fa1d002a530 comp rx=0 tx=0).stop 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 -- 172.21.15.27:0/822011133 shutdown_connections 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/822011133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 0x7fa1e010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/822011133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e0102e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 -- 172.21.15.27:0/822011133 >> 172.21.15.27:0/822011133 conn(0x7fa1e00fc550 msgr2=0x7fa1e00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 -- 172.21.15.27:0/822011133 shutdown_connections 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.908+0000 7fa1e4c40640 1 -- 172.21.15.27:0/822011133 wait complete. 2024-09-20T19:11:03.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 Processor -- start 2024-09-20T19:11:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 -- start start 2024-09-20T19:11:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 0x7fa1e019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e010edc0 con 0x7fa1e0102ab0 2024-09-20T19:11:03.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1e4c40640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e010ec40 con 0x7fa1e01033d0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42068/0 (socket says 172.21.15.27:42068) 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 -- 172.21.15.27:0/901717229 learned_addr learned my addr 172.21.15.27:0/901717229 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1ddd9b640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 0x7fa1e019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 -- 172.21.15.27:0/901717229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 msgr2=0x7fa1e019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 0x7fa1e019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.909+0000 7fa1de59c640 1 -- 172.21.15.27:0/901717229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e01977b0 con 0x7fa1e0102ab0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1de59c640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0031460 tx=0x7fa1d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1d003f070 con 0x7fa1e0102ab0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1d0004b10 con 0x7fa1e0102ab0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e0197a40 con 0x7fa1e0102ab0 2024-09-20T19:11:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1d0035030 con 0x7fa1e0102ab0 2024-09-20T19:11:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.910+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e0197f70 con 0x7fa1e0102ab0 2024-09-20T19:11:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.911+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e006a580 con 0x7fa1e0102ab0 2024-09-20T19:11:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.912+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa1d0042070 con 0x7fa1e0102ab0 2024-09-20T19:11:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.912+0000 7fa1cf7fe640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 0x7fa1c807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:03.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.912+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7fa1d00becd0 con 0x7fa1e0102ab0 2024-09-20T19:11:03.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.912+0000 7fa1ddd9b640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 0x7fa1c807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:03.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.913+0000 7fa1ddd9b640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 0x7fa1c807d400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00ff010 tx=0x7fa1d400b360 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:03.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:03.917+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1d008a0a0 con 0x7fa1e0102ab0 2024-09-20T19:11:04.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:03 smithi027 ceph-mon[110082]: osdmap e57: 6 total, 5 up, 6 in 2024-09-20T19:11:04.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:03 smithi027 ceph-mon[110082]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:04.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.144+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa1e0105f80 con 0x7fa1e0102ab0 2024-09-20T19:11:04.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.145+0000 7fa1cf7fe640 1 -- 172.21.15.27:0/901717229 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7fa1d008ef50 con 0x7fa1e0102ab0 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:11:04.148 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:04.149 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:11:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:04.151 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:04.152 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:11:04.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 msgr2=0x7fa1c807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 0x7fa1c807d400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00ff010 tx=0x7fa1d400b360 comp rx=0 tx=0).stop 2024-09-20T19:11:04.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 msgr2=0x7fa1e019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0031460 tx=0x7fa1d00045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 shutdown_connections 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa1c807af40 0x7fa1c807d400 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e01033d0 0x7fa1e019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 --2- 172.21.15.27:0/901717229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1e0102ab0 0x7fa1e019d630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 >> 172.21.15.27:0/901717229 conn(0x7fa1e00fc550 msgr2=0x7fa1e0108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 shutdown_connections 2024-09-20T19:11:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.148+0000 7fa1e4c40640 1 -- 172.21.15.27:0/901717229 wait complete. 2024-09-20T19:11:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:03 smithi098 ceph-mon[80954]: osdmap e57: 6 total, 5 up, 6 in 2024-09-20T19:11:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:03 smithi098 ceph-mon[80954]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 -- 172.21.15.27:0/3737357859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 msgr2=0x7f6288100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 --2- 172.21.15.27:0/3737357859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f6288100c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6278009880 tx=0x7f627802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 -- 172.21.15.27:0/3737357859 shutdown_connections 2024-09-20T19:11:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 --2- 172.21.15.27:0/3737357859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f6288100c50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 --2- 172.21.15.27:0/3737357859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62881067f0 0x7f6288106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 -- 172.21.15.27:0/3737357859 >> 172.21.15.27:0/3737357859 conn(0x7f62880fc550 msgr2=0x7f62880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 -- 172.21.15.27:0/3737357859 shutdown_connections 2024-09-20T19:11:04.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 -- 172.21.15.27:0/3737357859 wait complete. 2024-09-20T19:11:04.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.235+0000 7f628f8c6640 1 Processor -- start 2024-09-20T19:11:04.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628f8c6640 1 -- start start 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628f8c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628f8c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62881067f0 0x7f628819dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628f8c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f628810dd20 con 0x7f62881007f0 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628f8c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f628810dba0 con 0x7f62881067f0 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42086/0 (socket says 172.21.15.27:42086) 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 -- 172.21.15.27:0/301873284 learned_addr learned my addr 172.21.15.27:0/301873284 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 -- 172.21.15.27:0/301873284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62881067f0 msgr2=0x7f628819dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62881067f0 0x7f628819dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 -- 172.21.15.27:0/301873284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881978f0 con 0x7f62881007f0 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.236+0000 7f628d662640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f628400b420 tx=0x7f628400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:04.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.237+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6284011630 con 0x7f62881007f0 2024-09-20T19:11:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.237+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6284016070 con 0x7f62881007f0 2024-09-20T19:11:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.237+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6288197b80 con 0x7f62881007f0 2024-09-20T19:11:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.237+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6284010d40 con 0x7f62881007f0 2024-09-20T19:11:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.237+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6288198110 con 0x7f62881007f0 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.238+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6288101f30 con 0x7f62881007f0 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.238+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f628401b460 con 0x7f62881007f0 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.239+0000 7f627e7fc640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 0x7f627407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.239+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7f628409d970 con 0x7f62881007f0 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.239+0000 7f628ce61640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 0x7f627407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.239+0000 7f628ce61640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 0x7f627407d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62780096c0 tx=0x7f6278000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:04.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.243+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f628409fe20 con 0x7f62881007f0 2024-09-20T19:11:04.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.450+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6288198420 con 0x7f627407af40 2024-09-20T19:11:04.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.451+0000 7f627e7fc640 1 -- 172.21.15.27:0/301873284 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6288198420 con 0x7f627407af40 2024-09-20T19:11:04.453 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "6/23 daemons upgraded", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:11:04.454 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 msgr2=0x7f627407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 0x7f627407d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62780096c0 tx=0x7f6278000bc0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 msgr2=0x7f628819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f628400b420 tx=0x7f628400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 shutdown_connections 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f627407af40 0x7f627407d400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62881067f0 0x7f628819dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 --2- 172.21.15.27:0/301873284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62881007f0 0x7f628819d730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 >> 172.21.15.27:0/301873284 conn(0x7f62880fc550 msgr2=0x7f6288104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.453+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 shutdown_connections 2024-09-20T19:11:04.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.454+0000 7f628f8c6640 1 -- 172.21.15.27:0/301873284 wait complete. 2024-09-20T19:11:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 -- 172.21.15.27:0/2434813415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514101900 msgr2=0x7fd514101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2434813415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514101900 0x7fd514101d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd500009880 tx=0x7fd50002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 -- 172.21.15.27:0/2434813415 shutdown_connections 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2434813415 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514101900 0x7fd514101d60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2434813415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514107900 0x7fd514107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.537+0000 7fd51ab15640 1 -- 172.21.15.27:0/2434813415 >> 172.21.15.27:0/2434813415 conn(0x7fd5140fd600 msgr2=0x7fd5140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 -- 172.21.15.27:0/2434813415 shutdown_connections 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 -- 172.21.15.27:0/2434813415 wait complete. 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 Processor -- start 2024-09-20T19:11:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 -- start start 2024-09-20T19:11:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 0x7fd51419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd51410edb0 con 0x7fd514107900 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.538+0000 7fd51ab15640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd51410ec30 con 0x7fd514101900 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42104/0 (socket says 172.21.15.27:42104) 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 -- 172.21.15.27:0/2135176087 learned_addr learned my addr 172.21.15.27:0/2135176087 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd5188b1640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 0x7fd51419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 -- 172.21.15.27:0/2135176087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 msgr2=0x7fd51419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 0x7fd51419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 -- 172.21.15.27:0/2135176087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514197800 con 0x7fd514107900 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd5188b1640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 0x7fd51419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd513fff640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd500031460 tx=0x7fd5000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:04.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd50003f070 con 0x7fd514107900 2024-09-20T19:11:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd500004b10 con 0x7fd514107900 2024-09-20T19:11:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd500035030 con 0x7fd514107900 2024-09-20T19:11:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.539+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514197a90 con 0x7fd514107900 2024-09-20T19:11:04.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.540+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd514197fc0 con 0x7fd514107900 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.541+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd514103040 con 0x7fd514107900 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.541+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd500042070 con 0x7fd514107900 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.542+0000 7fd511ffb640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 0x7fd50407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.542+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6714+0+0 (secure 0 0 0) 0x7fd5000beca0 con 0x7fd514107900 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.542+0000 7fd5188b1640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 0x7fd50407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:04.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.542+0000 7fd5188b1640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 0x7fd50407d450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd5080058c0 tx=0x7fd508005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:04.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.546+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5000c3070 con 0x7fd514107900 2024-09-20T19:11:04.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.813+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd514198d30 con 0x7fd514107900 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.813+0000 7fd511ffb640 1 -- 172.21.15.27:0/2135176087 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1461 (secure 0 0 0) 0x7fd50008a0f0 con 0x7fd514107900 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 52/282 objects degraded (18.440%), 18 pgs degraded 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: osd.0 (root=default,host=smithi027) is down 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/282 objects degraded (18.440%), 18 pgs degraded 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-20T19:11:04.816 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-20T19:11:04.817 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-20T19:11:04.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.815+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 msgr2=0x7fd50407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.815+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 0x7fd50407d450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd5080058c0 tx=0x7fd508005850 comp rx=0 tx=0).stop 2024-09-20T19:11:04.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.815+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 msgr2=0x7fd51419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:04.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.815+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd500031460 tx=0x7fd5000045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 shutdown_connections 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd50407af90 0x7fd50407d450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd514107900 0x7fd51419dbc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 --2- 172.21.15.27:0/2135176087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd514101900 0x7fd51419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 >> 172.21.15.27:0/2135176087 conn(0x7fd5140fd600 msgr2=0x7fd5140fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 shutdown_connections 2024-09-20T19:11:04.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:04.816+0000 7fd51ab15640 1 -- 172.21.15.27:0/2135176087 wait complete. 2024-09-20T19:11:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:04 smithi027 ceph-mon[110082]: pgmap v134: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 87 MiB/s rd, 232 MiB/s wr, 932 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 3.0 MiB/s, 209 objects/s recovering 2024-09-20T19:11:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:04 smithi027 ceph-mon[110082]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:04 smithi027 ceph-mon[110082]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:04 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/4134014094' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:04 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/901717229' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:04 smithi098 ceph-mon[80954]: pgmap v134: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 87 MiB/s rd, 232 MiB/s wr, 932 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 3.0 MiB/s, 209 objects/s recovering 2024-09-20T19:11:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:04 smithi098 ceph-mon[80954]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:04 smithi098 ceph-mon[80954]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:04 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/4134014094' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:04 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/901717229' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:05 smithi027 ceph-mon[110082]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:05 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2135176087' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:06.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:05 smithi098 ceph-mon[80954]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:06.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:05 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2135176087' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:06.884 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:06 smithi027 ceph-mon[110082]: pgmap v135: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 67 MiB/s rd, 179 MiB/s wr, 719 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 2.3 MiB/s, 161 objects/s recovering 2024-09-20T19:11:07.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:06 smithi098 ceph-mon[80954]: pgmap v135: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 67 MiB/s rd, 179 MiB/s wr, 719 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 2.3 MiB/s, 161 objects/s recovering 2024-09-20T19:11:08.712 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:08 smithi027 ceph-mon[110082]: pgmap v136: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 MiB/s rd, 150 MiB/s wr, 605 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 1.9 MiB/s, 135 objects/s recovering 2024-09-20T19:11:08.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:08 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:08 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:08 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.713 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:08 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:08 smithi098 ceph-mon[80954]: pgmap v136: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 MiB/s rd, 150 MiB/s wr, 605 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 1.9 MiB/s, 135 objects/s recovering 2024-09-20T19:11:08.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:08 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:08 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:08 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:08.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:08 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:09.563 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:09 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 52/282 objects degraded (18.440%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:09.563 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:09 smithi027 ceph-mon[110082]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-20T19:11:09.564 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:09 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:11:09.215+0000 7feed2748640 -1 osd.0 49 log_to_monitors true 2024-09-20T19:11:09.564 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:11:09 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:11:09.400+0000 7feeca4f2640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:11:09.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:09 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 52/282 objects degraded (18.440%), 18 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:09.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:09 smithi098 ceph-mon[80954]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-20T19:11:10.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:10 smithi098 ceph-mon[80954]: pgmap v137: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 MiB/s rd, 116 MiB/s wr, 467 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 1.5 MiB/s, 104 objects/s recovering 2024-09-20T19:11:10.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:10 smithi098 ceph-mon[80954]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T19:11:10.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:10 smithi098 ceph-mon[80954]: osdmap e58: 6 total, 5 up, 6 in 2024-09-20T19:11:10.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:10 smithi098 ceph-mon[80954]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:11:10.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:10 smithi027 ceph-mon[110082]: pgmap v137: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 MiB/s rd, 116 MiB/s wr, 467 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%); 1.5 MiB/s, 104 objects/s recovering 2024-09-20T19:11:10.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:10 smithi027 ceph-mon[110082]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T19:11:10.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:10 smithi027 ceph-mon[110082]: osdmap e58: 6 total, 5 up, 6 in 2024-09-20T19:11:10.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:10 smithi027 ceph-mon[110082]: from='osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:11:11.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:11:11.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373] boot 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: osdmap e59: 6 total, 6 up, 6 in 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:11 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: osd.0 [v2:172.21.15.27:6802/2711836373,v1:172.21.15.27:6803/2711836373] boot 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: osdmap e59: 6 total, 6 up, 6 in 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:11.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:11 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T19:11:12.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:12 smithi098 ceph-mon[80954]: pgmap v140: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%) 2024-09-20T19:11:12.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:12 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T19:11:12.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:12 smithi098 ceph-mon[80954]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-20T19:11:12.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:12 smithi098 ceph-mon[80954]: osdmap e60: 6 total, 6 up, 6 in 2024-09-20T19:11:12.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:12 smithi098 ceph-mon[80954]: osdmap e61: 6 total, 6 up, 6 in 2024-09-20T19:11:12.785 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:12 smithi027 ceph-mon[110082]: pgmap v140: 65 pgs: 9 active+clean+remapped, 11 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 52/282 objects degraded (18.440%); 8/282 objects misplaced (2.837%) 2024-09-20T19:11:12.785 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:12 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T19:11:12.785 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:12 smithi027 ceph-mon[110082]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-20T19:11:12.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:12 smithi027 ceph-mon[110082]: osdmap e60: 6 total, 6 up, 6 in 2024-09-20T19:11:12.786 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:12 smithi027 ceph-mon[110082]: osdmap e61: 6 total, 6 up, 6 in 2024-09-20T19:11:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:13 smithi027 ceph-mon[110082]: osdmap e62: 6 total, 6 up, 6 in 2024-09-20T19:11:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:13 smithi098 ceph-mon[80954]: osdmap e62: 6 total, 6 up, 6 in 2024-09-20T19:11:14.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:14 smithi027 ceph-mon[110082]: pgmap v143: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 2 active+undersized+remapped, 1 active+clean+remapped, 5 active+undersized, 3 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 571/282 objects degraded (202.482%); 4.0 MiB/s, 77 objects/s recovering 2024-09-20T19:11:14.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:14 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 571/282 objects degraded (202.482%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:14.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:14 smithi027 ceph-mon[110082]: osdmap e63: 6 total, 6 up, 6 in 2024-09-20T19:11:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:14 smithi098 ceph-mon[80954]: pgmap v143: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 2 active+undersized+remapped, 1 active+clean+remapped, 5 active+undersized, 3 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 571/282 objects degraded (202.482%); 4.0 MiB/s, 77 objects/s recovering 2024-09-20T19:11:14.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:14 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 571/282 objects degraded (202.482%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:14.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:14 smithi098 ceph-mon[80954]: osdmap e63: 6 total, 6 up, 6 in 2024-09-20T19:11:16.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:16 smithi027 ceph-mon[110082]: pgmap v146: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 63 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 277/282 objects degraded (98.227%); 4.0 MiB/s, 75 objects/s recovering 2024-09-20T19:11:16.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:16 smithi027 ceph-mon[110082]: osdmap e64: 6 total, 6 up, 6 in 2024-09-20T19:11:16.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:16 smithi098 ceph-mon[80954]: pgmap v146: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 63 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 277/282 objects degraded (98.227%); 4.0 MiB/s, 75 objects/s recovering 2024-09-20T19:11:16.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:16 smithi098 ceph-mon[80954]: osdmap e64: 6 total, 6 up, 6 in 2024-09-20T19:11:18.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:18 smithi027 ceph-mon[110082]: pgmap v148: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 63 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 900 B/s rd, 1 op/s; 277/282 objects degraded (98.227%); 3.5 MiB/s, 66 objects/s recovering 2024-09-20T19:11:18.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:18 smithi098 ceph-mon[80954]: pgmap v148: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 63 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 900 B/s rd, 1 op/s; 277/282 objects degraded (98.227%); 3.5 MiB/s, 66 objects/s recovering 2024-09-20T19:11:19.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:19 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 277/282 objects degraded (98.227%), 1 pg degraded (PG_DEGRADED) 2024-09-20T19:11:19.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:19 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 277/282 objects degraded (98.227%), 1 pg degraded (PG_DEGRADED) 2024-09-20T19:11:20.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:20 smithi098 ceph-mon[80954]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 0 B/s, 44 objects/s recovering 2024-09-20T19:11:20.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:20 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 277/282 objects degraded (98.227%), 1 pg degraded) 2024-09-20T19:11:20.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:20 smithi027 ceph-mon[110082]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 0 B/s, 44 objects/s recovering 2024-09-20T19:11:20.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:20 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 277/282 objects degraded (98.227%), 1 pg degraded) 2024-09-20T19:11:22.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:22 smithi027 ceph-mon[110082]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 679 B/s rd, 1 op/s; 0 B/s, 35 objects/s recovering 2024-09-20T19:11:22.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:22 smithi098 ceph-mon[80954]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 679 B/s rd, 1 op/s; 0 B/s, 35 objects/s recovering 2024-09-20T19:11:24.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:24 smithi098 ceph-mon[80954]: pgmap v151: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 30 objects/s recovering 2024-09-20T19:11:24.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:24 smithi027 ceph-mon[110082]: pgmap v151: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 30 objects/s recovering 2024-09-20T19:11:26.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:26 smithi098 ceph-mon[80954]: pgmap v152: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 27 objects/s recovering 2024-09-20T19:11:26.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:26 smithi027 ceph-mon[110082]: pgmap v152: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 27 objects/s recovering 2024-09-20T19:11:27.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T19:11:27.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:27 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T19:11:27.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:27 smithi027 ceph-mon[110082]: Upgrade: osd.1 is safe to restart 2024-09-20T19:11:27.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T19:11:27.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:27 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T19:11:27.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:27 smithi098 ceph-mon[80954]: Upgrade: osd.1 is safe to restart 2024-09-20T19:11:28.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: pgmap v153: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 863 B/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2024-09-20T19:11:28.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:28.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-20T19:11:28.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: pgmap v153: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 863 B/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-20T19:11:28.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:29.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:29 smithi098 ceph-mon[80954]: Upgrade: Updating osd.1 2024-09-20T19:11:29.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:29 smithi098 ceph-mon[80954]: Deploying daemon osd.1 on smithi027 2024-09-20T19:11:29.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:29 smithi027 ceph-mon[110082]: Upgrade: Updating osd.1 2024-09-20T19:11:29.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:29 smithi027 ceph-mon[110082]: Deploying daemon osd.1 on smithi027 2024-09-20T19:11:30.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:30 smithi027 ceph-mon[110082]: pgmap v154: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 23 objects/s recovering 2024-09-20T19:11:30.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:30 smithi098 ceph-mon[80954]: pgmap v154: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 23 objects/s recovering 2024-09-20T19:11:31.303 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:31 smithi027 systemd[1]: Stopping Ceph osd.1 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:11:31.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:31 smithi027 ceph-mon[110082]: osd.1 marked itself down and dead 2024-09-20T19:11:31.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:31 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:11:31.299+0000 7f6a0c358640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:11:31.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:31 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:11:31.299+0000 7f6a0c358640 -1 osd.1 64 *** Got signal Terminated *** 2024-09-20T19:11:31.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:31 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[57231]: 2024-09-20T19:11:31.299+0000 7f6a0c358640 -1 osd.1 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:11:31.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:31 smithi098 ceph-mon[80954]: osd.1 marked itself down and dead 2024-09-20T19:11:32.433 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:32 smithi027 podman[123424]: 2024-09-20 19:11:32.137833925 +0000 UTC m=+0.942676801 container stop 42c6ccd48162845e6e9d6f6ebcff0ef6b52a704983e8b7bc5f8c1165cb4b44c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:11:32.433 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:32 smithi027 podman[123424]: 2024-09-20 19:11:32.163459442 +0000 UTC m=+0.968302332 container died 42c6ccd48162845e6e9d6f6ebcff0ef6b52a704983e8b7bc5f8c1165cb4b44c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T19:11:32.818 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:32 smithi027 podman[123424]: 2024-09-20 19:11:32.642695253 +0000 UTC m=+1.447538125 container cleanup 42c6ccd48162845e6e9d6f6ebcff0ef6b52a704983e8b7bc5f8c1165cb4b44c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T19:11:32.818 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:32 smithi027 bash[123424]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1 2024-09-20T19:11:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:32 smithi027 ceph-mon[110082]: pgmap v155: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:11:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:32 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:11:32.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:32 smithi027 ceph-mon[110082]: osdmap e65: 6 total, 5 up, 6 in 2024-09-20T19:11:32.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:32 smithi098 ceph-mon[80954]: pgmap v155: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:11:32.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:32 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:11:32.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:32 smithi098 ceph-mon[80954]: osdmap e65: 6 total, 5 up, 6 in 2024-09-20T19:11:33.161 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:32 smithi027 podman[123448]: 2024-09-20 19:11:32.857726112 +0000 UTC m=+0.713720599 container remove 42c6ccd48162845e6e9d6f6ebcff0ef6b52a704983e8b7bc5f8c1165cb4b44c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T19:11:33.429 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.169523286 +0000 UTC m=+0.016973746 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:11:33.429 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.295115238 +0000 UTC m=+0.142565704 container create b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:11:33.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:33 smithi027 ceph-mon[110082]: osdmap e66: 6 total, 5 up, 6 in 2024-09-20T19:11:33.819 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.547828134 +0000 UTC m=+0.395278598 container init b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-20T19:11:33.819 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.551311582 +0000 UTC m=+0.398762042 container start b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-20T19:11:33.819 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.64770732 +0000 UTC m=+0.495157790 container attach b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T19:11:33.819 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:33 smithi027 podman[123537]: 2024-09-20 19:11:33.745937445 +0000 UTC m=+0.593387904 container died b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux ) 2024-09-20T19:11:33.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:33 smithi098 ceph-mon[80954]: osdmap e66: 6 total, 5 up, 6 in 2024-09-20T19:11:34.662 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:34 smithi027 ceph-mon[110082]: pgmap v158: 65 pgs: 16 active+undersized, 2 stale+active+clean, 11 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:11:34.662 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:34 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:34.663 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 podman[123559]: 2024-09-20 19:11:34.410148465 +0000 UTC m=+0.657687421 container remove b15ceecd5cee2020d1a70d80ab41ed422aaa80276b4e6a6975c2f41b63bdbf87 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-20T19:11:34.663 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-20T19:11:34.663 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 systemd[1]: Stopped Ceph osd.1 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:11:34.663 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.1.service: Consumed 59.790s CPU time. 2024-09-20T19:11:34.663 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 systemd[1]: Starting Ceph osd.1 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:11:34.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:34 smithi098 ceph-mon[80954]: pgmap v158: 65 pgs: 16 active+undersized, 2 stale+active+clean, 11 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:11:34.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:34 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:34.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2643589722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481067f0 msgr2=0x7f3d48106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:34.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2643589722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481067f0 0x7f3d48106bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009880 tx=0x7f3d3802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:34.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2643589722 shutdown_connections 2024-09-20T19:11:34.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2643589722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481007f0 0x7f3d48100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:34.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2643589722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481067f0 0x7f3d48106bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2643589722 >> 172.21.15.27:0/2643589722 conn(0x7f3d480fc550 msgr2=0x7f3d480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.903+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2643589722 shutdown_connections 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.904+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2643589722 wait complete. 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.904+0000 7f3d4c9ec640 1 Processor -- start 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.904+0000 7f3d4c9ec640 1 -- start start 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4c9ec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4c9ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481067f0 0x7f3d48198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4c9ec640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4810dcc0 con 0x7f3d481007f0 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4c9ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4810db40 con 0x7f3d481067f0 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:34.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46612/0 (socket says 172.21.15.27:46612) 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 -- 172.21.15.27:0/2334819597 learned_addr learned my addr 172.21.15.27:0/2334819597 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d3ffff640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481067f0 0x7f3d48198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 -- 172.21.15.27:0/2334819597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481067f0 msgr2=0x7f3d48198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481067f0 0x7f3d48198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 -- 172.21.15.27:0/2334819597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d48199350 con 0x7f3d481007f0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.905+0000 7f3d4659c640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d38031460 tx=0x7f3d380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.906+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d3803f070 con 0x7f3d481007f0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.906+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d481995e0 con 0x7f3d481007f0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.906+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d481a1b90 con 0x7f3d481007f0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.906+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d380035f0 con 0x7f3d481007f0 2024-09-20T19:11:34.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.906+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d38035030 con 0x7f3d481007f0 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.907+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d48101f30 con 0x7f3d481007f0 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.907+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3d38042070 con 0x7f3d481007f0 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.908+0000 7f3d3f7fe640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 0x7f3d3407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.908+0000 7f3d3ffff640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 0x7f3d3407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.908+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7f3d380bea80 con 0x7f3d481007f0 2024-09-20T19:11:34.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.909+0000 7f3d3ffff640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 0x7f3d3407d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d4806a7f0 tx=0x7f3d3000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:34.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:34.913+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d38089f70 con 0x7f3d481007f0 2024-09-20T19:11:35.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.118+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d48062630 con 0x7f3d3407af30 2024-09-20T19:11:35.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.119+0000 7f3d3f7fe640 1 -- 172.21.15.27:0/2334819597 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3d48062630 con 0x7f3d3407af30 2024-09-20T19:11:35.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 msgr2=0x7f3d3407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 0x7f3d3407d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d4806a7f0 tx=0x7f3d3000b390 comp rx=0 tx=0).stop 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 msgr2=0x7f3d48198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d38031460 tx=0x7f3d380045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 shutdown_connections 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f3d3407af30 0x7f3d3407d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d481067f0 0x7f3d48198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 --2- 172.21.15.27:0/2334819597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d481007f0 0x7f3d48198810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 >> 172.21.15.27:0/2334819597 conn(0x7f3d480fc550 msgr2=0x7f3d480fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 shutdown_connections 2024-09-20T19:11:35.125 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 podman[123658]: 2024-09-20 19:11:34.775243427 +0000 UTC m=+0.016878259 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:11:35.125 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:34 smithi027 podman[123658]: 2024-09-20 19:11:34.894750678 +0000 UTC m=+0.136385505 container create 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, ceph=True) 2024-09-20T19:11:35.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.121+0000 7f3d4c9ec640 1 -- 172.21.15.27:0/2334819597 wait complete. 2024-09-20T19:11:35.133 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:11:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 -- 172.21.15.27:0/712409701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001007f0 msgr2=0x7f8900100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 --2- 172.21.15.27:0/712409701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001007f0 0x7f8900100c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009880 tx=0x7f88f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 -- 172.21.15.27:0/712409701 shutdown_connections 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 --2- 172.21.15.27:0/712409701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001007f0 0x7f8900100c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 --2- 172.21.15.27:0/712409701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001067f0 0x7f8900106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 -- 172.21.15.27:0/712409701 >> 172.21.15.27:0/712409701 conn(0x7f89000fc550 msgr2=0x7f89000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 -- 172.21.15.27:0/712409701 shutdown_connections 2024-09-20T19:11:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.209+0000 7f8905ad1640 1 -- 172.21.15.27:0/712409701 wait complete. 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.210+0000 7f8905ad1640 1 Processor -- start 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.210+0000 7f8905ad1640 1 -- start start 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f8905ad1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001007f0 0x7f890019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f8905ad1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f8905ad1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f890010dca0 con 0x7f89001067f0 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f8905ad1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f890010db20 con 0x7f89001007f0 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46632/0 (socket says 172.21.15.27:46632) 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 -- 172.21.15.27:0/2320351311 learned_addr learned my addr 172.21.15.27:0/2320351311 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88ff7fe640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001007f0 0x7f890019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 -- 172.21.15.27:0/2320351311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001007f0 msgr2=0x7f890019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001007f0 0x7f890019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 -- 172.21.15.27:0/2320351311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8900196670 con 0x7f89001067f0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.211+0000 7f88feffd640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f88f4031460 tx=0x7f88f40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.212+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f403f070 con 0x7f89001067f0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.212+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f40035f0 con 0x7f89001067f0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.212+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8900196900 con 0x7f89001067f0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.212+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f4035030 con 0x7f89001067f0 2024-09-20T19:11:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.212+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8900196e00 con 0x7f89001067f0 2024-09-20T19:11:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.213+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900101f30 con 0x7f89001067f0 2024-09-20T19:11:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.213+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f88f4042070 con 0x7f89001067f0 2024-09-20T19:11:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.214+0000 7f88fcff9640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 0x7f88e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.214+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7f88f40bea80 con 0x7f89001067f0 2024-09-20T19:11:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.214+0000 7f88ff7fe640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 0x7f88e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.215+0000 7f88ff7fe640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 0x7f88e807d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88f000bbe0 tx=0x7f88f000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.218+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88f4089f70 con 0x7f89001067f0 2024-09-20T19:11:35.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.429+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f89001970b0 con 0x7f88e807af30 2024-09-20T19:11:35.432 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 podman[123658]: 2024-09-20 19:11:35.172559604 +0000 UTC m=+0.414194430 container init 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-20T19:11:35.432 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 podman[123658]: 2024-09-20 19:11:35.176246495 +0000 UTC m=+0.417881331 container start 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:11:35.432 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 podman[123658]: 2024-09-20 19:11:35.255806105 +0000 UTC m=+0.497440939 container attach 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T19:11:35.432 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:35.433 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 bash[123658]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:35.433 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:35.433 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:35 smithi027 bash[123658]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.430+0000 7f88fcff9640 1 -- 172.21.15.27:0/2320351311 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f89001970b0 con 0x7f88e807af30 2024-09-20T19:11:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 msgr2=0x7f88e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 0x7f88e807d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88f000bbe0 tx=0x7f88f000b390 comp rx=0 tx=0).stop 2024-09-20T19:11:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 msgr2=0x7f890019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f88f4031460 tx=0x7f88f40045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 shutdown_connections 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f88e807af30 0x7f88e807d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89001067f0 0x7f890019cae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 --2- 172.21.15.27:0/2320351311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89001007f0 0x7f890019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 >> 172.21.15.27:0/2320351311 conn(0x7f89000fc550 msgr2=0x7f89000fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 shutdown_connections 2024-09-20T19:11:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.432+0000 7f8905ad1640 1 -- 172.21.15.27:0/2320351311 wait complete. 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1399326679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 msgr2=0x7ff69c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1399326679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c106be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009880 tx=0x7ff68c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1399326679 shutdown_connections 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1399326679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1399326679 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c106be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1399326679 >> 172.21.15.27:0/1399326679 conn(0x7ff69c0fc520 msgr2=0x7ff69c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1399326679 shutdown_connections 2024-09-20T19:11:35.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.516+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1399326679 wait complete. 2024-09-20T19:11:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.517+0000 7ff6a1df9640 1 Processor -- start 2024-09-20T19:11:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.517+0000 7ff6a1df9640 1 -- start start 2024-09-20T19:11:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff6a1df9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff6a1df9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff6a1df9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10dcb0 con 0x7ff69c106800 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff6a1df9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10db30 con 0x7ff69c100800 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55430/0 (socket says 172.21.15.27:55430) 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 -- 172.21.15.27:0/1354396884 learned_addr learned my addr 172.21.15.27:0/1354396884 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 -- 172.21.15.27:0/1354396884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 msgr2=0x7ff69c107c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69b7fe640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c107c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 -- 172.21.15.27:0/1354396884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1086a0 con 0x7ff69c106800 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69b7fe640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff69affd640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c8a0 tx=0x7ff69000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6900079b0 con 0x7ff69c106800 2024-09-20T19:11:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff690007b50 con 0x7ff69c106800 2024-09-20T19:11:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c108990 con 0x7ff69c106800 2024-09-20T19:11:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.518+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff690018700 con 0x7ff69c106800 2024-09-20T19:11:35.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.519+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a3dd0 con 0x7ff69c106800 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.519+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c101f40 con 0x7ff69c106800 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.520+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff690007d00 con 0x7ff69c106800 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.521+0000 7ff698ff9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 0x7ff68407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.521+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7ff69009e330 con 0x7ff69c106800 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.521+0000 7ff69b7fe640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 0x7ff68407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.521+0000 7ff69b7fe640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 0x7ff68407d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006010 tx=0x7ff68c0095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.525+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff690014030 con 0x7ff69c106800 2024-09-20T19:11:35.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.727+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff69c06a1b0 con 0x7ff68407af80 2024-09-20T19:11:35.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.737+0000 7ff698ff9640 1 -- 172.21.15.27:0/1354396884 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff69c06a1b0 con 0x7ff68407af80 2024-09-20T19:11:35.740 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:11:35.740 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (2m) 28s ago 13m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (5m) 28s ago 14m 8535k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (4m) 53s ago 13m 8669k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (61s) 28s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (56s) 53s ago 13m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (2m) 28s ago 13m 73.6M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (8m) 28s ago 8m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (8m) 28s ago 8m 16.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (8m) 53s ago 8m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (8m) 53s ago 8m 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (4m) 28s ago 15m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (4m) 53s ago 12m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (92s) 28s ago 15m 40.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:11:35.741 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (74s) 53s ago 12m 26.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (3m) 28s ago 13m 11.2M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (3m) 53s ago 12m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (34s) 28s ago 11m 14.5M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (11m) 28s ago 11m 229M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 42c6ccd48162 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (10m) 28s ago 10m 235M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (10m) 53s ago 10m 242M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (9m) 53s ago 9m 213M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (9m) 53s ago 9m 193M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:11:35.742 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (3m) 28s ago 13m 54.4M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 msgr2=0x7ff68407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 0x7ff68407d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006010 tx=0x7ff68c0095f0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 msgr2=0x7ff69c108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c8a0 tx=0x7ff69000cd60 comp rx=0 tx=0).stop 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 shutdown_connections 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7ff68407af80 0x7ff68407d440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff69c106800 0x7ff69c108160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 --2- 172.21.15.27:0/1354396884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff69c100800 0x7ff69c107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.739+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 >> 172.21.15.27:0/1354396884 conn(0x7ff69c0fc520 msgr2=0x7ff69c109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.740+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 shutdown_connections 2024-09-20T19:11:35.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.740+0000 7ff6a1df9640 1 -- 172.21.15.27:0/1354396884 wait complete. 2024-09-20T19:11:35.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 -- 172.21.15.27:0/2019264894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914107900 msgr2=0x7f6914107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 --2- 172.21.15.27:0/2019264894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914107900 0x7f6914107ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6904009880 tx=0x7f690402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 -- 172.21.15.27:0/2019264894 shutdown_connections 2024-09-20T19:11:35.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 --2- 172.21.15.27:0/2019264894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914101900 0x7f6914101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 --2- 172.21.15.27:0/2019264894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914107900 0x7f6914107ce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 -- 172.21.15.27:0/2019264894 >> 172.21.15.27:0/2019264894 conn(0x7f69140fd600 msgr2=0x7f69140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:35.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 -- 172.21.15.27:0/2019264894 shutdown_connections 2024-09-20T19:11:35.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.823+0000 7f691a06c640 1 -- 172.21.15.27:0/2019264894 wait complete. 2024-09-20T19:11:35.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 Processor -- start 2024-09-20T19:11:35.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 -- start start 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914107900 0x7f691419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f691410edb0 con 0x7f6914101900 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.824+0000 7f691a06c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f691410ec30 con 0x7f6914107900 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55448/0 (socket says 172.21.15.27:55448) 2024-09-20T19:11:35.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 -- 172.21.15.27:0/2827761316 learned_addr learned my addr 172.21.15.27:0/2827761316 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f6912ffd640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914107900 0x7f691419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 -- 172.21.15.27:0/2827761316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914107900 msgr2=0x7f691419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914107900 0x7f691419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 -- 172.21.15.27:0/2827761316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69141977c0 con 0x7f6914101900 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f69137fe640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6904031460 tx=0x7f69040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f690403f070 con 0x7f6914101900 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69040035f0 con 0x7f6914101900 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6914197a50 con 0x7f6914101900 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6904035030 con 0x7f6914101900 2024-09-20T19:11:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.825+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6914197f80 con 0x7f6914101900 2024-09-20T19:11:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.826+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6914103040 con 0x7f6914101900 2024-09-20T19:11:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.827+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6904042070 con 0x7f6914101900 2024-09-20T19:11:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.828+0000 7f6910ff9640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 0x7f68fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.828+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7f69040bea20 con 0x7f6914101900 2024-09-20T19:11:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.828+0000 7f6912ffd640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 0x7f68fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:35.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.828+0000 7f6912ffd640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 0x7f68fc07d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6908005fd0 tx=0x7f6908005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:35.832+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6904089f90 con 0x7f6914101900 2024-09-20T19:11:36.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.103+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6914104b10 con 0x7f6914101900 2024-09-20T19:11:36.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.104+0000 7f6910ff9640 1 -- 172.21.15.27:0/2827761316 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f690408ee40 con 0x7f6914101900 2024-09-20T19:11:36.107 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4, 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:11:36.108 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 8, 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 5 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:11:36.109 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 msgr2=0x7f68fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 0x7f68fc07d440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6908005fd0 tx=0x7f6908005850 comp rx=0 tx=0).stop 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 msgr2=0x7f691419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6904031460 tx=0x7f69040045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 shutdown_connections 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f68fc07af80 0x7f68fc07d440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6914107900 0x7f691419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 --2- 172.21.15.27:0/2827761316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6914101900 0x7f691419d640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 >> 172.21.15.27:0/2827761316 conn(0x7f69140fd600 msgr2=0x7f69140ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 shutdown_connections 2024-09-20T19:11:36.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.106+0000 7f691a06c640 1 -- 172.21.15.27:0/2827761316 wait complete. 2024-09-20T19:11:36.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 -- 172.21.15.27:0/1511789854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 msgr2=0x7fd22c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 --2- 172.21.15.27:0/1511789854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c101d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009880 tx=0x7fd21c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 -- 172.21.15.27:0/1511789854 shutdown_connections 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 --2- 172.21.15.27:0/1511789854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c101d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 --2- 172.21.15.27:0/1511789854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 -- 172.21.15.27:0/1511789854 >> 172.21.15.27:0/1511789854 conn(0x7fd22c0fd600 msgr2=0x7fd22c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 -- 172.21.15.27:0/1511789854 shutdown_connections 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.190+0000 7fd234772640 1 -- 172.21.15.27:0/1511789854 wait complete. 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 Processor -- start 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 -- start start 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c10edb0 con 0x7fd22c101900 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd234772640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c10ec30 con 0x7fd22c107900 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd23250e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd23250e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55464/0 (socket says 172.21.15.27:55464) 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd23250e640 1 -- 172.21.15.27:0/2864648668 learned_addr learned my addr 172.21.15.27:0/2864648668 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.191+0000 7fd231d0d640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd23250e640 1 -- 172.21.15.27:0/2864648668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 msgr2=0x7fd22c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd23250e640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd23250e640 1 -- 172.21.15.27:0/2864648668 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c197800 con 0x7fd22c101900 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd231d0d640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd23250e640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d8d0 tx=0x7fd22800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd228017070 con 0x7fd22c101900 2024-09-20T19:11:36.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd228010460 con 0x7fd22c101900 2024-09-20T19:11:36.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22c197af0 con 0x7fd22c101900 2024-09-20T19:11:36.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd22800f5f0 con 0x7fd22c101900 2024-09-20T19:11:36.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.192+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22c198050 con 0x7fd22c101900 2024-09-20T19:11:36.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.193+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22c103040 con 0x7fd22c101900 2024-09-20T19:11:36.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.194+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd228009a30 con 0x7fd22c101900 2024-09-20T19:11:36.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.194+0000 7fd2237fe640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 0x7fd21807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.194+0000 7fd231d0d640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 0x7fd21807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.194+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7fd22809df20 con 0x7fd22c101900 2024-09-20T19:11:36.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.195+0000 7fd231d0d640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 0x7fd21807d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd22c198b50 tx=0x7fd21c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.199+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd228069490 con 0x7fd22c101900 2024-09-20T19:11:36.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.424+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd22c109e90 con 0x7fd22c101900 2024-09-20T19:11:36.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.424+0000 7fd2237fe640 1 -- 172.21.15.27:0/2864648668 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7fd22806e340 con 0x7fd22c101900 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:11:36.428 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:11:36.429 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:36.430 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 msgr2=0x7fd21807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 0x7fd21807d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd22c198b50 tx=0x7fd21c031400 comp rx=0 tx=0).stop 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 msgr2=0x7fd22c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd22800d8d0 tx=0x7fd22800dd90 comp rx=0 tx=0).stop 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 shutdown_connections 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd21807af80 0x7fd21807d440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd22c107900 0x7fd22c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 --2- 172.21.15.27:0/2864648668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd22c101900 0x7fd22c19d680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.426+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 >> 172.21.15.27:0/2864648668 conn(0x7fd22c0fd600 msgr2=0x7fd22c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.427+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 shutdown_connections 2024-09-20T19:11:36.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.427+0000 7fd234772640 1 -- 172.21.15.27:0/2864648668 wait complete. 2024-09-20T19:11:36.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 -- 172.21.15.27:0/1947729509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 msgr2=0x7f7e101054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 --2- 172.21.15.27:0/1947729509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e101054a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009880 tx=0x7f7df802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 -- 172.21.15.27:0/1947729509 shutdown_connections 2024-09-20T19:11:36.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 --2- 172.21.15.27:0/1947729509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e101054a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 --2- 172.21.15.27:0/1947729509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e10101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.514+0000 7f7e15797640 1 -- 172.21.15.27:0/1947729509 >> 172.21.15.27:0/1947729509 conn(0x7f7e100771e0 msgr2=0x7f7e100775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 -- 172.21.15.27:0/1947729509 shutdown_connections 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 -- 172.21.15.27:0/1947729509 wait complete. 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 Processor -- start 2024-09-20T19:11:36.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 -- start start 2024-09-20T19:11:36.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e1010b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1010edd0 con 0x7f7e10101ef0 2024-09-20T19:11:36.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.515+0000 7f7e15797640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1010ec50 con 0x7f7e10101540 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55482/0 (socket says 172.21.15.27:55482) 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 -- 172.21.15.27:0/3024555525 learned_addr learned my addr 172.21.15.27:0/3024555525 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e0effd640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e1010b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 -- 172.21.15.27:0/3024555525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 msgr2=0x7f7e1010b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e1010b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 -- 172.21.15.27:0/3024555525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1010c250 con 0x7f7e10101ef0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e0effd640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e1010b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e07fff640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df80045e0 tx=0x7f7df8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7df803f070 con 0x7f7e10101ef0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.516+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7df80035f0 con 0x7f7e10101ef0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.517+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1010c4e0 con 0x7f7e10101ef0 2024-09-20T19:11:36.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.517+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e101a3d40 con 0x7f7e10101ef0 2024-09-20T19:11:36.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.517+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7df8035030 con 0x7f7e10101ef0 2024-09-20T19:11:36.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.518+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e100698d0 con 0x7f7e10101ef0 2024-09-20T19:11:36.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.519+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7df8042070 con 0x7f7e10101ef0 2024-09-20T19:11:36.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.519+0000 7f7e0cff9640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 0x7f7dfc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.519+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7f7df80beb60 con 0x7f7e10101ef0 2024-09-20T19:11:36.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.519+0000 7f7e0effd640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 0x7f7dfc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.520+0000 7f7e0effd640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 0x7f7dfc07d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e000058c0 tx=0x7f7e00005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.524+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7df808a050 con 0x7f7e10101ef0 2024-09-20T19:11:36.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.731+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7e10062630 con 0x7f7dfc07af40 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: pgmap v159: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2827761316' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:36.735 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:36 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2864648668' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:36.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.732+0000 7f7e0cff9640 1 -- 172.21.15.27:0/3024555525 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7e10062630 con 0x7f7dfc07af40 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:11:36.736 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "7/23 daemons upgraded", 2024-09-20T19:11:36.737 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:11:36.737 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:11:36.737 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:11:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 msgr2=0x7f7dfc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 0x7f7dfc07d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e000058c0 tx=0x7f7e00005850 comp rx=0 tx=0).stop 2024-09-20T19:11:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 msgr2=0x7f7e1010bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df80045e0 tx=0x7f7df8004610 comp rx=0 tx=0).stop 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 shutdown_connections 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7dfc07af40 0x7f7dfc07d400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e10101ef0 0x7f7e1010bd10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 --2- 172.21.15.27:0/3024555525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e10101540 0x7f7e1010b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 >> 172.21.15.27:0/3024555525 conn(0x7f7e100771e0 msgr2=0x7f7e100fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 shutdown_connections 2024-09-20T19:11:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.735+0000 7f7e15797640 1 -- 172.21.15.27:0/3024555525 wait complete. 2024-09-20T19:11:36.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 -- 172.21.15.27:0/289776628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 msgr2=0x7fe48010b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 --2- 172.21.15.27:0/289776628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48010b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe474009880 tx=0x7fe47402a530 comp rx=0 tx=0).stop 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 -- 172.21.15.27:0/289776628 shutdown_connections 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 --2- 172.21.15.27:0/289776628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48010b970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 --2- 172.21.15.27:0/289776628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 0x7fe480102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 -- 172.21.15.27:0/289776628 >> 172.21.15.27:0/289776628 conn(0x7fe4800fc520 msgr2=0x7fe4800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 -- 172.21.15.27:0/289776628 shutdown_connections 2024-09-20T19:11:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.821+0000 7fe4863b5640 1 -- 172.21.15.27:0/289776628 wait complete. 2024-09-20T19:11:36.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 Processor -- start 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 -- start start 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 0x7fe48019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe48010edf0 con 0x7fe480103480 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe4863b5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe48010ec70 con 0x7fe480102b60 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe47f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe47f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55502/0 (socket says 172.21.15.27:55502) 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe47f7fe640 1 -- 172.21.15.27:0/3931824289 learned_addr learned my addr 172.21.15.27:0/3931824289 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.822+0000 7fe47ffff640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 0x7fe48019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47f7fe640 1 -- 172.21.15.27:0/3931824289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 msgr2=0x7fe48019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:36.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47f7fe640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 0x7fe48019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47f7fe640 1 -- 172.21.15.27:0/3931824289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4801977e0 con 0x7fe480103480 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47f7fe640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe474004f90 tx=0x7fe4740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe47403f070 con 0x7fe480103480 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe480197a70 con 0x7fe480103480 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe474004c70 con 0x7fe480103480 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe474035030 con 0x7fe480103480 2024-09-20T19:11:36.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.823+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe480197fa0 con 0x7fe480103480 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.824+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48006a9f0 con 0x7fe480103480 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.825+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe474042070 con 0x7fe480103480 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.825+0000 7fe47d7fa640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 0x7fe46807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.826+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6417+0+0 (secure 0 0 0) 0x7fe4740beb80 con 0x7fe480103480 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.826+0000 7fe47ffff640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 0x7fe46807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:36.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.826+0000 7fe47ffff640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 0x7fe46807d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe47000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:36.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:36.830+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe47408a070 con 0x7fe480103480 2024-09-20T19:11:36.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: pgmap v159: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:36.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2827761316' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:36.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:36 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2864648668' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:37.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.099+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe480198d10 con 0x7fe480103480 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.099+0000 7fe47d7fa640 1 -- 172.21.15.27:0/3931824289 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1182 (secure 0 0 0) 0x7fe47408ef20 con 0x7fe480103480 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: osd.1 (root=default,host=smithi027) is down 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-20T19:11:37.103 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-20T19:11:37.104 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-20T19:11:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 msgr2=0x7fe46807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 0x7fe46807d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe47000b390 comp rx=0 tx=0).stop 2024-09-20T19:11:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 msgr2=0x7fe48019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe474004f90 tx=0x7fe4740048f0 comp rx=0 tx=0).stop 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 shutdown_connections 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46807af40 0x7fe46807d400 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe480103480 0x7fe48019dba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 --2- 172.21.15.27:0/3931824289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe480102b60 0x7fe48019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 >> 172.21.15.27:0/3931824289 conn(0x7fe4800fc520 msgr2=0x7fe480107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 shutdown_connections 2024-09-20T19:11:37.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:11:37.103+0000 7fe4863b5640 1 -- 172.21.15.27:0/3931824289 wait complete. 2024-09-20T19:11:37.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:37 smithi098 ceph-mon[80954]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:37.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:37 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3931824289' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:38.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:37 smithi027 ceph-mon[110082]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:38.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:37 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3931824289' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:38.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T19:11:38.569 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-20T19:11:38.570 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-20T19:11:38.970 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-mon[110082]: pgmap v160: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:38.970 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate[123695]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 bash[123658]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-20T19:11:38.971 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:38 smithi027 podman[123658]: 2024-09-20 19:11:38.622946845 +0000 UTC m=+3.864581682 container died 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-20T19:11:38.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:38 smithi098 ceph-mon[80954]: pgmap v160: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:39.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 podman[124062]: 2024-09-20 19:11:39.310023272 +0000 UTC m=+0.680432830 container remove 073f7befbb01acd2f1d4b95e31a3e51157e37acb4e2ac92400aa9779f96290a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:11:39.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 podman[124122]: 2024-09-20 19:11:39.430316897 +0000 UTC m=+0.016886053 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:11:39.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 podman[124122]: 2024-09-20 19:11:39.544300156 +0000 UTC m=+0.130869344 container create 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-20T19:11:39.890 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:39 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:39.890 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 podman[124122]: 2024-09-20 19:11:39.788377708 +0000 UTC m=+0.374946855 container init 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T19:11:39.891 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 podman[124122]: 2024-09-20 19:11:39.792016714 +0000 UTC m=+0.378585861 container start 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-20T19:11:39.891 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 ceph-osd[124141]: -- 172.21.15.27:0/914191686 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee9895c1e0 con 0x55ee97afbc00 2024-09-20T19:11:39.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:39 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:11:40.318 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 bash[124122]: 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 2024-09-20T19:11:40.318 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:39 smithi027 systemd[1]: Started Ceph osd.1 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:11:40.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:40 smithi027 ceph-mon[110082]: pgmap v161: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:40.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:40.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:40.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:40.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:40 smithi098 ceph-mon[80954]: pgmap v161: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:40.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:40.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:40.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:41.523 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:41 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:11:41.198+0000 7faac1acd640 -1 Falling back to public interface 2024-09-20T19:11:42.765 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:42 smithi027 ceph-mon[110082]: pgmap v162: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:42.765 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:42.765 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:42 smithi098 ceph-mon[80954]: pgmap v162: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:42.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:44.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:44 smithi027 ceph-mon[110082]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:44.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:44 smithi098 ceph-mon[80954]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:46.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-mon[110082]: pgmap v164: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:46.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.517 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.518 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:46 smithi098 ceph-mon[80954]: pgmap v164: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/282 objects degraded (13.475%) 2024-09-20T19:11:46.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:46.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:47.237 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:46 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:11:46.936+0000 7faac1acd640 -1 osd.1 64 log_to_monitors true 2024-09-20T19:11:47.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:47 smithi027 ceph-mon[110082]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-20T19:11:47.568 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:11:47 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:11:47.261+0000 7faab9877640 -1 osd.1 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:11:47.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:47 smithi098 ceph-mon[80954]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-20T19:11:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:48 smithi027 ceph-mon[110082]: pgmap v165: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:48 smithi027 ceph-mon[110082]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T19:11:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:48 smithi027 ceph-mon[110082]: osdmap e67: 6 total, 5 up, 6 in 2024-09-20T19:11:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:48 smithi027 ceph-mon[110082]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:11:48.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:48 smithi098 ceph-mon[80954]: pgmap v165: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:48.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:48 smithi098 ceph-mon[80954]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T19:11:48.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:48 smithi098 ceph-mon[80954]: osdmap e67: 6 total, 5 up, 6 in 2024-09-20T19:11:48.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:48 smithi098 ceph-mon[80954]: from='osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:11:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:49 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:11:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:49 smithi027 ceph-mon[110082]: osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897] boot 2024-09-20T19:11:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:49 smithi027 ceph-mon[110082]: osdmap e68: 6 total, 6 up, 6 in 2024-09-20T19:11:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:49 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-20T19:11:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:49 smithi027 ceph-mon[110082]: osdmap e69: 6 total, 6 up, 6 in 2024-09-20T19:11:49.689 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:49 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:11:49.689 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:49 smithi098 ceph-mon[80954]: osd.1 [v2:172.21.15.27:6810/4111182897,v1:172.21.15.27:6811/4111182897] boot 2024-09-20T19:11:49.690 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:49 smithi098 ceph-mon[80954]: osdmap e68: 6 total, 6 up, 6 in 2024-09-20T19:11:49.690 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:49 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-20T19:11:49.690 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:49 smithi098 ceph-mon[80954]: osdmap e69: 6 total, 6 up, 6 in 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: pgmap v168: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T19:11:50.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T19:11:50.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:50 smithi098 ceph-mon[80954]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-20T19:11:50.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: pgmap v168: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:50.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T19:11:50.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:50 smithi027 ceph-mon[110082]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-20T19:11:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:52 smithi098 ceph-mon[80954]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:52 smithi027 ceph-mon[110082]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 38/282 objects degraded (13.475%) 2024-09-20T19:11:53.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:53 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded) 2024-09-20T19:11:53.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:53 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/282 objects degraded (13.475%), 13 pgs degraded) 2024-09-20T19:11:54.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:54 smithi098 ceph-mon[80954]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:11:54.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:54 smithi027 ceph-mon[110082]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:11:56.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:56 smithi098 ceph-mon[80954]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T19:11:56.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:56 smithi027 ceph-mon[110082]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T19:11:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:58 smithi027 ceph-mon[110082]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 587 B/s rd, 1 op/s 2024-09-20T19:11:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:11:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:58.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:58 smithi098 ceph-mon[80954]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 587 B/s rd, 1 op/s 2024-09-20T19:11:58.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:11:58.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:11:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:00.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:00 smithi027 ceph-mon[110082]: pgmap v174: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:00.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:00 smithi098 ceph-mon[80954]: pgmap v174: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:02.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:02 smithi027 ceph-mon[110082]: pgmap v175: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 874 B/s rd, 1 op/s 2024-09-20T19:12:02.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:02 smithi098 ceph-mon[80954]: pgmap v175: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 874 B/s rd, 1 op/s 2024-09-20T19:12:03.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:03.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:04.939 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:04 smithi027 ceph-mon[110082]: pgmap v176: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:04.939 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:04 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T19:12:04.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:04 smithi098 ceph-mon[80954]: pgmap v176: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:04.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:04 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T19:12:05.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:05 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T19:12:05.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:05 smithi027 ceph-mon[110082]: Upgrade: osd.2 is safe to restart 2024-09-20T19:12:05.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:05 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T19:12:05.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:05 smithi098 ceph-mon[80954]: Upgrade: osd.2 is safe to restart 2024-09-20T19:12:06.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:06 smithi027 ceph-mon[110082]: pgmap v177: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:06.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:06.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-20T19:12:06.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:06.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:06 smithi098 ceph-mon[80954]: pgmap v177: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:06.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:06.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-20T19:12:06.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:07.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 -- 172.21.15.27:0/3204331086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4101000 msgr2=0x7fded410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 --2- 172.21.15.27:0/3204331086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4101000 0x7fded410dcc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009880 tx=0x7fdec402a490 comp rx=0 tx=0).stop 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 -- 172.21.15.27:0/3204331086 shutdown_connections 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 --2- 172.21.15.27:0/3204331086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4101000 0x7fded410dcc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 --2- 172.21.15.27:0/3204331086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4100650 0x7fded4100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 -- 172.21.15.27:0/3204331086 >> 172.21.15.27:0/3204331086 conn(0x7fded40fc520 msgr2=0x7fded40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 -- 172.21.15.27:0/3204331086 shutdown_connections 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 -- 172.21.15.27:0/3204331086 wait complete. 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.202+0000 7fdedb78e640 1 Processor -- start 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fdedb78e640 1 -- start start 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fdedb78e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fdedb78e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4101000 0x7fded419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fdedb78e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fded4110f70 con 0x7fded4100650 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fdedb78e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fded4110df0 con 0x7fded4101000 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39336/0 (socket says 172.21.15.27:39336) 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 -- 172.21.15.27:0/2936369231 learned_addr learned my addr 172.21.15.27:0/2936369231 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded8d29640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4101000 0x7fded419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 -- 172.21.15.27:0/2936369231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4101000 msgr2=0x7fded419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4101000 0x7fded419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.203+0000 7fded952a640 1 -- 172.21.15.27:0/2936369231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded41999e0 con 0x7fded4100650 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fded952a640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fded000d8d0 tx=0x7fded000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded0017070 con 0x7fded4100650 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fded0010460 con 0x7fded4100650 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded4199cd0 con 0x7fded4100650 2024-09-20T19:12:07.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded000f5f0 con 0x7fded4100650 2024-09-20T19:12:07.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.204+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded419a230 con 0x7fded4100650 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.205+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded406aa90 con 0x7fded4100650 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.206+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fded0009a30 con 0x7fded4100650 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.206+0000 7fdeca7fc640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 0x7fdec007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.207+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7fded009df40 con 0x7fded4100650 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.207+0000 7fded8d29640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 0x7fdec007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.207+0000 7fded8d29640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 0x7fdec007d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fded419b1d0 tx=0x7fdec4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.211+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fded0069430 con 0x7fded4100650 2024-09-20T19:12:07.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.421+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fded419af10 con 0x7fdec007af30 2024-09-20T19:12:07.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.422+0000 7fdeca7fc640 1 -- 172.21.15.27:0/2936369231 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fded419af10 con 0x7fdec007af30 2024-09-20T19:12:07.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 msgr2=0x7fdec007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 0x7fdec007d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fded419b1d0 tx=0x7fdec4031400 comp rx=0 tx=0).stop 2024-09-20T19:12:07.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 msgr2=0x7fded419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fded000d8d0 tx=0x7fded000dd90 comp rx=0 tx=0).stop 2024-09-20T19:12:07.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 shutdown_connections 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdec007af30 0x7fdec007d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fded4101000 0x7fded419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 --2- 172.21.15.27:0/2936369231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fded4100650 0x7fded419f820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 >> 172.21.15.27:0/2936369231 conn(0x7fded40fc520 msgr2=0x7fded40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 shutdown_connections 2024-09-20T19:12:07.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.425+0000 7fdedb78e640 1 -- 172.21.15.27:0/2936369231 wait complete. 2024-09-20T19:12:07.438 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:12:07.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 -- 172.21.15.27:0/956481873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 msgr2=0x7facc8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 --2- 172.21.15.27:0/956481873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc8102e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facb8009880 tx=0x7facb802a530 comp rx=0 tx=0).stop 2024-09-20T19:12:07.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 -- 172.21.15.27:0/956481873 shutdown_connections 2024-09-20T19:12:07.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 --2- 172.21.15.27:0/956481873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 0x7facc810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 --2- 172.21.15.27:0/956481873 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc8102e90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 -- 172.21.15.27:0/956481873 >> 172.21.15.27:0/956481873 conn(0x7facc80fc550 msgr2=0x7facc80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 -- 172.21.15.27:0/956481873 shutdown_connections 2024-09-20T19:12:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.513+0000 7facce3d8640 1 -- 172.21.15.27:0/956481873 wait complete. 2024-09-20T19:12:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.514+0000 7facce3d8640 1 Processor -- start 2024-09-20T19:12:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.514+0000 7facce3d8640 1 -- start start 2024-09-20T19:12:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facce3d8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facce3d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 0x7facc819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facce3d8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7facc810ede0 con 0x7facc8102ab0 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facce3d8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7facc810ec60 con 0x7facc81033d0 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facc7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facc7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39364/0 (socket says 172.21.15.27:39364) 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facc7fff640 1 -- 172.21.15.27:0/2193495541 learned_addr learned my addr 172.21.15.27:0/2193495541 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.515+0000 7facc77fe640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 0x7facc819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc7fff640 1 -- 172.21.15.27:0/2193495541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 msgr2=0x7facc819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc7fff640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 0x7facc819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc7fff640 1 -- 172.21.15.27:0/2193495541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc8199a20 con 0x7facc8102ab0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc7fff640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facb8031460 tx=0x7facb80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facb803f070 con 0x7facc8102ab0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc8199cb0 con 0x7facc8102ab0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facb80035f0 con 0x7facc8102ab0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.516+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facb8035030 con 0x7facc8102ab0 2024-09-20T19:12:07.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.517+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc819a1e0 con 0x7facc8102ab0 2024-09-20T19:12:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.518+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc806a580 con 0x7facc8102ab0 2024-09-20T19:12:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.518+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7facb8042070 con 0x7facc8102ab0 2024-09-20T19:12:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.519+0000 7facc57fa640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 0x7facb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.519+0000 7facc77fe640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 0x7facb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.519+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7facb80beb00 con 0x7facc8102ab0 2024-09-20T19:12:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.520+0000 7facc77fe640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 0x7facb007d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facc80feeb0 tx=0x7facbc00b2e0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.524+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facb8089f50 con 0x7facc8102ab0 2024-09-20T19:12:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.737+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7facc819af00 con 0x7facb007af30 2024-09-20T19:12:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.738+0000 7facc57fa640 1 -- 172.21.15.27:0/2193495541 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7facc819af00 con 0x7facb007af30 2024-09-20T19:12:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 msgr2=0x7facb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 0x7facb007d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facc80feeb0 tx=0x7facbc00b2e0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 msgr2=0x7facc819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facb8031460 tx=0x7facb80045e0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 shutdown_connections 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7facb007af30 0x7facb007d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facc81033d0 0x7facc819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 --2- 172.21.15.27:0/2193495541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7facc8102ab0 0x7facc819f810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 >> 172.21.15.27:0/2193495541 conn(0x7facc80fc550 msgr2=0x7facc8100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 shutdown_connections 2024-09-20T19:12:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.741+0000 7facce3d8640 1 -- 172.21.15.27:0/2193495541 wait complete. 2024-09-20T19:12:07.806 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:07 smithi027 ceph-mon[110082]: Upgrade: Updating osd.2 2024-09-20T19:12:07.806 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:07 smithi027 ceph-mon[110082]: Deploying daemon osd.2 on smithi027 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 -- 172.21.15.27:0/1088877945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa418102ab0 msgr2=0x7fa418102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 --2- 172.21.15.27:0/1088877945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa418102ab0 0x7fa418102e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009880 tx=0x7fa40c02a530 comp rx=0 tx=0).stop 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 -- 172.21.15.27:0/1088877945 shutdown_connections 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 --2- 172.21.15.27:0/1088877945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4181033d0 0x7fa41810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 --2- 172.21.15.27:0/1088877945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa418102ab0 0x7fa418102e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 -- 172.21.15.27:0/1088877945 >> 172.21.15.27:0/1088877945 conn(0x7fa4180fc550 msgr2=0x7fa4180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 -- 172.21.15.27:0/1088877945 shutdown_connections 2024-09-20T19:12:07.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.832+0000 7fa41eb74640 1 -- 172.21.15.27:0/1088877945 wait complete. 2024-09-20T19:12:07.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 Processor -- start 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 -- start start 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa418102ab0 0x7fa41819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa41810ede0 con 0x7fa4181033d0 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa41eb74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa41810ec60 con 0x7fa418102ab0 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa417fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa417fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39370/0 (socket says 172.21.15.27:39370) 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.833+0000 7fa417fff640 1 -- 172.21.15.27:0/4046538149 learned_addr learned my addr 172.21.15.27:0/4046538149 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa41c910640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa418102ab0 0x7fa41819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa417fff640 1 -- 172.21.15.27:0/4046538149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa418102ab0 msgr2=0x7fa41819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa417fff640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa418102ab0 0x7fa41819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa417fff640 1 -- 172.21.15.27:0/4046538149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4181977b0 con 0x7fa4181033d0 2024-09-20T19:12:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa417fff640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e970 tx=0x7fa40400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa40400cac0 con 0x7fa4181033d0 2024-09-20T19:12:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa418197aa0 con 0x7fa4181033d0 2024-09-20T19:12:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.834+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4040054e0 con 0x7fa4181033d0 2024-09-20T19:12:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.835+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa404004dd0 con 0x7fa4181033d0 2024-09-20T19:12:07.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.835+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa418198030 con 0x7fa4181033d0 2024-09-20T19:12:07.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.836+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41806a580 con 0x7fa4181033d0 2024-09-20T19:12:07.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.837+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa404005020 con 0x7fa4181033d0 2024-09-20T19:12:07.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.837+0000 7fa415ffb640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 0x7fa40807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:07.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.837+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7fa40409e810 con 0x7fa4181033d0 2024-09-20T19:12:07.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.837+0000 7fa41c910640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 0x7fa40807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:07.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.838+0000 7fa41c910640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 0x7fa40807d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0096c0 tx=0x7fa40c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:07.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:07.842+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa404069d00 con 0x7fa4181033d0 2024-09-20T19:12:07.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:07 smithi098 ceph-mon[80954]: Upgrade: Updating osd.2 2024-09-20T19:12:07.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:07 smithi098 ceph-mon[80954]: Deploying daemon osd.2 on smithi027 2024-09-20T19:12:08.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.040+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa418198340 con 0x7fa40807aed0 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.050+0000 7fa415ffb640 1 -- 172.21.15.27:0/4046538149 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa418198340 con 0x7fa40807aed0 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (3m) 22s ago 14m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (5m) 22s ago 14m 8606k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (5m) 85s ago 13m 8669k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (94s) 22s ago 14m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (89s) 85s ago 13m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:12:08.053 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (3m) 22s ago 14m 75.7M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (8m) 22s ago 8m 92.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (8m) 22s ago 8m 17.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (8m) 85s ago 8m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (8m) 85s ago 8m 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (5m) 22s ago 15m 525M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (4m) 85s ago 13m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (2m) 22s ago 15m 43.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (107s) 85s ago 13m 26.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (4m) 22s ago 14m 11.2M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 85s ago 13m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (66s) 22s ago 12m 122M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (28s) 22s ago 11m 11.1M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:12:08.054 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (11m) 22s ago 11m 234M 1216M 19.1.1-369-ged8ee0f2 6acb0a031eab 62dff7d2a248 2024-09-20T19:12:08.055 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (10m) 85s ago 10m 242M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:12:08.055 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (10m) 85s ago 10m 213M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:12:08.055 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (9m) 85s ago 9m 193M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:12:08.055 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (3m) 22s ago 13m 54.5M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:12:08.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 msgr2=0x7fa40807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 0x7fa40807d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0096c0 tx=0x7fa40c031400 comp rx=0 tx=0).stop 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 msgr2=0x7fa41819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e970 tx=0x7fa40400ee30 comp rx=0 tx=0).stop 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 shutdown_connections 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fa40807aed0 0x7fa40807d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4181033d0 0x7fa41819db70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 --2- 172.21.15.27:0/4046538149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa418102ab0 0x7fa41819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 >> 172.21.15.27:0/4046538149 conn(0x7fa4180fc550 msgr2=0x7fa41810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 shutdown_connections 2024-09-20T19:12:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.052+0000 7fa41eb74640 1 -- 172.21.15.27:0/4046538149 wait complete. 2024-09-20T19:12:08.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 -- 172.21.15.27:0/769563959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c10dfa0 msgr2=0x7f020c10e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 --2- 172.21.15.27:0/769563959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c10dfa0 0x7f020c10e380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0200009880 tx=0x7f020002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 -- 172.21.15.27:0/769563959 shutdown_connections 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 --2- 172.21.15.27:0/769563959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c07b980 0x7f020c07bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 --2- 172.21.15.27:0/769563959 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c10dfa0 0x7f020c10e380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 -- 172.21.15.27:0/769563959 >> 172.21.15.27:0/769563959 conn(0x7f020c0775f0 msgr2=0x7f020c079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.140+0000 7f0212f6d640 1 -- 172.21.15.27:0/769563959 shutdown_connections 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 -- 172.21.15.27:0/769563959 wait complete. 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 Processor -- start 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 -- start start 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c07b980 0x7f020c19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1153e0 con 0x7f020c07b980 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.141+0000 7f0212f6d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f020c115260 con 0x7f020c10dfa0 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.27:60962/0 (socket says 172.21.15.27:60962) 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 -- 172.21.15.27:0/932598511 learned_addr learned my addr 172.21.15.27:0/932598511 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:08.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f0210d09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c07b980 0x7f020c19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 -- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c07b980 msgr2=0x7f020c19dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c07b980 0x7f020c19dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 -- 172.21.15.27:0/932598511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c1a28b0 con 0x7f020c10dfa0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f020bfff640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d6f0 tx=0x7f01f800dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01f8017070 con 0x7f020c10dfa0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020c1a2ba0 con 0x7f020c10dfa0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.142+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01f800de00 con 0x7f020c10dfa0 2024-09-20T19:12:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.143+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01f8004bb0 con 0x7f020c10dfa0 2024-09-20T19:12:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.143+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020c1a3130 con 0x7f020c10dfa0 2024-09-20T19:12:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.144+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020c109650 con 0x7f020c10dfa0 2024-09-20T19:12:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.144+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f01f8009a30 con 0x7f020c10dfa0 2024-09-20T19:12:08.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.145+0000 7f0209ffb640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 0x7f01fc07d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.145+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7f01f809dc70 con 0x7f020c10dfa0 2024-09-20T19:12:08.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.145+0000 7f0210d09640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 0x7f01fc07d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.146+0000 7f0210d09640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 0x7f01fc07d490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02000096c0 tx=0x7f0200031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.150+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01f8069140 con 0x7f020c10dfa0 2024-09-20T19:12:08.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.416+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f020c07bda0 con 0x7f020c10dfa0 2024-09-20T19:12:08.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.417+0000 7f0209ffb640 1 -- 172.21.15.27:0/932598511 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f01f806dff0 con 0x7f020c10dfa0 2024-09-20T19:12:08.420 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:12:08.420 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:12:08.420 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 8, 2024-09-20T19:12:08.421 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 msgr2=0x7f01fc07d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 0x7f01fc07d490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02000096c0 tx=0x7f0200031400 comp rx=0 tx=0).stop 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 msgr2=0x7f020c19e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d6f0 tx=0x7f01f800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 shutdown_connections 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f01fc07afd0 0x7f01fc07d490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f020c10dfa0 0x7f020c19e520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 --2- 172.21.15.27:0/932598511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f020c07b980 0x7f020c19dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 >> 172.21.15.27:0/932598511 conn(0x7f020c0775f0 msgr2=0x7f020c078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 shutdown_connections 2024-09-20T19:12:08.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.419+0000 7f0212f6d640 1 -- 172.21.15.27:0/932598511 wait complete. 2024-09-20T19:12:08.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 -- 172.21.15.27:0/2251787324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501007f0 msgr2=0x7f6c50100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/2251787324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501007f0 0x7f6c50100c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009880 tx=0x7f6c4002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 -- 172.21.15.27:0/2251787324 shutdown_connections 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/2251787324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501007f0 0x7f6c50100c50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/2251787324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501067f0 0x7f6c50106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 -- 172.21.15.27:0/2251787324 >> 172.21.15.27:0/2251787324 conn(0x7f6c500fc550 msgr2=0x7f6c500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 -- 172.21.15.27:0/2251787324 shutdown_connections 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.504+0000 7f6c57c6b640 1 -- 172.21.15.27:0/2251787324 wait complete. 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 Processor -- start 2024-09-20T19:12:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 -- start start 2024-09-20T19:12:08.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501007f0 0x7f6c5019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5010dcc0 con 0x7f6c501067f0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c57c6b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5010db40 con 0x7f6c501007f0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39402/0 (socket says 172.21.15.27:39402) 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 -- 172.21.15.27:0/330826597 learned_addr learned my addr 172.21.15.27:0/330826597 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55a07640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501007f0 0x7f6c5019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 -- 172.21.15.27:0/330826597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501007f0 msgr2=0x7f6c5019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501007f0 0x7f6c5019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.505+0000 7f6c55206640 1 -- 172.21.15.27:0/330826597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c501977e0 con 0x7f6c501067f0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c55206640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c40031460 tx=0x7f6c40004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c4003f070 con 0x7f6c501067f0 2024-09-20T19:12:08.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c400035f0 con 0x7f6c501067f0 2024-09-20T19:12:08.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c50197a70 con 0x7f6c501067f0 2024-09-20T19:12:08.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c40035030 con 0x7f6c501067f0 2024-09-20T19:12:08.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.506+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c50197fa0 con 0x7f6c501067f0 2024-09-20T19:12:08.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.507+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c50101f30 con 0x7f6c501067f0 2024-09-20T19:12:08.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.508+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6c40042070 con 0x7f6c501067f0 2024-09-20T19:12:08.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.509+0000 7f6c46ffd640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 0x7f6c3c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.509+0000 7f6c55a07640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 0x7f6c3c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.509+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7f6c400be940 con 0x7f6c501067f0 2024-09-20T19:12:08.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.509+0000 7f6c55a07640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 0x7f6c3c07d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009bd0 tx=0x7f6c4c005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.513+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c40089eb0 con 0x7f6c501067f0 2024-09-20T19:12:08.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.739+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6c50109d70 con 0x7f6c501067f0 2024-09-20T19:12:08.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:08 smithi027 ceph-mon[110082]: pgmap v178: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:08.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:08 smithi027 ceph-mon[110082]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:08.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:08 smithi027 ceph-mon[110082]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:08.742 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:08 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/932598511' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.739+0000 7f6c46ffd640 1 -- 172.21.15.27:0/330826597 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7f6c4008ed60 con 0x7f6c501067f0 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:08.743 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:12:08.744 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:12:08.745 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:08.746 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.742+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 msgr2=0x7f6c3c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.742+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 0x7f6c3c07d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009bd0 tx=0x7f6c4c005f90 comp rx=0 tx=0).stop 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.742+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 msgr2=0x7f6c5019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.742+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c40031460 tx=0x7f6c40004530 comp rx=0 tx=0).stop 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 shutdown_connections 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6c3c07af80 0x7f6c3c07d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c501067f0 0x7f6c5019dba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 --2- 172.21.15.27:0/330826597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c501007f0 0x7f6c5019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 >> 172.21.15.27:0/330826597 conn(0x7f6c500fc550 msgr2=0x7f6c50069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 shutdown_connections 2024-09-20T19:12:08.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.743+0000 7f6c57c6b640 1 -- 172.21.15.27:0/330826597 wait complete. 2024-09-20T19:12:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3727183502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 msgr2=0x7fcba4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3727183502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba4100c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009880 tx=0x7fcb9802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3727183502 shutdown_connections 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3727183502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba4100c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3727183502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 0x7fcba4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3727183502 >> 172.21.15.27:0/3727183502 conn(0x7fcba40fc550 msgr2=0x7fcba40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3727183502 shutdown_connections 2024-09-20T19:12:08.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.835+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3727183502 wait complete. 2024-09-20T19:12:08.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 Processor -- start 2024-09-20T19:12:08.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 -- start start 2024-09-20T19:12:08.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 0x7fcba40fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcba410dd20 con 0x7fcba41007f0 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba8cf7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcba410dba0 con 0x7fcba41067f0 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39418/0 (socket says 172.21.15.27:39418) 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.836+0000 7fcba259c640 1 -- 172.21.15.27:0/3954501814 learned_addr learned my addr 172.21.15.27:0/3954501814 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba1d9b640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 0x7fcba40fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba259c640 1 -- 172.21.15.27:0/3954501814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 msgr2=0x7fcba40fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba259c640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 0x7fcba40fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba259c640 1 -- 172.21.15.27:0/3954501814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40fd770 con 0x7fcba41007f0 2024-09-20T19:12:08.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba259c640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400b420 tx=0x7fcb9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb94011630 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb94016070 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb94010d40 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba40fda60 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.837+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba41a3ed0 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.838+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba4101f30 con 0x7fcba41007f0 2024-09-20T19:12:08.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.839+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcb940117d0 con 0x7fcba41007f0 2024-09-20T19:12:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.840+0000 7fcb937fe640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 0x7fcb8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.840+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7fcb9409d900 con 0x7fcba41007f0 2024-09-20T19:12:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.840+0000 7fcba1d9b640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 0x7fcb8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:08.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.841+0000 7fcba1d9b640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 0x7fcb8c07d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcba40fe780 tx=0x7fcb98031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:08.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:08.848+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb94068df0 con 0x7fcba41007f0 2024-09-20T19:12:08.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:08 smithi098 ceph-mon[80954]: pgmap v178: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:08.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:08 smithi098 ceph-mon[80954]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:08.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:08 smithi098 ceph-mon[80954]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:08.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:08 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/932598511' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:09.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.055+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcba4062630 con 0x7fcb8c07af30 2024-09-20T19:12:09.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.056+0000 7fcb937fe640 1 -- 172.21.15.27:0/3954501814 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fcba4062630 con 0x7fcb8c07af30 2024-09-20T19:12:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:12:09.060 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "8/23 daemons upgraded", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:12:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 msgr2=0x7fcb8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 0x7fcb8c07d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcba40fe780 tx=0x7fcb98031400 comp rx=0 tx=0).stop 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 msgr2=0x7fcba40fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400b420 tx=0x7fcb9400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 shutdown_connections 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcb8c07af30 0x7fcb8c07d3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcba41067f0 0x7fcba40fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 --2- 172.21.15.27:0/3954501814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcba41007f0 0x7fcba40fccf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 >> 172.21.15.27:0/3954501814 conn(0x7fcba40fc550 msgr2=0x7fcba4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:09.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 shutdown_connections 2024-09-20T19:12:09.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.059+0000 7fcba8cf7640 1 -- 172.21.15.27:0/3954501814 wait complete. 2024-09-20T19:12:09.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.144+0000 7f0ee2878640 1 -- 172.21.15.27:0/1498501554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 msgr2=0x7f0edc102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.144+0000 7f0ee2878640 1 --2- 172.21.15.27:0/1498501554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc102f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009880 tx=0x7f0ecc02a530 comp rx=0 tx=0).stop 2024-09-20T19:12:09.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 -- 172.21.15.27:0/1498501554 shutdown_connections 2024-09-20T19:12:09.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 --2- 172.21.15.27:0/1498501554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 0x7f0edc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 --2- 172.21.15.27:0/1498501554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc102f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 -- 172.21.15.27:0/1498501554 >> 172.21.15.27:0/1498501554 conn(0x7f0edc0fc550 msgr2=0x7f0edc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 -- 172.21.15.27:0/1498501554 shutdown_connections 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 -- 172.21.15.27:0/1498501554 wait complete. 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 Processor -- start 2024-09-20T19:12:09.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.145+0000 7f0ee2878640 1 -- start start 2024-09-20T19:12:09.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ee2878640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:09.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ee2878640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 0x7f0edc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:09.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ee2878640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc10ede0 con 0x7f0edc102b70 2024-09-20T19:12:09.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ee2878640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc10ec60 con 0x7f0edc103490 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39424/0 (socket says 172.21.15.27:39424) 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 -- 172.21.15.27:0/2069905300 learned_addr learned my addr 172.21.15.27:0/2069905300 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edb7fe640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 0x7f0edc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 -- 172.21.15.27:0/2069905300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 msgr2=0x7f0edc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 0x7f0edc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 -- 172.21.15.27:0/2069905300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc1977b0 con 0x7f0edc102b70 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0edbfff640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc004f90 tx=0x7f0ecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc03f070 con 0x7f0edc102b70 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ecc004c70 con 0x7f0edc102b70 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.146+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc197a40 con 0x7f0edc102b70 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.147+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc035030 con 0x7f0edc102b70 2024-09-20T19:12:09.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.147+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc197f70 con 0x7f0edc102b70 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.148+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0edc06a4c0 con 0x7f0edc102b70 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.148+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0ecc042070 con 0x7f0edc102b70 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.149+0000 7f0ed97fa640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 0x7f0ec407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.149+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6417+0+0 (secure 0 0 0) 0x7f0ecc0beb40 con 0x7f0edc102b70 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.149+0000 7f0edb7fe640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 0x7f0ec407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:09.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.150+0000 7f0edb7fe640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 0x7f0ec407d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0005fd0 tx=0x7f0ed0005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:09.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.154+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ecc08a030 con 0x7f0edc102b70 2024-09-20T19:12:09.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.463+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0edc105fd0 con 0x7f0edc102b70 2024-09-20T19:12:09.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.463+0000 7f0ed97fa640 1 -- 172.21.15.27:0/2069905300 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f0ecc08eee0 con 0x7f0edc102b70 2024-09-20T19:12:09.467 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:09.467 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:09.467 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:12:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.465+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 msgr2=0x7f0ec407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.465+0000 7f0ee2878640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 0x7f0ec407d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0005fd0 tx=0x7f0ed0005850 comp rx=0 tx=0).stop 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.465+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 msgr2=0x7f0edc19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.465+0000 7f0ee2878640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc004f90 tx=0x7f0ecc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 shutdown_connections 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0ec407af30 0x7f0ec407d3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0edc103490 0x7f0edc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 --2- 172.21.15.27:0/2069905300 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0edc102b70 0x7f0edc19d630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 >> 172.21.15.27:0/2069905300 conn(0x7f0edc0fc550 msgr2=0x7f0edc108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 shutdown_connections 2024-09-20T19:12:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:09.466+0000 7f0ee2878640 1 -- 172.21.15.27:0/2069905300 wait complete. 2024-09-20T19:12:09.654 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:09 smithi027 systemd[1]: Stopping Ceph osd.2 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:12:09.655 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-mon[110082]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:09.655 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/330826597' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:09.655 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2069905300' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:09.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:09 smithi098 ceph-mon[80954]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:09.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:09 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/330826597' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:09.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:09 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2069905300' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:09.991 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:12:09.651+0000 7f991c987640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:12:09.991 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:12:09.651+0000 7f991c987640 -1 osd.2 69 *** Got signal Terminated *** 2024-09-20T19:12:09.992 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:09 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[64574]: 2024-09-20T19:12:09.651+0000 7f991c987640 -1 osd.2 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:12:10.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:10 smithi098 ceph-mon[80954]: pgmap v179: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:10.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:10 smithi098 ceph-mon[80954]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:10.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:10 smithi098 ceph-mon[80954]: osd.2 marked itself down and dead 2024-09-20T19:12:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:10 smithi027 ceph-mon[110082]: pgmap v179: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:10 smithi027 ceph-mon[110082]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:10 smithi027 ceph-mon[110082]: osd.2 marked itself down and dead 2024-09-20T19:12:11.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:11 smithi027 podman[129277]: 2024-09-20 19:12:11.065735729 +0000 UTC m=+1.515372927 container died 62dff7d2a248226ad661b13e247650a7bb665580121d4613539bc7da5c3d6caa (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ed8ee0f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-20T19:12:11.721 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:11 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:12:11.721 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:11 smithi027 ceph-mon[110082]: osdmap e70: 6 total, 5 up, 6 in 2024-09-20T19:12:11.722 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:11 smithi027 podman[129277]: 2024-09-20 19:12:11.443517266 +0000 UTC m=+1.893154455 container cleanup 62dff7d2a248226ad661b13e247650a7bb665580121d4613539bc7da5c3d6caa (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:12:11.722 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:11 smithi027 bash[129277]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2 2024-09-20T19:12:11.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:11 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:12:11.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:11 smithi098 ceph-mon[80954]: osdmap e70: 6 total, 5 up, 6 in 2024-09-20T19:12:12.066 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:11 smithi027 podman[129291]: 2024-09-20 19:12:11.719782366 +0000 UTC m=+0.655327459 container remove 62dff7d2a248226ad661b13e247650a7bb665580121d4613539bc7da5c3d6caa (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-20T19:12:12.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:11.968027861 +0000 UTC m=+0.016524352 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:12.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:12.095761751 +0000 UTC m=+0.144258276 container create 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-20T19:12:12.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:12.306836183 +0000 UTC m=+0.355332675 container init 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-20T19:12:12.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:12.310366493 +0000 UTC m=+0.358862981 container start 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=) 2024-09-20T19:12:12.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:12 smithi027 ceph-mon[110082]: pgmap v181: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:12.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:12 smithi027 ceph-mon[110082]: osdmap e71: 6 total, 5 up, 6 in 2024-09-20T19:12:12.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:12.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:12.819 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:12.406800329 +0000 UTC m=+0.455296833 container attach 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T19:12:12.819 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:12 smithi027 podman[129383]: 2024-09-20 19:12:12.508561304 +0000 UTC m=+0.557057786 container died 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-20T19:12:12.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:12 smithi098 ceph-mon[80954]: pgmap v181: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:12.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:12 smithi098 ceph-mon[80954]: osdmap e71: 6 total, 5 up, 6 in 2024-09-20T19:12:12.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:12.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:13.568 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 podman[129407]: 2024-09-20 19:12:13.177800066 +0000 UTC m=+0.663239560 container remove 3fa2d856ac7dd6fd0464b71bf4777884457717247a316c1b640d5f2487a0204d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:12:13.568 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-20T19:12:13.568 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 systemd[1]: Stopped Ceph osd.2 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:12:13.568 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.2.service: Consumed 53.657s CPU time. 2024-09-20T19:12:13.568 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 systemd[1]: Starting Ceph osd.2 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:12:13.909 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:13 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 29/282 objects degraded (10.284%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:13.909 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 podman[129505]: 2024-09-20 19:12:13.540137212 +0000 UTC m=+0.016641002 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:13.909 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 podman[129505]: 2024-09-20 19:12:13.671091444 +0000 UTC m=+0.147595220 container create eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-20T19:12:13.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:13 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 29/282 objects degraded (10.284%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:14.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 podman[129505]: 2024-09-20 19:12:13.907259544 +0000 UTC m=+0.383763333 container init eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:12:14.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:13 smithi027 podman[129505]: 2024-09-20 19:12:13.911678703 +0000 UTC m=+0.388182490 container start eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-20T19:12:14.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:14 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:14.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:14 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:14.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:14 smithi027 bash[129505]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:14.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:14 smithi027 bash[129505]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:14.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:14 smithi027 podman[129505]: 2024-09-20 19:12:14.074619439 +0000 UTC m=+0.551123233 container attach eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-20T19:12:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:14 smithi098 ceph-mon[80954]: pgmap v183: 65 pgs: 11 active+undersized, 5 stale+active+clean, 9 active+undersized+degraded, 40 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/282 objects degraded (10.284%) 2024-09-20T19:12:15.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:14 smithi027 ceph-mon[110082]: pgmap v183: 65 pgs: 11 active+undersized, 5 stale+active+clean, 9 active+undersized+degraded, 40 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/282 objects degraded (10.284%) 2024-09-20T19:12:16.969 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:16 smithi027 ceph-mon[110082]: pgmap v184: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:16 smithi098 ceph-mon[80954]: pgmap v184: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 bash[129505]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 bash[129505]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:16 smithi027 bash[129505]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:17.318 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T19:12:17.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T19:12:17.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-20T19:12:17.319 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate[129520]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 bash[129505]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-20T19:12:17.655 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:17 smithi027 podman[129505]: 2024-09-20 19:12:17.36697561 +0000 UTC m=+3.843479388 container died eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:12:18.425 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 podman[129732]: 2024-09-20 19:12:18.075674722 +0000 UTC m=+0.698913136 container remove eaec9cb1bc044dec126d241cb91e02603634738e8f0053f16cbcf5fb0b50f6ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-activate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-20T19:12:18.425 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 podman[129792]: 2024-09-20 19:12:18.196936354 +0000 UTC m=+0.017573938 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:18.425 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 podman[129792]: 2024-09-20 19:12:18.296548938 +0000 UTC m=+0.117186512 container create c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:12:18.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:18 smithi027 ceph-mon[110082]: pgmap v185: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:18.818 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 podman[129792]: 2024-09-20 19:12:18.532838656 +0000 UTC m=+0.353476239 container init c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-20T19:12:18.818 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 podman[129792]: 2024-09-20 19:12:18.536676419 +0000 UTC m=+0.357313996 container start c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:12:18.818 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 ceph-osd[129812]: -- 172.21.15.27:0/1616127531 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615373841e0 con 0x5615366e6000 2024-09-20T19:12:18.818 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 bash[129792]: c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 2024-09-20T19:12:18.818 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:18 smithi027 systemd[1]: Started Ceph osd.2 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:12:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:18 smithi098 ceph-mon[80954]: pgmap v185: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:19 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:19 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:19 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:19.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:19 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 40/282 objects degraded (14.184%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:20.058 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:19 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:20.058 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:19 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:20.058 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:19 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:20.058 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:19 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 40/282 objects degraded (14.184%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:20.701 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:20 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:12:20.411+0000 7fb274334640 -1 Falling back to public interface 2024-09-20T19:12:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:20 smithi098 ceph-mon[80954]: pgmap v186: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:21.044 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:20 smithi027 ceph-mon[110082]: pgmap v186: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:22.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:22 smithi098 ceph-mon[80954]: pgmap v187: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:22.988 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:22 smithi027 ceph-mon[110082]: pgmap v187: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:25.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:24 smithi027 ceph-mon[110082]: pgmap v188: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:25.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:24 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:24 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:24 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.027 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:24 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:24 smithi098 ceph-mon[80954]: pgmap v188: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/282 objects degraded (14.184%) 2024-09-20T19:12:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:24 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:24 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:24 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:25.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:24 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:26.060 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:25 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:12:25.979+0000 7fb274334640 -1 osd.2 69 log_to_monitors true 2024-09-20T19:12:27.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:26 smithi027 ceph-mon[110082]: pgmap v189: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 40/282 objects degraded (14.184%) 2024-09-20T19:12:27.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:26 smithi027 ceph-mon[110082]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-20T19:12:27.068 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:12:26 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:12:26.763+0000 7fb26c0de640 -1 osd.2 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:12:27.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:26 smithi098 ceph-mon[80954]: pgmap v189: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 40/282 objects degraded (14.184%) 2024-09-20T19:12:27.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:26 smithi098 ceph-mon[80954]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-20T19:12:27.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: osdmap e72: 6 total, 5 up, 6 in 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:12:27.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: osdmap e72: 6 total, 5 up, 6 in 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi027", "root=default"]} : dispatch 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:12:28.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: pgmap v191: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/282 objects degraded (14.184%) 2024-09-20T19:12:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:12:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538] boot 2024-09-20T19:12:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: osdmap e73: 6 total, 6 up, 6 in 2024-09-20T19:12:29.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T19:12:29.069 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:28 smithi027 ceph-mon[110082]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-20T19:12:29.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: pgmap v191: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/282 objects degraded (14.184%) 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: osd.2 [v2:172.21.15.27:6818/935097538,v1:172.21.15.27:6819/935097538] boot 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: osdmap e73: 6 total, 6 up, 6 in 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T19:12:29.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:28 smithi098 ceph-mon[80954]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-20T19:12:30.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:29 smithi027 ceph-mon[110082]: osdmap e74: 6 total, 6 up, 6 in 2024-09-20T19:12:30.123 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:29 smithi098 ceph-mon[80954]: osdmap e74: 6 total, 6 up, 6 in 2024-09-20T19:12:31.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:30 smithi027 ceph-mon[110082]: pgmap v194: 65 pgs: 10 peering, 12 active+undersized, 9 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/282 objects degraded (10.993%) 2024-09-20T19:12:31.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:30 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 31/282 objects degraded (10.993%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:31.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:30 smithi098 ceph-mon[80954]: pgmap v194: 65 pgs: 10 peering, 12 active+undersized, 9 active+undersized+degraded, 34 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/282 objects degraded (10.993%) 2024-09-20T19:12:31.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:30 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 31/282 objects degraded (10.993%), 9 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:33.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:32 smithi027 ceph-mon[110082]: pgmap v195: 65 pgs: 10 peering, 8 active+undersized, 7 active+undersized+degraded, 40 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/282 objects degraded (9.220%) 2024-09-20T19:12:33.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:32 smithi098 ceph-mon[80954]: pgmap v195: 65 pgs: 10 peering, 8 active+undersized, 7 active+undersized+degraded, 40 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/282 objects degraded (9.220%) 2024-09-20T19:12:34.197 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:33 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/282 objects degraded (9.220%), 7 pgs degraded) 2024-09-20T19:12:34.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:33 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/282 objects degraded (9.220%), 7 pgs degraded) 2024-09-20T19:12:35.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:34 smithi098 ceph-mon[80954]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T19:12:35.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:34 smithi027 ceph-mon[110082]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T19:12:37.120 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:36 smithi027 ceph-mon[110082]: pgmap v197: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:36 smithi098 ceph-mon[80954]: pgmap v197: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:39.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:38 smithi098 ceph-mon[80954]: pgmap v198: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T19:12:39.283 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:38 smithi027 ceph-mon[110082]: pgmap v198: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T19:12:39.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 -- 172.21.15.27:0/227723890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 msgr2=0x7f6b90107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 --2- 172.21.15.27:0/227723890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b90107ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009880 tx=0x7f6b8002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 -- 172.21.15.27:0/227723890 shutdown_connections 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 --2- 172.21.15.27:0/227723890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 0x7f6b90101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 --2- 172.21.15.27:0/227723890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b90107ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 -- 172.21.15.27:0/227723890 >> 172.21.15.27:0/227723890 conn(0x7f6b900fd600 msgr2=0x7f6b900ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 -- 172.21.15.27:0/227723890 shutdown_connections 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.556+0000 7f6b95380640 1 -- 172.21.15.27:0/227723890 wait complete. 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.557+0000 7f6b95380640 1 Processor -- start 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.557+0000 7f6b95380640 1 -- start start 2024-09-20T19:12:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b95380640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 0x7f6b9019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b95380640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b95380640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9010edd0 con 0x7f6b90107900 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b95380640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9010ec50 con 0x7f6b90101900 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41780/0 (socket says 172.21.15.27:41780) 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 -- 172.21.15.27:0/1115297746 learned_addr learned my addr 172.21.15.27:0/1115297746 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8effd640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 0x7f6b9019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 -- 172.21.15.27:0/1115297746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 msgr2=0x7f6b9019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 0x7f6b9019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 -- 172.21.15.27:0/1115297746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901977c0 con 0x7f6b90107900 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b8e7fc640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400d6f0 tx=0x7f6b8400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b84017070 con 0x7f6b90107900 2024-09-20T19:12:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.558+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b90197ab0 con 0x7f6b90107900 2024-09-20T19:12:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.559+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b90198040 con 0x7f6b90107900 2024-09-20T19:12:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.559+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b8400de00 con 0x7f6b90107900 2024-09-20T19:12:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.559+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b84004bb0 con 0x7f6b90107900 2024-09-20T19:12:39.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.560+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b90103040 con 0x7f6b90107900 2024-09-20T19:12:39.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.560+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6b84009a30 con 0x7f6b90107900 2024-09-20T19:12:39.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.561+0000 7f6b77fff640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 0x7f6b7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.561+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f6b8409dbd0 con 0x7f6b90107900 2024-09-20T19:12:39.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.561+0000 7f6b8effd640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 0x7f6b7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.561+0000 7f6b8effd640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 0x7f6b7807d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b800096c0 tx=0x7f6b80031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:39.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.565+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b84069140 con 0x7f6b90107900 2024-09-20T19:12:39.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.771+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b901982f0 con 0x7f6b7807af80 2024-09-20T19:12:39.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.772+0000 7f6b77fff640 1 -- 172.21.15.27:0/1115297746 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6b901982f0 con 0x7f6b7807af80 2024-09-20T19:12:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 msgr2=0x7f6b7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 0x7f6b7807d440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b800096c0 tx=0x7f6b80031400 comp rx=0 tx=0).stop 2024-09-20T19:12:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 msgr2=0x7f6b9019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400d6f0 tx=0x7f6b8400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 shutdown_connections 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6b7807af80 0x7f6b7807d440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b90107900 0x7f6b9019db80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 --2- 172.21.15.27:0/1115297746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90101900 0x7f6b9019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 >> 172.21.15.27:0/1115297746 conn(0x7f6b900fd600 msgr2=0x7f6b900fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 shutdown_connections 2024-09-20T19:12:39.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.774+0000 7f6b95380640 1 -- 172.21.15.27:0/1115297746 wait complete. 2024-09-20T19:12:39.785 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 -- 172.21.15.27:0/3738843078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c107900 msgr2=0x7f1b1c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/3738843078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c107900 0x7f1b1c107ce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009880 tx=0x7f1b1002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 -- 172.21.15.27:0/3738843078 shutdown_connections 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/3738843078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c101900 0x7f1b1c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/3738843078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c107900 0x7f1b1c107ce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 -- 172.21.15.27:0/3738843078 >> 172.21.15.27:0/3738843078 conn(0x7f1b1c0fd600 msgr2=0x7f1b1c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 -- 172.21.15.27:0/3738843078 shutdown_connections 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.861+0000 7f1b22ed4640 1 -- 172.21.15.27:0/3738843078 wait complete. 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 Processor -- start 2024-09-20T19:12:39.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 -- start start 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c107900 0x7f1b1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c10edb0 con 0x7f1b1c101900 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b22ed4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c10ec30 con 0x7f1b1c107900 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b20c70640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b20c70640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41786/0 (socket says 172.21.15.27:41786) 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.862+0000 7f1b20c70640 1 -- 172.21.15.27:0/2694619353 learned_addr learned my addr 172.21.15.27:0/2694619353 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b1bfff640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c107900 0x7f1b1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b20c70640 1 -- 172.21.15.27:0/2694619353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c107900 msgr2=0x7f1b1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b20c70640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c107900 0x7f1b1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b20c70640 1 -- 172.21.15.27:0/2694619353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c074f70 con 0x7f1b1c101900 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b20c70640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b10031460 tx=0x7f1b100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b1003f070 con 0x7f1b1c101900 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b100035f0 con 0x7f1b1c101900 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c075200 con 0x7f1b1c101900 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b10035030 con 0x7f1b1c101900 2024-09-20T19:12:39.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.863+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c1a3da0 con 0x7f1b1c101900 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.865+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c103040 con 0x7f1b1c101900 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.865+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1b10042070 con 0x7f1b1c101900 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.866+0000 7f1b19ffb640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 0x7f1b0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.866+0000 7f1b1bfff640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 0x7f1b0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.866+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f1b100bea80 con 0x7f1b1c101900 2024-09-20T19:12:39.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.866+0000 7f1b1bfff640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 0x7f1b0c07d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c075f80 tx=0x7f1b0800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:39.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:39.870+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b10089f70 con 0x7f1b1c101900 2024-09-20T19:12:40.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.075+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b1c062630 con 0x7f1b0c07af30 2024-09-20T19:12:40.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.076+0000 7f1b19ffb640 1 -- 172.21.15.27:0/2694619353 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1b1c062630 con 0x7f1b0c07af30 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 msgr2=0x7f1b0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 0x7f1b0c07d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c075f80 tx=0x7f1b0800b390 comp rx=0 tx=0).stop 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 msgr2=0x7f1b1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b10031460 tx=0x7f1b100045e0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 shutdown_connections 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1b0c07af30 0x7f1b0c07d3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b1c107900 0x7f1b1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 --2- 172.21.15.27:0/2694619353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1b1c101900 0x7f1b1c0744f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 >> 172.21.15.27:0/2694619353 conn(0x7f1b1c0fd600 msgr2=0x7f1b1c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 shutdown_connections 2024-09-20T19:12:40.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.079+0000 7f1b22ed4640 1 -- 172.21.15.27:0/2694619353 wait complete. 2024-09-20T19:12:40.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 -- 172.21.15.27:0/1036871217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258100800 msgr2=0x7f4258100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1036871217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258100800 0x7f4258100c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4240009880 tx=0x7f424002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 -- 172.21.15.27:0/1036871217 shutdown_connections 2024-09-20T19:12:40.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1036871217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258100800 0x7f4258100c60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1036871217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258106800 0x7f4258106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 -- 172.21.15.27:0/1036871217 >> 172.21.15.27:0/1036871217 conn(0x7f42580fc520 msgr2=0x7f42580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 -- 172.21.15.27:0/1036871217 shutdown_connections 2024-09-20T19:12:40.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.164+0000 7f425d5b8640 1 -- 172.21.15.27:0/1036871217 wait complete. 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 Processor -- start 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 -- start start 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258100800 0x7f4258198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f425810dcd0 con 0x7f4258106800 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f425d5b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f425810db50 con 0x7f4258100800 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f424ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f424ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41800/0 (socket says 172.21.15.27:41800) 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.165+0000 7f424ffff640 1 -- 172.21.15.27:0/1469700605 learned_addr learned my addr 172.21.15.27:0/1469700605 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f4256ffd640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258100800 0x7f4258198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f424ffff640 1 -- 172.21.15.27:0/1469700605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258100800 msgr2=0x7f4258198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f424ffff640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258100800 0x7f4258198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f424ffff640 1 -- 172.21.15.27:0/1469700605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258199360 con 0x7f4258106800 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f424ffff640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4240031460 tx=0x7f42400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f424003f070 con 0x7f4258106800 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4240004cf0 con 0x7f4258106800 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42581995f0 con 0x7f4258106800 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4240035030 con 0x7f4258106800 2024-09-20T19:12:40.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.166+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42581a1ba0 con 0x7f4258106800 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.168+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4258101f40 con 0x7f4258106800 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.168+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4240042070 con 0x7f4258106800 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.169+0000 7f4254ff9640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 0x7f424407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.169+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f42400bea40 con 0x7f4258106800 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.169+0000 7f4256ffd640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 0x7f424407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.169+0000 7f4256ffd640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 0x7f424407d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42480058c0 tx=0x7f424800a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.173+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4240089fb0 con 0x7f4258106800 2024-09-20T19:12:40.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.370+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4258062630 con 0x7f424407af80 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.380+0000 7f4254ff9640 1 -- 172.21.15.27:0/1469700605 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4258062630 con 0x7f424407af80 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (3m) 16s ago 14m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (6m) 16s ago 15m 8660k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (6m) 118s ago 14m 8669k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (2m) 16s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (2m) 118s ago 14m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (3m) 16s ago 14m 74.8M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:12:40.382 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (9m) 16s ago 9m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (9m) 16s ago 9m 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (9m) 118s ago 9m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (9m) 118s ago 9m 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (5m) 16s ago 16m 526M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (5m) 118s ago 14m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (2m) 16s ago 16m 44.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (2m) 118s ago 13m 26.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (4m) 16s ago 14m 11.0M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 118s ago 14m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:12:40.383 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (99s) 16s ago 12m 123M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (60s) 16s ago 12m 82.5M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (22s) 16s ago 11m 12.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (11m) 118s ago 11m 242M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab cd06a9eb7e9a 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (10m) 118s ago 10m 213M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (10m) 118s ago 10m 193M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:12:40.384 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (4m) 16s ago 14m 56.6M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 msgr2=0x7f424407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 0x7f424407d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42480058c0 tx=0x7f424800a250 comp rx=0 tx=0).stop 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 msgr2=0x7f4258198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4240031460 tx=0x7f42400048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 shutdown_connections 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f424407af80 0x7f424407d440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4258106800 0x7f4258198d60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 --2- 172.21.15.27:0/1469700605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4258100800 0x7f4258198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 >> 172.21.15.27:0/1469700605 conn(0x7f42580fc520 msgr2=0x7f42580fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 shutdown_connections 2024-09-20T19:12:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.382+0000 7f425d5b8640 1 -- 172.21.15.27:0/1469700605 wait complete. 2024-09-20T19:12:40.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 -- 172.21.15.27:0/540374582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 msgr2=0x7f89b8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 --2- 172.21.15.27:0/540374582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b8102ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009880 tx=0x7f89a802a530 comp rx=0 tx=0).stop 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 -- 172.21.15.27:0/540374582 shutdown_connections 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 --2- 172.21.15.27:0/540374582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 --2- 172.21.15.27:0/540374582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b8102ea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 -- 172.21.15.27:0/540374582 >> 172.21.15.27:0/540374582 conn(0x7f89b80fc520 msgr2=0x7f89b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 -- 172.21.15.27:0/540374582 shutdown_connections 2024-09-20T19:12:40.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.465+0000 7f89bc87e640 1 -- 172.21.15.27:0/540374582 wait complete. 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 Processor -- start 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 -- start start 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f89b810edf0 con 0x7f89b8102ac0 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.466+0000 7f89bc87e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89b810ec70 con 0x7f89b81033e0 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41820/0 (socket says 172.21.15.27:41820) 2024-09-20T19:12:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 -- 172.21.15.27:0/3060143951 learned_addr learned my addr 172.21.15.27:0/3060143951 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89affff640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 -- 172.21.15.27:0/3060143951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 msgr2=0x7f89b819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 -- 172.21.15.27:0/3060143951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b8197800 con 0x7f89b8102ac0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89affff640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89b659c640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89a8031460 tx=0x7f89a8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89a803f070 con 0x7f89b8102ac0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b8197a90 con 0x7f89b8102ac0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89a80035f0 con 0x7f89b8102ac0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89a8035030 con 0x7f89b8102ac0 2024-09-20T19:12:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.467+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b8197fc0 con 0x7f89b8102ac0 2024-09-20T19:12:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.469+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b806aa90 con 0x7f89b8102ac0 2024-09-20T19:12:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.469+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f89a8042070 con 0x7f89b8102ac0 2024-09-20T19:12:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.470+0000 7f89af7fe640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 0x7f89a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.470+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f89a80be9f0 con 0x7f89b8102ac0 2024-09-20T19:12:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.470+0000 7f89affff640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 0x7f89a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.471+0000 7f89affff640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 0x7f89a407d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89b80fe470 tx=0x7f89a0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.474+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89a8089f60 con 0x7f89b8102ac0 2024-09-20T19:12:40.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.743+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f89b8105f90 con 0x7f89b8102ac0 2024-09-20T19:12:40.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.743+0000 7f89af7fe640 1 -- 172.21.15.27:0/3060143951 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f89a808ee10 con 0x7f89b8102ac0 2024-09-20T19:12:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:12:40.746 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 7, 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 7 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:12:40.747 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:12:40.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 msgr2=0x7f89a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 0x7f89a407d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89b80fe470 tx=0x7f89a0005f90 comp rx=0 tx=0).stop 2024-09-20T19:12:40.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 msgr2=0x7f89b819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89a8031460 tx=0x7f89a8004530 comp rx=0 tx=0).stop 2024-09-20T19:12:40.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 shutdown_connections 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89a407af80 0x7f89a407d440 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89b81033e0 0x7f89b819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 --2- 172.21.15.27:0/3060143951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8102ac0 0x7f89b819d680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 >> 172.21.15.27:0/3060143951 conn(0x7f89b80fc520 msgr2=0x7f89b8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 shutdown_connections 2024-09-20T19:12:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.746+0000 7f89bc87e640 1 -- 172.21.15.27:0/3060143951 wait complete. 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 -- 172.21.15.27:0/1345116209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c101900 msgr2=0x7f240c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 --2- 172.21.15.27:0/1345116209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c101900 0x7f240c101d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2400009880 tx=0x7f240002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 -- 172.21.15.27:0/1345116209 shutdown_connections 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 --2- 172.21.15.27:0/1345116209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c101900 0x7f240c101d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 --2- 172.21.15.27:0/1345116209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c107900 0x7f240c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 -- 172.21.15.27:0/1345116209 >> 172.21.15.27:0/1345116209 conn(0x7f240c0fd600 msgr2=0x7f240c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:40.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 -- 172.21.15.27:0/1345116209 shutdown_connections 2024-09-20T19:12:40.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.831+0000 7f241237c640 1 -- 172.21.15.27:0/1345116209 wait complete. 2024-09-20T19:12:40.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 Processor -- start 2024-09-20T19:12:40.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 -- start start 2024-09-20T19:12:40.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c101900 0x7f240c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10edb0 con 0x7f240c107900 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f241237c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10ec30 con 0x7f240c101900 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f240b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f240b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41838/0 (socket says 172.21.15.27:41838) 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.832+0000 7f240b7fe640 1 -- 172.21.15.27:0/2629358991 learned_addr learned my addr 172.21.15.27:0/2629358991 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f240bfff640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c101900 0x7f240c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f240b7fe640 1 -- 172.21.15.27:0/2629358991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c101900 msgr2=0x7f240c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f240b7fe640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c101900 0x7f240c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f240b7fe640 1 -- 172.21.15.27:0/2629358991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c197800 con 0x7f240c107900 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f240b7fe640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2400031460 tx=0x7f24000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f240003f070 con 0x7f240c107900 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2400004cf0 con 0x7f240c107900 2024-09-20T19:12:40.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2400035030 con 0x7f240c107900 2024-09-20T19:12:40.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c197a90 con 0x7f240c107900 2024-09-20T19:12:40.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.833+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c197fc0 con 0x7f240c107900 2024-09-20T19:12:40.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.834+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c103040 con 0x7f240c107900 2024-09-20T19:12:40.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.835+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2400042070 con 0x7f240c107900 2024-09-20T19:12:40.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.836+0000 7f24097fa640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 0x7f23f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:40.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.836+0000 7f240bfff640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 0x7f23f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:40.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.836+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f24000bea40 con 0x7f240c107900 2024-09-20T19:12:40.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.836+0000 7f240bfff640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 0x7f23f407d440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0058c0 tx=0x7f23fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:40.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:40.842+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2400089fb0 con 0x7f240c107900 2024-09-20T19:12:41.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:40 smithi027 ceph-mon[110082]: pgmap v199: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1004 B/s rd, 1 op/s 2024-09-20T19:12:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:40 smithi027 ceph-mon[110082]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:40 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3060143951' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:41.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.074+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f240c109e90 con 0x7f240c107900 2024-09-20T19:12:41.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.074+0000 7f24097fa640 1 -- 172.21.15.27:0/2629358991 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7f240008ee60 con 0x7f240c107900 2024-09-20T19:12:41.076 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:12:41.076 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:12:41.076 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:12:41.077 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:12:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:41.079 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 msgr2=0x7f23f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 0x7f23f407d440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0058c0 tx=0x7f23fc00a2d0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 msgr2=0x7f240c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2400031460 tx=0x7f24000048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 shutdown_connections 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f23f407af80 0x7f23f407d440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f240c107900 0x7f240c19dbc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 --2- 172.21.15.27:0/2629358991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c101900 0x7f240c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 >> 172.21.15.27:0/2629358991 conn(0x7f240c0fd600 msgr2=0x7f240c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 shutdown_connections 2024-09-20T19:12:41.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.077+0000 7f241237c640 1 -- 172.21.15.27:0/2629358991 wait complete. 2024-09-20T19:12:41.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 -- 172.21.15.27:0/1728929960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c106800 msgr2=0x7f845c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1728929960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c106800 0x7f845c106be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f844c009880 tx=0x7f844c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 -- 172.21.15.27:0/1728929960 shutdown_connections 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1728929960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c100800 0x7f845c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1728929960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c106800 0x7f845c106be0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 -- 172.21.15.27:0/1728929960 >> 172.21.15.27:0/1728929960 conn(0x7f845c0fc520 msgr2=0x7f845c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 -- 172.21.15.27:0/1728929960 shutdown_connections 2024-09-20T19:12:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.162+0000 7f8460c6a640 1 -- 172.21.15.27:0/1728929960 wait complete. 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.163+0000 7f8460c6a640 1 Processor -- start 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.163+0000 7f8460c6a640 1 -- start start 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.163+0000 7f8460c6a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8460c6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 0x7f845c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8460c6a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f845c10dcb0 con 0x7f845c100800 2024-09-20T19:12:41.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8460c6a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f845c10db30 con 0x7f845c106800 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41856/0 (socket says 172.21.15.27:41856) 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 -- 172.21.15.27:0/1980823223 learned_addr learned my addr 172.21.15.27:0/1980823223 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8453fff640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 0x7f845c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 -- 172.21.15.27:0/1980823223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 msgr2=0x7f845c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 0x7f845c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 -- 172.21.15.27:0/1980823223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c197740 con 0x7f845c100800 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8453fff640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 0x7f845c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f845a59c640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f844c031460 tx=0x7f844c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f844c03f070 con 0x7f845c100800 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c1979d0 con 0x7f845c100800 2024-09-20T19:12:41.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f844c004cf0 con 0x7f845c100800 2024-09-20T19:12:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f844c035030 con 0x7f845c100800 2024-09-20T19:12:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.164+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c197f00 con 0x7f845c100800 2024-09-20T19:12:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.165+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845c101f40 con 0x7f845c100800 2024-09-20T19:12:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.166+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f844c042070 con 0x7f845c100800 2024-09-20T19:12:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.167+0000 7f84537fe640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 0x7f844807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.167+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7f844c0bebd0 con 0x7f845c100800 2024-09-20T19:12:41.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.167+0000 7f8453fff640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 0x7f844807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.167+0000 7f8453fff640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 0x7f844807d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f845c198f90 tx=0x7f8444005d90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:41.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.171+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f844c08a0c0 con 0x7f845c100800 2024-09-20T19:12:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:40 smithi098 ceph-mon[80954]: pgmap v199: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1004 B/s rd, 1 op/s 2024-09-20T19:12:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:40 smithi098 ceph-mon[80954]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:40 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3060143951' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:41.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.378+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f845c198270 con 0x7f844807af30 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.379+0000 7f84537fe640 1 -- 172.21.15.27:0/1980823223 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f845c198270 con 0x7f844807af30 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:12:41.381 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:12:41.382 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "9/23 daemons upgraded", 2024-09-20T19:12:41.382 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:12:41.382 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:12:41.382 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:12:41.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 msgr2=0x7f844807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 0x7f844807d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f845c198f90 tx=0x7f8444005d90 comp rx=0 tx=0).stop 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 msgr2=0x7f845c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f844c031460 tx=0x7f844c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 shutdown_connections 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f844807af30 0x7f844807d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f845c106800 0x7f845c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 --2- 172.21.15.27:0/1980823223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f845c100800 0x7f845c19d670 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.381+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 >> 172.21.15.27:0/1980823223 conn(0x7f845c0fc520 msgr2=0x7f845c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.382+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 shutdown_connections 2024-09-20T19:12:41.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.382+0000 7f8460c6a640 1 -- 172.21.15.27:0/1980823223 wait complete. 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.465+0000 7fcbe7f16640 1 -- 172.21.15.27:0/2767481394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0106800 msgr2=0x7fcbe0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.465+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/2767481394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0106800 0x7fcbe0106be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009880 tx=0x7fcbdc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 -- 172.21.15.27:0/2767481394 shutdown_connections 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/2767481394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0100800 0x7fcbe0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/2767481394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0106800 0x7fcbe0106be0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 -- 172.21.15.27:0/2767481394 >> 172.21.15.27:0/2767481394 conn(0x7fcbe00fc520 msgr2=0x7fcbe00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:41.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 -- 172.21.15.27:0/2767481394 shutdown_connections 2024-09-20T19:12:41.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 -- 172.21.15.27:0/2767481394 wait complete. 2024-09-20T19:12:41.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 Processor -- start 2024-09-20T19:12:41.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.466+0000 7fcbe7f16640 1 -- start start 2024-09-20T19:12:41.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe7f16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe7f16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 0x7fcbe0107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe7f16640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe010dcb0 con 0x7fcbe0100800 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe7f16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe010db30 con 0x7fcbe0106800 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41876/0 (socket says 172.21.15.27:41876) 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 -- 172.21.15.27:0/3969618720 learned_addr learned my addr 172.21.15.27:0/3969618720 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe54b1640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 0x7fcbe0107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 -- 172.21.15.27:0/3969618720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 msgr2=0x7fcbe0107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 0x7fcbe0107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 -- 172.21.15.27:0/3969618720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe01081b0 con 0x7fcbe0100800 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe54b1640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 0x7fcbe0107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbe5cb2640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc031460 tx=0x7fcbdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.467+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbdc03f070 con 0x7fcbe0100800 2024-09-20T19:12:41.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.468+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbdc004cf0 con 0x7fcbe0100800 2024-09-20T19:12:41.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.468+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe0108440 con 0x7fcbe0100800 2024-09-20T19:12:41.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.468+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbdc035030 con 0x7fcbe0100800 2024-09-20T19:12:41.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.468+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01a3d80 con 0x7fcbe0100800 2024-09-20T19:12:41.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.469+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe0101f40 con 0x7fcbe0100800 2024-09-20T19:12:41.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.469+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcbdc042070 con 0x7fcbe0100800 2024-09-20T19:12:41.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.470+0000 7fcbd6ffd640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 0x7fcbcc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:41.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.470+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6417+0+0 (secure 0 0 0) 0x7fcbdc0beaf0 con 0x7fcbe0100800 2024-09-20T19:12:41.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.470+0000 7fcbe54b1640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 0x7fcbcc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:41.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.470+0000 7fcbe54b1640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 0x7fcbcc07d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbe01091c0 tx=0x7fcbd0005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:41.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.474+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbdc08a060 con 0x7fcbe0100800 2024-09-20T19:12:41.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.733+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcbe01a4030 con 0x7fcbe0100800 2024-09-20T19:12:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.734+0000 7fcbd6ffd640 1 -- 172.21.15.27:0/3969618720 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fcbdc08ef10 con 0x7fcbe0100800 2024-09-20T19:12:41.736 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:41.736 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:41.736 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:12:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 msgr2=0x7fcbcc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 0x7fcbcc07d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbe01091c0 tx=0x7fcbd0005d30 comp rx=0 tx=0).stop 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 msgr2=0x7fcbe0107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc031460 tx=0x7fcbdc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 shutdown_connections 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fcbcc07af80 0x7fcbcc07d440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbe0106800 0x7fcbe0107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.736+0000 7fcbe7f16640 1 --2- 172.21.15.27:0/3969618720 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbe0100800 0x7fcbe0107730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.737+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 >> 172.21.15.27:0/3969618720 conn(0x7fcbe00fc520 msgr2=0x7fcbe006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.737+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 shutdown_connections 2024-09-20T19:12:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:12:41.737+0000 7fcbe7f16640 1 -- 172.21.15.27:0/3969618720 wait complete. 2024-09-20T19:12:42.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:41 smithi027 ceph-mon[110082]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:42.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:41 smithi027 ceph-mon[110082]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:42.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:41 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2629358991' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:42.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:41 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3969618720' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:42.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:41 smithi098 ceph-mon[80954]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:42.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:41 smithi098 ceph-mon[80954]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:42.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:41 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2629358991' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:42.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:41 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3969618720' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: pgmap v200: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T19:12:43.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T19:12:43.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:42 smithi098 ceph-mon[80954]: Upgrade: osd.3 is safe to restart 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: pgmap v200: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T19:12:43.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:42 smithi027 ceph-mon[110082]: Upgrade: osd.3 is safe to restart 2024-09-20T19:12:44.218 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:43 smithi098 ceph-mon[80954]: pgmap v201: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:44.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:43 smithi027 ceph-mon[110082]: pgmap v201: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:12:45.541 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:45 smithi098 ceph-mon[80954]: Upgrade: Updating osd.3 2024-09-20T19:12:45.542 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:45.542 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-20T19:12:45.542 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:45 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:45.542 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:45 smithi098 ceph-mon[80954]: Deploying daemon osd.3 on smithi098 2024-09-20T19:12:45.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:45 smithi027 ceph-mon[110082]: Upgrade: Updating osd.3 2024-09-20T19:12:45.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:45.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-20T19:12:45.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:45 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:12:45.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:45 smithi027 ceph-mon[110082]: Deploying daemon osd.3 on smithi098 2024-09-20T19:12:46.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:46 smithi098 ceph-mon[80954]: pgmap v202: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:46.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:46 smithi027 ceph-mon[110082]: pgmap v202: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:47.548 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:47 smithi098 systemd[1]: Stopping Ceph osd.3 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:12:47.972 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:47 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:12:47.544+0000 7f39eebc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:12:47.972 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:47 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:12:47.544+0000 7f39eebc8640 -1 osd.3 74 *** Got signal Terminated *** 2024-09-20T19:12:47.973 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:47 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[41695]: 2024-09-20T19:12:47.544+0000 7f39eebc8640 -1 osd.3 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:12:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:48 smithi027 ceph-mon[110082]: pgmap v203: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:48.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:48 smithi027 ceph-mon[110082]: osd.3 marked itself down and dead 2024-09-20T19:12:48.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:48 smithi098 ceph-mon[80954]: pgmap v203: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:12:48.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:48 smithi098 ceph-mon[80954]: osd.3 marked itself down and dead 2024-09-20T19:12:49.107 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:48 smithi098 podman[87916]: 2024-09-20 19:12:48.771754151 +0000 UTC m=+1.398098711 container died cd06a9eb7e9adc3f932b0f0d90a759780c6f11e11fbb3fecc47468c6d7dcec52 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T19:12:49.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:49 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:12:49.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:49 smithi098 ceph-mon[80954]: osdmap e75: 6 total, 5 up, 6 in 2024-09-20T19:12:49.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:49 smithi098 podman[87916]: 2024-09-20 19:12:49.279192269 +0000 UTC m=+1.905536831 container cleanup cd06a9eb7e9adc3f932b0f0d90a759780c6f11e11fbb3fecc47468c6d7dcec52 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ed8ee0f, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-20T19:12:49.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:49 smithi098 bash[87916]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3 2024-09-20T19:12:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:49 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:12:49.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:49 smithi027 ceph-mon[110082]: osdmap e75: 6 total, 5 up, 6 in 2024-09-20T19:12:49.895 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:49 smithi098 podman[87931]: 2024-09-20 19:12:49.530143438 +0000 UTC m=+0.755477917 container remove cd06a9eb7e9adc3f932b0f0d90a759780c6f11e11fbb3fecc47468c6d7dcec52 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-ed8ee0f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-20T19:12:50.219 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:49 smithi098 podman[88020]: 2024-09-20 19:12:49.796387458 +0000 UTC m=+0.016189110 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:50.219 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:49 smithi098 podman[88020]: 2024-09-20 19:12:49.91443416 +0000 UTC m=+0.134235801 container create a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-20T19:12:50.219 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:50 smithi098 podman[88020]: 2024-09-20 19:12:50.133978051 +0000 UTC m=+0.353779702 container init a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-20T19:12:50.219 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:50 smithi098 podman[88020]: 2024-09-20 19:12:50.137413087 +0000 UTC m=+0.357214729 container start a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:12:50.219 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:50 smithi098 podman[88020]: 2024-09-20 19:12:50.217305113 +0000 UTC m=+0.437106770 container attach a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-20T19:12:50.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:50 smithi098 ceph-mon[80954]: pgmap v205: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:50.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:50 smithi098 ceph-mon[80954]: osdmap e76: 6 total, 5 up, 6 in 2024-09-20T19:12:50.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:50 smithi098 podman[88020]: 2024-09-20 19:12:50.325703558 +0000 UTC m=+0.545505200 container died a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T19:12:50.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:50 smithi027 ceph-mon[110082]: pgmap v205: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:12:50.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:50 smithi027 ceph-mon[110082]: osdmap e76: 6 total, 5 up, 6 in 2024-09-20T19:12:51.324 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88043]: 2024-09-20 19:12:51.021913431 +0000 UTC m=+0.690406181 container remove a294e3646ea5ef635cfc5c3e5b8dd30c435888625b5f9c49e1be217419f9e6ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-20T19:12:51.324 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-20T19:12:51.325 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 systemd[1]: Stopped Ceph osd.3 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:12:51.325 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.3.service: Consumed 1min 2.697s CPU time. 2024-09-20T19:12:51.325 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 systemd[1]: Starting Ceph osd.3 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:12:51.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:51 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 9/282 objects degraded (3.191%), 3 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:51.590 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88143]: 2024-09-20 19:12:51.358859955 +0000 UTC m=+0.015974569 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:51.590 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88143]: 2024-09-20 19:12:51.481375923 +0000 UTC m=+0.138490566 container create d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-20T19:12:51.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:51 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 9/282 objects degraded (3.191%), 3 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:51.859 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88143]: 2024-09-20 19:12:51.725667798 +0000 UTC m=+0.382782402 container init d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-20T19:12:51.859 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88143]: 2024-09-20 19:12:51.729027792 +0000 UTC m=+0.386142397 container start d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-20T19:12:51.859 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 podman[88143]: 2024-09-20 19:12:51.808828817 +0000 UTC m=+0.465943426 container attach d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T19:12:52.222 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:52.223 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 bash[88143]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:52.223 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:52.223 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:51 smithi098 bash[88143]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:52 smithi098 ceph-mon[80954]: pgmap v207: 65 pgs: 4 active+undersized, 10 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/282 objects degraded (3.191%) 2024-09-20T19:12:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:52 smithi027 ceph-mon[110082]: pgmap v207: 65 pgs: 4 active+undersized, 10 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/282 objects degraded (3.191%) 2024-09-20T19:12:54.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-mon[80954]: pgmap v208: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:54.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:54 smithi027 ceph-mon[110082]: pgmap v208: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 bash[88143]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 bash[88143]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 bash[88143]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T19:12:55.127 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 bash[88143]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T19:12:55.128 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-20T19:12:55.128 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:54 smithi098 bash[88143]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-20T19:12:55.128 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-20T19:12:55.128 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 bash[88143]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-20T19:12:55.447 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-20T19:12:55.447 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 bash[88143]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 bash[88143]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 bash[88143]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate[88159]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 bash[88143]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-20T19:12:55.448 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 podman[88143]: 2024-09-20 19:12:55.154547619 +0000 UTC m=+3.811662218 container died d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-20T19:12:56.105 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 podman[88369]: 2024-09-20 19:12:55.745936929 +0000 UTC m=+0.585131785 container remove d4f89bc7e06264ea17479ba1cfebcd3c6c1b598da74e00d7564101a68fa9c260 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T19:12:56.105 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 podman[88429]: 2024-09-20 19:12:55.867577333 +0000 UTC m=+0.017017317 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:12:56.105 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:55 smithi098 podman[88429]: 2024-09-20 19:12:55.988344739 +0000 UTC m=+0.137784708 container create 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-20T19:12:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:56 smithi098 ceph-mon[80954]: pgmap v209: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:56.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:56 smithi098 podman[88429]: 2024-09-20 19:12:56.20762607 +0000 UTC m=+0.357066039 container init 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-20T19:12:56.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:56 smithi098 podman[88429]: 2024-09-20 19:12:56.211086477 +0000 UTC m=+0.360526448 container start 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-20T19:12:56.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:56 smithi098 ceph-osd[88448]: -- 172.21.15.98:0/3378250236 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b85c5de1e0 con 0x55b85c56e000 2024-09-20T19:12:56.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:56 smithi098 bash[88429]: 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d 2024-09-20T19:12:56.473 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:56 smithi098 systemd[1]: Started Ceph osd.3 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:12:56.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:56 smithi027 ceph-mon[110082]: pgmap v209: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:57.782 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:12:57 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:12:57.603+0000 7f70b2580640 -1 Falling back to public interface 2024-09-20T19:12:57.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:57.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:57.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:12:58.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:58 smithi098 ceph-mon[80954]: pgmap v210: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:58.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:58.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:58 smithi027 ceph-mon[110082]: pgmap v210: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:12:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:59.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:59 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 54/282 objects degraded (19.149%), 16 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:59.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:59.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:12:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:59.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:59 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 54/282 objects degraded (19.149%), 16 pgs degraded (PG_DEGRADED) 2024-09-20T19:12:59.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:12:59.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:12:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:00.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:00 smithi098 ceph-mon[80954]: pgmap v211: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:00.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:00.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:00.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:00 smithi027 ceph-mon[110082]: pgmap v211: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:00.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:00.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:03.063 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:02 smithi098 ceph-mon[80954]: pgmap v212: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:03.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:02 smithi027 ceph-mon[110082]: pgmap v212: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:03.445 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:13:03.069+0000 7f70b2580640 -1 osd.3 74 log_to_monitors true 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:03.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:03.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:03.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:03.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:03 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T19:13:04.223 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:13:03.753+0000 7f70a6322640 -1 osd.3 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:13:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T19:13:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T19:13:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:04.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:03 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: pgmap v213: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: osdmap e77: 6 total, 5 up, 6 in 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: from='osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:04 smithi027 ceph-mon[110082]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:05.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: pgmap v213: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/282 objects degraded (19.149%) 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: osdmap e77: 6 total, 5 up, 6 in 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: from='osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:05.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:04 smithi098 ceph-mon[80954]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:06.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:05 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:13:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:05 smithi027 ceph-mon[110082]: osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556] boot 2024-09-20T19:13:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:05 smithi027 ceph-mon[110082]: osdmap e78: 6 total, 6 up, 6 in 2024-09-20T19:13:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:05 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-20T19:13:06.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:05 smithi027 ceph-mon[110082]: osdmap e79: 6 total, 6 up, 6 in 2024-09-20T19:13:06.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:05 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:13:06.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:05 smithi098 ceph-mon[80954]: osd.3 [v2:172.21.15.98:6800/3209618556,v1:172.21.15.98:6801/3209618556] boot 2024-09-20T19:13:06.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:05 smithi098 ceph-mon[80954]: osdmap e78: 6 total, 6 up, 6 in 2024-09-20T19:13:06.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:05 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-20T19:13:06.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:05 smithi098 ceph-mon[80954]: osdmap e79: 6 total, 6 up, 6 in 2024-09-20T19:13:07.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:06 smithi027 ceph-mon[110082]: pgmap v216: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 54/282 objects degraded (19.149%) 2024-09-20T19:13:07.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:06 smithi098 ceph-mon[80954]: pgmap v216: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 54/282 objects degraded (19.149%) 2024-09-20T19:13:08.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:07 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 50/282 objects degraded (17.730%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:08.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:07 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 50/282 objects degraded (17.730%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:09.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:08 smithi027 ceph-mon[110082]: pgmap v218: 65 pgs: 16 active+undersized, 14 active+undersized+degraded, 35 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/282 objects degraded (17.730%) 2024-09-20T19:13:09.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:08 smithi098 ceph-mon[80954]: pgmap v218: 65 pgs: 16 active+undersized, 14 active+undersized+degraded, 35 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/282 objects degraded (17.730%) 2024-09-20T19:13:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:10 smithi027 ceph-mon[110082]: pgmap v219: 65 pgs: 4 active+undersized, 1 active+undersized+degraded, 60 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 3/282 objects degraded (1.064%) 2024-09-20T19:13:11.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:10 smithi098 ceph-mon[80954]: pgmap v219: 65 pgs: 4 active+undersized, 1 active+undersized+degraded, 60 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 3/282 objects degraded (1.064%) 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 -- 172.21.15.27:0/2291171911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441007f0 msgr2=0x7f3144100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 --2- 172.21.15.27:0/2291171911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441007f0 0x7f3144100c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3138009880 tx=0x7f313802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 -- 172.21.15.27:0/2291171911 shutdown_connections 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 --2- 172.21.15.27:0/2291171911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441007f0 0x7f3144100c50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 --2- 172.21.15.27:0/2291171911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441067f0 0x7f3144106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:11.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 -- 172.21.15.27:0/2291171911 >> 172.21.15.27:0/2291171911 conn(0x7f31440fc550 msgr2=0x7f31440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:11.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 -- 172.21.15.27:0/2291171911 shutdown_connections 2024-09-20T19:13:11.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.836+0000 7f314b6c9640 1 -- 172.21.15.27:0/2291171911 wait complete. 2024-09-20T19:13:11.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 Processor -- start 2024-09-20T19:13:11.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 -- start start 2024-09-20T19:13:11.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441007f0 0x7f31441987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:11.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f314410dcc0 con 0x7f31441067f0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f314b6c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f314410db40 con 0x7f31441007f0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f3148c64640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f3148c64640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50778/0 (socket says 172.21.15.27:50778) 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f3148c64640 1 -- 172.21.15.27:0/1607496805 learned_addr learned my addr 172.21.15.27:0/1607496805 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.837+0000 7f3149465640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441007f0 0x7f31441987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f3148c64640 1 -- 172.21.15.27:0/1607496805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441007f0 msgr2=0x7f31441987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f3148c64640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441007f0 0x7f31441987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f3148c64640 1 -- 172.21.15.27:0/1607496805 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3144199330 con 0x7f31441067f0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f3148c64640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3138031460 tx=0x7f31380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f313803f070 con 0x7f31441067f0 2024-09-20T19:13:11.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31380035f0 con 0x7f31441067f0 2024-09-20T19:13:11.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441995c0 con 0x7f31441067f0 2024-09-20T19:13:11.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3138035030 con 0x7f31441067f0 2024-09-20T19:13:11.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.838+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a1b70 con 0x7f31441067f0 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.839+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3144101f30 con 0x7f31441067f0 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.840+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3138042070 con 0x7f31441067f0 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.840+0000 7f31427fc640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 0x7f312c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.841+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7f31380be970 con 0x7f31441067f0 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.841+0000 7f3149465640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 0x7f312c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:11.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.841+0000 7f3149465640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 0x7f312c07d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f313c005fd0 tx=0x7f313c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:11.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:11.845+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31380c0e20 con 0x7f31441067f0 2024-09-20T19:13:12.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.052+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3144062630 con 0x7f312c07af80 2024-09-20T19:13:12.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.053+0000 7f31427fc640 1 -- 172.21.15.27:0/1607496805 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f3144062630 con 0x7f312c07af80 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 msgr2=0x7f312c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 0x7f312c07d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f313c005fd0 tx=0x7f313c00b390 comp rx=0 tx=0).stop 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 msgr2=0x7f3144198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3138031460 tx=0x7f31380045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 shutdown_connections 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f312c07af80 0x7f312c07d440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31441067f0 0x7f3144198d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 --2- 172.21.15.27:0/1607496805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31441007f0 0x7f31441987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 >> 172.21.15.27:0/1607496805 conn(0x7f31440fc550 msgr2=0x7f31440fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 shutdown_connections 2024-09-20T19:13:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.056+0000 7f314b6c9640 1 -- 172.21.15.27:0/1607496805 wait complete. 2024-09-20T19:13:12.066 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:13:12.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 -- 172.21.15.27:0/2114750069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 msgr2=0x7fc6c810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/2114750069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c810b920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00098b0 tx=0x7fc6b002a560 comp rx=0 tx=0).stop 2024-09-20T19:13:12.144 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:11 smithi027 ceph-mon[110082]: pgmap v220: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 565 B/s rd, 1 op/s 2024-09-20T19:13:12.144 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:11 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/282 objects degraded (1.064%), 1 pg degraded) 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 -- 172.21.15.27:0/2114750069 shutdown_connections 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/2114750069 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c810b920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/2114750069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 -- 172.21.15.27:0/2114750069 >> 172.21.15.27:0/2114750069 conn(0x7fc6c80fc550 msgr2=0x7fc6c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 -- 172.21.15.27:0/2114750069 shutdown_connections 2024-09-20T19:13:12.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.142+0000 7fc6ccf17640 1 -- 172.21.15.27:0/2114750069 wait complete. 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 Processor -- start 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 -- start start 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810ede0 con 0x7fc6c8103430 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6ccf17640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810ec60 con 0x7fc6c8102b10 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50796/0 (socket says 172.21.15.27:50796) 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6c5d9b640 1 -- 172.21.15.27:0/3731259506 learned_addr learned my addr 172.21.15.27:0/3731259506 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.143+0000 7fc6c659c640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6c659c640 1 -- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 msgr2=0x7fc6c819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6c659c640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6c659c640 1 -- 172.21.15.27:0/3731259506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c81977f0 con 0x7fc6c8102b10 2024-09-20T19:13:12.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6c5d9b640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6c659c640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c819d670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8005fd0 tx=0x7fc6b800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8004b20 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6b8004cc0 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c8197ae0 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8011470 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.144+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c8198040 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.145+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c806a520 con 0x7fc6c8102b10 2024-09-20T19:13:12.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.146+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc6b800cb20 con 0x7fc6c8102b10 2024-09-20T19:13:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.147+0000 7fc6bf7fe640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 0x7fc6b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.147+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7fc6b809e2f0 con 0x7fc6c8102b10 2024-09-20T19:13:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.147+0000 7fc6c5d9b640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 0x7fc6b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.147+0000 7fc6c5d9b640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 0x7fc6b407d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009230 tx=0x7fc6b00058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.151+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6b8016030 con 0x7fc6c8102b10 2024-09-20T19:13:12.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:11 smithi098 ceph-mon[80954]: pgmap v220: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 565 B/s rd, 1 op/s 2024-09-20T19:13:12.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:11 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/282 objects degraded (1.064%), 1 pg degraded) 2024-09-20T19:13:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.360+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6c8198320 con 0x7fc6b407af80 2024-09-20T19:13:12.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.361+0000 7fc6bf7fe640 1 -- 172.21.15.27:0/3731259506 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fc6c8198320 con 0x7fc6b407af80 2024-09-20T19:13:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.363+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 msgr2=0x7fc6b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.363+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 0x7fc6b407d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009230 tx=0x7fc6b00058d0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.363+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 msgr2=0x7fc6c819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.363+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c819d670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8005fd0 tx=0x7fc6b800ee00 comp rx=0 tx=0).stop 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 shutdown_connections 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc6b407af80 0x7fc6b407d440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6c8103430 0x7fc6c819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 --2- 172.21.15.27:0/3731259506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6c8102b10 0x7fc6c819d670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 >> 172.21.15.27:0/3731259506 conn(0x7fc6c80fc550 msgr2=0x7fc6c8103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 shutdown_connections 2024-09-20T19:13:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.364+0000 7fc6ccf17640 1 -- 172.21.15.27:0/3731259506 wait complete. 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 -- 172.21.15.27:0/1504802258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8103450 msgr2=0x7f38a810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 --2- 172.21.15.27:0/1504802258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8103450 0x7f38a810b940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f389c009880 tx=0x7f389c02a530 comp rx=0 tx=0).stop 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 -- 172.21.15.27:0/1504802258 shutdown_connections 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 --2- 172.21.15.27:0/1504802258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8103450 0x7f38a810b940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 --2- 172.21.15.27:0/1504802258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8102b30 0x7f38a8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 -- 172.21.15.27:0/1504802258 >> 172.21.15.27:0/1504802258 conn(0x7f38a80fc550 msgr2=0x7f38a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 -- 172.21.15.27:0/1504802258 shutdown_connections 2024-09-20T19:13:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.449+0000 7f38afbbd640 1 -- 172.21.15.27:0/1504802258 wait complete. 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 Processor -- start 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 -- start start 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8103450 0x7f38a819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f38a810ede0 con 0x7f38a8102b30 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38afbbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38a810ec60 con 0x7f38a8103450 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50820/0 (socket says 172.21.15.27:50820) 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 -- 172.21.15.27:0/2567221403 learned_addr learned my addr 172.21.15.27:0/2567221403 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad158640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8103450 0x7f38a819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 -- 172.21.15.27:0/2567221403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8103450 msgr2=0x7f38a819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8103450 0x7f38a819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.450+0000 7f38ad959640 1 -- 172.21.15.27:0/2567221403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a81977b0 con 0x7f38a8102b30 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38ad959640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c8f0 tx=0x7f38a000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38a00079b0 con 0x7f38a8102b30 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a8197aa0 con 0x7f38a8102b30 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38a00054e0 con 0x7f38a8102b30 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38a0004dd0 con 0x7f38a8102b30 2024-09-20T19:13:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.451+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a8198000 con 0x7f38a8102b30 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.452+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a806a500 con 0x7f38a8102b30 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.452+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f38a0005020 con 0x7f38a8102b30 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.453+0000 7f38a6ffd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 0x7f389007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.453+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7f38a009e030 con 0x7f38a8102b30 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.453+0000 7f38ad158640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 0x7f389007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.454+0000 7f38ad158640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 0x7f389007d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38a8198b00 tx=0x7f389c004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.457+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38a0014030 con 0x7f38a8102b30 2024-09-20T19:13:12.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.652+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f38a8198310 con 0x7f389007aed0 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.662+0000 7f38a6ffd640 1 -- 172.21.15.27:0/2567221403 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f38a8198310 con 0x7f389007aed0 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (4m) 48s ago 15m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (6m) 48s ago 15m 8660k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (6m) 13s ago 14m 8850k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (2m) 48s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (2m) 13s ago 14m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (4m) 48s ago 15m 74.8M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (9m) 48s ago 9m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (10m) 48s ago 10m 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:13:12.664 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (10m) 13s ago 10m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (9m) 13s ago 9m 18.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (6m) 48s ago 16m 526M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (5m) 13s ago 14m 458M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (3m) 48s ago 16m 44.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (2m) 13s ago 14m 38.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (5m) 48s ago 15m 11.0M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 13s ago 14m 10.7M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (2m) 48s ago 13m 123M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (93s) 48s ago 12m 82.5M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (54s) 48s ago 12m 12.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (16s) 13s ago 11m 12.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (11m) 13s ago 11m 220M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab c550e7bec9ab 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (11m) 13s ago 11m 209M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:13:12.665 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (4m) 48s ago 14m 56.6M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:13:12.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 msgr2=0x7f389007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 0x7f389007d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38a8198b00 tx=0x7f389c004f30 comp rx=0 tx=0).stop 2024-09-20T19:13:12.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 msgr2=0x7f38a819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c8f0 tx=0x7f38a000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 shutdown_connections 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f389007aed0 0x7f389007d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8103450 0x7f38a819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 --2- 172.21.15.27:0/2567221403 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a8102b30 0x7f38a819d630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 >> 172.21.15.27:0/2567221403 conn(0x7f38a80fc550 msgr2=0x7f38a8103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 shutdown_connections 2024-09-20T19:13:12.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.664+0000 7f38afbbd640 1 -- 172.21.15.27:0/2567221403 wait complete. 2024-09-20T19:13:12.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 -- 172.21.15.27:0/2976219791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c1033e0 msgr2=0x7f516c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 --2- 172.21.15.27:0/2976219791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c1033e0 0x7f516c10b8d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5154009880 tx=0x7f515402a530 comp rx=0 tx=0).stop 2024-09-20T19:13:12.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 -- 172.21.15.27:0/2976219791 shutdown_connections 2024-09-20T19:13:12.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 --2- 172.21.15.27:0/2976219791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c1033e0 0x7f516c10b8d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 --2- 172.21.15.27:0/2976219791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c102ac0 0x7f516c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 -- 172.21.15.27:0/2976219791 >> 172.21.15.27:0/2976219791 conn(0x7f516c0fc520 msgr2=0x7f516c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:12.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 -- 172.21.15.27:0/2976219791 shutdown_connections 2024-09-20T19:13:12.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.747+0000 7f5170c62640 1 -- 172.21.15.27:0/2976219791 wait complete. 2024-09-20T19:13:12.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.748+0000 7f5170c62640 1 Processor -- start 2024-09-20T19:13:12.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.748+0000 7f5170c62640 1 -- start start 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5170c62640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5170c62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 0x7f516c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5170c62640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f516c10edd0 con 0x7f516c102ac0 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5170c62640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f516c10ec50 con 0x7f516c1033e0 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50824/0 (socket says 172.21.15.27:50824) 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 -- 172.21.15.27:0/2269776132 learned_addr learned my addr 172.21.15.27:0/2269776132 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5169d9b640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 0x7f516c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 -- 172.21.15.27:0/2269776132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 msgr2=0x7f516c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 0x7f516c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:12.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 -- 172.21.15.27:0/2269776132 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c1977e0 con 0x7f516c102ac0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f5169d9b640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 0x7f516c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.749+0000 7f516a59c640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c8a0 tx=0x7f515c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.750+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f515c0079b0 con 0x7f516c102ac0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.750+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f515c007b50 con 0x7f516c102ac0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.750+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c197ad0 con 0x7f516c102ac0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.750+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f515c018700 con 0x7f516c102ac0 2024-09-20T19:13:12.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.750+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c198030 con 0x7f516c102ac0 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.751+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c06aa90 con 0x7f516c102ac0 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.752+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f515c007d00 con 0x7f516c102ac0 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.752+0000 7f51637fe640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 0x7f515807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.752+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7f515c09e360 con 0x7f516c102ac0 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.752+0000 7f5169d9b640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 0x7f515807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:12.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.753+0000 7f5169d9b640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 0x7f515807d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f516c198b30 tx=0x7f5154009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:12.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:12.758+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f515c014030 con 0x7f516c102ac0 2024-09-20T19:13:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.024+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f516c105f60 con 0x7f516c102ac0 2024-09-20T19:13:13.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.024+0000 7f51637fe640 1 -- 172.21.15.27:0/2269776132 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f515c0698d0 con 0x7f516c102ac0 2024-09-20T19:13:13.026 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:13:13.026 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:13:13.026 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2, 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:13:13.027 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6, 2024-09-20T19:13:13.028 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 8 2024-09-20T19:13:13.028 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:13:13.028 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 msgr2=0x7f515807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 0x7f515807d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f516c198b30 tx=0x7f5154009560 comp rx=0 tx=0).stop 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 msgr2=0x7f516c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c8a0 tx=0x7f515c00cd60 comp rx=0 tx=0).stop 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 shutdown_connections 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f515807af80 0x7f515807d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f516c1033e0 0x7f516c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 --2- 172.21.15.27:0/2269776132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f516c102ac0 0x7f516c19d660 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 >> 172.21.15.27:0/2269776132 conn(0x7f516c0fc520 msgr2=0x7f516c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 shutdown_connections 2024-09-20T19:13:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.027+0000 7f5170c62640 1 -- 172.21.15.27:0/2269776132 wait complete. 2024-09-20T19:13:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 -- 172.21.15.27:0/3705055794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 msgr2=0x7f6204106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3705055794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f6204106610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009880 tx=0x7f61f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 -- 172.21.15.27:0/3705055794 shutdown_connections 2024-09-20T19:13:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3705055794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f6204106610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3705055794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 0x7f6204100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.111+0000 7f620b3bf640 1 -- 172.21.15.27:0/3705055794 >> 172.21.15.27:0/3705055794 conn(0x7f62040fbc90 msgr2=0x7f62040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 -- 172.21.15.27:0/3705055794 shutdown_connections 2024-09-20T19:13:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 -- 172.21.15.27:0/3705055794 wait complete. 2024-09-20T19:13:13.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 Processor -- start 2024-09-20T19:13:13.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 -- start start 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 0x7f62041010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f620410eec0 con 0x7f6204100ad0 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.112+0000 7f620b3bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f620410ed40 con 0x7f6204100120 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50830/0 (socket says 172.21.15.27:50830) 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 -- 172.21.15.27:0/3140285982 learned_addr learned my addr 172.21.15.27:0/3140285982 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620915b640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 0x7f62041010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 -- 172.21.15.27:0/3140285982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 msgr2=0x7f62041010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 0x7f62041010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 -- 172.21.15.27:0/3140285982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6204101b20 con 0x7f6204100ad0 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620895a640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61f4031460 tx=0x7f61f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61f403f070 con 0x7f6204100ad0 2024-09-20T19:13:13.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61f4004cf0 con 0x7f6204100ad0 2024-09-20T19:13:13.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6204101db0 con 0x7f6204100ad0 2024-09-20T19:13:13.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61f4035030 con 0x7f6204100ad0 2024-09-20T19:13:13.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.113+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62041a3f30 con 0x7f6204100ad0 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.114+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62041031e0 con 0x7f6204100ad0 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.115+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f61f4042070 con 0x7f6204100ad0 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.115+0000 7f61fa7fc640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 0x7f61f007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.116+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7f61f40beb00 con 0x7f6204100ad0 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.116+0000 7f620915b640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 0x7f61f007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.116+0000 7f620915b640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 0x7f61f007d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6200009990 tx=0x7f6200009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.120+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61f408a070 con 0x7f6204100ad0 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.347+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f62041025d0 con 0x7f6204100ad0 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.347+0000 7f61fa7fc640 1 -- 172.21.15.27:0/3140285982 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7f61f408ef20 con 0x7f6204100ad0 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:13:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:13:13.351 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:13:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 msgr2=0x7f61f007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 0x7f61f007d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6200009990 tx=0x7f6200009110 comp rx=0 tx=0).stop 2024-09-20T19:13:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 msgr2=0x7f62041015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61f4031460 tx=0x7f61f40048f0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 shutdown_connections 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61f007af80 0x7f61f007d440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6204100ad0 0x7f62041015e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 --2- 172.21.15.27:0/3140285982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6204100120 0x7f62041010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.350+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 >> 172.21.15.27:0/3140285982 conn(0x7f62040fbc90 msgr2=0x7f62040fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.351+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 shutdown_connections 2024-09-20T19:13:13.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.351+0000 7f620b3bf640 1 -- 172.21.15.27:0/3140285982 wait complete. 2024-09-20T19:13:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- 172.21.15.27:0/526015628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341067f0 msgr2=0x7f5b34106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/526015628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341067f0 0x7f5b34106bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009880 tx=0x7f5b2c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- 172.21.15.27:0/526015628 shutdown_connections 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/526015628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341007f0 0x7f5b34100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/526015628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341067f0 0x7f5b34106bd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- 172.21.15.27:0/526015628 >> 172.21.15.27:0/526015628 conn(0x7f5b340fc550 msgr2=0x7f5b340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- 172.21.15.27:0/526015628 shutdown_connections 2024-09-20T19:13:13.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- 172.21.15.27:0/526015628 wait complete. 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 Processor -- start 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.437+0000 7f5b3bebb640 1 -- start start 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b3bebb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b3bebb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 0x7f5b3419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b3bebb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3410dca0 con 0x7f5b341007f0 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b3bebb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3410db20 con 0x7f5b341067f0 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50858/0 (socket says 172.21.15.27:50858) 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 -- 172.21.15.27:0/3309123718 learned_addr learned my addr 172.21.15.27:0/3309123718 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39456640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 0x7f5b3419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 -- 172.21.15.27:0/3309123718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 msgr2=0x7f5b3419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 0x7f5b3419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 -- 172.21.15.27:0/3309123718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b34197750 con 0x7f5b341007f0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39456640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 0x7f5b3419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b39c57640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c031460 tx=0x7f5b2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c03f070 con 0x7f5b341007f0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b2c004b10 con 0x7f5b341007f0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b341979e0 con 0x7f5b341007f0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.438+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c035030 con 0x7f5b341007f0 2024-09-20T19:13:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.439+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b34197ee0 con 0x7f5b341007f0 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.440+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34101f30 con 0x7f5b341007f0 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.440+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5b2c042070 con 0x7f5b341007f0 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.441+0000 7f5b32ffd640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 0x7f5b1c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.441+0000 7f5b39456640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 0x7f5b1c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.441+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7f5b2c0beb80 con 0x7f5b341007f0 2024-09-20T19:13:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.441+0000 7f5b39456640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 0x7f5b1c07d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b280058c0 tx=0x7f5b28005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.445+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b2c08a0f0 con 0x7f5b341007f0 2024-09-20T19:13:13.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.653+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5b34198250 con 0x7f5b1c07af90 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2269776132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:13.656 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:13 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3140285982' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:13.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.655+0000 7f5b32ffd640 1 -- 172.21.15.27:0/3309123718 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5b34198250 con 0x7f5b1c07af90 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "10/23 daemons upgraded", 2024-09-20T19:13:13.657 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:13:13.658 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:13:13.658 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 msgr2=0x7f5b1c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 0x7f5b1c07d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b280058c0 tx=0x7f5b28005850 comp rx=0 tx=0).stop 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 msgr2=0x7f5b3419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c031460 tx=0x7f5b2c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 shutdown_connections 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5b1c07af90 0x7f5b1c07d450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b341067f0 0x7f5b3419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 --2- 172.21.15.27:0/3309123718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b341007f0 0x7f5b3419d680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 >> 172.21.15.27:0/3309123718 conn(0x7f5b340fc550 msgr2=0x7f5b34069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 shutdown_connections 2024-09-20T19:13:13.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.658+0000 7f5b3bebb640 1 -- 172.21.15.27:0/3309123718 wait complete. 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 -- 172.21.15.27:0/751238779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc101900 msgr2=0x7feddc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 --2- 172.21.15.27:0/751238779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc101900 0x7feddc101d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009880 tx=0x7fedcc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 -- 172.21.15.27:0/751238779 shutdown_connections 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 --2- 172.21.15.27:0/751238779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc101900 0x7feddc101d60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 --2- 172.21.15.27:0/751238779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc107900 0x7feddc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 -- 172.21.15.27:0/751238779 >> 172.21.15.27:0/751238779 conn(0x7feddc0fd600 msgr2=0x7feddc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 -- 172.21.15.27:0/751238779 shutdown_connections 2024-09-20T19:13:13.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.744+0000 7fede3f8a640 1 -- 172.21.15.27:0/751238779 wait complete. 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 Processor -- start 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 -- start start 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc101900 0x7feddc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7feddc10ee30 con 0x7feddc107900 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede3f8a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feddc10ecb0 con 0x7feddc101900 2024-09-20T19:13:13.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede1525640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede1525640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50864/0 (socket says 172.21.15.27:50864) 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede1525640 1 -- 172.21.15.27:0/2974012306 learned_addr learned my addr 172.21.15.27:0/2974012306 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.745+0000 7fede1d26640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc101900 0x7feddc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fede1525640 1 -- 172.21.15.27:0/2974012306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc101900 msgr2=0x7feddc19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fede1525640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc101900 0x7feddc19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fede1525640 1 -- 172.21.15.27:0/2974012306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc197840 con 0x7feddc107900 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fede1525640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031460 tx=0x7fedcc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc03f070 con 0x7feddc107900 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedcc004cf0 con 0x7feddc107900 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc197ad0 con 0x7feddc107900 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.746+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc035030 con 0x7feddc107900 2024-09-20T19:13:13.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.747+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc198000 con 0x7feddc107900 2024-09-20T19:13:13.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.748+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc103040 con 0x7feddc107900 2024-09-20T19:13:13.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.748+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fedcc042070 con 0x7feddc107900 2024-09-20T19:13:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.749+0000 7fedd2ffd640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 0x7fedc407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.749+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6417+0+0 (secure 0 0 0) 0x7fedcc0beaf0 con 0x7feddc107900 2024-09-20T19:13:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.749+0000 7fede1d26640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 0x7fedc407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:13.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.750+0000 7fede1d26640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 0x7fedc407d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009890 tx=0x7fedd8008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:13.754+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedcc08a060 con 0x7feddc107900 2024-09-20T19:13:13.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:13.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2269776132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:13.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:13 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3140285982' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:14.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.015+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7feddc109e90 con 0x7feddc107900 2024-09-20T19:13:14.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.015+0000 7fedd2ffd640 1 -- 172.21.15.27:0/2974012306 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fedcc08ef10 con 0x7feddc107900 2024-09-20T19:13:14.017 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:14.017 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:14.017 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.017+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 msgr2=0x7fedc407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.017+0000 7fede3f8a640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 0x7fedc407d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009890 tx=0x7fedd8008040 comp rx=0 tx=0).stop 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.017+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 msgr2=0x7feddc19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.017+0000 7fede3f8a640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031460 tx=0x7fedcc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 shutdown_connections 2024-09-20T19:13:14.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedc407af80 0x7fedc407d440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:14.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feddc107900 0x7feddc19dc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:14.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 --2- 172.21.15.27:0/2974012306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc101900 0x7feddc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:14.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 >> 172.21.15.27:0/2974012306 conn(0x7feddc0fd600 msgr2=0x7feddc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:14.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 shutdown_connections 2024-09-20T19:13:14.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:14.018+0000 7fede3f8a640 1 -- 172.21.15.27:0/2974012306 wait complete. 2024-09-20T19:13:14.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:14 smithi027 ceph-mon[110082]: pgmap v221: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 497 B/s rd, 0 op/s 2024-09-20T19:13:14.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:14 smithi027 ceph-mon[110082]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:14.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:14 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2974012306' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:14 smithi098 ceph-mon[80954]: pgmap v221: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 497 B/s rd, 0 op/s 2024-09-20T19:13:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:14 smithi098 ceph-mon[80954]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:14 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2974012306' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:16.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:16 smithi027 ceph-mon[110082]: pgmap v222: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-20T19:13:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:16 smithi098 ceph-mon[80954]: pgmap v222: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-20T19:13:18.849 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:18 smithi098 ceph-mon[80954]: pgmap v223: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 820 B/s rd, 1 op/s 2024-09-20T19:13:18.850 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:18 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:18.850 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:18 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T19:13:18.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:18 smithi027 ceph-mon[110082]: pgmap v223: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 820 B/s rd, 1 op/s 2024-09-20T19:13:18.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:18.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T19:13:19.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:19 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T19:13:19.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:19 smithi098 ceph-mon[80954]: Upgrade: osd.4 is safe to restart 2024-09-20T19:13:19.987 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:19 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T19:13:19.987 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:19 smithi027 ceph-mon[110082]: Upgrade: osd.4 is safe to restart 2024-09-20T19:13:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: pgmap v224: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:13:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: Upgrade: Updating osd.4 2024-09-20T19:13:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-20T19:13:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:20.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:20 smithi098 ceph-mon[80954]: Deploying daemon osd.4 on smithi098 2024-09-20T19:13:21.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: pgmap v224: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:13:21.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: Upgrade: Updating osd.4 2024-09-20T19:13:21.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:21.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-20T19:13:21.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:21.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:20 smithi027 ceph-mon[110082]: Deploying daemon osd.4 on smithi098 2024-09-20T19:13:22.801 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:22 smithi098 ceph-mon[80954]: pgmap v225: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:22.802 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:22 smithi098 systemd[1]: Stopping Ceph osd.4 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:13:22.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:22 smithi027 ceph-mon[110082]: pgmap v225: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:23.222 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:22 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:13:22.837+0000 7fafd2a93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:13:23.222 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:22 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:13:22.837+0000 7fafd2a93640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-20T19:13:23.222 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:22 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[48155]: 2024-09-20T19:13:22.837+0000 7fafd2a93640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:13:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:23 smithi098 ceph-mon[80954]: osd.4 marked itself down and dead 2024-09-20T19:13:24.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:23 smithi027 ceph-mon[110082]: osd.4 marked itself down and dead 2024-09-20T19:13:24.491 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:24 smithi098 podman[93095]: 2024-09-20 19:13:24.221957122 +0000 UTC m=+1.521901876 container died c550e7bec9abf3d6d39bbdb5ffaf28cb64e2cb19327f3b253258483d2075a9e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ed8ee0f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-20T19:13:24.883 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:24 smithi098 ceph-mon[80954]: pgmap v226: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:24.883 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:24 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:13:24.883 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:24 smithi098 ceph-mon[80954]: osdmap e80: 6 total, 5 up, 6 in 2024-09-20T19:13:24.883 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:24 smithi098 podman[93095]: 2024-09-20 19:13:24.587910096 +0000 UTC m=+1.887854881 container cleanup c550e7bec9abf3d6d39bbdb5ffaf28cb64e2cb19327f3b253258483d2075a9e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-20T19:13:24.883 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:24 smithi098 bash[93095]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4 2024-09-20T19:13:24.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:24 smithi027 ceph-mon[110082]: pgmap v226: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:24.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:24 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:13:24.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:24 smithi027 ceph-mon[110082]: osdmap e80: 6 total, 5 up, 6 in 2024-09-20T19:13:25.192 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:24 smithi098 podman[93122]: 2024-09-20 19:13:24.881001095 +0000 UTC m=+0.662695228 container remove c550e7bec9abf3d6d39bbdb5ffaf28cb64e2cb19327f3b253258483d2075a9e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T19:13:25.472 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.09371221 +0000 UTC m=+0.015767775 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:13:25.472 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.206800287 +0000 UTC m=+0.128855843 container create fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T19:13:25.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:25 smithi098 ceph-mon[80954]: osdmap e81: 6 total, 5 up, 6 in 2024-09-20T19:13:25.972 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.476390098 +0000 UTC m=+0.398445661 container init fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:13:25.973 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.479731204 +0000 UTC m=+0.401786759 container start fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:13:25.973 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.576292346 +0000 UTC m=+0.498347916 container attach fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:13:25.973 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:25 smithi098 podman[93209]: 2024-09-20 19:13:25.662303239 +0000 UTC m=+0.584358806 container died fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T19:13:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:25 smithi027 ceph-mon[110082]: osdmap e81: 6 total, 5 up, 6 in 2024-09-20T19:13:26.688 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 podman[93232]: 2024-09-20 19:13:26.280135474 +0000 UTC m=+0.612346367 container remove fe6584e203dd58a6fe56d5c5d1a7aa175906897a38dcef792d4eb668b9fb0839 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-20T19:13:26.688 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-20T19:13:26.688 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 systemd[1]: Stopped Ceph osd.4 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:13:26.688 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.4.service: Consumed 51.133s CPU time. 2024-09-20T19:13:26.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 systemd[1]: Starting Ceph osd.4 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:13:26.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:26 smithi098 ceph-mon[80954]: pgmap v229: 65 pgs: 17 peering, 3 stale+active+clean, 45 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:13:26.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:26 smithi098 ceph-mon[80954]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-20T19:13:26.969 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 podman[93334]: 2024-09-20 19:13:26.627923888 +0000 UTC m=+0.015966421 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:13:26.969 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 podman[93334]: 2024-09-20 19:13:26.731210185 +0000 UTC m=+0.119252713 container create 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True) 2024-09-20T19:13:27.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:26 smithi027 ceph-mon[110082]: pgmap v229: 65 pgs: 17 peering, 3 stale+active+clean, 45 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:13:27.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:26 smithi027 ceph-mon[110082]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-20T19:13:27.222 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 podman[93334]: 2024-09-20 19:13:26.967751477 +0000 UTC m=+0.355794009 container init 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:26 smithi098 podman[93334]: 2024-09-20 19:13:26.971500515 +0000 UTC m=+0.359543050 container start 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:27 smithi098 podman[93334]: 2024-09-20 19:13:27.067404106 +0000 UTC m=+0.455446644 container attach 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:27 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:27 smithi098 bash[93334]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:27 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:27.223 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:27 smithi098 bash[93334]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:28.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:28 smithi027 ceph-mon[110082]: pgmap v230: 65 pgs: 4 active+undersized, 17 peering, 2 stale+active+clean, 42 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-09-20T19:13:28.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:28.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:28.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:28 smithi098 ceph-mon[80954]: pgmap v230: 65 pgs: 4 active+undersized, 17 peering, 2 stale+active+clean, 42 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-09-20T19:13:28.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:28.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:29.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:29 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:30.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:29 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-20T19:13:30.365 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-20T19:13:30.366 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-20T19:13:30.689 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-mon[80954]: pgmap v231: 65 pgs: 13 active+undersized, 8 peering, 11 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate[93348]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-20T19:13:30.689 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 bash[93334]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-20T19:13:30.690 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 podman[93334]: 2024-09-20 19:13:30.393155364 +0000 UTC m=+3.781197899 container died 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-20T19:13:30.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:30 smithi027 ceph-mon[110082]: pgmap v231: 65 pgs: 13 active+undersized, 8 peering, 11 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:13:31.288 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:30 smithi098 podman[93556]: 2024-09-20 19:13:30.971156979 +0000 UTC m=+0.571729510 container remove 8d5955bd8bc426f1b094f39806c4facead7a5c7860e5ed235a242238d3ca63ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-20T19:13:31.288 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 podman[93614]: 2024-09-20 19:13:31.079133642 +0000 UTC m=+0.015592406 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:13:31.288 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 podman[93614]: 2024-09-20 19:13:31.180332008 +0000 UTC m=+0.116790763 container create 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-20T19:13:31.722 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 podman[93614]: 2024-09-20 19:13:31.408163222 +0000 UTC m=+0.344621987 container init 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T19:13:31.723 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 podman[93614]: 2024-09-20 19:13:31.411627681 +0000 UTC m=+0.348086439 container start 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T19:13:31.723 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 ceph-osd[93633]: -- 172.21.15.98:0/2431199793 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d9658e1e0 con 0x561d9572dc00 2024-09-20T19:13:31.723 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 bash[93614]: 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 2024-09-20T19:13:31.723 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:31 smithi098 systemd[1]: Started Ceph osd.4 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:13:32.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:32 smithi027 ceph-mon[110082]: pgmap v232: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:32.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:32.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:32.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:32.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:32 smithi027 ceph-mon[110082]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-20T19:13:32.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:32 smithi098 ceph-mon[80954]: pgmap v232: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:32.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:32.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:32.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:32.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:32 smithi098 ceph-mon[80954]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-20T19:13:33.116 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:33 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:13:33.040+0000 7fc2d0ede640 -1 Falling back to public interface 2024-09-20T19:13:34.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:34 smithi027 ceph-mon[110082]: pgmap v233: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 881 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:34.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:34.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:34.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:34 smithi098 ceph-mon[80954]: pgmap v233: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 881 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:34.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:34.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:36.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:35 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:36.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:35 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:36.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:35 smithi098 ceph-mon[80954]: pgmap v234: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 994 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:36.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:35 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:36.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:35 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:36.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:35 smithi027 ceph-mon[110082]: pgmap v234: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 994 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:38.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:38 smithi098 ceph-mon[80954]: pgmap v235: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:38.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:38 smithi027 ceph-mon[110082]: pgmap v235: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:38.722 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:38 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:13:38.232+0000 7fc2d0ede640 -1 osd.4 79 log_to_monitors true 2024-09-20T19:13:39.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T19:13:39.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T19:13:39.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:39 smithi027 ceph-mon[110082]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-20T19:13:39.472 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:13:39.052+0000 7fc2c4c80640 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:13:39.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T19:13:39.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T19:13:39.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T19:13:39.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:39 smithi098 ceph-mon[80954]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-20T19:13:40.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: pgmap v236: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:40.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T19:13:40.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: osdmap e82: 6 total, 5 up, 6 in 2024-09-20T19:13:40.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: from='osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:40.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:40.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:40 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:40.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: pgmap v236: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:40.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T19:13:40.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: osdmap e82: 6 total, 5 up, 6 in 2024-09-20T19:13:40.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: from='osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:40.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:13:40.461 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:40 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:41.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:41 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:13:41.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:41 smithi027 ceph-mon[110082]: osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470] boot 2024-09-20T19:13:41.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:41 smithi027 ceph-mon[110082]: osdmap e83: 6 total, 6 up, 6 in 2024-09-20T19:13:41.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:41 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-20T19:13:41.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:41 smithi027 ceph-mon[110082]: osdmap e84: 6 total, 6 up, 6 in 2024-09-20T19:13:41.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:41 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:13:41.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:41 smithi098 ceph-mon[80954]: osd.4 [v2:172.21.15.98:6808/3481126470,v1:172.21.15.98:6809/3481126470] boot 2024-09-20T19:13:41.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:41 smithi098 ceph-mon[80954]: osdmap e83: 6 total, 6 up, 6 in 2024-09-20T19:13:41.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:41 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-20T19:13:41.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:41 smithi098 ceph-mon[80954]: osdmap e84: 6 total, 6 up, 6 in 2024-09-20T19:13:42.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:42 smithi027 ceph-mon[110082]: pgmap v239: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:42.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:42 smithi098 ceph-mon[80954]: pgmap v239: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 47/282 objects degraded (16.667%) 2024-09-20T19:13:43.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:43.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:43.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:43.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.119+0000 7f04aa77e640 1 -- 172.21.15.27:0/1682366173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41067f0 msgr2=0x7f04a4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.119+0000 7f04aa77e640 1 --2- 172.21.15.27:0/1682366173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41067f0 0x7f04a4106bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0494009880 tx=0x7f049402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 -- 172.21.15.27:0/1682366173 shutdown_connections 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 --2- 172.21.15.27:0/1682366173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41007f0 0x7f04a4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 --2- 172.21.15.27:0/1682366173 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41067f0 0x7f04a4106bd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 -- 172.21.15.27:0/1682366173 >> 172.21.15.27:0/1682366173 conn(0x7f04a40fc550 msgr2=0x7f04a40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 -- 172.21.15.27:0/1682366173 shutdown_connections 2024-09-20T19:13:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 -- 172.21.15.27:0/1682366173 wait complete. 2024-09-20T19:13:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.120+0000 7f04aa77e640 1 Processor -- start 2024-09-20T19:13:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04aa77e640 1 -- start start 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04aa77e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04aa77e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 0x7f04a419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04aa77e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f04a410dca0 con 0x7f04a41007f0 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04aa77e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f04a410db20 con 0x7f04a41067f0 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57306/0 (socket says 172.21.15.27:57306) 2024-09-20T19:13:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04a3fff640 1 -- 172.21.15.27:0/905515269 learned_addr learned my addr 172.21.15.27:0/905515269 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.121+0000 7f04a37fe640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 0x7f04a419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a3fff640 1 -- 172.21.15.27:0/905515269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 msgr2=0x7f04a419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a3fff640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 0x7f04a419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a3fff640 1 -- 172.21.15.27:0/905515269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a4197750 con 0x7f04a41007f0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a37fe640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 0x7f04a419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a3fff640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0494031460 tx=0x7f04940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f049403f070 con 0x7f04a41007f0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a41979e0 con 0x7f04a41007f0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0494004b10 con 0x7f04a41007f0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0494035030 con 0x7f04a41007f0 2024-09-20T19:13:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.122+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a4197ee0 con 0x7f04a41007f0 2024-09-20T19:13:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.123+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a4101f30 con 0x7f04a41007f0 2024-09-20T19:13:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.124+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0494042070 con 0x7f04a41007f0 2024-09-20T19:13:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.125+0000 7f04a17fa640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 0x7f048c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.125+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f04940bebb0 con 0x7f04a41007f0 2024-09-20T19:13:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.125+0000 7f04a37fe640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 0x7f048c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.125+0000 7f04a37fe640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 0x7f048c07d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04a4198fa0 tx=0x7f049800b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.129+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04940c5080 con 0x7f04a41007f0 2024-09-20T19:13:44.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.337+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f04a4198190 con 0x7f048c07af40 2024-09-20T19:13:44.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.338+0000 7f04a17fa640 1 -- 172.21.15.27:0/905515269 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f04a4198190 con 0x7f048c07af40 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 msgr2=0x7f048c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 0x7f048c07d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04a4198fa0 tx=0x7f049800b410 comp rx=0 tx=0).stop 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 msgr2=0x7f04a419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0494031460 tx=0x7f04940045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 shutdown_connections 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f048c07af40 0x7f048c07d400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04a41067f0 0x7f04a419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 --2- 172.21.15.27:0/905515269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04a41007f0 0x7f04a419d680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.340+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 >> 172.21.15.27:0/905515269 conn(0x7f04a40fc550 msgr2=0x7f04a4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.341+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 shutdown_connections 2024-09-20T19:13:44.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.341+0000 7f04aa77e640 1 -- 172.21.15.27:0/905515269 wait complete. 2024-09-20T19:13:44.352 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:13:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 -- 172.21.15.27:0/622513550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 msgr2=0x7f71cc100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 --2- 172.21.15.27:0/622513550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc100c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009880 tx=0x7f71c802a530 comp rx=0 tx=0).stop 2024-09-20T19:13:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 -- 172.21.15.27:0/622513550 shutdown_connections 2024-09-20T19:13:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 --2- 172.21.15.27:0/622513550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc1056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 --2- 172.21.15.27:0/622513550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc100c90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 -- 172.21.15.27:0/622513550 >> 172.21.15.27:0/622513550 conn(0x7f71cc0fc520 msgr2=0x7f71cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.426+0000 7f71d3613640 1 -- 172.21.15.27:0/622513550 shutdown_connections 2024-09-20T19:13:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.427+0000 7f71d3613640 1 -- 172.21.15.27:0/622513550 wait complete. 2024-09-20T19:13:44.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.427+0000 7f71d3613640 1 Processor -- start 2024-09-20T19:13:44.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.427+0000 7f71d3613640 1 -- start start 2024-09-20T19:13:44.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.427+0000 7f71d3613640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.427+0000 7f71d3613640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc19e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d3613640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc1153d0 con 0x7f71cc1008b0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d3613640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc115250 con 0x7f71cc1011d0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57334/0 (socket says 172.21.15.27:57334) 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 -- 172.21.15.27:0/3689540188 learned_addr learned my addr 172.21.15.27:0/3689540188 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d0bae640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc19e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 -- 172.21.15.27:0/3689540188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 msgr2=0x7f71cc19e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc19e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 -- 172.21.15.27:0/3689540188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc1a2980 con 0x7f71cc1008b0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d0bae640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71d13af640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f71c8031460 tx=0x7f71c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.428+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71c803f070 con 0x7f71cc1008b0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.429+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc1a2c10 con 0x7f71cc1008b0 2024-09-20T19:13:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.429+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71c8004b10 con 0x7f71cc1008b0 2024-09-20T19:13:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.429+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc1a3140 con 0x7f71cc1008b0 2024-09-20T19:13:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.429+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71c8035030 con 0x7f71cc1008b0 2024-09-20T19:13:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.430+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc06aa90 con 0x7f71cc1008b0 2024-09-20T19:13:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.431+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f71c8042070 con 0x7f71cc1008b0 2024-09-20T19:13:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.431+0000 7f71c27fc640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 0x7f71b807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.431+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f71c80bec30 con 0x7f71cc1008b0 2024-09-20T19:13:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.431+0000 7f71d0bae640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 0x7f71b807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.432+0000 7f71d0bae640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 0x7f71b807d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0058c0 tx=0x7f71bc005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.436+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71c808a120 con 0x7f71cc1008b0 2024-09-20T19:13:44.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.640+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f71cc19f410 con 0x7f71b807af40 2024-09-20T19:13:44.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.642+0000 7f71c27fc640 1 -- 172.21.15.27:0/3689540188 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f71cc19f410 con 0x7f71b807af40 2024-09-20T19:13:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 msgr2=0x7f71b807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 0x7f71b807d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0058c0 tx=0x7f71bc005850 comp rx=0 tx=0).stop 2024-09-20T19:13:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 msgr2=0x7f71cc19e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f71c8031460 tx=0x7f71c80045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 shutdown_connections 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71b807af40 0x7f71b807d400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71cc1011d0 0x7f71cc19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 --2- 172.21.15.27:0/3689540188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71cc1008b0 0x7f71cc19e0b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 >> 172.21.15.27:0/3689540188 conn(0x7f71cc0fc520 msgr2=0x7f71cc112b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 shutdown_connections 2024-09-20T19:13:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.644+0000 7f71d3613640 1 -- 172.21.15.27:0/3689540188 wait complete. 2024-09-20T19:13:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 -- 172.21.15.27:0/2145288668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 msgr2=0x7f61c0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 --2- 172.21.15.27:0/2145288668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c0100c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009880 tx=0x7f61a802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 -- 172.21.15.27:0/2145288668 shutdown_connections 2024-09-20T19:13:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 --2- 172.21.15.27:0/2145288668 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c0100c50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 --2- 172.21.15.27:0/2145288668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 0x7f61c0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.732 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:44 smithi027 ceph-mon[110082]: pgmap v241: 65 pgs: 10 active+undersized, 10 active+undersized+degraded, 45 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/282 objects degraded (12.411%) 2024-09-20T19:13:44.732 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:44 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 35/282 objects degraded (12.411%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 -- 172.21.15.27:0/2145288668 >> 172.21.15.27:0/2145288668 conn(0x7f61c00fc550 msgr2=0x7f61c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 -- 172.21.15.27:0/2145288668 shutdown_connections 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.728+0000 7f61c631f640 1 -- 172.21.15.27:0/2145288668 wait complete. 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 Processor -- start 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 -- start start 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 0x7f61c019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f61c010dca0 con 0x7f61c01007f0 2024-09-20T19:13:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61c631f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61c010db20 con 0x7f61c01067f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61bffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61bffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57358/0 (socket says 172.21.15.27:57358) 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61bffff640 1 -- 172.21.15.27:0/1351713075 learned_addr learned my addr 172.21.15.27:0/1351713075 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.729+0000 7f61b7fff640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 0x7f61c019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bffff640 1 -- 172.21.15.27:0/1351713075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 msgr2=0x7f61c019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bffff640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 0x7f61c019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bffff640 1 -- 172.21.15.27:0/1351713075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c0197780 con 0x7f61c01007f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bffff640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61b000d8d0 tx=0x7f61b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61b0017030 con 0x7f61c01007f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c0197a70 con 0x7f61c01007f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c0197fd0 con 0x7f61c01007f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61b0004020 con 0x7f61c01007f0 2024-09-20T19:13:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.730+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61b00047a0 con 0x7f61c01007f0 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.731+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a0005290 con 0x7f61c01007f0 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.732+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f61b00041d0 con 0x7f61c01007f0 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.732+0000 7f61bdffb640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 0x7f61ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.733+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f61b0018070 con 0x7f61c01007f0 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.733+0000 7f61b7fff640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 0x7f61ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:44.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.733+0000 7f61b7fff640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 0x7f61ac07d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61c0198ad0 tx=0x7f61a8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.737+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61b00692a0 con 0x7f61c01007f0 2024-09-20T19:13:44.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.937+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f61a0000bc0 con 0x7f61ac07af80 2024-09-20T19:13:44.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.947+0000 7f61bdffb640 1 -- 172.21.15.27:0/1351713075 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f61a0000bc0 con 0x7f61ac07af80 2024-09-20T19:13:44.949 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:13:44.949 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (5m) 81s ago 15m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (7m) 81s ago 16m 8660k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (7m) 10s ago 15m 8896k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (3m) 81s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (3m) 10s ago 15m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (4m) 81s ago 15m 74.8M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (10m) 81s ago 10m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (10m) 81s ago 10m 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (10m) 10s ago 10m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (10m) 10s ago 10m 18.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (6m) 81s ago 17m 526M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (6m) 10s ago 15m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (3m) 81s ago 17m 44.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:13:44.950 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (3m) 10s ago 15m 39.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (5m) 81s ago 16m 11.0M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 10s ago 15m 11.3M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (2m) 81s ago 13m 123M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (2m) 81s ago 13m 82.5M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (86s) 81s ago 12m 12.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (49s) 10s ago 12m 85.7M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (13s) 10s ago 12m 12.7M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (11m) 10s ago 11m 211M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 246509c2a603 2024-09-20T19:13:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (5m) 81s ago 15m 56.6M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 msgr2=0x7f61ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 0x7f61ac07d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61c0198ad0 tx=0x7f61a8031400 comp rx=0 tx=0).stop 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 msgr2=0x7f61c019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61b000d8d0 tx=0x7f61b000dd90 comp rx=0 tx=0).stop 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 shutdown_connections 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f61ac07af80 0x7f61ac07d440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01067f0 0x7f61c019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 --2- 172.21.15.27:0/1351713075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61c01007f0 0x7f61c019d600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 >> 172.21.15.27:0/1351713075 conn(0x7f61c00fc550 msgr2=0x7f61c0069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 shutdown_connections 2024-09-20T19:13:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:44.949+0000 7f61c631f640 1 -- 172.21.15.27:0/1351713075 wait complete. 2024-09-20T19:13:44.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:44 smithi098 ceph-mon[80954]: pgmap v241: 65 pgs: 10 active+undersized, 10 active+undersized+degraded, 45 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/282 objects degraded (12.411%) 2024-09-20T19:13:44.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:44 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 35/282 objects degraded (12.411%), 10 pgs degraded (PG_DEGRADED) 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 -- 172.21.15.27:0/3463300778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4107900 msgr2=0x7f90b4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 --2- 172.21.15.27:0/3463300778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4107900 0x7f90b4107ce0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009880 tx=0x7f90a402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 -- 172.21.15.27:0/3463300778 shutdown_connections 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 --2- 172.21.15.27:0/3463300778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4101900 0x7f90b4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 --2- 172.21.15.27:0/3463300778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4107900 0x7f90b4107ce0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 -- 172.21.15.27:0/3463300778 >> 172.21.15.27:0/3463300778 conn(0x7f90b40fd600 msgr2=0x7f90b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 -- 172.21.15.27:0/3463300778 shutdown_connections 2024-09-20T19:13:45.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.032+0000 7f90ba21a640 1 -- 172.21.15.27:0/3463300778 wait complete. 2024-09-20T19:13:45.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 Processor -- start 2024-09-20T19:13:45.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 -- start start 2024-09-20T19:13:45.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 0x7f90b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410edd0 con 0x7f90b4101900 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.033+0000 7f90ba21a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410ec50 con 0x7f90b4107900 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57384/0 (socket says 172.21.15.27:57384) 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 -- 172.21.15.27:0/4095982977 learned_addr learned my addr 172.21.15.27:0/4095982977 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b2ffd640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 0x7f90b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 -- 172.21.15.27:0/4095982977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 msgr2=0x7f90b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 0x7f90b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 -- 172.21.15.27:0/4095982977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b4074f70 con 0x7f90b4101900 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b2ffd640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 0x7f90b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:45.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b37fe640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a4031460 tx=0x7f90a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90a403f070 con 0x7f90b4101900 2024-09-20T19:13:45.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b4075200 con 0x7f90b4101900 2024-09-20T19:13:45.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90a40035f0 con 0x7f90b4101900 2024-09-20T19:13:45.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.034+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90a4035030 con 0x7f90b4101900 2024-09-20T19:13:45.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.035+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b41a3d40 con 0x7f90b4101900 2024-09-20T19:13:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.036+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b4103040 con 0x7f90b4101900 2024-09-20T19:13:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.036+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f90a4042070 con 0x7f90b4101900 2024-09-20T19:13:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.037+0000 7f90b0ff9640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 0x7f909c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.037+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f90a40beac0 con 0x7f90b4101900 2024-09-20T19:13:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.037+0000 7f90b2ffd640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 0x7f909c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.037+0000 7f90b2ffd640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 0x7f909c07d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90a80058c0 tx=0x7f90a8005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.042+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90a4089fb0 con 0x7f90b4101900 2024-09-20T19:13:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.305+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f90b4109e70 con 0x7f90b4101900 2024-09-20T19:13:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.306+0000 7f90b0ff9640 1 -- 172.21.15.27:0/4095982977 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f90a408ee60 con 0x7f90b4101900 2024-09-20T19:13:45.308 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 5 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:13:45.309 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 5, 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 9 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:13:45.310 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 msgr2=0x7f909c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 0x7f909c07d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90a80058c0 tx=0x7f90a8005850 comp rx=0 tx=0).stop 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 msgr2=0x7f90b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a4031460 tx=0x7f90a40045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 shutdown_connections 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f909c07af30 0x7f909c07d3f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b4107900 0x7f90b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 --2- 172.21.15.27:0/4095982977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90b4101900 0x7f90b40744f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 >> 172.21.15.27:0/4095982977 conn(0x7f90b40fd600 msgr2=0x7f90b40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 shutdown_connections 2024-09-20T19:13:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.308+0000 7f90ba21a640 1 -- 172.21.15.27:0/4095982977 wait complete. 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 -- 172.21.15.27:0/1700508700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 msgr2=0x7f4be4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 --2- 172.21.15.27:0/1700508700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be4102ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009880 tx=0x7f4bd402a530 comp rx=0 tx=0).stop 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 -- 172.21.15.27:0/1700508700 shutdown_connections 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 --2- 172.21.15.27:0/1700508700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 0x7f4be410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 --2- 172.21.15.27:0/1700508700 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be4102ea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 -- 172.21.15.27:0/1700508700 >> 172.21.15.27:0/1700508700 conn(0x7f4be40fc520 msgr2=0x7f4be40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 -- 172.21.15.27:0/1700508700 shutdown_connections 2024-09-20T19:13:45.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.392+0000 7f4be8a27640 1 -- 172.21.15.27:0/1700508700 wait complete. 2024-09-20T19:13:45.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 Processor -- start 2024-09-20T19:13:45.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 -- start start 2024-09-20T19:13:45.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 0x7f4be419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410edd0 con 0x7f4be4102ac0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.393+0000 7f4be8a27640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410ec50 con 0x7f4be41033e0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51626/0 (socket says 172.21.15.27:51626) 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 -- 172.21.15.27:0/3394060524 learned_addr learned my addr 172.21.15.27:0/3394060524 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be1d9b640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 0x7f4be419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 -- 172.21.15.27:0/3394060524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 msgr2=0x7f4be419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 0x7f4be419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 -- 172.21.15.27:0/3394060524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be41977c0 con 0x7f4be4102ac0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be259c640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031460 tx=0x7f4bd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bd403f070 con 0x7f4be4102ac0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be4197a50 con 0x7f4be4102ac0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bd4004cf0 con 0x7f4be4102ac0 2024-09-20T19:13:45.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bd4035030 con 0x7f4be4102ac0 2024-09-20T19:13:45.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.394+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be4197f80 con 0x7f4be4102ac0 2024-09-20T19:13:45.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.395+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be406aa90 con 0x7f4be4102ac0 2024-09-20T19:13:45.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.396+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4bd4042070 con 0x7f4be4102ac0 2024-09-20T19:13:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.397+0000 7f4bd37fe640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 0x7f4bcc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.397+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f4bd40beb20 con 0x7f4be4102ac0 2024-09-20T19:13:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.397+0000 7f4be1d9b640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 0x7f4bcc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.397+0000 7f4be1d9b640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 0x7f4bcc07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4be4108900 tx=0x7f4bd800a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.401+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bd408a010 con 0x7f4be4102ac0 2024-09-20T19:13:45.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:45 smithi027 ceph-mon[110082]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:45.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:45 smithi027 ceph-mon[110082]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:45.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:45 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/4095982977' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:45.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.638+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4be4198cf0 con 0x7f4be4102ac0 2024-09-20T19:13:45.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.639+0000 7f4bd37fe640 1 -- 172.21.15.27:0/3394060524 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2043 (secure 0 0 0) 0x7f4bd408eec0 con 0x7f4be4102ac0 2024-09-20T19:13:45.641 INFO:teuthology.orchestra.run.smithi027.stdout:e16 2024-09-20T19:13:45.641 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:03:23:519637+0000 2024-09-20T19:13:45.641 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 16 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:03:23.519617+0000 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:13:45.642 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 47 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:13:45.643 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.27:6828/1555909616,v1:172.21.15.27:6829/1555909616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:13:45.644 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:14594} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/3242536468,v1:172.21.15.27:6827/3242536468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:45.645 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:45.645 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 16 2024-09-20T19:13:45.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 msgr2=0x7f4bcc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 0x7f4bcc07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4be4108900 tx=0x7f4bd800a250 comp rx=0 tx=0).stop 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 msgr2=0x7f4be419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031460 tx=0x7f4bd40048f0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 shutdown_connections 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f4bcc07af30 0x7f4bcc07d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be41033e0 0x7f4be419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 --2- 172.21.15.27:0/3394060524 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4be4102ac0 0x7f4be419d640 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 >> 172.21.15.27:0/3394060524 conn(0x7f4be40fc520 msgr2=0x7f4be4108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 shutdown_connections 2024-09-20T19:13:45.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.641+0000 7f4be8a27640 1 -- 172.21.15.27:0/3394060524 wait complete. 2024-09-20T19:13:45.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.726+0000 7f1ccceb1640 1 -- 172.21.15.27:0/4008177930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100c00 msgr2=0x7f1cc8104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.726+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/4008177930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100c00 0x7f1cc8104c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009880 tx=0x7f1cbc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 -- 172.21.15.27:0/4008177930 shutdown_connections 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/4008177930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100c00 0x7f1cc8104c50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/4008177930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100250 0x7f1cc8100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 -- 172.21.15.27:0/4008177930 >> 172.21.15.27:0/4008177930 conn(0x7f1cc80fbc90 msgr2=0x7f1cc80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 -- 172.21.15.27:0/4008177930 shutdown_connections 2024-09-20T19:13:45.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 -- 172.21.15.27:0/4008177930 wait complete. 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 Processor -- start 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.727+0000 7f1ccceb1640 1 -- start start 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1ccceb1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1ccceb1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 0x7f1cc80fc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1ccceb1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc810d4d0 con 0x7f1cc8100250 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1ccceb1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc810d350 con 0x7f1cc8100c00 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51644/0 (socket says 172.21.15.27:51644) 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 -- 172.21.15.27:0/1934910252 learned_addr learned my addr 172.21.15.27:0/1934910252 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc5d9b640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 0x7f1cc80fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 -- 172.21.15.27:0/1934910252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 msgr2=0x7f1cc80fc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 0x7f1cc80fc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 -- 172.21.15.27:0/1934910252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc80fcbc0 con 0x7f1cc8100250 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc5d9b640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 0x7f1cc80fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.728+0000 7f1cc659c640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d6f0 tx=0x7f1cb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.729+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cb8017070 con 0x7f1cc8100250 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.729+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc80fceb0 con 0x7f1cc8100250 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.729+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cb800de00 con 0x7f1cc8100250 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.729+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cb8004bb0 con 0x7f1cc8100250 2024-09-20T19:13:45.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.729+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc81a3f10 con 0x7f1cc8100250 2024-09-20T19:13:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.730+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc8101730 con 0x7f1cc8100250 2024-09-20T19:13:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.730+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1cb8004e60 con 0x7f1cc8100250 2024-09-20T19:13:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.731+0000 7f1cb77fe640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.731+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7f1cb809dd60 con 0x7f1cc8100250 2024-09-20T19:13:45.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.731+0000 7f1cc5d9b640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:45.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.732+0000 7f1cc5d9b640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 0x7f1cb007d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80fdbd0 tx=0x7f1cbc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:45.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.735+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cb8069250 con 0x7f1cc8100250 2024-09-20T19:13:45.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.943+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1cc8102330 con 0x7f1cb007af30 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.945+0000 7f1cb77fe640 1 -- 172.21.15.27:0/1934910252 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f1cc8102330 con 0x7f1cb007af30 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:13:45.947 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr" 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "11/23 daemons upgraded", 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:13:45.948 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:13:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 msgr2=0x7f1cb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 0x7f1cb007d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80fdbd0 tx=0x7f1cbc031400 comp rx=0 tx=0).stop 2024-09-20T19:13:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 msgr2=0x7f1cc80fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d6f0 tx=0x7f1cb800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 shutdown_connections 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cc8100c00 0x7f1cc80fc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 --2- 172.21.15.27:0/1934910252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cc8100250 0x7f1cc80fc140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 >> 172.21.15.27:0/1934910252 conn(0x7f1cc80fbc90 msgr2=0x7f1cc8101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 shutdown_connections 2024-09-20T19:13:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:45.947+0000 7f1ccceb1640 1 -- 172.21.15.27:0/1934910252 wait complete. 2024-09-20T19:13:45.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:45 smithi098 ceph-mon[80954]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:45.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:45 smithi098 ceph-mon[80954]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:45.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:45 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/4095982977' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:46.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 -- 172.21.15.27:0/3292860910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 msgr2=0x7fd2e010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:46.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 --2- 172.21.15.27:0/3292860910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e010b8d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009880 tx=0x7fd2d402a530 comp rx=0 tx=0).stop 2024-09-20T19:13:46.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 -- 172.21.15.27:0/3292860910 shutdown_connections 2024-09-20T19:13:46.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 --2- 172.21.15.27:0/3292860910 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e010b8d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 --2- 172.21.15.27:0/3292860910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 -- 172.21.15.27:0/3292860910 >> 172.21.15.27:0/3292860910 conn(0x7fd2e00fc520 msgr2=0x7fd2e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:46.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 -- 172.21.15.27:0/3292860910 shutdown_connections 2024-09-20T19:13:46.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.042+0000 7fd2e76df640 1 -- 172.21.15.27:0/3292860910 wait complete. 2024-09-20T19:13:46.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 Processor -- start 2024-09-20T19:13:46.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 -- start start 2024-09-20T19:13:46.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 0x7fd2e019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:46.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:46.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010edf0 con 0x7fd2e01033e0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e76df640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010ec70 con 0x7fd2e0102ac0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e4c7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e4c7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51662/0 (socket says 172.21.15.27:51662) 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e4c7a640 1 -- 172.21.15.27:0/2665333791 learned_addr learned my addr 172.21.15.27:0/2665333791 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.043+0000 7fd2e547b640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 0x7fd2e019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e4c7a640 1 -- 172.21.15.27:0/2665333791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 msgr2=0x7fd2e019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e4c7a640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 0x7fd2e019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e4c7a640 1 -- 172.21.15.27:0/2665333791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e0197800 con 0x7fd2e01033e0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e4c7a640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4031460 tx=0x7fd2d4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2d403f070 con 0x7fd2e01033e0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e0197a90 con 0x7fd2e01033e0 2024-09-20T19:13:46.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2d40035f0 con 0x7fd2e01033e0 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2d4035030 con 0x7fd2e01033e0 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.044+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e0197fc0 con 0x7fd2e01033e0 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.045+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e006aa90 con 0x7fd2e01033e0 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.046+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd2d4042070 con 0x7fd2e01033e0 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.046+0000 7fd2d27fc640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:46.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.046+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6417+0+0 (secure 0 0 0) 0x7fd2d40bea10 con 0x7fd2e01033e0 2024-09-20T19:13:46.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.046+0000 7fd2e547b640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:46.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.047+0000 7fd2e547b640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005fd0 tx=0x7fd2dc00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:46.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.051+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2d4089f00 con 0x7fd2e01033e0 2024-09-20T19:13:46.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.312+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd2e0105f60 con 0x7fd2e01033e0 2024-09-20T19:13:46.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.313+0000 7fd2d27fc640 1 -- 172.21.15.27:0/2665333791 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fd2d408edb0 con 0x7fd2e01033e0 2024-09-20T19:13:46.316 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:46.316 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:46.316 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:13:46.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 msgr2=0x7fd2cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005fd0 tx=0x7fd2dc00b390 comp rx=0 tx=0).stop 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 msgr2=0x7fd2e019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4031460 tx=0x7fd2d4004530 comp rx=0 tx=0).stop 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 shutdown_connections 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2e01033e0 0x7fd2e019dbc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 --2- 172.21.15.27:0/2665333791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2e0102ac0 0x7fd2e019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 >> 172.21.15.27:0/2665333791 conn(0x7fd2e00fc520 msgr2=0x7fd2e0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 shutdown_connections 2024-09-20T19:13:46.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:13:46.315+0000 7fd2e76df640 1 -- 172.21.15.27:0/2665333791 wait complete. 2024-09-20T19:13:46.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:46 smithi027 ceph-mon[110082]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:46.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:46 smithi027 ceph-mon[110082]: pgmap v242: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-20T19:13:46.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:46 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/282 objects degraded (12.411%), 10 pgs degraded) 2024-09-20T19:13:46.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:46 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3394060524' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:46.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:46 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2665333791' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:46.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:46 smithi098 ceph-mon[80954]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:46.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:46 smithi098 ceph-mon[80954]: pgmap v242: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-20T19:13:46.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:46 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/282 objects degraded (12.411%), 10 pgs degraded) 2024-09-20T19:13:46.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:46 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3394060524' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:46.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:46 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2665333791' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:47.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:47 smithi027 ceph-mon[110082]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:47.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:47 smithi098 ceph-mon[80954]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:48 smithi027 ceph-mon[110082]: pgmap v243: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 386 B/s rd, 0 op/s 2024-09-20T19:13:48.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:48 smithi098 ceph-mon[80954]: pgmap v243: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 386 B/s rd, 0 op/s 2024-09-20T19:13:50.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:50 smithi027 ceph-mon[110082]: pgmap v244: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 916 B/s rd, 1 op/s 2024-09-20T19:13:50.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:50 smithi098 ceph-mon[80954]: pgmap v244: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 916 B/s rd, 1 op/s 2024-09-20T19:13:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:52 smithi027 ceph-mon[110082]: pgmap v245: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s 2024-09-20T19:13:52.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:52 smithi098 ceph-mon[80954]: pgmap v245: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s 2024-09-20T19:13:53.912 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:53 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:53.912 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:53 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T19:13:54.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:53 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:54.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:53 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T19:13:54.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:54 smithi098 ceph-mon[80954]: pgmap v246: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 686 B/s rd, 1 op/s 2024-09-20T19:13:54.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:54 smithi098 ceph-mon[80954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T19:13:54.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:54 smithi098 ceph-mon[80954]: Upgrade: osd.5 is safe to restart 2024-09-20T19:13:54.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:54 smithi027 ceph-mon[110082]: pgmap v246: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 686 B/s rd, 1 op/s 2024-09-20T19:13:54.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:54 smithi027 ceph-mon[110082]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T19:13:54.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:54 smithi027 ceph-mon[110082]: Upgrade: osd.5 is safe to restart 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: Upgrade: Updating osd.5 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: Deploying daemon osd.5 on smithi098 2024-09-20T19:13:56.126 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:55 smithi098 ceph-mon[80954]: pgmap v247: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T19:13:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: Upgrade: Updating osd.5 2024-09-20T19:13:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-20T19:13:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:13:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: Deploying daemon osd.5 on smithi098 2024-09-20T19:13:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:55 smithi027 ceph-mon[110082]: pgmap v247: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T19:13:57.980 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:57 smithi098 systemd[1]: Stopping Ceph osd.5 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:13:58.472 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:13:58.003+0000 7f7829eaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:13:58.472 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:13:58.003+0000 7f7829eaa640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-20T19:13:58.472 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[55178]: 2024-09-20T19:13:58.003+0000 7f7829eaa640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:13:58.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:58 smithi027 ceph-mon[110082]: pgmap v248: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:58.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:58 smithi027 ceph-mon[110082]: osd.5 marked itself down and dead 2024-09-20T19:13:58.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-mon[80954]: pgmap v248: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:13:58.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:13:58.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:58.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:58 smithi098 ceph-mon[80954]: osd.5 marked itself down and dead 2024-09-20T19:13:59.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:58 smithi098 podman[97958]: 2024-09-20 19:13:58.948045782 +0000 UTC m=+1.069338830 container died 246509c2a603c26c163b10172abb05dcf5035a696ded0f802c1677711ea48e58 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:13:59.541 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:59 smithi098 podman[97958]: 2024-09-20 19:13:59.362185415 +0000 UTC m=+1.483478456 container cleanup 246509c2a603c26c163b10172abb05dcf5035a696ded0f802c1677711ea48e58 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:13:59.541 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:59 smithi098 bash[97958]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5 2024-09-20T19:13:59.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:59 smithi027 ceph-mon[110082]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:13:59.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:13:59 smithi027 ceph-mon[110082]: osdmap e85: 6 total, 5 up, 6 in 2024-09-20T19:13:59.898 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:59 smithi098 ceph-mon[80954]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T19:13:59.898 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:13:59 smithi098 ceph-mon[80954]: osdmap e85: 6 total, 5 up, 6 in 2024-09-20T19:13:59.898 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:59 smithi098 podman[97986]: 2024-09-20 19:13:59.588017476 +0000 UTC m=+0.636826072 container remove 246509c2a603c26c163b10172abb05dcf5035a696ded0f802c1677711ea48e58 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-20T19:14:00.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:59 smithi098 podman[98073]: 2024-09-20 19:13:59.79972902 +0000 UTC m=+0.015963901 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:14:00.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:13:59 smithi098 podman[98073]: 2024-09-20 19:13:59.914531351 +0000 UTC m=+0.130766268 container create 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-20T19:14:00.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 podman[98073]: 2024-09-20 19:14:00.142004355 +0000 UTC m=+0.358239236 container init 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True) 2024-09-20T19:14:00.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 podman[98073]: 2024-09-20 19:14:00.145260408 +0000 UTC m=+0.361495287 container start 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True) 2024-09-20T19:14:00.543 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 podman[98073]: 2024-09-20 19:14:00.22507699 +0000 UTC m=+0.441311877 container attach 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-20T19:14:00.543 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 podman[98073]: 2024-09-20 19:14:00.339337145 +0000 UTC m=+0.555572018 container died 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:14:00.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:00 smithi027 ceph-mon[110082]: pgmap v250: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s 2024-09-20T19:14:00.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:00 smithi027 ceph-mon[110082]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-20T19:14:00.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:00 smithi027 ceph-mon[110082]: osdmap e86: 6 total, 5 up, 6 in 2024-09-20T19:14:00.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:00 smithi098 ceph-mon[80954]: pgmap v250: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1 op/s 2024-09-20T19:14:00.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:00 smithi098 ceph-mon[80954]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-20T19:14:00.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:00 smithi098 ceph-mon[80954]: osdmap e86: 6 total, 5 up, 6 in 2024-09-20T19:14:01.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 podman[98096]: 2024-09-20 19:14:00.93733683 +0000 UTC m=+0.587371802 container remove 5842bcae8b50bca07c18fd26d71cf5cde87ac2510868f98afd39cd3d1ab5ce2f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-20T19:14:01.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-20T19:14:01.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 systemd[1]: Stopped Ceph osd.5 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:14:01.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:00 smithi098 systemd[1]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.5.service: Consumed 51.374s CPU time. 2024-09-20T19:14:01.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 systemd[1]: Starting Ceph osd.5 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:14:01.641 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 podman[98196]: 2024-09-20 19:14:01.290043111 +0000 UTC m=+0.015966686 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:14:01.641 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 podman[98196]: 2024-09-20 19:14:01.38811775 +0000 UTC m=+0.114041325 container create aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-20T19:14:01.641 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 podman[98196]: 2024-09-20 19:14:01.640151657 +0000 UTC m=+0.366075230 container init aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:14:01.949 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 podman[98196]: 2024-09-20 19:14:01.64364675 +0000 UTC m=+0.369570320 container start aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-20T19:14:01.950 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 podman[98196]: 2024-09-20 19:14:01.723182096 +0000 UTC m=+0.449105665 container attach aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:14:01.950 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:01.950 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 bash[98196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:01.950 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:01.950 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:01 smithi098 bash[98196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:02 smithi027 ceph-mon[110082]: pgmap v252: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:14:02.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:02 smithi098 ceph-mon[80954]: pgmap v252: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-20T19:14:03.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:03 smithi098 ceph-mon[80954]: Health check failed: Degraded data redundancy: 12/282 objects degraded (4.255%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:03.982 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:03 smithi027 ceph-mon[110082]: Health check failed: Degraded data redundancy: 12/282 objects degraded (4.255%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:04.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-mon[80954]: pgmap v253: 65 pgs: 4 active+undersized, 20 peering, 5 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 12/282 objects degraded (4.255%) 2024-09-20T19:14:04.972 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:14:04.972 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 bash[98196]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 bash[98196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 bash[98196]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 bash[98196]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-20T19:14:04.973 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:04 smithi098 bash[98196]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-20T19:14:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:04 smithi027 ceph-mon[110082]: pgmap v253: 65 pgs: 4 active+undersized, 20 peering, 5 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 12/282 objects degraded (4.255%) 2024-09-20T19:14:05.329 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-20T19:14:05.329 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 bash[98196]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-20T19:14:05.329 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-20T19:14:05.329 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 bash[98196]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 bash[98196]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 bash[98196]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate[98210]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 bash[98196]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-20T19:14:05.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 podman[98196]: 2024-09-20 19:14:05.050006582 +0000 UTC m=+3.775930154 container died aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-20T19:14:05.908 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:05 smithi098 ceph-mon[80954]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 9 pgs peering) 2024-09-20T19:14:05.909 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 podman[98427]: 2024-09-20 19:14:05.601809382 +0000 UTC m=+0.541294396 container remove aad7e7e2757c713c68d18c45825af4fbc684217641a5f7e4b487fd1cfc447dae (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:14:05.909 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 podman[98487]: 2024-09-20 19:14:05.802746047 +0000 UTC m=+0.102398519 container create 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-20T19:14:05.909 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:05 smithi098 podman[98487]: 2024-09-20 19:14:05.716188232 +0000 UTC m=+0.015840651 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:14:06.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:05 smithi027 ceph-mon[110082]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 9 pgs peering) 2024-09-20T19:14:06.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:06 smithi098 podman[98487]: 2024-09-20 19:14:06.030553873 +0000 UTC m=+0.330206286 container init 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T19:14:06.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:06 smithi098 podman[98487]: 2024-09-20 19:14:06.034394401 +0000 UTC m=+0.334046813 container start 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T19:14:06.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:06 smithi098 ceph-osd[98506]: -- 172.21.15.98:0/2622017314 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563cd412a1e0 con 0x563cd40ba000 2024-09-20T19:14:06.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:06 smithi098 bash[98487]: 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 2024-09-20T19:14:06.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:06 smithi098 systemd[1]: Started Ceph osd.5 for e7838b9c-7781-11ef-baf5-efdc52797490. 2024-09-20T19:14:06.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:06 smithi098 ceph-mon[80954]: pgmap v254: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:06.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:06.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:06.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:06 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:06.985 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:06 smithi027 ceph-mon[110082]: pgmap v254: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:06.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:06.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:06.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:06 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:07.722 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:07 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:14:07.652+0000 7f26dc768640 -1 Falling back to public interface 2024-09-20T19:14:08.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:08 smithi098 ceph-mon[80954]: pgmap v255: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:09.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:08 smithi027 ceph-mon[110082]: pgmap v255: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: pgmap v256: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 43/282 objects degraded (15.248%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.089 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:09 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: pgmap v256: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:10.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 43/282 objects degraded (15.248%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:10.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:10.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:09 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:12.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:12 smithi027 ceph-mon[110082]: pgmap v257: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:12.425 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:12 smithi098 ceph-mon[80954]: pgmap v257: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:13.222 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:12 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:14:12.917+0000 7f26dc768640 -1 osd.5 84 log_to_monitors true 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-20T19:14:13.819 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.820 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-20T19:14:13.974 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:14:13.564+0000 7f26d4512640 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T19:14:13.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:13.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.974 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T19:14:13.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:13.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-20T19:14:14.678 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all osd 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: pgmap v258: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: osdmap e87: 6 total, 5 up, 6 in 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:14.679 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.680 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:14 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all osd 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: pgmap v258: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: osdmap e87: 6 total, 5 up, 6 in 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-20T19:14:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:14.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:14 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390] boot 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: osdmap e88: 6 total, 6 up, 6 in 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6828/448016576,v1:172.21.15.27:6829/448016576] up:boot 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:14:15.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:15 smithi027 ceph-mon[110082]: osdmap e89: 6 total, 6 up, 6 in 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: osd.5 [v2:172.21.15.98:6816/1744387390,v1:172.21.15.98:6817/1744387390] boot 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: osdmap e88: 6 total, 6 up, 6 in 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6828/448016576,v1:172.21.15.27:6829/448016576] up:boot 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:14:15.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:15 smithi098 ceph-mon[80954]: osdmap e89: 6 total, 6 up, 6 in 2024-09-20T19:14:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.402+0000 7f70ecaa6640 1 -- 172.21.15.27:0/195666051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8102b60 msgr2=0x7f70e8102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.402+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/195666051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8102b60 0x7f70e8102f40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009880 tx=0x7f70d802a530 comp rx=0 tx=0).stop 2024-09-20T19:14:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 -- 172.21.15.27:0/195666051 shutdown_connections 2024-09-20T19:14:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/195666051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8103480 0x7f70e810b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/195666051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8102b60 0x7f70e8102f40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 -- 172.21.15.27:0/195666051 >> 172.21.15.27:0/195666051 conn(0x7f70e80fc520 msgr2=0x7f70e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 -- 172.21.15.27:0/195666051 shutdown_connections 2024-09-20T19:14:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 -- 172.21.15.27:0/195666051 wait complete. 2024-09-20T19:14:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 Processor -- start 2024-09-20T19:14:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.403+0000 7f70ecaa6640 1 -- start start 2024-09-20T19:14:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70ecaa6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8102b60 0x7f70e819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70ecaa6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70ecaa6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f70e810edf0 con 0x7f70e8103480 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70ecaa6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f70e810ec70 con 0x7f70e8102b60 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35946/0 (socket says 172.21.15.27:35946) 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 -- 172.21.15.27:0/1118075608 learned_addr learned my addr 172.21.15.27:0/1118075608 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e659c640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8102b60 0x7f70e819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 -- 172.21.15.27:0/1118075608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8102b60 msgr2=0x7f70e819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8102b60 0x7f70e819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 -- 172.21.15.27:0/1118075608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81999e0 con 0x7f70e8103480 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.404+0000 7f70e5d9b640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00d6f0 tx=0x7f70dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.405+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70dc017070 con 0x7f70e8103480 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.405+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e8199cd0 con 0x7f70e8103480 2024-09-20T19:14:16.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.405+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70dc00de00 con 0x7f70e8103480 2024-09-20T19:14:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.405+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70dc004bb0 con 0x7f70e8103480 2024-09-20T19:14:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.405+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e819a260 con 0x7f70e8103480 2024-09-20T19:14:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.406+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e806a9f0 con 0x7f70e8103480 2024-09-20T19:14:16.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.407+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f70dc004e60 con 0x7f70e8103480 2024-09-20T19:14:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.407+0000 7f70d77fe640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 0x7f70d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.407+0000 7f70e659c640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 0x7f70d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.407+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6417+0+0 (secure 0 0 0) 0x7f70dc09dcb0 con 0x7f70e8103480 2024-09-20T19:14:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.408+0000 7f70e659c640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 0x7f70d007d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:16.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.412+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70dc0691a0 con 0x7f70e8103480 2024-09-20T19:14:16.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.624+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f70e819af10 con 0x7f70d007af30 2024-09-20T19:14:16.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.626+0000 7f70d77fe640 1 -- 172.21.15.27:0/1118075608 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f70e819af10 con 0x7f70d007af30 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 msgr2=0x7f70d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 0x7f70d007d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8004f30 comp rx=0 tx=0).stop 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 msgr2=0x7f70e819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00d6f0 tx=0x7f70dc00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 shutdown_connections 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f70d007af30 0x7f70d007d3f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f70e8103480 0x7f70e819fd60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 --2- 172.21.15.27:0/1118075608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70e8102b60 0x7f70e819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 >> 172.21.15.27:0/1118075608 conn(0x7f70e80fc520 msgr2=0x7f70e8100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:16.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 shutdown_connections 2024-09-20T19:14:16.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.628+0000 7f70ecaa6640 1 -- 172.21.15.27:0/1118075608 wait complete. 2024-09-20T19:14:16.639 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:14:16.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- 172.21.15.27:0/1522349206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 msgr2=0x7fd0e8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1522349206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8102ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009c20 tx=0x7fd0d802aa00 comp rx=0 tx=0).stop 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- 172.21.15.27:0/1522349206 shutdown_connections 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1522349206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1522349206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8102ea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- 172.21.15.27:0/1522349206 >> 172.21.15.27:0/1522349206 conn(0x7fd0e80fc520 msgr2=0x7fd0e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- 172.21.15.27:0/1522349206 shutdown_connections 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- 172.21.15.27:0/1522349206 wait complete. 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 Processor -- start 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.715+0000 7fd0f0705640 1 -- start start 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0f0705640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0f0705640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0f0705640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e810ee50 con 0x7fd0e8102ac0 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0f0705640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e810ecd0 con 0x7fd0e81033e0 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35974/0 (socket says 172.21.15.27:35974) 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 -- 172.21.15.27:0/1534395326 learned_addr learned my addr 172.21.15.27:0/1534395326 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0edca0640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 -- 172.21.15.27:0/1534395326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 msgr2=0x7fd0e8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 -- 172.21.15.27:0/1534395326 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e81011a0 con 0x7fd0e8102ac0 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0edca0640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:16.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0ee4a1640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005cc0 tx=0x7fd0d802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0d8047070 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.716+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e8101430 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.717+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0d8003e30 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.717+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0d8033050 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.717+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e81a3ec0 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.718+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e806aa90 con 0x7fd0e8102ac0 2024-09-20T19:14:16.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.718+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd0d804a070 con 0x7fd0e8102ac0 2024-09-20T19:14:16.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.719+0000 7fd0e77fe640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 0x7fd0d007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:16.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.719+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6417+0+0 (secure 0 0 0) 0x7fd0d803e030 con 0x7fd0e8102ac0 2024-09-20T19:14:16.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.719+0000 7fd0edca0640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 0x7fd0d007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:16.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.719+0000 7fd0edca0640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 0x7fd0d007d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81021b0 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:16.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.723+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0d808a870 con 0x7fd0e8102ac0 2024-09-20T19:14:16.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.928+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd0e8062630 con 0x7fd0d007af40 2024-09-20T19:14:16.930 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: pgmap v261: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:16.931 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: Upgrade: Updating mds.cephfs.smithi027.paximv 2024-09-20T19:14:16.931 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:16.931 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:16.931 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:16.931 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:16 smithi027 ceph-mon[110082]: Deploying daemon mds.cephfs.smithi027.paximv on smithi027 2024-09-20T19:14:16.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.929+0000 7fd0e77fe640 1 -- 172.21.15.27:0/1534395326 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fd0e8062630 con 0x7fd0d007af40 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 msgr2=0x7fd0d007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 0x7fd0d007d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81021b0 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 msgr2=0x7fd0e8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005cc0 tx=0x7fd0d802ee60 comp rx=0 tx=0).stop 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 shutdown_connections 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0d007af40 0x7fd0d007d400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0e81033e0 0x7fd0e8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 --2- 172.21.15.27:0/1534395326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e8102ac0 0x7fd0e8100720 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 >> 172.21.15.27:0/1534395326 conn(0x7fd0e80fc520 msgr2=0x7fd0e8103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:16.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 shutdown_connections 2024-09-20T19:14:16.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:16.931+0000 7fd0f0705640 1 -- 172.21.15.27:0/1534395326 wait complete. 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: pgmap v261: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 43/282 objects degraded (15.248%) 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: Upgrade: Updating mds.cephfs.smithi027.paximv 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.paximv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:16.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:16 smithi098 ceph-mon[80954]: Deploying daemon mds.cephfs.smithi027.paximv on smithi027 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 -- 172.21.15.27:0/3963558678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901007f0 msgr2=0x7f8790100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 --2- 172.21.15.27:0/3963558678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901007f0 0x7f8790100c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8780009880 tx=0x7f878002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 -- 172.21.15.27:0/3963558678 shutdown_connections 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 --2- 172.21.15.27:0/3963558678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901007f0 0x7f8790100c50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 --2- 172.21.15.27:0/3963558678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901067f0 0x7f8790106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 -- 172.21.15.27:0/3963558678 >> 172.21.15.27:0/3963558678 conn(0x7f87900fc550 msgr2=0x7f87900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 -- 172.21.15.27:0/3963558678 shutdown_connections 2024-09-20T19:14:17.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.018+0000 7f87972c7640 1 -- 172.21.15.27:0/3963558678 wait complete. 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 Processor -- start 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 -- start start 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901007f0 0x7f87901987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f879010dca0 con 0x7f87901067f0 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f87972c7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f879010db20 con 0x7f87901007f0 2024-09-20T19:14:17.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.019+0000 7f8794862640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35992/0 (socket says 172.21.15.27:35992) 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 -- 172.21.15.27:0/3425301117 learned_addr learned my addr 172.21.15.27:0/3425301117 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8795063640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901007f0 0x7f87901987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 -- 172.21.15.27:0/3425301117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901007f0 msgr2=0x7f87901987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901007f0 0x7f87901987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 -- 172.21.15.27:0/3425301117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8790199260 con 0x7f87901067f0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f8794862640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8780031460 tx=0x7f87800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f878003f070 con 0x7f87901067f0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8780004cf0 con 0x7f87901067f0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8780035030 con 0x7f87901067f0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87901994f0 con 0x7f87901067f0 2024-09-20T19:14:17.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.020+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87901a1aa0 con 0x7f87901067f0 2024-09-20T19:14:17.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.021+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8790101f30 con 0x7f87901067f0 2024-09-20T19:14:17.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.022+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8780042070 con 0x7f87901067f0 2024-09-20T19:14:17.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.023+0000 7f87867fc640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 0x7f877c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.023+0000 7f8795063640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 0x7f877c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.023+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6417+0+0 (secure 0 0 0) 0x7f87800bea20 con 0x7f87901067f0 2024-09-20T19:14:17.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.023+0000 7f8795063640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 0x7f877c07d440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f878c00abe0 tx=0x7f878c00a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.027+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8780089f90 con 0x7f87901067f0 2024-09-20T19:14:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.234+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f87900fd460 con 0x7f877c07af80 2024-09-20T19:14:17.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.245+0000 7f87867fc640 1 -- 172.21.15.27:0/3425301117 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f87900fd460 con 0x7f877c07af80 2024-09-20T19:14:17.247 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:14:17.247 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (5m) 113s ago 16m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:14:17.247 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (7m) 113s ago 16m 8660k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:14:17.247 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (7m) 8s ago 15m 9034k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (3m) 113s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (3m) 8s ago 15m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (5m) 113s ago 16m 74.8M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (11m) 113s ago 11m 93.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab dc97e69b776c 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (11m) 113s ago 11m 17.4M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0d16e29ead1a 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (11m) 8s ago 11m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (10m) 8s ago 10m 18.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (7m) 113s ago 17m 526M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (6m) 8s ago 15m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (4m) 113s ago 18m 44.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (3m) 8s ago 15m 39.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (6m) 113s ago 16m 11.0M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:14:17.248 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 8s ago 15m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (3m) 113s ago 14m 123M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (2m) 113s ago 13m 82.5M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (119s) 113s ago 13m 12.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (81s) 8s ago 13m 85.4M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (46s) 8s ago 12m 82.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (11s) 8s ago 12m 11.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:14:17.249 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (5m) 113s ago 16m 56.6M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 msgr2=0x7f877c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 0x7f877c07d440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f878c00abe0 tx=0x7f878c00a2d0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 msgr2=0x7f8790198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8780031460 tx=0x7f87800048f0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 shutdown_connections 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f877c07af80 0x7f877c07d440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87901067f0 0x7f8790198cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 --2- 172.21.15.27:0/3425301117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87901007f0 0x7f87901987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 >> 172.21.15.27:0/3425301117 conn(0x7f87900fc550 msgr2=0x7f87900fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 shutdown_connections 2024-09-20T19:14:17.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.247+0000 7f87972c7640 1 -- 172.21.15.27:0/3425301117 wait complete. 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 -- 172.21.15.27:0/957817059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 msgr2=0x7f5c90100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 --2- 172.21.15.27:0/957817059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c90100c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009880 tx=0x7f5c8402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 -- 172.21.15.27:0/957817059 shutdown_connections 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 --2- 172.21.15.27:0/957817059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c90100c50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 --2- 172.21.15.27:0/957817059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 0x7f5c90106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.336+0000 7f5c94d08640 1 -- 172.21.15.27:0/957817059 >> 172.21.15.27:0/957817059 conn(0x7f5c900fc550 msgr2=0x7f5c900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.337+0000 7f5c94d08640 1 -- 172.21.15.27:0/957817059 shutdown_connections 2024-09-20T19:14:17.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.337+0000 7f5c94d08640 1 -- 172.21.15.27:0/957817059 wait complete. 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.337+0000 7f5c94d08640 1 Processor -- start 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.337+0000 7f5c94d08640 1 -- start start 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c94d08640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c94d08640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 0x7f5c900fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c94d08640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9010dd20 con 0x7f5c901007f0 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c94d08640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9010dba0 con 0x7f5c901067f0 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36020/0 (socket says 172.21.15.27:36020) 2024-09-20T19:14:17.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 -- 172.21.15.27:0/2582946490 learned_addr learned my addr 172.21.15.27:0/2582946490 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:17.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8dd9b640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 0x7f5c900fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 -- 172.21.15.27:0/2582946490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 msgr2=0x7f5c900fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 0x7f5c900fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 -- 172.21.15.27:0/2582946490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c900fd750 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c8e59c640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000b420 tx=0x7f5c8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.338+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c80011630 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.339+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c900fda40 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.339+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c80016070 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.339+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c901a3f50 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.339+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c80010d40 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.340+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c70005290 con 0x7f5c901007f0 2024-09-20T19:14:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.340+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5c800117d0 con 0x7f5c901007f0 2024-09-20T19:14:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.341+0000 7f5c7f7fe640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 0x7f5c7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.341+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6417+0+0 (secure 0 0 0) 0x7f5c8009d6f0 con 0x7f5c901007f0 2024-09-20T19:14:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.341+0000 7f5c8dd9b640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 0x7f5c7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.342+0000 7f5c8dd9b640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 0x7f5c7807d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c900fe760 tx=0x7f5c84031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.345+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c80068c60 con 0x7f5c901007f0 2024-09-20T19:14:17.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.623+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5c70005d90 con 0x7f5c901007f0 2024-09-20T19:14:17.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.623+0000 7f5c7f7fe640 1 -- 172.21.15.27:0/2582946490 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+731 (secure 0 0 0) 0x7f5c8006db10 con 0x7f5c901007f0 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:14:17.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 10 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:14:17.627 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 msgr2=0x7f5c7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 0x7f5c7807d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c900fe760 tx=0x7f5c84031400 comp rx=0 tx=0).stop 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 msgr2=0x7f5c900fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000b420 tx=0x7f5c8000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 shutdown_connections 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5c7807af80 0x7f5c7807d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c901067f0 0x7f5c900fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 --2- 172.21.15.27:0/2582946490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5c901007f0 0x7f5c900fccd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 >> 172.21.15.27:0/2582946490 conn(0x7f5c900fc550 msgr2=0x7f5c90069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.625+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 shutdown_connections 2024-09-20T19:14:17.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.626+0000 7f5c94d08640 1 -- 172.21.15.27:0/2582946490 wait complete. 2024-09-20T19:14:17.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/1633297648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 msgr2=0x7fc7f410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/1633297648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f410b920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80098b0 tx=0x7fc7e802a560 comp rx=0 tx=0).stop 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/1633297648 shutdown_connections 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/1633297648 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f410b920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/1633297648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/1633297648 >> 172.21.15.27:0/1633297648 conn(0x7fc7f40fc550 msgr2=0x7fc7f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/1633297648 shutdown_connections 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/1633297648 wait complete. 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 Processor -- start 2024-09-20T19:14:17.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.710+0000 7fc7fb6fb640 1 -- start start 2024-09-20T19:14:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7fb6fb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7fb6fb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7fb6fb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f410ede0 con 0x7fc7f4103430 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7fb6fb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f410ec60 con 0x7fc7f4102b10 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36026/0 (socket says 172.21.15.27:36026) 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 -- 172.21.15.27:0/2198589543 learned_addr learned my addr 172.21.15.27:0/2198589543 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f9497640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 -- 172.21.15.27:0/2198589543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 msgr2=0x7fc7f419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 -- 172.21.15.27:0/2198589543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f41977f0 con 0x7fc7f4103430 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f9497640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f8c96640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8031460 tx=0x7fc7e80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7e803f070 con 0x7fc7f4103430 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7e80035f0 con 0x7fc7f4103430 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.711+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f4197a80 con 0x7fc7f4103430 2024-09-20T19:14:17.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.712+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7e8035030 con 0x7fc7f4103430 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.712+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f4197fb0 con 0x7fc7f4103430 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.713+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f406a520 con 0x7fc7f4103430 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.713+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc7e8042070 con 0x7fc7f4103430 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.714+0000 7fc7f27fc640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 0x7fc7dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.714+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6417+0+0 (secure 0 0 0) 0x7fc7e80be9a0 con 0x7fc7f4103430 2024-09-20T19:14:17.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.714+0000 7fc7f9497640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 0x7fc7dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:17.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.714+0000 7fc7f9497640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 0x7fc7dc07d440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009b40 tx=0x7fc7ec005e50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:17.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.718+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7e8089f10 con 0x7fc7f4103430 2024-09-20T19:14:17.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:17 smithi027 ceph-mon[110082]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:17.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.947+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc7f4106010 con 0x7fc7f4103430 2024-09-20T19:14:17.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.947+0000 7fc7f27fc640 1 -- 172.21.15.27:0/2198589543 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+1836 (secure 0 0 0) 0x7fc7e808edc0 con 0x7fc7f4103430 2024-09-20T19:14:17.950 INFO:teuthology.orchestra.run.smithi027.stdout:e19 2024-09-20T19:14:17.950 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:14:17:593916+0000 2024-09-20T19:14:17.950 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:14:17.950 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 17 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:14:12.952208+0000 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:14:17.951 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:14:17.952 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:14:17.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:17.954 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:17.954 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6828/448016576,v1:172.21.15.27:6829/448016576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:17.954 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 19 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.949+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 msgr2=0x7fc7dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.949+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 0x7fc7dc07d440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009b40 tx=0x7fc7ec005e50 comp rx=0 tx=0).stop 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.949+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 msgr2=0x7fc7f419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.949+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8031460 tx=0x7fc7e80045c0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 shutdown_connections 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc7dc07af80 0x7fc7dc07d440 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7f4103430 0x7fc7f419dbb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 --2- 172.21.15.27:0/2198589543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7f4102b10 0x7fc7f419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 >> 172.21.15.27:0/2198589543 conn(0x7fc7f40fc550 msgr2=0x7fc7f4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 shutdown_connections 2024-09-20T19:14:17.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:17.950+0000 7fc7fb6fb640 1 -- 172.21.15.27:0/2198589543 wait complete. 2024-09-20T19:14:17.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:17 smithi098 ceph-mon[80954]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 -- 172.21.15.27:0/1595524440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 msgr2=0x7f28d4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 --2- 172.21.15.27:0/1595524440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d4107ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009880 tx=0x7f28c402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 -- 172.21.15.27:0/1595524440 shutdown_connections 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 --2- 172.21.15.27:0/1595524440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 0x7f28d4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 --2- 172.21.15.27:0/1595524440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d4107ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.035+0000 7f28da23c640 1 -- 172.21.15.27:0/1595524440 >> 172.21.15.27:0/1595524440 conn(0x7f28d40fd600 msgr2=0x7f28d40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.036+0000 7f28da23c640 1 -- 172.21.15.27:0/1595524440 shutdown_connections 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.036+0000 7f28da23c640 1 -- 172.21.15.27:0/1595524440 wait complete. 2024-09-20T19:14:18.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.036+0000 7f28da23c640 1 Processor -- start 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.036+0000 7f28da23c640 1 -- start start 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28da23c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 0x7f28d419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28da23c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28da23c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f28d410edd0 con 0x7f28d4107900 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28da23c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28d410ec50 con 0x7f28d4101900 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36034/0 (socket says 172.21.15.27:36034) 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 -- 172.21.15.27:0/2672739721 learned_addr learned my addr 172.21.15.27:0/2672739721 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:18.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d37fe640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 0x7f28d419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 -- 172.21.15.27:0/2672739721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 msgr2=0x7f28d419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 0x7f28d419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 -- 172.21.15.27:0/2672739721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d4197840 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.037+0000 7f28d2ffd640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c8f0 tx=0x7f28c800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.038+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28c80079b0 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.038+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28c80054e0 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.038+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d4197b30 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.038+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28c8004dd0 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.038+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d41980c0 con 0x7f28d4107900 2024-09-20T19:14:18.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.039+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d4103040 con 0x7f28d4107900 2024-09-20T19:14:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.039+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f28c8005020 con 0x7f28d4107900 2024-09-20T19:14:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.040+0000 7f28d0ff9640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 0x7f28bc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.040+0000 7f28d37fe640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 0x7f28bc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.040+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6417+0+0 (secure 0 0 0) 0x7f28c809df00 con 0x7f28d4107900 2024-09-20T19:14:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.041+0000 7f28d37fe640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 0x7f28bc07d400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:18.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.045+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28c8014030 con 0x7f28d4107900 2024-09-20T19:14:18.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.253+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f28d41983d0 con 0x7f28bc07af40 2024-09-20T19:14:18.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.255+0000 7f28d0ff9640 1 -- 172.21.15.27:0/2672739721 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f28d41983d0 con 0x7f28bc07af40 2024-09-20T19:14:18.257 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:14:18.257 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:14:18.257 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:14:18.257 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "osd" 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "12/23 daemons upgraded", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:14:18.258 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 msgr2=0x7f28bc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 0x7f28bc07d400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c4031400 comp rx=0 tx=0).stop 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 msgr2=0x7f28d419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c8f0 tx=0x7f28c800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 shutdown_connections 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f28bc07af40 0x7f28bc07d400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28d4107900 0x7f28d419dc00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 --2- 172.21.15.27:0/2672739721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28d4101900 0x7f28d419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.257+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 >> 172.21.15.27:0/2672739721 conn(0x7f28d40fd600 msgr2=0x7f28d40fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.258+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 shutdown_connections 2024-09-20T19:14:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.258+0000 7f28da23c640 1 -- 172.21.15.27:0/2672739721 wait complete. 2024-09-20T19:14:18.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- 172.21.15.27:0/2193235556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 msgr2=0x7fe484106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/2193235556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe484106bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009880 tx=0x7fe47c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- 172.21.15.27:0/2193235556 shutdown_connections 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/2193235556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4841007f0 0x7fe484100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/2193235556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe484106bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- 172.21.15.27:0/2193235556 >> 172.21.15.27:0/2193235556 conn(0x7fe4840fc550 msgr2=0x7fe4840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- 172.21.15.27:0/2193235556 shutdown_connections 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- 172.21.15.27:0/2193235556 wait complete. 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 Processor -- start 2024-09-20T19:14:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.342+0000 7fe48bfd3640 1 -- start start 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4841007f0 0x7fe48419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe48410dca0 con 0x7fe4841067f0 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe48410db20 con 0x7fe4841007f0 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36054/0 (socket says 172.21.15.27:36054) 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 -- 172.21.15.27:0/4225516690 learned_addr learned my addr 172.21.15.27:0/4225516690 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 -- 172.21.15.27:0/4225516690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4841007f0 msgr2=0x7fe48419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4841007f0 0x7fe48419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 -- 172.21.15.27:0/4225516690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484197750 con 0x7fe4841067f0 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48956e640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c810 tx=0x7fe47800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:18.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe478004020 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4780041c0 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe484197a40 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4780047a0 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.343+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe484197fa0 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.345+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe484101f30 con 0x7fe4841067f0 2024-09-20T19:14:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.345+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe4780079b0 con 0x7fe4841067f0 2024-09-20T19:14:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.346+0000 7fe482ffd640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 0x7fe46c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.346+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6417+0+0 (secure 0 0 0) 0x7fe47809df70 con 0x7fe4841067f0 2024-09-20T19:14:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.346+0000 7fe489d6f640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 0x7fe46c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:18.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.346+0000 7fe489d6f640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 0x7fe46c07d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0096c0 tx=0x7fe47c000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:18.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.350+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe478014030 con 0x7fe4841067f0 2024-09-20T19:14:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.615+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe484198310 con 0x7fe4841067f0 2024-09-20T19:14:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.615+0000 7fe482ffd640 1 -- 172.21.15.27:0/4225516690 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+986 (secure 0 0 0) 0x7fe4780694e0 con 0x7fe4841067f0 2024-09-20T19:14:18.617 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.16 is active+undersized+degraded, acting [0,2] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-20T19:14:18.618 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-20T19:14:18.619 INFO:teuthology.orchestra.run.smithi027.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-20T19:14:18.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 msgr2=0x7fe46c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 0x7fe46c07d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0096c0 tx=0x7fe47c000bc0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 msgr2=0x7fe48419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:18.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c810 tx=0x7fe47800ccd0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 shutdown_connections 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe46c07af80 0x7fe46c07d440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4841067f0 0x7fe48419dbc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 --2- 172.21.15.27:0/4225516690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4841007f0 0x7fe48419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 >> 172.21.15.27:0/4225516690 conn(0x7fe4840fc550 msgr2=0x7fe484069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 shutdown_connections 2024-09-20T19:14:18.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:18.618+0000 7fe48bfd3640 1 -- 172.21.15.27:0/4225516690 wait complete. 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: pgmap v263: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: Health check update: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: osdmap e90: 6 total, 6 up, 6 in 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2582946490' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:14:18.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:18 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2198589543' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: pgmap v263: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 36/282 objects degraded (12.766%) 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: Health check update: Degraded data redundancy: 36/282 objects degraded (12.766%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: osdmap e90: 6 total, 6 up, 6 in 2024-09-20T19:14:18.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:18.981 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2582946490' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:18.981 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:14:18.981 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:18 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2198589543' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:19.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:19 smithi098 ceph-mon[80954]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:19.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:19 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/4225516690' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:20.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:19 smithi027 ceph-mon[110082]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:20.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:19 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/4225516690' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:20.862 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:20 smithi027 ceph-mon[110082]: pgmap v265: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 60 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 752 B/s rd, 1 op/s; 5/282 objects degraded (1.773%) 2024-09-20T19:14:20.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:20 smithi098 ceph-mon[80954]: pgmap v265: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 60 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 752 B/s rd, 1 op/s; 5/282 objects degraded (1.773%) 2024-09-20T19:14:21.961 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:21 smithi027 ceph-mon[110082]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/282 objects degraded (1.773%), 2 pgs degraded) 2024-09-20T19:14:21.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:21 smithi098 ceph-mon[80954]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/282 objects degraded (1.773%), 2 pgs degraded) 2024-09-20T19:14:22.771 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:22 smithi027 ceph-mon[110082]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:22.771 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:22 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:22.772 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:22 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:22.772 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:22 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:22.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:22 smithi098 ceph-mon[80954]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:22.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:22 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:22.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:22 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:22.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:22 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:23.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:23 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:boot 2024-09-20T19:14:23.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:23 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:23.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:23 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:14:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:23 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:boot 2024-09-20T19:14:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:23 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:23 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:14:24.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:24 smithi027 ceph-mon[110082]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:24.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:24 smithi098 ceph-mon[80954]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:26.853 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:26 smithi027 ceph-mon[110082]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:26.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:26 smithi098 ceph-mon[80954]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.600 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:28.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:30.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:30 smithi098 ceph-mon[80954]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:30.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:30 smithi027 ceph-mon[110082]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:32.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:32.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:32 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:32.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:32.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:32 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:33.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:33 smithi098 ceph-mon[80954]: Upgrade: Updating mds.cephfs.smithi027.esfeuy 2024-09-20T19:14:33.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:33.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:33.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:33.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:33 smithi098 ceph-mon[80954]: Deploying daemon mds.cephfs.smithi027.esfeuy on smithi027 2024-09-20T19:14:33.984 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:33 smithi027 ceph-mon[110082]: Upgrade: Updating mds.cephfs.smithi027.esfeuy 2024-09-20T19:14:33.984 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:33.985 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi027.esfeuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:33.985 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:33.985 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:33 smithi027 ceph-mon[110082]: Deploying daemon mds.cephfs.smithi027.esfeuy on smithi027 2024-09-20T19:14:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:34 smithi098 ceph-mon[80954]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:35.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:34 smithi027 ceph-mon[110082]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:36.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:36 smithi098 ceph-mon[80954]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:36.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:36 smithi098 ceph-mon[80954]: osdmap e91: 6 total, 6 up, 6 in 2024-09-20T19:14:36.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:36 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:36.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:36 smithi027 ceph-mon[110082]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:36.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:36 smithi027 ceph-mon[110082]: osdmap e91: 6 total, 6 up, 6 in 2024-09-20T19:14:36.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:36 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 2 up:standby 2024-09-20T19:14:38.964 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:38 smithi027 ceph-mon[110082]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:38.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:38 smithi098 ceph-mon[80954]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:41.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] up:boot 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:41.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] up:boot 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.fdtjxi=up:active} 3 up:standby 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:41.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:42 smithi098 ceph-mon[80954]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:42.975 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:42 smithi027 ceph-mon[110082]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:42.976 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:45.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:44 smithi027 ceph-mon[110082]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:45.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:44 smithi098 ceph-mon[80954]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.245 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:46 smithi027 ceph-mon[110082]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.246 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.246 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.246 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.246 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:46 smithi098 ceph-mon[80954]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:46.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:48.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:48 smithi027 ceph-mon[110082]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:48.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:48 smithi098 ceph-mon[80954]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 -- 172.21.15.27:0/1362769570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 msgr2=0x7face4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 --2- 172.21.15.27:0/1362769570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face4106bd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd4009880 tx=0x7facd402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 -- 172.21.15.27:0/1362769570 shutdown_connections 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 --2- 172.21.15.27:0/1362769570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 0x7face4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 --2- 172.21.15.27:0/1362769570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face4106bd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 -- 172.21.15.27:0/1362769570 >> 172.21.15.27:0/1362769570 conn(0x7face40fc550 msgr2=0x7face40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 -- 172.21.15.27:0/1362769570 shutdown_connections 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.712+0000 7face9373640 1 -- 172.21.15.27:0/1362769570 wait complete. 2024-09-20T19:14:48.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 Processor -- start 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 -- start start 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 0x7face40fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7face410dd20 con 0x7face41067f0 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face9373640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7face410dba0 con 0x7face41007f0 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34496/0 (socket says 172.21.15.27:34496) 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face27fc640 1 -- 172.21.15.27:0/3234596229 learned_addr learned my addr 172.21.15.27:0/3234596229 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.713+0000 7face2ffd640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 0x7face40fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:48.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face27fc640 1 -- 172.21.15.27:0/3234596229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 msgr2=0x7face40fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face27fc640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 0x7face40fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face27fc640 1 -- 172.21.15.27:0/3234596229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face40fd7a0 con 0x7face41067f0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face27fc640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facd800b420 tx=0x7facd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facd8011630 con 0x7face41067f0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facd8016070 con 0x7face41067f0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face40fda90 con 0x7face41067f0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facd8010d40 con 0x7face41067f0 2024-09-20T19:14:48.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.714+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41a3e80 con 0x7face41067f0 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.715+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face4101f30 con 0x7face41067f0 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.716+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7facd801b460 con 0x7face41067f0 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.716+0000 7faccbfff640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 0x7faccc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.716+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7facd809d7d0 con 0x7face41067f0 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.716+0000 7face2ffd640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 0x7faccc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:48.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.717+0000 7face2ffd640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 0x7faccc07d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facd40096c0 tx=0x7facd4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.721+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facd8068cc0 con 0x7face41067f0 2024-09-20T19:14:48.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.927+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7face4062630 con 0x7faccc07af30 2024-09-20T19:14:48.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.928+0000 7faccbfff640 1 -- 172.21.15.27:0/3234596229 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7face4062630 con 0x7faccc07af30 2024-09-20T19:14:48.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 msgr2=0x7faccc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 0x7faccc07d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facd40096c0 tx=0x7facd4031400 comp rx=0 tx=0).stop 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 msgr2=0x7face40fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facd800b420 tx=0x7facd800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 shutdown_connections 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faccc07af30 0x7faccc07d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7face41067f0 0x7face40fd260 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 --2- 172.21.15.27:0/3234596229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7face41007f0 0x7face40fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 >> 172.21.15.27:0/3234596229 conn(0x7face40fc550 msgr2=0x7face4069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 shutdown_connections 2024-09-20T19:14:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:48.931+0000 7face9373640 1 -- 172.21.15.27:0/3234596229 wait complete. 2024-09-20T19:14:48.941 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:14:49.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.019+0000 7f0c00d51640 1 -- 172.21.15.27:0/2451242890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 msgr2=0x7f0bfc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.019+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2451242890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc106bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009880 tx=0x7f0bec02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 -- 172.21.15.27:0/2451242890 shutdown_connections 2024-09-20T19:14:49.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2451242890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2451242890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc106bd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 -- 172.21.15.27:0/2451242890 >> 172.21.15.27:0/2451242890 conn(0x7f0bfc0fc550 msgr2=0x7f0bfc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 -- 172.21.15.27:0/2451242890 shutdown_connections 2024-09-20T19:14:49.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 -- 172.21.15.27:0/2451242890 wait complete. 2024-09-20T19:14:49.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 Processor -- start 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.020+0000 7f0c00d51640 1 -- start start 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0c00d51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc0fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0c00d51640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0c00d51640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc10dd20 con 0x7f0bfc1067f0 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0c00d51640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc10dba0 con 0x7f0bfc1007f0 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34514/0 (socket says 172.21.15.27:34514) 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 -- 172.21.15.27:0/2406644499 learned_addr learned my addr 172.21.15.27:0/2406644499 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bfa59c640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc0fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 -- 172.21.15.27:0/2406644499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 msgr2=0x7f0bfc0fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc0fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 -- 172.21.15.27:0/2406644499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc0fd7a0 con 0x7f0bfc1067f0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bfa59c640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc0fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.021+0000 7f0bf9d9b640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b420 tx=0x7f0bf000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.022+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0bf0011630 con 0x7f0bfc1067f0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.022+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0bf0016070 con 0x7f0bfc1067f0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.022+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0bf0010d40 con 0x7f0bfc1067f0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.022+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc0fda90 con 0x7f0bfc1067f0 2024-09-20T19:14:49.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.022+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc1a3e80 con 0x7f0bfc1067f0 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.023+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc101f30 con 0x7f0bfc1067f0 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.023+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0bf001b460 con 0x7f0bfc1067f0 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.024+0000 7f0beb7fe640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 0x7f0be407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.024+0000 7f0bfa59c640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 0x7f0be407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.024+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7f0bf009d8c0 con 0x7f0bfc1067f0 2024-09-20T19:14:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.025+0000 7f0bfa59c640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 0x7f0be407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0bec000c00 tx=0x7f0bec031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.028+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bf0021250 con 0x7f0bfc1067f0 2024-09-20T19:14:49.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.239+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0bfc062630 con 0x7f0be407af30 2024-09-20T19:14:49.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.241+0000 7f0beb7fe640 1 -- 172.21.15.27:0/2406644499 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0bfc062630 con 0x7f0be407af30 2024-09-20T19:14:49.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 msgr2=0x7f0be407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 0x7f0be407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0bec000c00 tx=0x7f0bec031400 comp rx=0 tx=0).stop 2024-09-20T19:14:49.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 msgr2=0x7f0bfc0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b420 tx=0x7f0bf000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 shutdown_connections 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0be407af30 0x7f0be407d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0bfc1067f0 0x7f0bfc0fd260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 --2- 172.21.15.27:0/2406644499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bfc1007f0 0x7f0bfc0fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 >> 172.21.15.27:0/2406644499 conn(0x7f0bfc0fc550 msgr2=0x7f0bfc069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 shutdown_connections 2024-09-20T19:14:49.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.243+0000 7f0c00d51640 1 -- 172.21.15.27:0/2406644499 wait complete. 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 -- 172.21.15.27:0/800868592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c102900 msgr2=0x7f427c102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 --2- 172.21.15.27:0/800868592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c102900 0x7f427c102ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f426c009880 tx=0x7f426c02a530 comp rx=0 tx=0).stop 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 -- 172.21.15.27:0/800868592 shutdown_connections 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 --2- 172.21.15.27:0/800868592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c103220 0x7f427c10b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 --2- 172.21.15.27:0/800868592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c102900 0x7f427c102ce0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 -- 172.21.15.27:0/800868592 >> 172.21.15.27:0/800868592 conn(0x7f427c0fc340 msgr2=0x7f427c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 -- 172.21.15.27:0/800868592 shutdown_connections 2024-09-20T19:14:49.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.327+0000 7f428099e640 1 -- 172.21.15.27:0/800868592 wait complete. 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.328+0000 7f428099e640 1 Processor -- start 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.328+0000 7f428099e640 1 -- start start 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f428099e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c102900 0x7f427c19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f428099e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f428099e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10ec90 con 0x7f427c103220 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f428099e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10eb10 con 0x7f427c102900 2024-09-20T19:14:49.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34540/0 (socket says 172.21.15.27:34540) 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 -- 172.21.15.27:0/2110615588 learned_addr learned my addr 172.21.15.27:0/2110615588 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f427b7fe640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c102900 0x7f427c19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 -- 172.21.15.27:0/2110615588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c102900 msgr2=0x7f427c19d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c102900 0x7f427c19d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 -- 172.21.15.27:0/2110615588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c197660 con 0x7f427c103220 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.329+0000 7f4272ffd640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f426400b370 tx=0x7f426400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.330+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4264015020 con 0x7f427c103220 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.330+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4264011af0 con 0x7f427c103220 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.330+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c197950 con 0x7f427c103220 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.330+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4264010d60 con 0x7f427c103220 2024-09-20T19:14:49.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.330+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c197eb0 con 0x7f427c103220 2024-09-20T19:14:49.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.331+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c06aa90 con 0x7f427c103220 2024-09-20T19:14:49.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.331+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4264018020 con 0x7f427c103220 2024-09-20T19:14:49.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.332+0000 7f42797fa640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 0x7f426807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.332+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7f426409d940 con 0x7f427c103220 2024-09-20T19:14:49.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.332+0000 7f427b7fe640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 0x7f426807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.333+0000 7f427b7fe640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 0x7f426807d440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f426c0096c0 tx=0x7f426c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.336+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f426401f020 con 0x7f427c103220 2024-09-20T19:14:49.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.534+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f427c1981c0 con 0x7f426807af80 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.545+0000 7f42797fa640 1 -- 172.21.15.27:0/2110615588 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f427c1981c0 con 0x7f426807af80 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (6m) 4s ago 17m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (8m) 4s ago 17m 8908k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (8m) 40s ago 16m 9034k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (4m) 4s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:14:49.547 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (4m) 40s ago 16m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (5m) 4s ago 16m 76.5M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (10s) 4s ago 11m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 461a49846ce8 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (27s) 4s ago 11m 15.4M - 19.3.0-5099-g88deadb8 441f9a3fe515 6c863db5eb1a 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (11m) 40s ago 11m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab e782e0069a35 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (11m) 40s ago 11m 18.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (8m) 4s ago 18m 530M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (7m) 40s ago 16m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (4m) 4s ago 18m 53.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (4m) 40s ago 16m 39.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (7m) 4s ago 17m 11.4M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 40s ago 16m 10.9M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (3m) 4s ago 14m 124M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:14:49.548 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (3m) 4s ago 14m 84.8M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (2m) 4s ago 13m 88.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (113s) 40s ago 13m 85.4M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (78s) 40s ago 13m 82.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (43s) 40s ago 12m 11.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (6m) 4s ago 16m 58.8M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 msgr2=0x7f426807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 0x7f426807d440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f426c0096c0 tx=0x7f426c031400 comp rx=0 tx=0).stop 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 msgr2=0x7f427c19dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f426400b370 tx=0x7f426400b830 comp rx=0 tx=0).stop 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 shutdown_connections 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f426807af80 0x7f426807d440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f427c103220 0x7f427c19dad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 --2- 172.21.15.27:0/2110615588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f427c102900 0x7f427c19d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 >> 172.21.15.27:0/2110615588 conn(0x7f427c0fc340 msgr2=0x7f427c10ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 shutdown_connections 2024-09-20T19:14:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.547+0000 7f428099e640 1 -- 172.21.15.27:0/2110615588 wait complete. 2024-09-20T19:14:49.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 -- 172.21.15.27:0/3043006712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174107900 msgr2=0x7f7174107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 --2- 172.21.15.27:0/3043006712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174107900 0x7f7174107ce0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f716c009880 tx=0x7f716c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 -- 172.21.15.27:0/3043006712 shutdown_connections 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 --2- 172.21.15.27:0/3043006712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174101900 0x7f7174101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 --2- 172.21.15.27:0/3043006712 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174107900 0x7f7174107ce0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 -- 172.21.15.27:0/3043006712 >> 172.21.15.27:0/3043006712 conn(0x7f71740fd600 msgr2=0x7f71740ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 -- 172.21.15.27:0/3043006712 shutdown_connections 2024-09-20T19:14:49.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.630+0000 7f717c488640 1 -- 172.21.15.27:0/3043006712 wait complete. 2024-09-20T19:14:49.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 Processor -- start 2024-09-20T19:14:49.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 -- start start 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 0x7f717419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f717410edd0 con 0x7f7174101900 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717c488640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f717410ec50 con 0x7f7174107900 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717a224640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717a224640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34566/0 (socket says 172.21.15.27:34566) 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f717a224640 1 -- 172.21.15.27:0/2116821031 learned_addr learned my addr 172.21.15.27:0/2116821031 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.631+0000 7f7179a23640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 0x7f717419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717a224640 1 -- 172.21.15.27:0/2116821031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 msgr2=0x7f717419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717a224640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 0x7f717419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717a224640 1 -- 172.21.15.27:0/2116821031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71741977a0 con 0x7f7174101900 2024-09-20T19:14:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f7179a23640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 0x7f717419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717a224640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f716c031460 tx=0x7f716c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f716c03f070 con 0x7f7174101900 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f716c004b10 con 0x7f7174101900 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7174197a30 con 0x7f7174101900 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f716c035030 con 0x7f7174101900 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.632+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7174197f60 con 0x7f7174101900 2024-09-20T19:14:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.633+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7174103040 con 0x7f7174101900 2024-09-20T19:14:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.634+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f716c042070 con 0x7f7174101900 2024-09-20T19:14:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.634+0000 7f71737fe640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 0x7f715c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.635+0000 7f7179a23640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 0x7f715c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.635+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7f716c0bf350 con 0x7f7174101900 2024-09-20T19:14:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.635+0000 7f7179a23640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 0x7f715c07d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71740ffc20 tx=0x7f7168009520 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.638+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f716c08a820 con 0x7f7174101900 2024-09-20T19:14:49.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.903+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7174109e70 con 0x7f7174101900 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.903+0000 7f71737fe640 1 -- 172.21.15.27:0/2116821031 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f716c08f6d0 con 0x7f7174101900 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:49.906 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2, 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2, 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 12 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:14:49.907 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.905+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 msgr2=0x7f715c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.905+0000 7f717c488640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 0x7f715c07d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71740ffc20 tx=0x7f7168009520 comp rx=0 tx=0).stop 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.905+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 msgr2=0x7f717419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.905+0000 7f717c488640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f716c031460 tx=0x7f716c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 shutdown_connections 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f715c07af40 0x7f715c07d400 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7174107900 0x7f717419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 --2- 172.21.15.27:0/2116821031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7174101900 0x7f717419d620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 >> 172.21.15.27:0/2116821031 conn(0x7f71740fd600 msgr2=0x7f71740fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 shutdown_connections 2024-09-20T19:14:49.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.906+0000 7f717c488640 1 -- 172.21.15.27:0/2116821031 wait complete. 2024-09-20T19:14:49.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/4213821208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14107900 msgr2=0x7fbc14107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/4213821208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14107900 0x7fbc14107ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc0402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/4213821208 shutdown_connections 2024-09-20T19:14:49.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/4213821208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14101900 0x7fbc14101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/4213821208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14107900 0x7fbc14107ce0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/4213821208 >> 172.21.15.27:0/4213821208 conn(0x7fbc140fd600 msgr2=0x7fbc140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:49.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/4213821208 shutdown_connections 2024-09-20T19:14:49.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.990+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/4213821208 wait complete. 2024-09-20T19:14:49.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 Processor -- start 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 -- start start 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14107900 0x7fbc1419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410edb0 con 0x7fbc14101900 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc1b3dc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410ec30 con 0x7fbc14107900 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc19178640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc19178640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34576/0 (socket says 172.21.15.27:34576) 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.991+0000 7fbc19178640 1 -- 172.21.15.27:0/3217492180 learned_addr learned my addr 172.21.15.27:0/3217492180 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc18977640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14107900 0x7fbc1419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc19178640 1 -- 172.21.15.27:0/3217492180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14107900 msgr2=0x7fbc1419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc19178640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14107900 0x7fbc1419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc19178640 1 -- 172.21.15.27:0/3217492180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc141977c0 con 0x7fbc14101900 2024-09-20T19:14:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc19178640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031460 tx=0x7fbc040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:49.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc0403f070 con 0x7fbc14101900 2024-09-20T19:14:49.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc04004cf0 con 0x7fbc14101900 2024-09-20T19:14:49.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc14197a50 con 0x7fbc14101900 2024-09-20T19:14:49.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc04035030 con 0x7fbc14101900 2024-09-20T19:14:49.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.992+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc14197f80 con 0x7fbc14101900 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.993+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14103040 con 0x7fbc14101900 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.994+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbc04042070 con 0x7fbc14101900 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.994+0000 7fbc127fc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 0x7fbbfc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.994+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7fbc040bec30 con 0x7fbc14101900 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.995+0000 7fbc18977640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 0x7fbbfc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:49.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.995+0000 7fbc18977640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 0x7fbbfc07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc14100e00 tx=0x7fbc08005cc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:50.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:49.999+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc040c5080 con 0x7fbc14101900 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:50 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2116821031' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.225+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbc14198d20 con 0x7fbc14101900 2024-09-20T19:14:50.227 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.228 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.229 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:50.229 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:50 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2116821031' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:50.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.225+0000 7fbc127fc640 1 -- 172.21.15.27:0/3217492180 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) ==== 76+0+2011 (secure 0 0 0) 0x7fbc14198d20 con 0x7fbc14101900 2024-09-20T19:14:50.229 INFO:teuthology.orchestra.run.smithi027.stdout:e22 2024-09-20T19:14:50.229 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:14:39:759274+0000 2024-09-20T19:14:50.229 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 17 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:14:12.952208+0000 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:14:50.230 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24337} 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:14:50.231 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 24337 members: 24337 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{0:24337} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.98:6824/3223633733,v1:172.21.15.98:6825/3223633733] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:14:50.232 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:24353} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{-1:34350} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{-1:34354} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 22 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 msgr2=0x7fbbfc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 0x7fbbfc07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc14100e00 tx=0x7fbc08005cc0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 msgr2=0x7fbc1419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc04031460 tx=0x7fbc040048f0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 shutdown_connections 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbbfc07af30 0x7fbbfc07d3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc14107900 0x7fbc1419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 --2- 172.21.15.27:0/3217492180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc14101900 0x7fbc1419d640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 >> 172.21.15.27:0/3217492180 conn(0x7fbc140fd600 msgr2=0x7fbc140ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 shutdown_connections 2024-09-20T19:14:50.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.228+0000 7fbc1b3dc640 1 -- 172.21.15.27:0/3217492180 wait complete. 2024-09-20T19:14:50.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 -- 172.21.15.27:0/3530525876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0101900 msgr2=0x7f49f0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 --2- 172.21.15.27:0/3530525876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0101900 0x7f49f0101d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009c20 tx=0x7f49e002a970 comp rx=0 tx=0).stop 2024-09-20T19:14:50.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 -- 172.21.15.27:0/3530525876 shutdown_connections 2024-09-20T19:14:50.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 --2- 172.21.15.27:0/3530525876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0101900 0x7f49f0101d60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 --2- 172.21.15.27:0/3530525876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0107900 0x7f49f0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 -- 172.21.15.27:0/3530525876 >> 172.21.15.27:0/3530525876 conn(0x7f49f00fd600 msgr2=0x7f49f00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:50.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 -- 172.21.15.27:0/3530525876 shutdown_connections 2024-09-20T19:14:50.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 -- 172.21.15.27:0/3530525876 wait complete. 2024-09-20T19:14:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.315+0000 7f49f6b45640 1 Processor -- start 2024-09-20T19:14:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f6b45640 1 -- start start 2024-09-20T19:14:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f6b45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0101900 0x7f49f019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f6b45640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f6b45640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f49f010edd0 con 0x7f49f0107900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f6b45640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f49f010ec50 con 0x7f49f0101900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34598/0 (socket says 172.21.15.27:34598) 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 -- 172.21.15.27:0/2083911692 learned_addr learned my addr 172.21.15.27:0/2083911692 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49f48e1640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0101900 0x7f49f019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 -- 172.21.15.27:0/2083911692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0101900 msgr2=0x7f49f019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0101900 0x7f49f019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.316+0000 7f49effff640 1 -- 172.21.15.27:0/2083911692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f01977a0 con 0x7f49f0107900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49effff640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49e002ae90 tx=0x7f49e002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49e0047070 con 0x7f49f0107900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49e002f7e0 con 0x7f49f0107900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f0197a30 con 0x7f49f0107900 2024-09-20T19:14:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49e0034070 con 0x7f49f0107900 2024-09-20T19:14:50.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.317+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f0197f60 con 0x7f49f0107900 2024-09-20T19:14:50.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.318+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f0103040 con 0x7f49f0107900 2024-09-20T19:14:50.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.319+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f49e004a070 con 0x7f49f0107900 2024-09-20T19:14:50.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.319+0000 7f49edffb640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 0x7f49dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.320+0000 7f49f48e1640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 0x7f49dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.320+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7f49e00bee00 con 0x7f49f0107900 2024-09-20T19:14:50.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.320+0000 7f49f48e1640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 0x7f49dc07d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49d8005fd0 tx=0x7f49d800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:50.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.324+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49e003f070 con 0x7f49f0107900 2024-09-20T19:14:50.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.529+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f49f01982d0 con 0x7f49dc07af30 2024-09-20T19:14:50.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.530+0000 7f49edffb640 1 -- 172.21.15.27:0/2083911692 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f49f01982d0 con 0x7f49dc07af30 2024-09-20T19:14:50.532 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "osd" 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "14/23 daemons upgraded", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:14:50.533 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:14:50.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 msgr2=0x7f49dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 0x7f49dc07d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49d8005fd0 tx=0x7f49d800b390 comp rx=0 tx=0).stop 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 msgr2=0x7f49f019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49e002ae90 tx=0x7f49e002f5f0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 shutdown_connections 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f49dc07af30 0x7f49dc07d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49f0107900 0x7f49f019db60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 --2- 172.21.15.27:0/2083911692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49f0101900 0x7f49f019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 >> 172.21.15.27:0/2083911692 conn(0x7f49f00fd600 msgr2=0x7f49f00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 shutdown_connections 2024-09-20T19:14:50.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.532+0000 7f49f6b45640 1 -- 172.21.15.27:0/2083911692 wait complete. 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 -- 172.21.15.27:0/3158703424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 msgr2=0x7fbca0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 --2- 172.21.15.27:0/3158703424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca0100c60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009880 tx=0x7fbc9002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 -- 172.21.15.27:0/3158703424 shutdown_connections 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 --2- 172.21.15.27:0/3158703424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca0100c60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 --2- 172.21.15.27:0/3158703424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 0x7fbca0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 -- 172.21.15.27:0/3158703424 >> 172.21.15.27:0/3158703424 conn(0x7fbca00fc520 msgr2=0x7fbca00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 -- 172.21.15.27:0/3158703424 shutdown_connections 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.617+0000 7fbca78ef640 1 -- 172.21.15.27:0/3158703424 wait complete. 2024-09-20T19:14:50.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 Processor -- start 2024-09-20T19:14:50.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 -- start start 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 0x7fbca00fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010dcd0 con 0x7fbca0100800 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca78ef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010db50 con 0x7fbca0106800 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca568b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca568b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34630/0 (socket says 172.21.15.27:34630) 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca568b640 1 -- 172.21.15.27:0/688031208 learned_addr learned my addr 172.21.15.27:0/688031208 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.618+0000 7fbca4e8a640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 0x7fbca00fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca568b640 1 -- 172.21.15.27:0/688031208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 msgr2=0x7fbca00fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca568b640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 0x7fbca00fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca568b640 1 -- 172.21.15.27:0/688031208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca00fd670 con 0x7fbca0100800 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca568b640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d6f0 tx=0x7fbc9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc9c017070 con 0x7fbca0100800 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc9c00de00 con 0x7fbca0100800 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca00fd960 con 0x7fbca0100800 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc9c004bb0 con 0x7fbca0100800 2024-09-20T19:14:50.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.619+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca01a3e70 con 0x7fbca0100800 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.621+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca0101f40 con 0x7fbca0100800 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.621+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbc9c004e60 con 0x7fbca0100800 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.621+0000 7fbc967fc640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 0x7fbc8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.621+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6417+0+0 (secure 0 0 0) 0x7fbc9c09dc90 con 0x7fbca0100800 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.621+0000 7fbca4e8a640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 0x7fbc8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:50.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.622+0000 7fbca4e8a640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 0x7fbc8c07d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbca00fe680 tx=0x7fbc90031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:50.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.628+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc9c069180 con 0x7fbca0100800 2024-09-20T19:14:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.892+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbca0109d80 con 0x7fbca0100800 2024-09-20T19:14:50.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.892+0000 7fbc967fc640 1 -- 172.21.15.27:0/688031208 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fbc9c06e030 con 0x7fbca0100800 2024-09-20T19:14:50.895 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:50.895 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:50.895 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:14:50.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 msgr2=0x7fbc8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 0x7fbc8c07d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbca00fe680 tx=0x7fbc90031400 comp rx=0 tx=0).stop 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 msgr2=0x7fbca00fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d6f0 tx=0x7fbc9c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 shutdown_connections 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fbc8c07af30 0x7fbc8c07d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbca0106800 0x7fbca00fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 --2- 172.21.15.27:0/688031208 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca0100800 0x7fbca00fcbf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 >> 172.21.15.27:0/688031208 conn(0x7fbca00fc520 msgr2=0x7fbca006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 shutdown_connections 2024-09-20T19:14:50.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:14:50.894+0000 7fbca78ef640 1 -- 172.21.15.27:0/688031208 wait complete. 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3217492180' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: Upgrade: Updating mds.cephfs.smithi098.fdtjxi 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: Deploying daemon mds.cephfs.smithi098.fdtjxi on smithi098 2024-09-20T19:14:51.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:51 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/688031208' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:51.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3217492180' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:51.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:51.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: Upgrade: Updating mds.cephfs.smithi098.fdtjxi 2024-09-20T19:14:51.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:51.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.fdtjxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:14:51.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:51.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: Deploying daemon mds.cephfs.smithi098.fdtjxi on smithi098 2024-09-20T19:14:51.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:51 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/688031208' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: osdmap e92: 6 total, 6 up, 6 in 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: Standby daemon mds.cephfs.smithi098.hnflps assigned to filesystem cephfs as rank 0 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:14:52.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-20T19:14:52.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:52 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:replay} 2 up:standby 2024-09-20T19:14:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[110078]: 2024-09-20T19:14:52.420+0000 7f8c0d623640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:14:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:14:52.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:14:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: osdmap e92: 6 total, 6 up, 6 in 2024-09-20T19:14:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: Standby daemon mds.cephfs.smithi098.hnflps assigned to filesystem cephfs as rank 0 2024-09-20T19:14:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:14:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-20T19:14:52.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:52 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:replay} 2 up:standby 2024-09-20T19:14:53.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:53 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:14:54.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:53 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:14:54.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:54 smithi098 ceph-mon[80954]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:54.981 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:54 smithi027 ceph-mon[110082]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:56.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:56 smithi027 ceph-mon[110082]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-09-20T19:14:56.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:56 smithi098 ceph-mon[80954]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-09-20T19:14:58.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:58 smithi027 ceph-mon[110082]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-20T19:14:58.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:58.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:14:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:58 smithi098 ceph-mon[80954]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-20T19:14:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:14:58.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:14:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:00.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:00 smithi027 ceph-mon[110082]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-20T19:15:00.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:00 smithi098 ceph-mon[80954]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-20T19:15:02.794 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:02 smithi098 ceph-mon[80954]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-20T19:15:02.795 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:02 smithi098 ceph-mon[80954]: reconnect by client.24381 192.168.0.1:0/3323058285 after 0.000999988 2024-09-20T19:15:02.795 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:02 smithi098 ceph-mon[80954]: reconnect by client.14610 192.168.0.1:0/2845282958 after 0.00199998 2024-09-20T19:15:02.795 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:02 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:reconnect 2024-09-20T19:15:02.795 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:02 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:reconnect} 2 up:standby 2024-09-20T19:15:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:02 smithi027 ceph-mon[110082]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-20T19:15:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:02 smithi027 ceph-mon[110082]: reconnect by client.24381 192.168.0.1:0/3323058285 after 0.000999988 2024-09-20T19:15:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:02 smithi027 ceph-mon[110082]: reconnect by client.14610 192.168.0.1:0/2845282958 after 0.00199998 2024-09-20T19:15:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:02 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:reconnect 2024-09-20T19:15:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:02 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:reconnect} 2 up:standby 2024-09-20T19:15:03.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:03 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:rejoin 2024-09-20T19:15:03.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:03 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:rejoin} 2 up:standby 2024-09-20T19:15:03.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:03 smithi098 ceph-mon[80954]: daemon mds.cephfs.smithi098.hnflps is now active in filesystem cephfs as rank 0 2024-09-20T19:15:03.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:03 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:rejoin 2024-09-20T19:15:03.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:03 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi098.hnflps=up:rejoin} 2 up:standby 2024-09-20T19:15:03.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:03 smithi027 ceph-mon[110082]: daemon mds.cephfs.smithi098.hnflps is now active in filesystem cephfs as rank 0 2024-09-20T19:15:04.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:active 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.hnflps=up:active} 2 up:standby 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:04.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:04 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.98:6826/1988280792,v1:172.21.15.98:6827/1988280792] up:active 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.hnflps=up:active} 2 up:standby 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:05.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:05.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:04 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:05.927 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:05 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.98:6824/3298509789,v1:172.21.15.98:6825/3298509789] up:boot 2024-09-20T19:15:05.928 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:05 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi098.hnflps=up:active} 3 up:standby 2024-09-20T19:15:05.928 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:05 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:15:06.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:05 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.98:6824/3298509789,v1:172.21.15.98:6825/3298509789] up:boot 2024-09-20T19:15:06.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:05 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi098.hnflps=up:active} 3 up:standby 2024-09-20T19:15:06.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:05 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:15:06.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:06 smithi098 ceph-mon[80954]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-20T19:15:06.991 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:06 smithi027 ceph-mon[110082]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-20T19:15:07.812 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:07 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:07.812 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:07 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:07.812 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:07 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:07.812 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:07 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:08.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:08.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:08.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:08.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:07 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:08.920 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:08 smithi098 ceph-mon[80954]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 341 B/s wr, 7 op/s 2024-09-20T19:15:09.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:08 smithi027 ceph-mon[110082]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 341 B/s wr, 7 op/s 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:10.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:10 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-20T19:15:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:11.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:11.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:10 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:12.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-20T19:15:12.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:12.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:15:12.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:12.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:12.818 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.hnflps", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:12.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:13.767 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:13 smithi098 ceph-mon[80954]: Upgrade: Updating mds.cephfs.smithi098.hnflps 2024-09-20T19:15:13.767 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:13 smithi098 ceph-mon[80954]: Deploying daemon mds.cephfs.smithi098.hnflps on smithi098 2024-09-20T19:15:14.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:13 smithi027 ceph-mon[110082]: Upgrade: Updating mds.cephfs.smithi098.hnflps 2024-09-20T19:15:14.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:13 smithi027 ceph-mon[110082]: Deploying daemon mds.cephfs.smithi098.hnflps on smithi098 2024-09-20T19:15:14.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:13 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[110078]: 2024-09-20T19:15:13.766+0000 7f8c0d623640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:15:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: osdmap e93: 6 total, 6 up, 6 in 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: Standby daemon mds.cephfs.smithi027.paximv assigned to filesystem cephfs as rank 0 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-20T19:15:14.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:14 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:replay} 2 up:standby 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: osdmap e93: 6 total, 6 up, 6 in 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: Standby daemon mds.cephfs.smithi027.paximv assigned to filesystem cephfs as rank 0 2024-09-20T19:15:15.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:15:15.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-20T19:15:15.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:14 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:replay} 2 up:standby 2024-09-20T19:15:16.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:16 smithi098 ceph-mon[80954]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-09-20T19:15:17.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:16 smithi027 ceph-mon[110082]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-09-20T19:15:18.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:18 smithi098 ceph-mon[80954]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-20T19:15:18.976 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:18 smithi027 ceph-mon[110082]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-20T19:15:20.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:20 smithi098 ceph-mon[80954]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-20T19:15:20.986 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:20 smithi027 ceph-mon[110082]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-20T19:15:20.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.984+0000 7f87b1cbd640 1 -- 172.21.15.27:0/4204345224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 msgr2=0x7f87ac100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.984+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/4204345224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac100c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009880 tx=0x7f87a002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 -- 172.21.15.27:0/4204345224 shutdown_connections 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/4204345224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac100c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/4204345224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 0x7f87ac106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 -- 172.21.15.27:0/4204345224 >> 172.21.15.27:0/4204345224 conn(0x7f87ac0fc550 msgr2=0x7f87ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 -- 172.21.15.27:0/4204345224 shutdown_connections 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 -- 172.21.15.27:0/4204345224 wait complete. 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.985+0000 7f87b1cbd640 1 Processor -- start 2024-09-20T19:15:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87b1cbd640 1 -- start start 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87b1cbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87b1cbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 0x7f87ac19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87b1cbd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac10dcc0 con 0x7f87ac1007f0 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87b1cbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac10db40 con 0x7f87ac1067f0 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40254/0 (socket says 172.21.15.27:40254) 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87ab7fe640 1 -- 172.21.15.27:0/833561083 learned_addr learned my addr 172.21.15.27:0/833561083 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.986+0000 7f87aaffd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 0x7f87ac19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87ab7fe640 1 -- 172.21.15.27:0/833561083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 msgr2=0x7f87ac19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87ab7fe640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 0x7f87ac19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87ab7fe640 1 -- 172.21.15.27:0/833561083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac1977e0 con 0x7f87ac1007f0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87ab7fe640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f879c00d6f0 tx=0x7f879c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f879c017070 con 0x7f87ac1007f0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac197ad0 con 0x7f87ac1007f0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f879c00de00 con 0x7f87ac1007f0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f879c004bb0 con 0x7f87ac1007f0 2024-09-20T19:15:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.987+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac198030 con 0x7f87ac1007f0 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.989+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ac101f30 con 0x7f87ac1007f0 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.989+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f879c004e60 con 0x7f87ac1007f0 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.990+0000 7f87a8ff9640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.990+0000 7f87aaffd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.990+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f879c09dd50 con 0x7f87ac1007f0 2024-09-20T19:15:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.990+0000 7f87aaffd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 0x7f879407d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87ac198b30 tx=0x7f87a0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:20.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:20.994+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f879c0691a0 con 0x7f87ac1007f0 2024-09-20T19:15:21.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.237+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f87ac1982e0 con 0x7f879407af30 2024-09-20T19:15:21.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.238+0000 7f87a8ff9640 1 -- 172.21.15.27:0/833561083 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f87ac1982e0 con 0x7f879407af30 2024-09-20T19:15:21.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 msgr2=0x7f879407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 0x7f879407d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87ac198b30 tx=0x7f87a0031400 comp rx=0 tx=0).stop 2024-09-20T19:15:21.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 msgr2=0x7f87ac19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f879c00d6f0 tx=0x7f879c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 shutdown_connections 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87ac1067f0 0x7f87ac19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 --2- 172.21.15.27:0/833561083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f87ac1007f0 0x7f87ac19d660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 >> 172.21.15.27:0/833561083 conn(0x7f87ac0fc550 msgr2=0x7f87ac069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 shutdown_connections 2024-09-20T19:15:21.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.241+0000 7f87b1cbd640 1 -- 172.21.15.27:0/833561083 wait complete. 2024-09-20T19:15:21.251 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:15:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- 172.21.15.27:0/3736692083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 msgr2=0x7faeec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 --2- 172.21.15.27:0/3736692083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec100c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faed8009880 tx=0x7faed802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- 172.21.15.27:0/3736692083 shutdown_connections 2024-09-20T19:15:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 --2- 172.21.15.27:0/3736692083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec100c50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 --2- 172.21.15.27:0/3736692083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 0x7faeec106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- 172.21.15.27:0/3736692083 >> 172.21.15.27:0/3736692083 conn(0x7faeec0fc550 msgr2=0x7faeec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- 172.21.15.27:0/3736692083 shutdown_connections 2024-09-20T19:15:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- 172.21.15.27:0/3736692083 wait complete. 2024-09-20T19:15:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 Processor -- start 2024-09-20T19:15:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.328+0000 7faef31c3640 1 -- start start 2024-09-20T19:15:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef31c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef31c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 0x7faeec198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef31c3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7faeec10dcc0 con 0x7faeec1007f0 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef31c3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faeec10db40 con 0x7faeec1067f0 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40274/0 (socket says 172.21.15.27:40274) 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 -- 172.21.15.27:0/2735899032 learned_addr learned my addr 172.21.15.27:0/2735899032 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faeebfff640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 0x7faeec198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 -- 172.21.15.27:0/2735899032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 msgr2=0x7faeec198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 0x7faeec198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 -- 172.21.15.27:0/2735899032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec199330 con 0x7faeec1007f0 2024-09-20T19:15:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.329+0000 7faef0f5f640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faee000e970 tx=0x7faee000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.330+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faee000cac0 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.330+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec199620 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.330+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faee00054e0 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.330+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faee0010430 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.330+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec1969a0 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.331+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec101f30 con 0x7faeec1007f0 2024-09-20T19:15:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.332+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faee0004f00 con 0x7faeec1007f0 2024-09-20T19:15:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.333+0000 7faee9ffb640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 0x7faedc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.333+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7faee009e850 con 0x7faeec1007f0 2024-09-20T19:15:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.333+0000 7faeebfff640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 0x7faedc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.334+0000 7faeebfff640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 0x7faedc07d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faeec06a7f0 tx=0x7faed8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.338+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faeec199620 con 0x7faeec1007f0 2024-09-20T19:15:21.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.540+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faeec062630 con 0x7faedc07af30 2024-09-20T19:15:21.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.542+0000 7faee9ffb640 1 -- 172.21.15.27:0/2735899032 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7faeec062630 con 0x7faedc07af30 2024-09-20T19:15:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 msgr2=0x7faedc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 0x7faedc07d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faeec06a7f0 tx=0x7faed8031400 comp rx=0 tx=0).stop 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 msgr2=0x7faeec1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faee000e970 tx=0x7faee000ed70 comp rx=0 tx=0).stop 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 shutdown_connections 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7faedc07af30 0x7faedc07d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeec1067f0 0x7faeec198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 --2- 172.21.15.27:0/2735899032 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faeec1007f0 0x7faeec1987f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.544+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 >> 172.21.15.27:0/2735899032 conn(0x7faeec0fc550 msgr2=0x7faeec0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.545+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 shutdown_connections 2024-09-20T19:15:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.545+0000 7faef31c3640 1 -- 172.21.15.27:0/2735899032 wait complete. 2024-09-20T19:15:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 -- 172.21.15.27:0/2472427472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0102b70 msgr2=0x7f02d0102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 --2- 172.21.15.27:0/2472427472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0102b70 0x7f02d0102f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009880 tx=0x7f02c002a530 comp rx=0 tx=0).stop 2024-09-20T19:15:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 -- 172.21.15.27:0/2472427472 shutdown_connections 2024-09-20T19:15:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 --2- 172.21.15.27:0/2472427472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0103490 0x7f02d010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 --2- 172.21.15.27:0/2472427472 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0102b70 0x7f02d0102f50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 -- 172.21.15.27:0/2472427472 >> 172.21.15.27:0/2472427472 conn(0x7f02d00fc550 msgr2=0x7f02d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 -- 172.21.15.27:0/2472427472 shutdown_connections 2024-09-20T19:15:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.633+0000 7f02d56dd640 1 -- 172.21.15.27:0/2472427472 wait complete. 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 Processor -- start 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 -- start start 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0102b70 0x7f02d019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010edc0 con 0x7f02d0103490 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02d56dd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010ec40 con 0x7f02d0102b70 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.634+0000 7f02ce7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40294/0 (socket says 172.21.15.27:40294) 2024-09-20T19:15:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 -- 172.21.15.27:0/682031209 learned_addr learned my addr 172.21.15.27:0/682031209 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ceffd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0102b70 0x7f02d019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 -- 172.21.15.27:0/682031209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0102b70 msgr2=0x7f02d019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0102b70 0x7f02d019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 -- 172.21.15.27:0/682031209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d01977b0 con 0x7f02d0103490 2024-09-20T19:15:21.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02ce7fc640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02c400e970 tx=0x7f02c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02c400cac0 con 0x7f02d0103490 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02c400cc60 con 0x7f02d0103490 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d0197aa0 con 0x7f02d0103490 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02c4018720 con 0x7f02d0103490 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.635+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d0198030 con 0x7f02d0103490 2024-09-20T19:15:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.637+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d006a4c0 con 0x7f02d0103490 2024-09-20T19:15:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.637+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f02c4010430 con 0x7f02d0103490 2024-09-20T19:15:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.638+0000 7f02b7fff640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 0x7f02b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.638+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f02c409e7b0 con 0x7f02d0103490 2024-09-20T19:15:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.638+0000 7f02ceffd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 0x7f02b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.638+0000 7f02ceffd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 0x7f02b807d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c00096c0 tx=0x7f02c0004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.642+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02c4069c80 con 0x7f02d0103490 2024-09-20T19:15:21.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.861+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f02d01983a0 con 0x7f02b807af80 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.879+0000 7f02b7fff640 1 -- 172.21.15.27:0/682031209 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f02d01983a0 con 0x7f02b807af80 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (6m) 36s ago 17m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (8m) 36s ago 17m 8908k - 19.1.1-369-ged8ee0f2 6acb0a031eab eaa126ea1bea 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (8m) 15s ago 16m 9273k - 19.1.1-369-ged8ee0f2 6acb0a031eab cf87b12dcf42 2024-09-20T19:15:21.880 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (4m) 36s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (4m) 15s ago 16m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (6m) 36s ago 17m 76.5M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (42s) 36s ago 12m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 461a49846ce8 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (60s) 36s ago 12m 15.4M - 19.3.0-5099-g88deadb8 441f9a3fe515 6c863db5eb1a 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (18s) 15s ago 12m 11.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 d0f1745fc781 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (12m) 15s ago 12m 89.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 0fb662193d2a 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (8m) 36s ago 18m 530M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (7m) 15s ago 16m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (5m) 36s ago 19m 53.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (5m) 15s ago 16m 42.7M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (7m) 36s ago 17m 11.4M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:15:21.881 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 15s ago 16m 11.4M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (4m) 36s ago 15m 124M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (3m) 36s ago 14m 84.8M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (3m) 36s ago 14m 88.2M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (2m) 15s ago 14m 95.0M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (110s) 15s ago 13m 86.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (76s) 15s ago 13m 86.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:15:21.882 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (6m) 36s ago 17m 58.8M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 msgr2=0x7f02b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 0x7f02b807d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c00096c0 tx=0x7f02c0004f30 comp rx=0 tx=0).stop 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 msgr2=0x7f02d019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02c400e970 tx=0x7f02c400ee30 comp rx=0 tx=0).stop 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 shutdown_connections 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f02b807af80 0x7f02b807d440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02d0103490 0x7f02d019db70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 --2- 172.21.15.27:0/682031209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02d0102b70 0x7f02d019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 >> 172.21.15.27:0/682031209 conn(0x7f02d00fc550 msgr2=0x7f02d0108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 shutdown_connections 2024-09-20T19:15:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.881+0000 7f02d56dd640 1 -- 172.21.15.27:0/682031209 wait complete. 2024-09-20T19:15:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.964+0000 7fdfeba0c640 1 -- 172.21.15.27:0/278927632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 msgr2=0x7fdfe4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.964+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/278927632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe4102f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009880 tx=0x7fdfe002a530 comp rx=0 tx=0).stop 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 -- 172.21.15.27:0/278927632 shutdown_connections 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/278927632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 0x7fdfe410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/278927632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe4102f50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 -- 172.21.15.27:0/278927632 >> 172.21.15.27:0/278927632 conn(0x7fdfe40fc550 msgr2=0x7fdfe40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 -- 172.21.15.27:0/278927632 shutdown_connections 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 -- 172.21.15.27:0/278927632 wait complete. 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.965+0000 7fdfeba0c640 1 Processor -- start 2024-09-20T19:15:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfeba0c640 1 -- start start 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfeba0c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfeba0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 0x7fdfe419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfeba0c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410edc0 con 0x7fdfe4102b70 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfeba0c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe410ec40 con 0x7fdfe4103490 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40326/0 (socket says 172.21.15.27:40326) 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 -- 172.21.15.27:0/3726414593 learned_addr learned my addr 172.21.15.27:0/3726414593 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe8fa7640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 0x7fdfe419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 -- 172.21.15.27:0/3726414593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 msgr2=0x7fdfe419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 0x7fdfe419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.966+0000 7fdfe97a8640 1 -- 172.21.15.27:0/3726414593 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe41977b0 con 0x7fdfe4102b70 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfe97a8640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0004f90 tx=0x7fdfe00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfe003f070 con 0x7fdfe4102b70 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfe0004c70 con 0x7fdfe4102b70 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe4197a40 con 0x7fdfe4102b70 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfe0035030 con 0x7fdfe4102b70 2024-09-20T19:15:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.967+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4197f70 con 0x7fdfe4102b70 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.968+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe406a4c0 con 0x7fdfe4102b70 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.969+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdfe0042070 con 0x7fdfe4102b70 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.969+0000 7fdfda7fc640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.969+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fdfe00beb30 con 0x7fdfe4102b70 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.969+0000 7fdfe8fa7640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.970+0000 7fdfe8fa7640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 0x7fdfd007d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4108940 tx=0x7fdfd400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:21.974+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfe0089f80 con 0x7fdfe4102b70 2024-09-20T19:15:22.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.254+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdfe4105fd0 con 0x7fdfe4102b70 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.255+0000 7fdfda7fc640 1 -- 172.21.15.27:0/3726414593 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fdfe008ee30 con 0x7fdfe4102b70 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:15:22.256 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:15:22.257 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 msgr2=0x7fdfd007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 0x7fdfd007d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4108940 tx=0x7fdfd400b390 comp rx=0 tx=0).stop 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 msgr2=0x7fdfe419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0004f90 tx=0x7fdfe00048f0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 shutdown_connections 2024-09-20T19:15:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfe4103490 0x7fdfe419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 --2- 172.21.15.27:0/3726414593 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfe4102b70 0x7fdfe419d630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 >> 172.21.15.27:0/3726414593 conn(0x7fdfe40fc550 msgr2=0x7fdfe4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 shutdown_connections 2024-09-20T19:15:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.257+0000 7fdfeba0c640 1 -- 172.21.15.27:0/3726414593 wait complete. 2024-09-20T19:15:22.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 -- 172.21.15.27:0/1227306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 msgr2=0x7fd910100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 --2- 172.21.15.27:0/1227306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd910100c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009880 tx=0x7fd8f802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 -- 172.21.15.27:0/1227306133 shutdown_connections 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 --2- 172.21.15.27:0/1227306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd910100c50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 --2- 172.21.15.27:0/1227306133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd910106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 -- 172.21.15.27:0/1227306133 >> 172.21.15.27:0/1227306133 conn(0x7fd9100fc550 msgr2=0x7fd9100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 -- 172.21.15.27:0/1227306133 shutdown_connections 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 -- 172.21.15.27:0/1227306133 wait complete. 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.341+0000 7fd915c15640 1 Processor -- start 2024-09-20T19:15:22.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd915c15640 1 -- start start 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd915c15640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd915c15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd91019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd915c15640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd91010dd20 con 0x7fd9101007f0 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd915c15640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd91010dba0 con 0x7fd9101067f0 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40348/0 (socket says 172.21.15.27:40348) 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 -- 172.21.15.27:0/3224129052 learned_addr learned my addr 172.21.15.27:0/3224129052 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90effd640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd91019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 -- 172.21.15.27:0/3224129052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 msgr2=0x7fd91019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd91019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90f7fe640 1 -- 172.21.15.27:0/3224129052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9101978d0 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.342+0000 7fd90effd640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd91019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd90f7fe640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b420 tx=0x7fd90000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd900011630 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd910197bc0 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd900016070 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd900010d40 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.343+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd910198120 con 0x7fd9101007f0 2024-09-20T19:15:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.344+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd910101f30 con 0x7fd9101007f0 2024-09-20T19:15:22.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.344+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd90001b460 con 0x7fd9101007f0 2024-09-20T19:15:22.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.345+0000 7fd90cff9640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 0x7fd8fc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.345+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fd90009d8f0 con 0x7fd9101007f0 2024-09-20T19:15:22.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.345+0000 7fd90effd640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 0x7fd8fc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.346+0000 7fd90effd640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 0x7fd8fc07d400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9101990c0 tx=0x7fd8f8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.349+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd900021250 con 0x7fd9101007f0 2024-09-20T19:15:22.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.574+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd910198e00 con 0x7fd9101007f0 2024-09-20T19:15:22.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.574+0000 7fd90cff9640 1 -- 172.21.15.27:0/3224129052 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+1826 (secure 0 0 0) 0x7fd900068d40 con 0x7fd9101007f0 2024-09-20T19:15:22.575 INFO:teuthology.orchestra.run.smithi027.stdout:e30 2024-09-20T19:15:22.575 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:15:13:772740+0000 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 30 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:15:13.772724+0000 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:15:22.576 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 93 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=34350} 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:15:22.577 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{0:34350} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{-1:34354} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/3298509789,v1:172.21.15.98:6825/3298509789] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 msgr2=0x7fd8fc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 0x7fd8fc07d400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9101990c0 tx=0x7fd8f8031400 comp rx=0 tx=0).stop 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 msgr2=0x7fd91019d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b420 tx=0x7fd90000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 shutdown_connections 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd8fc07af40 0x7fd8fc07d400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9101067f0 0x7fd91019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 --2- 172.21.15.27:0/3224129052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9101007f0 0x7fd91019d710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.576+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 >> 172.21.15.27:0/3224129052 conn(0x7fd9100fc550 msgr2=0x7fd910069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.577+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 shutdown_connections 2024-09-20T19:15:22.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.577+0000 7fd915c15640 1 -- 172.21.15.27:0/3224129052 wait complete. 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 -- 172.21.15.27:0/2708077579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 msgr2=0x7fc624106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/2708077579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624106bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc620009880 tx=0x7fc62002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 -- 172.21.15.27:0/2708077579 shutdown_connections 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/2708077579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 0x7fc624100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/2708077579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624106bd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 -- 172.21.15.27:0/2708077579 >> 172.21.15.27:0/2708077579 conn(0x7fc6240fc550 msgr2=0x7fc6240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 -- 172.21.15.27:0/2708077579 shutdown_connections 2024-09-20T19:15:22.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 -- 172.21.15.27:0/2708077579 wait complete. 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.663+0000 7fc62b8e3640 1 Processor -- start 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62b8e3640 1 -- start start 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62b8e3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 0x7fc624198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62b8e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62b8e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc62410dcc0 con 0x7fc6241067f0 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62b8e3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc62410db40 con 0x7fc6241007f0 2024-09-20T19:15:22.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40374/0 (socket says 172.21.15.27:40374) 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 -- 172.21.15.27:0/591332643 learned_addr learned my addr 172.21.15.27:0/591332643 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc62967f640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 0x7fc624198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 -- 172.21.15.27:0/591332643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 msgr2=0x7fc624198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 0x7fc624198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 -- 172.21.15.27:0/591332643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc624199350 con 0x7fc6241067f0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.664+0000 7fc628e7e640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc61400d6f0 tx=0x7fc61400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.665+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc614017070 con 0x7fc6241067f0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.665+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc61400de00 con 0x7fc6241067f0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.665+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc624199640 con 0x7fc6241067f0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.665+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc614004bb0 con 0x7fc6241067f0 2024-09-20T19:15:22.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.665+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6241a1c40 con 0x7fc6241067f0 2024-09-20T19:15:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.666+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc624101f30 con 0x7fc6241067f0 2024-09-20T19:15:22.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.666+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc614009a30 con 0x7fc6241067f0 2024-09-20T19:15:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.667+0000 7fc61a7fc640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 0x7fc61007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.667+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fc61409dc70 con 0x7fc6241067f0 2024-09-20T19:15:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.667+0000 7fc62967f640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 0x7fc61007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.668+0000 7fc62967f640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 0x7fc61007d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6200096c0 tx=0x7fc620031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.672+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc624199640 con 0x7fc6241067f0 2024-09-20T19:15:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.878+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc624062630 con 0x7fc61007af80 2024-09-20T19:15:22.879 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-20T19:15:22.880 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.880 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.880 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.880 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3726414593' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:22.880 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:22 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3224129052' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:15:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.879+0000 7fc61a7fc640 1 -- 172.21.15.27:0/591332643 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc624062630 con 0x7fc61007af80 2024-09-20T19:15:22.880 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "osd" 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:15:22.881 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.881+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 msgr2=0x7fc61007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.881+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 0x7fc61007d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6200096c0 tx=0x7fc620031400 comp rx=0 tx=0).stop 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.881+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 msgr2=0x7fc624198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.881+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc61400d6f0 tx=0x7fc61400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.881+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 shutdown_connections 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc61007af80 0x7fc61007d440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6241067f0 0x7fc624198d50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 --2- 172.21.15.27:0/591332643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6241007f0 0x7fc624198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 >> 172.21.15.27:0/591332643 conn(0x7fc6240fc550 msgr2=0x7fc6240fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 shutdown_connections 2024-09-20T19:15:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.882+0000 7fc62b8e3640 1 -- 172.21.15.27:0/591332643 wait complete. 2024-09-20T19:15:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 -- 172.21.15.27:0/2341310456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 msgr2=0x7f10a0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 --2- 172.21.15.27:0/2341310456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a0107ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1090009880 tx=0x7f109002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 -- 172.21.15.27:0/2341310456 shutdown_connections 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 --2- 172.21.15.27:0/2341310456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 0x7f10a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 --2- 172.21.15.27:0/2341310456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a0107ce0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 -- 172.21.15.27:0/2341310456 >> 172.21.15.27:0/2341310456 conn(0x7f10a00fd600 msgr2=0x7f10a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 -- 172.21.15.27:0/2341310456 shutdown_connections 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.966+0000 7f10a587f640 1 -- 172.21.15.27:0/2341310456 wait complete. 2024-09-20T19:15:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 Processor -- start 2024-09-20T19:15:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 -- start start 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 0x7f10a019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010edb0 con 0x7f10a0107900 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f10a587f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010ec30 con 0x7f10a0101900 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f109e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f109e7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40402/0 (socket says 172.21.15.27:40402) 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.967+0000 7f109e7fc640 1 -- 172.21.15.27:0/3947022368 learned_addr learned my addr 172.21.15.27:0/3947022368 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f109effd640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 0x7f10a019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f109e7fc640 1 -- 172.21.15.27:0/3947022368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 msgr2=0x7f10a019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f109e7fc640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 0x7f10a019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f109e7fc640 1 -- 172.21.15.27:0/3947022368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0199a50 con 0x7f10a0107900 2024-09-20T19:15:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f109e7fc640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f109400d8d0 tx=0x7f109400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1094017070 con 0x7f10a0107900 2024-09-20T19:15:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1094010460 con 0x7f10a0107900 2024-09-20T19:15:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a0199d40 con 0x7f10a0107900 2024-09-20T19:15:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f109400f5f0 con 0x7f10a0107900 2024-09-20T19:15:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.968+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a019a2d0 con 0x7f10a0107900 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.969+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a0103040 con 0x7f10a0107900 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.970+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1094009a30 con 0x7f10a0107900 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.970+0000 7f10a487d640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 0x7f108807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.970+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f109409e090 con 0x7f10a0107900 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.970+0000 7f109effd640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 0x7f108807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.971+0000 7f109effd640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 0x7f108807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1090031460 tx=0x7f1090009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3726414593' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:22.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:22 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3224129052' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:15:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:22.975+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10940694e0 con 0x7f10a0107900 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.236+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f10a019af80 con 0x7f10a0107900 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.237+0000 7f10a487d640 1 -- 172.21.15.27:0/3947022368 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f109406e390 con 0x7f10a0107900 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs is degraded 2024-09-20T19:15:23.238 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:23.239 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 msgr2=0x7f108807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 0x7f108807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1090031460 tx=0x7f1090009560 comp rx=0 tx=0).stop 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 msgr2=0x7f10a019fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f109400d8d0 tx=0x7f109400dd90 comp rx=0 tx=0).stop 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 shutdown_connections 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f108807af30 0x7f108807d3f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10a0107900 0x7f10a019fdd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 --2- 172.21.15.27:0/3947022368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a0101900 0x7f10a019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 >> 172.21.15.27:0/3947022368 conn(0x7f10a00fd600 msgr2=0x7f10a0074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:23.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 shutdown_connections 2024-09-20T19:15:23.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:23.239+0000 7f10a587f640 1 -- 172.21.15.27:0/3947022368 wait complete. 2024-09-20T19:15:23.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:23 smithi098 ceph-mon[80954]: reconnect by client.14610 192.168.0.1:0/2845282958 after 0 2024-09-20T19:15:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:23 smithi098 ceph-mon[80954]: reconnect by client.24381 192.168.0.1:0/3323058285 after 0.000999976 2024-09-20T19:15:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:23 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:reconnect 2024-09-20T19:15:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:23 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:reconnect} 2 up:standby 2024-09-20T19:15:23.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:23 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3947022368' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:24.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:23 smithi027 ceph-mon[110082]: reconnect by client.14610 192.168.0.1:0/2845282958 after 0 2024-09-20T19:15:24.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:23 smithi027 ceph-mon[110082]: reconnect by client.24381 192.168.0.1:0/3323058285 after 0.000999976 2024-09-20T19:15:24.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:23 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:reconnect 2024-09-20T19:15:24.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:23 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:reconnect} 2 up:standby 2024-09-20T19:15:24.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:23 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3947022368' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:24.912 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:24 smithi098 ceph-mon[80954]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:24.913 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:24 smithi098 ceph-mon[80954]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-20T19:15:24.913 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:24 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:rejoin 2024-09-20T19:15:24.913 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:24 smithi098 ceph-mon[80954]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:rejoin} 2 up:standby 2024-09-20T19:15:24.913 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:24 smithi098 ceph-mon[80954]: daemon mds.cephfs.smithi027.paximv is now active in filesystem cephfs as rank 0 2024-09-20T19:15:24.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:24 smithi027 ceph-mon[110082]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:24.991 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:24 smithi027 ceph-mon[110082]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-20T19:15:24.991 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:24 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:rejoin 2024-09-20T19:15:24.991 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:24 smithi027 ceph-mon[110082]: fsmap cephfs:1/1 {0=cephfs.smithi027.paximv=up:rejoin} 2 up:standby 2024-09-20T19:15:24.991 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:24 smithi027 ceph-mon[110082]: daemon mds.cephfs.smithi027.paximv is now active in filesystem cephfs as rank 0 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:active 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 2 up:standby 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:25.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:25 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] up:active 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 2 up:standby 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:26.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:25 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:26.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:26 smithi098 ceph-mon[80954]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 182 B/s wr, 7 op/s 2024-09-20T19:15:26.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:26 smithi098 ceph-mon[80954]: mds.? [v2:172.21.15.98:6826/1308977984,v1:172.21.15.98:6827/1308977984] up:boot 2024-09-20T19:15:26.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:26 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 3 up:standby 2024-09-20T19:15:26.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:26 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"} : dispatch 2024-09-20T19:15:27.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:26 smithi027 ceph-mon[110082]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 182 B/s wr, 7 op/s 2024-09-20T19:15:27.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:26 smithi027 ceph-mon[110082]: mds.? [v2:172.21.15.98:6826/1308977984,v1:172.21.15.98:6827/1308977984] up:boot 2024-09-20T19:15:27.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:26 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 3 up:standby 2024-09-20T19:15:27.068 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:26 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "mds metadata", "who": "cephfs.smithi098.hnflps"} : dispatch 2024-09-20T19:15:27.840 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:27.982 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:28.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:28 smithi098 ceph-mon[80954]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-20T19:15:28.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:28.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:29.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:28 smithi027 ceph-mon[110082]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-20T19:15:29.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:29.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:30.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:29 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:30.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:29 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:30.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:29 smithi098 ceph-mon[80954]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-20T19:15:30.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:29 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:30.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:29 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:30.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:29 smithi027 ceph-mon[110082]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-20T19:15:32.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:32 smithi027 ceph-mon[110082]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-20T19:15:32.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:32 smithi098 ceph-mon[80954]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-20T19:15:33.458 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all mds 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.459 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.esfeuy"}]': finished 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.paximv"}]': finished 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.fdtjxi"}]': finished 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.hnflps"} : dispatch 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.hnflps"}]': finished 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:33.460 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:33 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:33.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all mds 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.esfeuy"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.esfeuy"}]': finished 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.paximv"} : dispatch 2024-09-20T19:15:33.568 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi027.paximv"}]': finished 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.fdtjxi"} : dispatch 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.fdtjxi"}]': finished 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.hnflps"} : dispatch 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.hnflps"}]': finished 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:33.569 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:33 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:34.548 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-20T19:15:34.548 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:34.548 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 3 up:standby 2024-09-20T19:15:34.548 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-20T19:15:34.548 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.549 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:34 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:34.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 3 up:standby 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.722 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:34.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:34.723 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:34 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:35.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:35 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all rgw 2024-09-20T19:15:35.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:35 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:15:35.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:35 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all rgw 2024-09-20T19:15:35.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:35 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: Upgrade: Updating ceph-exporter.smithi027 (1/2) 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:37.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:36 smithi098 ceph-mon[80954]: Deploying daemon ceph-exporter.smithi027 on smithi027 2024-09-20T19:15:37.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-20T19:15:37.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: Upgrade: Updating ceph-exporter.smithi027 (1/2) 2024-09-20T19:15:37.257 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:37.258 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi027", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:15:37.258 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:37.258 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:36 smithi027 ceph-mon[110082]: Deploying daemon ceph-exporter.smithi027 on smithi027 2024-09-20T19:15:39.175 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:38 smithi027 ceph-mon[110082]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-20T19:15:39.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:38 smithi098 ceph-mon[80954]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-20T19:15:40.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:40 smithi098 ceph-mon[80954]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-20T19:15:40.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:40.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:40 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:41.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:40 smithi027 ceph-mon[110082]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-20T19:15:41.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:41.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:40 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: Upgrade: Updating ceph-exporter.smithi098 (2/2) 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-20T19:15:42.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:42.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-20T19:15:42.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: Upgrade: Updating ceph-exporter.smithi098 (2/2) 2024-09-20T19:15:42.989 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:42.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:15:42.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:42.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-20T19:15:42.990 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:44.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:44 smithi098 ceph-mon[80954]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-20T19:15:45.067 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:44 smithi027 ceph-mon[110082]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-20T19:15:46.676 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:46 smithi098 ceph-mon[80954]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-20T19:15:46.676 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:46.676 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:46.676 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:46 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:46.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:46 smithi027 ceph-mon[110082]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-20T19:15:46.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:46.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:46.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:46 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:48.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:48 smithi098 ceph-mon[80954]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-20T19:15:48.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:48 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:48 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:48 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.613 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:48 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:48 smithi027 ceph-mon[110082]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-20T19:15:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:48 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:48 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:48 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:48.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:48 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:50.632 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:50 smithi098 ceph-mon[80954]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-20T19:15:50.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:50 smithi027 ceph-mon[110082]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.244 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:52 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-09-20T19:15:52.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:52.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:52 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 -- 172.21.15.27:0/3821966685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100330 msgr2=0x7f81f0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3821966685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100330 0x7f81f0100710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009880 tx=0x7f81ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 -- 172.21.15.27:0/3821966685 shutdown_connections 2024-09-20T19:15:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3821966685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100ce0 0x7f81f0104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3821966685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100330 0x7f81f0100710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 -- 172.21.15.27:0/3821966685 >> 172.21.15.27:0/3821966685 conn(0x7f81f0077270 msgr2=0x7f81f0077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 -- 172.21.15.27:0/3821966685 shutdown_connections 2024-09-20T19:15:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.328+0000 7f81f84ab640 1 -- 172.21.15.27:0/3821966685 wait complete. 2024-09-20T19:15:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.329+0000 7f81f84ab640 1 Processor -- start 2024-09-20T19:15:53.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.329+0000 7f81f84ab640 1 -- start start 2024-09-20T19:15:53.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.329+0000 7f81f84ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 0x7f81f019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.329+0000 7f81f84ab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f84ab640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f81f010d4a0 con 0x7f81f0100ce0 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f84ab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81f010d320 con 0x7f81f0100330 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42414/0 (socket says 172.21.15.27:42414) 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 -- 172.21.15.27:0/3040164216 learned_addr learned my addr 172.21.15.27:0/3040164216 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f6247640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 0x7f81f019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 -- 172.21.15.27:0/3040164216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 msgr2=0x7f81f019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 0x7f81f019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 -- 172.21.15.27:0/3040164216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f0197900 con 0x7f81f0100ce0 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f6247640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 0x7f81f019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:15:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f5a46640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c8f0 tx=0x7f81e000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81e00079b0 con 0x7f81f0100ce0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81e0007b50 con 0x7f81f0100ce0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f0197bf0 con 0x7f81f0100ce0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.330+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81e0018630 con 0x7f81f0100ce0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.331+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f0198180 con 0x7f81f0100ce0 2024-09-20T19:15:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.332+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f0101700 con 0x7f81f0100ce0 2024-09-20T19:15:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.332+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f81e000f9a0 con 0x7f81f0100ce0 2024-09-20T19:15:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.333+0000 7f81e77fe640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 0x7f81dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.333+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f81e009e410 con 0x7f81f0100ce0 2024-09-20T19:15:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.333+0000 7f81f6247640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 0x7f81dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.333+0000 7f81f6247640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 0x7f81dc07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.337+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81e0014030 con 0x7f81f0100ce0 2024-09-20T19:15:53.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.548+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f81f0198490 con 0x7f81dc07af30 2024-09-20T19:15:53.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.550+0000 7f81e77fe640 1 -- 172.21.15.27:0/3040164216 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f81f0198490 con 0x7f81dc07af30 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 msgr2=0x7f81dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 0x7f81dc07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec031400 comp rx=0 tx=0).stop 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 msgr2=0x7f81f019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c8f0 tx=0x7f81e000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 shutdown_connections 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f81dc07af30 0x7f81dc07d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f81f0100ce0 0x7f81f019dbe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 --2- 172.21.15.27:0/3040164216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81f0100330 0x7f81f019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 >> 172.21.15.27:0/3040164216 conn(0x7f81f0077270 msgr2=0x7f81f00fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 shutdown_connections 2024-09-20T19:15:53.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.552+0000 7f81f84ab640 1 -- 172.21.15.27:0/3040164216 wait complete. 2024-09-20T19:15:53.563 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:15:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 -- 172.21.15.27:0/1006292990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100ad0 msgr2=0x7f9898106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 --2- 172.21.15.27:0/1006292990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100ad0 0x7f9898106610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9880009880 tx=0x7f988002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 -- 172.21.15.27:0/1006292990 shutdown_connections 2024-09-20T19:15:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 --2- 172.21.15.27:0/1006292990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100ad0 0x7f9898106610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 --2- 172.21.15.27:0/1006292990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100120 0x7f9898100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 -- 172.21.15.27:0/1006292990 >> 172.21.15.27:0/1006292990 conn(0x7f98980fbc90 msgr2=0x7f98980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 -- 172.21.15.27:0/1006292990 shutdown_connections 2024-09-20T19:15:53.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.639+0000 7f989e0dd640 1 -- 172.21.15.27:0/1006292990 wait complete. 2024-09-20T19:15:53.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 Processor -- start 2024-09-20T19:15:53.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 -- start start 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100ad0 0x7f989819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f989810eec0 con 0x7f9898100120 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.640+0000 7f989e0dd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f989810ed40 con 0x7f9898100ad0 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42438/0 (socket says 172.21.15.27:42438) 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 -- 172.21.15.27:0/854529748 learned_addr learned my addr 172.21.15.27:0/854529748 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f9896ffd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100ad0 0x7f989819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 -- 172.21.15.27:0/854529748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100ad0 msgr2=0x7f989819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100ad0 0x7f989819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 -- 172.21.15.27:0/854529748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9898199b00 con 0x7f9898100120 2024-09-20T19:15:53.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f98977fe640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988800ba50 tx=0x7f988800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9888019070 con 0x7f9898100120 2024-09-20T19:15:53.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f988800ce20 con 0x7f9898100120 2024-09-20T19:15:53.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9898199df0 con 0x7f9898100120 2024-09-20T19:15:53.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98880075a0 con 0x7f9898100120 2024-09-20T19:15:53.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.641+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989819a350 con 0x7f9898100120 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.642+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98981031e0 con 0x7f9898100120 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.643+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f988801c070 con 0x7f9898100120 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.644+0000 7f9894ff9640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 0x7f988407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.644+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f988809daa0 con 0x7f9898100120 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.644+0000 7f9896ffd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 0x7f988407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.644+0000 7f9896ffd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 0x7f988407d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f98800095c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.648+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9888068ef0 con 0x7f9898100120 2024-09-20T19:15:53.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.856+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f989819aff0 con 0x7f988407af40 2024-09-20T19:15:53.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.857+0000 7f9894ff9640 1 -- 172.21.15.27:0/854529748 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f989819aff0 con 0x7f988407af40 2024-09-20T19:15:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 msgr2=0x7f988407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 0x7f988407d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f98800095c0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 msgr2=0x7f989819f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988800ba50 tx=0x7f988800bf10 comp rx=0 tx=0).stop 2024-09-20T19:15:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 shutdown_connections 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988407af40 0x7f988407d400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9898100ad0 0x7f989819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 --2- 172.21.15.27:0/854529748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9898100120 0x7f989819f940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 >> 172.21.15.27:0/854529748 conn(0x7f98980fbc90 msgr2=0x7f98980fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 shutdown_connections 2024-09-20T19:15:53.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.860+0000 7f989e0dd640 1 -- 172.21.15.27:0/854529748 wait complete. 2024-09-20T19:15:53.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 -- 172.21.15.27:0/4142250388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 msgr2=0x7f390c10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 --2- 172.21.15.27:0/4142250388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c10b920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f80098b0 tx=0x7f38f802a560 comp rx=0 tx=0).stop 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 -- 172.21.15.27:0/4142250388 shutdown_connections 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 --2- 172.21.15.27:0/4142250388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c10b920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 --2- 172.21.15.27:0/4142250388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 -- 172.21.15.27:0/4142250388 >> 172.21.15.27:0/4142250388 conn(0x7f390c0fc550 msgr2=0x7f390c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 -- 172.21.15.27:0/4142250388 shutdown_connections 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.954+0000 7f391316c640 1 -- 172.21.15.27:0/4142250388 wait complete. 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 Processor -- start 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 -- start start 2024-09-20T19:15:53.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10edc0 con 0x7f390c103430 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f391316c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10ec40 con 0x7f390c102b10 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f390bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f390bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42446/0 (socket says 172.21.15.27:42446) 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.955+0000 7f390bfff640 1 -- 172.21.15.27:0/1917139207 learned_addr learned my addr 172.21.15.27:0/1917139207 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f3910f08640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f390bfff640 1 -- 172.21.15.27:0/1917139207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 msgr2=0x7f390c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f390bfff640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f390bfff640 1 -- 172.21.15.27:0/1917139207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1977f0 con 0x7f390c103430 2024-09-20T19:15:53.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f3910f08640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:15:53.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f390bfff640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38f8031460 tx=0x7f38f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38f803f070 con 0x7f390c103430 2024-09-20T19:15:53.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38f80035f0 con 0x7f390c103430 2024-09-20T19:15:53.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c197a80 con 0x7f390c103430 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.956+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38f8035030 con 0x7f390c103430 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.957+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c197fb0 con 0x7f390c103430 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.958+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c06a520 con 0x7f390c103430 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.959+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f38f8042070 con 0x7f390c103430 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.959+0000 7f3909ffb640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 0x7f38fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:53.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.960+0000 7f3910f08640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 0x7f38fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:53.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.960+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f38f80bea40 con 0x7f390c103430 2024-09-20T19:15:53.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.960+0000 7f3910f08640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 0x7f38fc07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3900009c20 tx=0x7f3900005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:53.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:53.964+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38f8089f10 con 0x7f390c103430 2024-09-20T19:15:54.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.183+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f390c1982d0 con 0x7f38fc07af80 2024-09-20T19:15:54.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.193+0000 7f3909ffb640 1 -- 172.21.15.27:0/1917139207 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f390c1982d0 con 0x7f38fc07af80 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (7m) 3s ago 18m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (14s) 3s ago 18m 8228k - 19.3.0-5099-g88deadb8 441f9a3fe515 4f616db7552c 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (9s) 6s ago 17m 7285k - 19.3.0-5099-g88deadb8 441f9a3fe515 e357518cf6f0 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (5m) 3s ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (5m) 6s ago 17m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (6m) 3s ago 17m 77.6M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (74s) 3s ago 12m 88.5M - 19.3.0-5099-g88deadb8 441f9a3fe515 461a49846ce8 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (92s) 3s ago 12m 87.3M - 19.3.0-5099-g88deadb8 441f9a3fe515 6c863db5eb1a 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (50s) 6s ago 12m 14.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 d0f1745fc781 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (29s) 6s ago 12m 16.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 4ca2e8d9ad72 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (9m) 3s ago 19m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:15:54.196 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (8m) 6s ago 17m 460M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (5m) 3s ago 19m 56.2M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (5m) 6s ago 17m 44.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (8m) 3s ago 18m 11.9M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 6s ago 17m 11.3M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (4m) 3s ago 16m 114M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (4m) 3s ago 15m 96.4M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (3m) 3s ago 15m 99.6M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (2m) 6s ago 14m 98.7M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (2m) 6s ago 14m 89.6M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (108s) 6s ago 13m 89.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:15:54.197 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (7m) 3s ago 17m 58.8M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:15:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 msgr2=0x7f38fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 0x7f38fc07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3900009c20 tx=0x7f3900005f90 comp rx=0 tx=0).stop 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 msgr2=0x7f390c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38f8031460 tx=0x7f38f80045e0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 shutdown_connections 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f38fc07af80 0x7f38fc07d440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f390c103430 0x7f390c19dbb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 --2- 172.21.15.27:0/1917139207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f390c102b10 0x7f390c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 >> 172.21.15.27:0/1917139207 conn(0x7f390c0fc550 msgr2=0x7f390c103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 shutdown_connections 2024-09-20T19:15:54.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.196+0000 7f391316c640 1 -- 172.21.15.27:0/1917139207 wait complete. 2024-09-20T19:15:54.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 -- 172.21.15.27:0/578623438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 msgr2=0x7f71ec10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 --2- 172.21.15.27:0/578623438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec10b8d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009880 tx=0x7f71d402a530 comp rx=0 tx=0).stop 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 -- 172.21.15.27:0/578623438 shutdown_connections 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 --2- 172.21.15.27:0/578623438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec10b8d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 --2- 172.21.15.27:0/578623438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 0x7f71ec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 -- 172.21.15.27:0/578623438 >> 172.21.15.27:0/578623438 conn(0x7f71ec0fc520 msgr2=0x7f71ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.280+0000 7f71f1d88640 1 -- 172.21.15.27:0/578623438 shutdown_connections 2024-09-20T19:15:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.281+0000 7f71f1d88640 1 -- 172.21.15.27:0/578623438 wait complete. 2024-09-20T19:15:54.284 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:54 smithi027 ceph-mon[110082]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-09-20T19:15:54.284 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:54 smithi027 ceph-mon[110082]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:54.284 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:54 smithi027 ceph-mon[110082]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:54.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.281+0000 7f71f1d88640 1 Processor -- start 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.281+0000 7f71f1d88640 1 -- start start 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71f1d88640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 0x7f71ec100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71f1d88640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71f1d88640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec10edd0 con 0x7f71ec1033e0 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71f1d88640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec10ec50 con 0x7f71ec102ac0 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42470/0 (socket says 172.21.15.27:42470) 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 -- 172.21.15.27:0/1168193547 learned_addr learned my addr 172.21.15.27:0/1168193547 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eb7fe640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 0x7f71ec100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 -- 172.21.15.27:0/1168193547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 msgr2=0x7f71ec100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 0x7f71ec100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 -- 172.21.15.27:0/1168193547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec1011a0 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.282+0000 7f71eaffd640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71d4031460 tx=0x7f71d4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.283+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71d403f070 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.283+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec101430 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.283+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71d40035f0 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.283+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71d4035030 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.283+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec1a3da0 con 0x7f71ec1033e0 2024-09-20T19:15:54.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.284+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec06aa90 con 0x7f71ec1033e0 2024-09-20T19:15:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.285+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f71d4042070 con 0x7f71ec1033e0 2024-09-20T19:15:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.285+0000 7f71e8ff9640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 0x7f71d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.285+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f71d40beab0 con 0x7f71ec1033e0 2024-09-20T19:15:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.285+0000 7f71eb7fe640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 0x7f71d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.286+0000 7f71eb7fe640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 0x7f71d807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00bbe0 tx=0x7f71dc00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.290+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71d4089f00 con 0x7f71ec1033e0 2024-09-20T19:15:54.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:54 smithi098 ceph-mon[80954]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-09-20T19:15:54.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:54 smithi098 ceph-mon[80954]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:54.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:54 smithi098 ceph-mon[80954]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:54.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.562+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f71ec02d7c0 con 0x7f71ec1033e0 2024-09-20T19:15:54.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.562+0000 7f71e8ff9640 1 -- 172.21.15.27:0/1168193547 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f71d408edb0 con 0x7f71ec1033e0 2024-09-20T19:15:54.563 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:15:54.563 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:15:54.563 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:15:54.564 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 msgr2=0x7f71d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 0x7f71d807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00bbe0 tx=0x7f71dc00b390 comp rx=0 tx=0).stop 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 msgr2=0x7f71ec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f71d4031460 tx=0x7f71d4004530 comp rx=0 tx=0).stop 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 shutdown_connections 2024-09-20T19:15:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f71d807af30 0x7f71d807d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f71ec1033e0 0x7f71ec100c60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 --2- 172.21.15.27:0/1168193547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71ec102ac0 0x7f71ec100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 >> 172.21.15.27:0/1168193547 conn(0x7f71ec0fc520 msgr2=0x7f71ec108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 shutdown_connections 2024-09-20T19:15:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.565+0000 7f71f1d88640 1 -- 172.21.15.27:0/1168193547 wait complete. 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.649+0000 7f89f200c640 1 -- 172.21.15.27:0/3244236781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 msgr2=0x7f89ec10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.649+0000 7f89f200c640 1 --2- 172.21.15.27:0/3244236781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec10b8c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009880 tx=0x7f89d402a530 comp rx=0 tx=0).stop 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.649+0000 7f89f200c640 1 -- 172.21.15.27:0/3244236781 shutdown_connections 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 --2- 172.21.15.27:0/3244236781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec10b8c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 --2- 172.21.15.27:0/3244236781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 0x7f89ec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 -- 172.21.15.27:0/3244236781 >> 172.21.15.27:0/3244236781 conn(0x7f89ec0fc550 msgr2=0x7f89ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 -- 172.21.15.27:0/3244236781 shutdown_connections 2024-09-20T19:15:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 -- 172.21.15.27:0/3244236781 wait complete. 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.650+0000 7f89f200c640 1 Processor -- start 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89f200c640 1 -- start start 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89f200c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 0x7f89ec100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89f200c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89f200c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec10ede0 con 0x7f89ec1033d0 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89f200c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec10ec60 con 0x7f89ec102ab0 2024-09-20T19:15:54.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42482/0 (socket says 172.21.15.27:42482) 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 -- 172.21.15.27:0/203575657 learned_addr learned my addr 172.21.15.27:0/203575657 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eb7fe640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 0x7f89ec100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 -- 172.21.15.27:0/203575657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 msgr2=0x7f89ec100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 0x7f89ec100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 -- 172.21.15.27:0/203575657 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec101190 con 0x7f89ec1033d0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.651+0000 7f89eaffd640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89d4031460 tx=0x7f89d40045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.652+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89d403f070 con 0x7f89ec1033d0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.652+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec101420 con 0x7f89ec1033d0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.652+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89d40035f0 con 0x7f89ec1033d0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.652+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89d4035030 con 0x7f89ec1033d0 2024-09-20T19:15:54.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.652+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec1a3dd0 con 0x7f89ec1033d0 2024-09-20T19:15:54.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.653+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec06a580 con 0x7f89ec1033d0 2024-09-20T19:15:54.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.653+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f89d4042070 con 0x7f89ec1033d0 2024-09-20T19:15:54.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.654+0000 7f89e8ff9640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 0x7f89d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.654+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f89d40beaa0 con 0x7f89ec1033d0 2024-09-20T19:15:54.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.654+0000 7f89eb7fe640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 0x7f89d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.654+0000 7f89eb7fe640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 0x7f89d807d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005fd0 tx=0x7f89e4009500 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.658+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89d4089ef0 con 0x7f89ec1033d0 2024-09-20T19:15:54.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.884+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f89ec105f50 con 0x7f89ec1033d0 2024-09-20T19:15:54.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.884+0000 7f89e8ff9640 1 -- 172.21.15.27:0/203575657 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) ==== 76+0+2040 (secure 0 0 0) 0x7f89d40be8c0 con 0x7f89ec1033d0 2024-09-20T19:15:54.885 INFO:teuthology.orchestra.run.smithi027.stdout:e36 2024-09-20T19:15:54.885 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:15:34:123615+0000 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 36 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:15:34.123595+0000 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:15:54.886 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 93 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=34350} 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:15:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 34350 members: 34350 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{0:34350} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/3298509789,v1:172.21.15.98:6825/3298509789] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:54.888 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/1308977984,v1:172.21.15.98:6827/1308977984] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.886+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 msgr2=0x7f89d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.886+0000 7f89f200c640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 0x7f89d807d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005fd0 tx=0x7f89e4009500 comp rx=0 tx=0).stop 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.886+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 msgr2=0x7f89ec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.886+0000 7f89f200c640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89d4031460 tx=0x7f89d40045c0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 shutdown_connections 2024-09-20T19:15:54.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f89d807af30 0x7f89d807d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89ec1033d0 0x7f89ec100c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 --2- 172.21.15.27:0/203575657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89ec102ab0 0x7f89ec100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 >> 172.21.15.27:0/203575657 conn(0x7f89ec0fc550 msgr2=0x7f89ec108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 shutdown_connections 2024-09-20T19:15:54.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.887+0000 7f89f200c640 1 -- 172.21.15.27:0/203575657 wait complete. 2024-09-20T19:15:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 -- 172.21.15.27:0/3825562178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c1033d0 msgr2=0x7f9e2c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/3825562178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c10b8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009880 tx=0x7f9e1c02a540 comp rx=0 tx=0).stop 2024-09-20T19:15:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 -- 172.21.15.27:0/3825562178 shutdown_connections 2024-09-20T19:15:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/3825562178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c10b8c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/3825562178 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c102ab0 0x7f9e2c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 -- 172.21.15.27:0/3825562178 >> 172.21.15.27:0/3825562178 conn(0x7f9e2c0fc4d0 msgr2=0x7f9e2c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 -- 172.21.15.27:0/3825562178 shutdown_connections 2024-09-20T19:15:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.978+0000 7f9e33ef3640 1 -- 172.21.15.27:0/3825562178 wait complete. 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 Processor -- start 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 -- start start 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c102ab0 0x7f9e2c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c10edc0 con 0x7f9e2c1033d0 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.979+0000 7f9e33ef3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c10ec40 con 0x7f9e2c102ab0 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42492/0 (socket says 172.21.15.27:42492) 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 -- 172.21.15.27:0/1708507497 learned_addr learned my addr 172.21.15.27:0/1708507497 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e31c8f640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c102ab0 0x7f9e2c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 -- 172.21.15.27:0/1708507497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c102ab0 msgr2=0x7f9e2c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c102ab0 0x7f9e2c19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 -- 172.21.15.27:0/1708507497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c199ae0 con 0x7f9e2c1033d0 2024-09-20T19:15:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e3148e640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c031460 tx=0x7f9e1c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c03f070 con 0x7f9e2c1033d0 2024-09-20T19:15:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e1c0035f0 con 0x7f9e2c1033d0 2024-09-20T19:15:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c199d10 con 0x7f9e2c1033d0 2024-09-20T19:15:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.980+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e1c035030 con 0x7f9e2c1033d0 2024-09-20T19:15:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.981+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c19a240 con 0x7f9e2c1033d0 2024-09-20T19:15:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.982+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2c06ada0 con 0x7f9e2c1033d0 2024-09-20T19:15:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.983+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9e1c042070 con 0x7f9e2c1033d0 2024-09-20T19:15:54.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.984+0000 7f9e22ffd640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 0x7f9e1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:54.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.984+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f9e1c0be570 con 0x7f9e2c1033d0 2024-09-20T19:15:54.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.984+0000 7f9e31c8f640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 0x7f9e1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:54.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.985+0000 7f9e31c8f640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 0x7f9e1807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c19b280 tx=0x7f9e28005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:54.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:54.989+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e1c0899c0 con 0x7f9e2c1033d0 2024-09-20T19:15:55.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.211+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9e2c10b400 con 0x7f9e1807af30 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1168193547' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/203575657' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.212 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:55.213 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:55.213 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:55 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.212+0000 7f9e22ffd640 1 -- 172.21.15.27:0/1708507497 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f9e2800e460 con 0x7f9e1807af30 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": true, 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:15:55.213 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [ 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "mon", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "mds", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph-exporter", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "osd" 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": "18/23 daemons upgraded", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:15:55.214 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 msgr2=0x7f9e1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 0x7f9e1807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c19b280 tx=0x7f9e28005f90 comp rx=0 tx=0).stop 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 msgr2=0x7f9e2c19fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c031460 tx=0x7f9e1c0045c0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 shutdown_connections 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f9e1807af30 0x7f9e1807d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9e2c1033d0 0x7f9e2c19fe10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 --2- 172.21.15.27:0/1708507497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e2c102ab0 0x7f9e2c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 >> 172.21.15.27:0/1708507497 conn(0x7f9e2c0fc4d0 msgr2=0x7f9e2c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:55.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 shutdown_connections 2024-09-20T19:15:55.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.214+0000 7f9e33ef3640 1 -- 172.21.15.27:0/1708507497 wait complete. 2024-09-20T19:15:55.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 -- 172.21.15.27:0/1639027952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 msgr2=0x7fb9ac102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/1639027952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac102ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009880 tx=0x7fb99c02a530 comp rx=0 tx=0).stop 2024-09-20T19:15:55.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 -- 172.21.15.27:0/1639027952 shutdown_connections 2024-09-20T19:15:55.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/1639027952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 0x7fb9ac10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/1639027952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac102ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 -- 172.21.15.27:0/1639027952 >> 172.21.15.27:0/1639027952 conn(0x7fb9ac0fc520 msgr2=0x7fb9ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 -- 172.21.15.27:0/1639027952 shutdown_connections 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.299+0000 7fb9b46b6640 1 -- 172.21.15.27:0/1639027952 wait complete. 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 Processor -- start 2024-09-20T19:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 -- start start 2024-09-20T19:15:55.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:55.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 0x7fb9ac100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:55.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac10ee50 con 0x7fb9ac102ac0 2024-09-20T19:15:55.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b46b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac10ecd0 con 0x7fb9ac1033e0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:42498/0 (socket says 172.21.15.27:42498) 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 -- 172.21.15.27:0/2508101747 learned_addr learned my addr 172.21.15.27:0/2508101747 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b1c51640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 0x7fb9ac100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 -- 172.21.15.27:0/2508101747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 msgr2=0x7fb9ac100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 0x7fb9ac100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 -- 172.21.15.27:0/2508101747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac1011a0 con 0x7fb9ac102ac0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.300+0000 7fb9b2452640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb99c031460 tx=0x7fb99c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.301+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb99c03f070 con 0x7fb9ac102ac0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.301+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb99c0044d0 con 0x7fb9ac102ac0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.301+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac101430 con 0x7fb9ac102ac0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.301+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb99c035030 con 0x7fb9ac102ac0 2024-09-20T19:15:55.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.301+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac1a3e20 con 0x7fb9ac102ac0 2024-09-20T19:15:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.302+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac06aa90 con 0x7fb9ac102ac0 2024-09-20T19:15:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.303+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb99c042070 con 0x7fb9ac102ac0 2024-09-20T19:15:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.303+0000 7fb9a37fe640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 0x7fb99807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:55.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.303+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fb99c0bec40 con 0x7fb9ac102ac0 2024-09-20T19:15:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.303+0000 7fb9b1c51640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 0x7fb99807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:55.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.304+0000 7fb9b1c51640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 0x7fb99807d450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac1021b0 tx=0x7fb9a8009060 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:55.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.308+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb99c004cf0 con 0x7fb9ac102ac0 2024-09-20T19:15:55.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1168193547' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/203575657' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:55.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:55 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:55.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.573+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb9ac1a4190 con 0x7fb9ac102ac0 2024-09-20T19:15:55.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.574+0000 7fb9a37fe640 1 -- 172.21.15.27:0/2508101747 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb99c08a070 con 0x7fb9ac102ac0 2024-09-20T19:15:55.575 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:55.575 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:55.575 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 msgr2=0x7fb99807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 0x7fb99807d450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac1021b0 tx=0x7fb9a8009060 comp rx=0 tx=0).stop 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 msgr2=0x7fb9ac100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb99c031460 tx=0x7fb99c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 shutdown_connections 2024-09-20T19:15:55.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb99807af90 0x7fb99807d450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9ac1033e0 0x7fb9ac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 --2- 172.21.15.27:0/2508101747 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9ac102ac0 0x7fb9ac100720 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 >> 172.21.15.27:0/2508101747 conn(0x7fb9ac0fc520 msgr2=0x7fb9ac10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 shutdown_connections 2024-09-20T19:15:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:15:55.576+0000 7fb9b46b6640 1 -- 172.21.15.27:0/2508101747 wait complete. 2024-09-20T19:15:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2 op/s 2024-09-20T19:15:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:56.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:56 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2508101747' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:56.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2 op/s 2024-09-20T19:15:56.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:56.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:56 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2508101747' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:57.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi027"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi027"}]': finished 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"} : dispatch 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]': finished 2024-09-20T19:15:57.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all nfs 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.319 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Finalizing container_image settings 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:15:57.320 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.321 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: Upgrade: Complete! 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:57.322 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: fsmap cephfs:1 {0=cephfs.smithi027.paximv=up:active} 1 up:standby-replay 2 up:standby 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi027"} : dispatch 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi027"}]': finished 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"} : dispatch 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]': finished 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all nfs 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.473 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Finalizing container_image settings 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:15:57.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-20T19:15:57.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: Upgrade: Complete! 2024-09-20T19:15:57.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:57.477 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:58.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:58 smithi027 ceph-mon[110082]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:15:58.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:58.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:15:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:15:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:58 smithi098 ceph-mon[80954]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:15:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:15:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:16:00.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:00 smithi098 ceph-mon[80954]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:00.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:00 smithi027 ceph-mon[110082]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:02.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:02 smithi098 ceph-mon[80954]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:02.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:02 smithi027 ceph-mon[110082]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:04.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:04 smithi027 ceph-mon[110082]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:04.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:04 smithi098 ceph-mon[80954]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:06.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:06 smithi027 ceph-mon[110082]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:06.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:06 smithi098 ceph-mon[80954]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:08.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:08 smithi027 ceph-mon[110082]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:08.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:08 smithi098 ceph-mon[80954]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:10.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:10 smithi027 ceph-mon[110082]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:10.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:10 smithi098 ceph-mon[80954]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:12.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:12 smithi098 ceph-mon[80954]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:12.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:12 smithi027 ceph-mon[110082]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:13.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:13.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:14.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:14 smithi027 ceph-mon[110082]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:14.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:14 smithi098 ceph-mon[80954]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:16.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:16 smithi027 ceph-mon[110082]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:16.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:16 smithi098 ceph-mon[80954]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:18.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:18 smithi027 ceph-mon[110082]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:18.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:18 smithi098 ceph-mon[80954]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:20.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:20 smithi027 ceph-mon[110082]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:20.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:20 smithi098 ceph-mon[80954]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:22.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:22 smithi027 ceph-mon[110082]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:22.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:22 smithi098 ceph-mon[80954]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:24.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:24 smithi027 ceph-mon[110082]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:24.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:24 smithi098 ceph-mon[80954]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:25.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 -- 172.21.15.27:0/3095034047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 msgr2=0x7fb3b0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:25.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/3095034047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b0102ea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009880 tx=0x7fb3a002a530 comp rx=0 tx=0).stop 2024-09-20T19:16:25.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 -- 172.21.15.27:0/3095034047 shutdown_connections 2024-09-20T19:16:25.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/3095034047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 0x7fb3b010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/3095034047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b0102ea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 -- 172.21.15.27:0/3095034047 >> 172.21.15.27:0/3095034047 conn(0x7fb3b00fc520 msgr2=0x7fb3b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 -- 172.21.15.27:0/3095034047 shutdown_connections 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.674+0000 7fb3b51a6640 1 -- 172.21.15.27:0/3095034047 wait complete. 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 Processor -- start 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 -- start start 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 0x7fb3b019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b010edd0 con 0x7fb3b0102ac0 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3b51a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b010ec50 con 0x7fb3b01033e0 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3aed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3aed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39034/0 (socket says 172.21.15.27:39034) 2024-09-20T19:16:25.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3aed9d640 1 -- 172.21.15.27:0/683961086 learned_addr learned my addr 172.21.15.27:0/683961086 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:16:25.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.675+0000 7fb3ae59c640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 0x7fb3b019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:25.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3aed9d640 1 -- 172.21.15.27:0/683961086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 msgr2=0x7fb3b019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:25.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3aed9d640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 0x7fb3b019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3aed9d640 1 -- 172.21.15.27:0/683961086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b0199ad0 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3aed9d640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0031460 tx=0x7fb3a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3a003f070 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3a00035f0 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b0199d60 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3a0035030 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.676+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b019a290 con 0x7fb3b0102ac0 2024-09-20T19:16:25.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.678+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b006aa90 con 0x7fb3b0102ac0 2024-09-20T19:16:25.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.678+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb3a0042070 con 0x7fb3b0102ac0 2024-09-20T19:16:25.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.679+0000 7fb3a7fff640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 0x7fb39c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:25.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.679+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fb3a00bea10 con 0x7fb3b0102ac0 2024-09-20T19:16:25.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.679+0000 7fb3ae59c640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 0x7fb39c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:25.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.680+0000 7fb3ae59c640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 0x7fb39c07d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00feec0 tx=0x7fb39800b360 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:25.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.683+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3a0089ee0 con 0x7fb3b0102ac0 2024-09-20T19:16:25.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.890+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb3b019afc0 con 0x7fb39c07af80 2024-09-20T19:16:25.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.891+0000 7fb3a7fff640 1 -- 172.21.15.27:0/683961086 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fb3b019afc0 con 0x7fb39c07af80 2024-09-20T19:16:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 msgr2=0x7fb39c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 0x7fb39c07d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00feec0 tx=0x7fb39800b360 comp rx=0 tx=0).stop 2024-09-20T19:16:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 msgr2=0x7fb3b019f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:25.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0031460 tx=0x7fb3a00045e0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 shutdown_connections 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb39c07af80 0x7fb39c07d440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b01033e0 0x7fb3b019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 --2- 172.21.15.27:0/683961086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b0102ac0 0x7fb3b019f910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.893+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 >> 172.21.15.27:0/683961086 conn(0x7fb3b00fc520 msgr2=0x7fb3b0100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.894+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 shutdown_connections 2024-09-20T19:16:25.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:25.894+0000 7fb3b51a6640 1 -- 172.21.15.27:0/683961086 wait complete. 2024-09-20T19:16:26.353 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:26 smithi027 ceph-mon[110082]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:26.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:26 smithi098 ceph-mon[80954]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:26.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T19:16:27.068 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:27.510 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:27 smithi027 ceph-mon[110082]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 -- 172.21.15.27:0/511088366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00106800 msgr2=0x7f6c00106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/511088366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00106800 0x7f6c00106be0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009880 tx=0x7f6bf002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 -- 172.21.15.27:0/511088366 shutdown_connections 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/511088366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00100800 0x7f6c00100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/511088366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00106800 0x7f6c00106be0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 -- 172.21.15.27:0/511088366 >> 172.21.15.27:0/511088366 conn(0x7f6c000fc520 msgr2=0x7f6c000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.507+0000 7f6c04bc7640 1 -- 172.21.15.27:0/511088366 shutdown_connections 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.508+0000 7f6c04bc7640 1 -- 172.21.15.27:0/511088366 wait complete. 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.508+0000 7f6c04bc7640 1 Processor -- start 2024-09-20T19:16:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.508+0000 7f6c04bc7640 1 -- start start 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6c04bc7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6c04bc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00106800 0x7f6c0019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6c04bc7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010edd0 con 0x7f6c00100800 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6c04bc7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010ec50 con 0x7f6c00106800 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39042/0 (socket says 172.21.15.27:39042) 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 -- 172.21.15.27:0/4188349933 learned_addr learned my addr 172.21.15.27:0/4188349933 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfdd9b640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00106800 0x7f6c0019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 -- 172.21.15.27:0/4188349933 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00106800 msgr2=0x7f6c0019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00106800 0x7f6c0019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 -- 172.21.15.27:0/4188349933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c001977d0 con 0x7f6c00100800 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.509+0000 7f6bfe59c640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0031460 tx=0x7f6bf0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.510+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bf003f070 con 0x7f6c00100800 2024-09-20T19:16:27.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.510+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bf00035f0 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.510+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c00197a60 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.510+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bf0035030 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.510+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c00197f90 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.511+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c00101f40 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.511+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6bf0042070 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.512+0000 7f6bf77fe640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 0x7f6bec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.512+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f6bf00beab0 con 0x7f6c00100800 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.512+0000 7f6bfdd9b640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 0x7f6bec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.512+0000 7f6bfdd9b640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 0x7f6bec07d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c000fead0 tx=0x7f6be8005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.517+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bf0089f00 con 0x7f6c00100800 2024-09-20T19:16:27.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:27 smithi098 ceph-mon[80954]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:27.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.729+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6c00198240 con 0x7f6bec07af30 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.739+0000 7f6bf77fe640 1 -- 172.21.15.27:0/4188349933 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f6c00198240 con 0x7f6bec07af30 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (7m) 36s ago 18m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (47s) 36s ago 18m 8228k - 19.3.0-5099-g88deadb8 441f9a3fe515 4f616db7552c 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (42s) 40s ago 17m 7285k - 19.3.0-5099-g88deadb8 441f9a3fe515 e357518cf6f0 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (5m) 36s ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (5m) 40s ago 17m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (7m) 36s ago 18m 77.6M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (108s) 36s ago 13m 88.5M - 19.3.0-5099-g88deadb8 441f9a3fe515 461a49846ce8 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (2m) 36s ago 13m 87.3M - 19.3.0-5099-g88deadb8 441f9a3fe515 6c863db5eb1a 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (84s) 40s ago 13m 14.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 d0f1745fc781 2024-09-20T19:16:27.741 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (62s) 40s ago 13m 16.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 4ca2e8d9ad72 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (9m) 36s ago 20m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (8m) 40s ago 17m 460M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (6m) 36s ago 20m 56.2M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (6m) 40s ago 17m 44.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (8m) 36s ago 18m 11.9M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 40s ago 17m 11.3M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (5m) 36s ago 16m 114M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (4m) 36s ago 16m 96.4M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (4m) 36s ago 15m 99.6M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (3m) 40s ago 15m 98.7M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (2m) 40s ago 14m 89.6M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (2m) 40s ago 14m 89.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:16:27.742 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (8m) 36s ago 18m 58.8M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:16:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 msgr2=0x7f6bec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 0x7f6bec07d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c000fead0 tx=0x7f6be8005f90 comp rx=0 tx=0).stop 2024-09-20T19:16:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 msgr2=0x7f6c0019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0031460 tx=0x7f6bf0004530 comp rx=0 tx=0).stop 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 shutdown_connections 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f6bec07af30 0x7f6bec07d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c00106800 0x7f6c0019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 --2- 172.21.15.27:0/4188349933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c00100800 0x7f6c0019d650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.741+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 >> 172.21.15.27:0/4188349933 conn(0x7f6c000fc520 msgr2=0x7f6c000fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.742+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 shutdown_connections 2024-09-20T19:16:27.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:27.742+0000 7f6c04bc7640 1 -- 172.21.15.27:0/4188349933 wait complete. 2024-09-20T19:16:28.295 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:28 smithi027 ceph-mon[110082]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:28.295 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:28.296 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:28 smithi027 ceph-mon[110082]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:28.700 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade status' 2024-09-20T19:16:28.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:28 smithi098 ceph-mon[80954]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:28.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:28.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:28 smithi098 ceph-mon[80954]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:28.965 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:29.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 -- 172.21.15.27:0/3198046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 msgr2=0x7f5e0c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/3198046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c102ef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5e080098b0 tx=0x7f5e0802a560 comp rx=0 tx=0).stop 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 -- 172.21.15.27:0/3198046123 shutdown_connections 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/3198046123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/3198046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c102ef0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 -- 172.21.15.27:0/3198046123 >> 172.21.15.27:0/3198046123 conn(0x7f5e0c0fc550 msgr2=0x7f5e0c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 -- 172.21.15.27:0/3198046123 shutdown_connections 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.585+0000 7f5e13bc4640 1 -- 172.21.15.27:0/3198046123 wait complete. 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 Processor -- start 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 -- start start 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:29.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c10ede0 con 0x7f5e0c102b10 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e13bc4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c10ec60 con 0x7f5e0c103430 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39056/0 (socket says 172.21.15.27:39056) 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 -- 172.21.15.27:0/207721794 learned_addr learned my addr 172.21.15.27:0/207721794 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e1115f640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 -- 172.21.15.27:0/207721794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 msgr2=0x7f5e0c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e11960640 1 -- 172.21.15.27:0/207721794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c197870 con 0x7f5e0c102b10 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.586+0000 7f5e1115f640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e11960640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e08031460 tx=0x7f5e080045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:29.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e0803f070 con 0x7f5e0c102b10 2024-09-20T19:16:29.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c197b00 con 0x7f5e0c102b10 2024-09-20T19:16:29.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e080035f0 con 0x7f5e0c102b10 2024-09-20T19:16:29.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e08035030 con 0x7f5e0c102b10 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.587+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c198030 con 0x7f5e0c102b10 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.588+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c06a520 con 0x7f5e0c102b10 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.589+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5e08042070 con 0x7f5e0c102b10 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.589+0000 7f5e02ffd640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 0x7f5df807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.589+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f5e080beb10 con 0x7f5e0c102b10 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.589+0000 7f5e1115f640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 0x7f5df807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:29.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.590+0000 7f5e1115f640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 0x7f5df807d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0058c0 tx=0x7f5dfc005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:29.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.594+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e08089f60 con 0x7f5e0c102b10 2024-09-20T19:16:29.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.801+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5e0c198da0 con 0x7f5df807af30 2024-09-20T19:16:29.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.802+0000 7f5e02ffd640 1 -- 172.21.15.27:0/207721794 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f5e0c198da0 con 0x7f5df807af30 2024-09-20T19:16:29.804 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:16:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "target_image": null, 2024-09-20T19:16:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "in_progress": false, 2024-09-20T19:16:29.804 INFO:teuthology.orchestra.run.smithi027.stdout: "which": "", 2024-09-20T19:16:29.805 INFO:teuthology.orchestra.run.smithi027.stdout: "services_complete": [], 2024-09-20T19:16:29.805 INFO:teuthology.orchestra.run.smithi027.stdout: "progress": null, 2024-09-20T19:16:29.805 INFO:teuthology.orchestra.run.smithi027.stdout: "message": "", 2024-09-20T19:16:29.805 INFO:teuthology.orchestra.run.smithi027.stdout: "is_paused": false 2024-09-20T19:16:29.805 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 msgr2=0x7f5df807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 0x7f5df807d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0058c0 tx=0x7f5dfc005850 comp rx=0 tx=0).stop 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 msgr2=0x7f5e0c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e08031460 tx=0x7f5e080045c0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 shutdown_connections 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5df807af30 0x7f5df807d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e0c103430 0x7f5e0c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 --2- 172.21.15.27:0/207721794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e0c102b10 0x7f5e0c19d6b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 >> 172.21.15.27:0/207721794 conn(0x7f5e0c0fc550 msgr2=0x7f5e0c107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:29.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 shutdown_connections 2024-09-20T19:16:29.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:29.805+0000 7f5e13bc4640 1 -- 172.21.15.27:0/207721794 wait complete. 2024-09-20T19:16:30.523 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:30 smithi098 ceph-mon[80954]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:30.524 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:30 smithi098 ceph-mon[80954]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:30.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:30 smithi027 ceph-mon[110082]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:30.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:30 smithi027 ceph-mon[110082]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:30.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph health detail' 2024-09-20T19:16:31.085 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:31.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- 172.21.15.27:0/2014348665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f341033d0 msgr2=0x7f7f3410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 --2- 172.21.15.27:0/2014348665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f341033d0 0x7f7f3410b8c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009880 tx=0x7f7f2802a530 comp rx=0 tx=0).stop 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- 172.21.15.27:0/2014348665 shutdown_connections 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 --2- 172.21.15.27:0/2014348665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f341033d0 0x7f7f3410b8c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 --2- 172.21.15.27:0/2014348665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f34102ab0 0x7f7f34102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- 172.21.15.27:0/2014348665 >> 172.21.15.27:0/2014348665 conn(0x7f7f340fc550 msgr2=0x7f7f340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- 172.21.15.27:0/2014348665 shutdown_connections 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- 172.21.15.27:0/2014348665 wait complete. 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 Processor -- start 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.547+0000 7f7f3b393640 1 -- start start 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3b393640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:31.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3b393640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 0x7f7f34100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3b393640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3410ede0 con 0x7f7f34102ab0 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3b393640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3410ec60 con 0x7f7f341033d0 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39072/0 (socket says 172.21.15.27:39072) 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3892e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 0x7f7f34100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:31.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 -- 172.21.15.27:0/234652863 learned_addr learned my addr 172.21.15.27:0/234652863 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:16:31.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 -- 172.21.15.27:0/234652863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 msgr2=0x7f7f34100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:31.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 0x7f7f34100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 -- 172.21.15.27:0/234652863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f34101190 con 0x7f7f34102ab0 2024-09-20T19:16:31.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3892e640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 0x7f7f34100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3912f640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400eb10 tx=0x7f7f2400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f2400cce0 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f24005020 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f34101480 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.548+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f24010660 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.549+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f341a3e90 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.549+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f3406a580 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.550+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7f240051d0 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.551+0000 7f7f327fc640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 0x7f7f1c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.551+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f7f2409e9a0 con 0x7f7f34102ab0 2024-09-20T19:16:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.551+0000 7f7f3892e640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 0x7f7f1c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:31.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.551+0000 7f7f3892e640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 0x7f7f1c07d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f341021a0 tx=0x7f7f28031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:31.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.555+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f24069df0 con 0x7f7f34102ab0 2024-09-20T19:16:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.820+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7f34102e90 con 0x7f7f34102ab0 2024-09-20T19:16:31.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.821+0000 7f7f327fc640 1 -- 172.21.15.27:0/234652863 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f7f2406eca0 con 0x7f7f34102ab0 2024-09-20T19:16:31.822 INFO:teuthology.orchestra.run.smithi027.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:16:31.823 INFO:teuthology.orchestra.run.smithi027.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:16:31.823 INFO:teuthology.orchestra.run.smithi027.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 msgr2=0x7f7f1c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 0x7f7f1c07d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f341021a0 tx=0x7f7f28031400 comp rx=0 tx=0).stop 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 msgr2=0x7f7f34100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400eb10 tx=0x7f7f2400c2d0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 shutdown_connections 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7f1c07af30 0x7f7f1c07d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f341033d0 0x7f7f34100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 --2- 172.21.15.27:0/234652863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f34102ab0 0x7f7f34100710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:31.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 >> 172.21.15.27:0/234652863 conn(0x7f7f340fc550 msgr2=0x7f7f34108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:31.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 shutdown_connections 2024-09-20T19:16:31.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:31.823+0000 7f7f3b393640 1 -- 172.21.15.27:0/234652863 wait complete. 2024-09-20T19:16:32.432 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:32 smithi027 ceph-mon[110082]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:32.432 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:32 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/234652863' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:16:32.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions' 2024-09-20T19:16:32.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:32 smithi098 ceph-mon[80954]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:32.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:32 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/234652863' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:16:32.862 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:33.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 -- 172.21.15.27:0/3585600897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 msgr2=0x7fe238100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/3585600897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe238100c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009880 tx=0x7fe22c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 -- 172.21.15.27:0/3585600897 shutdown_connections 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/3585600897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe238100c50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/3585600897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe238106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 -- 172.21.15.27:0/3585600897 >> 172.21.15.27:0/3585600897 conn(0x7fe2380fc550 msgr2=0x7fe2380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 -- 172.21.15.27:0/3585600897 shutdown_connections 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 -- 172.21.15.27:0/3585600897 wait complete. 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.331+0000 7fe23dd5e640 1 Processor -- start 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe23dd5e640 1 -- start start 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe23dd5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe23dd5e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe23819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe23dd5e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fe23810dcc0 con 0x7fe2381007f0 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe23dd5e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe23810db40 con 0x7fe2381067f0 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39088/0 (socket says 172.21.15.27:39088) 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 -- 172.21.15.27:0/2351812471 learned_addr learned my addr 172.21.15.27:0/2351812471 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe236ffd640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe23819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 -- 172.21.15.27:0/2351812471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 msgr2=0x7fe23819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe23819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 -- 172.21.15.27:0/2351812471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381977e0 con 0x7fe2381007f0 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe236ffd640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe23819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.332+0000 7fe2377fe640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe22800eb10 tx=0x7fe22800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.333+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe22800cce0 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.333+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe228005020 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.333+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238197ad0 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.333+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe228010660 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.333+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe238198030 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.334+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238101f30 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.334+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe2280051d0 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.335+0000 7fe234ff9640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 0x7fe22007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.335+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fe22809eaa0 con 0x7fe2381007f0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.335+0000 7fe236ffd640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 0x7fe22007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.335+0000 7fe236ffd640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 0x7fe22007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe238198b30 tx=0x7fe22c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:33.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.339+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe228069ef0 con 0x7fe2381007f0 2024-09-20T19:16:33.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.603+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe238109d70 con 0x7fe2381007f0 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.604+0000 7fe234ff9640 1 -- 172.21.15.27:0/2351812471 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe22806eda0 con 0x7fe2381007f0 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:16:33.606 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:16:33.607 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:16:33.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 msgr2=0x7fe22007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 0x7fe22007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe238198b30 tx=0x7fe22c031400 comp rx=0 tx=0).stop 2024-09-20T19:16:33.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 msgr2=0x7fe23819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe22800eb10 tx=0x7fe22800c2d0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 shutdown_connections 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fe22007af30 0x7fe22007d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe2381067f0 0x7fe23819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 --2- 172.21.15.27:0/2351812471 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2381007f0 0x7fe23819d660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.606+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 >> 172.21.15.27:0/2351812471 conn(0x7fe2380fc550 msgr2=0x7fe238069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.607+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 shutdown_connections 2024-09-20T19:16:33.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:16:33.607+0000 7fe23dd5e640 1 -- 172.21.15.27:0/2351812471 wait complete. 2024-09-20T19:16:34.371 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-20T19:16:34.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:34 smithi027 ceph-mon[110082]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:34.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:34 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2351812471' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:34.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:34 smithi098 ceph-mon[80954]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:34.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:34 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2351812471' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:35.143 INFO:teuthology.orchestra.run.smithi027.stdout:wait for servicemap items w/ changing names to refresh 2024-09-20T19:16:35.732 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'sleep 60' 2024-09-20T19:16:35.998 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:16:36.400 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:36 smithi027 ceph-mon[110082]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:36.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:36 smithi098 ceph-mon[80954]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:38.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:38 smithi027 ceph-mon[110082]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:38.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:38 smithi098 ceph-mon[80954]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:40.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:40 smithi027 ceph-mon[110082]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:40.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:40 smithi098 ceph-mon[80954]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:42.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:42 smithi027 ceph-mon[110082]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:42.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:42 smithi098 ceph-mon[80954]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:43.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:43.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:44.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:44 smithi027 ceph-mon[110082]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:44.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:44 smithi098 ceph-mon[80954]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:46.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:46 smithi098 ceph-mon[80954]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:46.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:46 smithi027 ceph-mon[110082]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:48.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:48 smithi027 ceph-mon[110082]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:48.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:48 smithi098 ceph-mon[80954]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:50.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:50 smithi027 ceph-mon[110082]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:50.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:50 smithi098 ceph-mon[80954]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:52.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:52 smithi027 ceph-mon[110082]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:52.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:52 smithi098 ceph-mon[80954]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:54.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:54 smithi027 ceph-mon[110082]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:54.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:54 smithi098 ceph-mon[80954]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:56.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:56 smithi027 ceph-mon[110082]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:56.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:56 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:16:56.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:56 smithi098 ceph-mon[80954]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:16:56.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:56 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:16:57.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:16:57.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:16:57.567 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:16:57.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:16:57.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:16:57.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:16:58.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:58 smithi098 ceph-mon[80954]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:58.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:16:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:58.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:58 smithi027 ceph-mon[110082]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:16:58.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:16:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:00.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:00 smithi098 ceph-mon[80954]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:00.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:00 smithi027 ceph-mon[110082]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:02.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:02 smithi098 ceph-mon[80954]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:02.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:02 smithi027 ceph-mon[110082]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:04.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:04 smithi098 ceph-mon[80954]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:04.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:04 smithi027 ceph-mon[110082]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:06.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:06 smithi098 ceph-mon[80954]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:06.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:06 smithi027 ceph-mon[110082]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:08.604 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:08 smithi027 ceph-mon[110082]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:08.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:08 smithi098 ceph-mon[80954]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:10.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:10 smithi098 ceph-mon[80954]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:10.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:10 smithi027 ceph-mon[110082]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:12.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:12 smithi098 ceph-mon[80954]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:12.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:12 smithi027 ceph-mon[110082]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:13.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:13.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:14.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:14 smithi098 ceph-mon[80954]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:14.817 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:14 smithi027 ceph-mon[110082]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:16.648 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:16 smithi098 ceph-mon[80954]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:16.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:16 smithi027 ceph-mon[110082]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:18.683 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:18 smithi027 ceph-mon[110082]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:18.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:18 smithi098 ceph-mon[80954]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:20.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:20 smithi098 ceph-mon[80954]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:20.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:20 smithi027 ceph-mon[110082]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:22.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:22 smithi098 ceph-mon[80954]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:22.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:22 smithi027 ceph-mon[110082]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:24.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:24 smithi098 ceph-mon[80954]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:24.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:24 smithi027 ceph-mon[110082]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:26.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:26 smithi098 ceph-mon[80954]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:26.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:26 smithi027 ceph-mon[110082]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:28.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:28 smithi098 ceph-mon[80954]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:28.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:28.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:28 smithi027 ceph-mon[110082]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:28.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:30.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:30 smithi098 ceph-mon[80954]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:30.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:30 smithi027 ceph-mon[110082]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:32.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:32 smithi098 ceph-mon[80954]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:32.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:32 smithi027 ceph-mon[110082]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:34.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:34 smithi098 ceph-mon[80954]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:34.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:34 smithi027 ceph-mon[110082]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:36.704 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:36 smithi027 ceph-mon[110082]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:36.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:36 smithi098 ceph-mon[80954]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:37.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T19:17:37.524 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:38.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 -- 172.21.15.27:0/2404186765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0100800 msgr2=0x7fedd0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:38.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/2404186765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0100800 0x7fedd0100c60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009880 tx=0x7fedc002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 -- 172.21.15.27:0/2404186765 shutdown_connections 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/2404186765 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0100800 0x7fedd0100c60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/2404186765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0106800 0x7fedd0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 -- 172.21.15.27:0/2404186765 >> 172.21.15.27:0/2404186765 conn(0x7fedd00fc520 msgr2=0x7fedd00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 -- 172.21.15.27:0/2404186765 shutdown_connections 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.007+0000 7fedd4b1e640 1 -- 172.21.15.27:0/2404186765 wait complete. 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 Processor -- start 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 -- start start 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0100800 0x7fedd01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010dcb0 con 0x7fedd0106800 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedd4b1e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fedd010db30 con 0x7fedd0100800 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.008+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:38.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59610/0 (socket says 172.21.15.27:59610) 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 -- 172.21.15.27:0/3035786780 learned_addr learned my addr 172.21.15.27:0/3035786780 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedce59c640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0100800 0x7fedd01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 -- 172.21.15.27:0/3035786780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0100800 msgr2=0x7fedd01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0100800 0x7fedd01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 -- 172.21.15.27:0/3035786780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd0199320 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedcdd9b640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fedc0031460 tx=0x7fedc00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc003f070 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedc00035f0 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd01995b0 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc0035030 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.009+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd01a1b60 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.010+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd0101f40 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.011+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fedc0042070 con 0x7fedd0106800 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.011+0000 7fedc77fe640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 0x7fedbc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:38.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.012+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fedc00beab0 con 0x7fedd0106800 2024-09-20T19:17:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.012+0000 7fedce59c640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 0x7fedbc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.012+0000 7fedce59c640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 0x7fedbc07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fedb800bbe0 tx=0x7fedb800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:38.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.016+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedc0089ee0 con 0x7fedd0106800 2024-09-20T19:17:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.217+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 --> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fedd0062630 con 0x7fedbc07af80 2024-09-20T19:17:38.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.228+0000 7fedc77fe640 1 -- 172.21.15.27:0/3035786780 <== mgr.14764 v2:172.21.15.27:6800/2136930053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fedd0062630 con 0x7fedbc07af80 2024-09-20T19:17:38.230 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:17:38.230 INFO:teuthology.orchestra.run.smithi027.stdout:alertmanager.smithi027 smithi027 *:9093,9094 running (8m) 107s ago 19m 19.3M - 0.27.0 11f11916f8cd 803de256e9f4 2024-09-20T19:17:38.230 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi027 smithi027 running (118s) 107s ago 20m 8228k - 19.3.0-5099-g88deadb8 441f9a3fe515 4f616db7552c 2024-09-20T19:17:38.230 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-exporter.smithi098 smithi098 running (113s) 110s ago 19m 7285k - 19.3.0-5099-g88deadb8 441f9a3fe515 e357518cf6f0 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi027 smithi027 running (7m) 107s ago 20m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 76afe86407ca 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:crash.smithi098 smithi098 running (6m) 110s ago 19m 6891k - 19.3.0-5099-g88deadb8 441f9a3fe515 ceb27c8eaeb9 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:grafana.smithi027 smithi027 *:3000 running (8m) 107s ago 19m 77.6M - 10.4.8 5aad1d7cf004 dd51ac90fccd 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.esfeuy smithi027 running (2m) 107s ago 14m 88.5M - 19.3.0-5099-g88deadb8 441f9a3fe515 461a49846ce8 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi027.paximv smithi027 running (3m) 107s ago 14m 87.3M - 19.3.0-5099-g88deadb8 441f9a3fe515 6c863db5eb1a 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.fdtjxi smithi098 running (2m) 110s ago 14m 14.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 d0f1745fc781 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mds.cephfs.smithi098.hnflps smithi098 running (2m) 110s ago 14m 16.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 4ca2e8d9ad72 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi027.tlgpqo smithi027 *:8443,9283,8765 running (10m) 107s ago 21m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 07ecf1eac501 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.smithi098.wrcvbg smithi098 *:8443,9283,8765 running (10m) 110s ago 18m 460M - 19.3.0-5099-g88deadb8 441f9a3fe515 44cfa25d679c 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi027 smithi027 running (7m) 107s ago 21m 56.2M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 8feb78653ee3 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:mon.smithi098 smithi098 running (7m) 110s ago 18m 44.6M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 3959011c7458 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi027 smithi027 *:9100 running (9m) 107s ago 19m 11.9M - 1.7.0 72c9c2088986 6062989bed02 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:node-exporter.smithi098 smithi098 *:9100 running (9m) 110s ago 19m 11.3M - 1.7.0 72c9c2088986 53410ce88706 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (6m) 107s ago 17m 114M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 608855b7e07e 2024-09-20T19:17:38.231 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi027 running (5m) 107s ago 17m 96.4M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 1cdccf8bb4b5 2024-09-20T19:17:38.232 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi027 running (5m) 107s ago 16m 99.6M 1216M 19.3.0-5099-g88deadb8 441f9a3fe515 c369c6546689 2024-09-20T19:17:38.232 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi098 running (4m) 110s ago 16m 98.7M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6a772126b9d9 2024-09-20T19:17:38.232 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi098 running (4m) 110s ago 15m 89.6M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 129e99f5af51 2024-09-20T19:17:38.232 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi098 running (3m) 110s ago 15m 89.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 8369594e8285 2024-09-20T19:17:38.232 INFO:teuthology.orchestra.run.smithi027.stdout:prometheus.smithi027 smithi027 *:9095 running (9m) 107s ago 19m 58.8M - 2.51.0 1d3b7f56885b ade154f9ea4a 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 msgr2=0x7fedbc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 0x7fedbc07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fedb800bbe0 tx=0x7fedb800b390 comp rx=0 tx=0).stop 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 msgr2=0x7fedd0198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fedc0031460 tx=0x7fedc00045e0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 shutdown_connections 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fedbc07af80 0x7fedbc07d440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fedd0106800 0x7fedd0198d20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 --2- 172.21.15.27:0/3035786780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd0100800 0x7fedd01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:38.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.231+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 >> 172.21.15.27:0/3035786780 conn(0x7fedd00fc520 msgr2=0x7fedd00fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:38.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.232+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 shutdown_connections 2024-09-20T19:17:38.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:38.232+0000 7fedd4b1e640 1 -- 172.21.15.27:0/3035786780 wait complete. 2024-09-20T19:17:38.523 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:38 smithi027 ceph-mon[110082]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:38.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:38 smithi098 ceph-mon[80954]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:38.932 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions' 2024-09-20T19:17:39.205 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:39.649 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:39 smithi027 ceph-mon[110082]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 -- 172.21.15.27:0/550511789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0107900 msgr2=0x7f98a0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 --2- 172.21.15.27:0/550511789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0107900 0x7f98a0107ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f989c009880 tx=0x7f989c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 -- 172.21.15.27:0/550511789 shutdown_connections 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 --2- 172.21.15.27:0/550511789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0101900 0x7f98a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 --2- 172.21.15.27:0/550511789 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0107900 0x7f98a0107ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 -- 172.21.15.27:0/550511789 >> 172.21.15.27:0/550511789 conn(0x7f98a00fd600 msgr2=0x7f98a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 -- 172.21.15.27:0/550511789 shutdown_connections 2024-09-20T19:17:39.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.647+0000 7f98a79c6640 1 -- 172.21.15.27:0/550511789 wait complete. 2024-09-20T19:17:39.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 Processor -- start 2024-09-20T19:17:39.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 -- start start 2024-09-20T19:17:39.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:39.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0107900 0x7f98a019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f98a010ee30 con 0x7f98a0101900 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a79c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f98a010ecb0 con 0x7f98a0107900 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a5762640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a5762640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59628/0 (socket says 172.21.15.27:59628) 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.648+0000 7f98a5762640 1 -- 172.21.15.27:0/4030053629 learned_addr learned my addr 172.21.15.27:0/4030053629 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a4f61640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0107900 0x7f98a019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:39.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a5762640 1 -- 172.21.15.27:0/4030053629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0107900 msgr2=0x7f98a019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a5762640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0107900 0x7f98a019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a5762640 1 -- 172.21.15.27:0/4030053629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a0197860 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a5762640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f989c031460 tx=0x7f989c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f989c03f070 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a0197af0 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f989c004cf0 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f989c035030 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.649+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a0198020 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.650+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a0103040 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.651+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f989c042070 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.651+0000 7f98967fc640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 0x7f988c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.652+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f989c0becb0 con 0x7f98a0101900 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.652+0000 7f98a4f61640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 0x7f988c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:39.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.652+0000 7f98a4f61640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 0x7f988c07d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f98a00ffc20 tx=0x7f9890008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:39.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.656+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f989c08a100 con 0x7f98a0101900 2024-09-20T19:17:39.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:39 smithi098 ceph-mon[80954]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:17:39.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.920+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f98a0198d90 con 0x7f98a0101900 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.920+0000 7f98967fc640 1 -- 172.21.15.27:0/4030053629 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f989c08efb0 con 0x7f98a0101900 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": { 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": { 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:17:39.922 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": { 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "overall": { 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-20T19:17:39.923 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.922+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 msgr2=0x7f988c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.922+0000 7f98a79c6640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 0x7f988c07d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f98a00ffc20 tx=0x7f9890008040 comp rx=0 tx=0).stop 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.922+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 msgr2=0x7f98a019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.922+0000 7f98a79c6640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f989c031460 tx=0x7f989c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 shutdown_connections 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f988c07af30 0x7f988c07d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98a0107900 0x7f98a019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 --2- 172.21.15.27:0/4030053629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98a0101900 0x7f98a019d6a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 >> 172.21.15.27:0/4030053629 conn(0x7f98a00fd600 msgr2=0x7f98a00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 shutdown_connections 2024-09-20T19:17:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:39.923+0000 7f98a79c6640 1 -- 172.21.15.27:0/4030053629 wait complete. 2024-09-20T19:17:40.694 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:40 smithi027 ceph-mon[110082]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:40.694 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:40 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/4030053629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:40.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:40 smithi098 ceph-mon[80954]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:40.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:40 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/4030053629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:40.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-20T19:17:40.987 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- 172.21.15.27:0/229004430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0107900 msgr2=0x7f79d0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 --2- 172.21.15.27:0/229004430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0107900 0x7f79d0107ce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009880 tx=0x7f79c002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- 172.21.15.27:0/229004430 shutdown_connections 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 --2- 172.21.15.27:0/229004430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0101900 0x7f79d0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 --2- 172.21.15.27:0/229004430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0107900 0x7f79d0107ce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- 172.21.15.27:0/229004430 >> 172.21.15.27:0/229004430 conn(0x7f79d00fd600 msgr2=0x7f79d00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- 172.21.15.27:0/229004430 shutdown_connections 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- 172.21.15.27:0/229004430 wait complete. 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 Processor -- start 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.428+0000 7f79d6874640 1 -- start start 2024-09-20T19:17:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79d6874640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79d6874640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0107900 0x7f79d019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79d6874640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f79d010ee30 con 0x7f79d0101900 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79d6874640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79d010ecb0 con 0x7f79d0107900 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59640/0 (socket says 172.21.15.27:59640) 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 -- 172.21.15.27:0/3298031138 learned_addr learned my addr 172.21.15.27:0/3298031138 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cf7fe640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0107900 0x7f79d019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 -- 172.21.15.27:0/3298031138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0107900 msgr2=0x7f79d019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0107900 0x7f79d019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.429+0000 7f79cffff640 1 -- 172.21.15.27:0/3298031138 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d0197860 con 0x7f79d0101900 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79cffff640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f79c0031460 tx=0x7f79c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79c003f070 con 0x7f79d0101900 2024-09-20T19:17:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79c0004cf0 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d0197af0 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79c0035030 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.430+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d0198020 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.431+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d0103040 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.432+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f79c0042070 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.432+0000 7f79cd7fa640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 0x7f79b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.432+0000 7f79cf7fe640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 0x7f79b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.432+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f79c00bec40 con 0x7f79d0101900 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.433+0000 7f79cf7fe640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 0x7f79b807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79d00ffc20 tx=0x7f79c4009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:41.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.437+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79c008a090 con 0x7f79d0101900 2024-09-20T19:17:41.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.704+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f79d0198d90 con 0x7f79d0101900 2024-09-20T19:17:41.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.704+0000 7f79cd7fa640 1 -- 172.21.15.27:0/3298031138 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f79c008ef40 con 0x7f79d0101900 2024-09-20T19:17:41.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.706+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 msgr2=0x7f79b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:41.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.706+0000 7f79d6874640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 0x7f79b807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79d00ffc20 tx=0x7f79c4009110 comp rx=0 tx=0).stop 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.706+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 msgr2=0x7f79d019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.706+0000 7f79d6874640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f79c0031460 tx=0x7f79c00048f0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 shutdown_connections 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f79b807af30 0x7f79b807d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79d0107900 0x7f79d019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 --2- 172.21.15.27:0/3298031138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79d0101900 0x7f79d019d6a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 >> 172.21.15.27:0/3298031138 conn(0x7f79d00fd600 msgr2=0x7f79d00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 shutdown_connections 2024-09-20T19:17:41.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:41.707+0000 7f79d6874640 1 -- 172.21.15.27:0/3298031138 wait complete. 2024-09-20T19:17:41.717 INFO:teuthology.orchestra.run.smithi027.stdout:true 2024-09-20T19:17:42.339 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-20T19:17:42.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:42 smithi027 ceph-mon[110082]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:42.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:42 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3298031138' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:42.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:42 smithi098 ceph-mon[80954]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:42.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:42 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3298031138' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.228+0000 7f67f69f9640 1 -- 172.21.15.27:0/2769425762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 msgr2=0x7f67f0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.228+0000 7f67f69f9640 1 --2- 172.21.15.27:0/2769425762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f0106be0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009880 tx=0x7f67e002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 -- 172.21.15.27:0/2769425762 shutdown_connections 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 --2- 172.21.15.27:0/2769425762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 0x7f67f0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 --2- 172.21.15.27:0/2769425762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f0106be0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 -- 172.21.15.27:0/2769425762 >> 172.21.15.27:0/2769425762 conn(0x7f67f00fc520 msgr2=0x7f67f00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:43.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 -- 172.21.15.27:0/2769425762 shutdown_connections 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 -- 172.21.15.27:0/2769425762 wait complete. 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 Processor -- start 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.229+0000 7f67f69f9640 1 -- start start 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67f69f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 0x7f67f019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67f69f9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67f69f9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f67f010dcb0 con 0x7f67f0106800 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67f69f9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67f010db30 con 0x7f67f0100800 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59662/0 (socket says 172.21.15.27:59662) 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 -- 172.21.15.27:0/3511527006 learned_addr learned my addr 172.21.15.27:0/3511527006 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67effff640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 0x7f67f019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 -- 172.21.15.27:0/3511527006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 msgr2=0x7f67f019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 0x7f67f019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 -- 172.21.15.27:0/3511527006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f0197850 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ef7fe640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c810 tx=0x7f67e400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67e4004020 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67e40041c0 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f0197b40 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.230+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67e40047a0 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.231+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f01980d0 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.231+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f0101f40 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.232+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f67e40079b0 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.233+0000 7f67ed7fa640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.233+0000 7f67effff640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.233+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f67e409e000 con 0x7f67f0106800 2024-09-20T19:17:43.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.234+0000 7f67effff640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 0x7f67d807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:43.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.238+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67e4014030 con 0x7f67f0106800 2024-09-20T19:17:43.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.499+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f67f01983e0 con 0x7f67f0106800 2024-09-20T19:17:43.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.500+0000 7f67ed7fa640 1 -- 172.21.15.27:0/3511527006 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f67e4069450 con 0x7f67f0106800 2024-09-20T19:17:43.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 msgr2=0x7f67d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:43.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 0x7f67d807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000c00 tx=0x7f67e0031400 comp rx=0 tx=0).stop 2024-09-20T19:17:43.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 msgr2=0x7f67f019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:43.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c810 tx=0x7f67e400ccd0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 shutdown_connections 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67f0106800 0x7f67f019dc10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 --2- 172.21.15.27:0/3511527006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f0100800 0x7f67f019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 >> 172.21.15.27:0/3511527006 conn(0x7f67f00fc520 msgr2=0x7f67f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 shutdown_connections 2024-09-20T19:17:43.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:43.502+0000 7f67f69f9640 1 -- 172.21.15.27:0/3511527006 wait complete. 2024-09-20T19:17:43.512 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)" 2024-09-20T19:17:43.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:43.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:44.208 DEBUG:teuthology.parallel:result is None 2024-09-20T19:17:44.208 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:17:44.219 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:17:44.219 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T19:17:44.481 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:44.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:44 smithi027 ceph-mon[110082]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:44.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:44 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3511527006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:44.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:44 smithi098 ceph-mon[80954]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:44.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:44 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3511527006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 -- 172.21.15.27:0/1501160035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 msgr2=0x7f399c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 --2- 172.21.15.27:0/1501160035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c107ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f398c009880 tx=0x7f398c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 -- 172.21.15.27:0/1501160035 shutdown_connections 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 --2- 172.21.15.27:0/1501160035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 0x7f399c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 --2- 172.21.15.27:0/1501160035 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c107ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 -- 172.21.15.27:0/1501160035 >> 172.21.15.27:0/1501160035 conn(0x7f399c0fd600 msgr2=0x7f399c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 -- 172.21.15.27:0/1501160035 shutdown_connections 2024-09-20T19:17:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.970+0000 7f39a242e640 1 -- 172.21.15.27:0/1501160035 wait complete. 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 Processor -- start 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 -- start start 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 0x7f399c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10edd0 con 0x7f399c107900 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f39a242e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10ec50 con 0x7f399c101900 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f3993fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f3993fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59688/0 (socket says 172.21.15.27:59688) 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f3993fff640 1 -- 172.21.15.27:0/3389593621 learned_addr learned my addr 172.21.15.27:0/3389593621 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.971+0000 7f399bfff640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 0x7f399c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3993fff640 1 -- 172.21.15.27:0/3389593621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 msgr2=0x7f399c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3993fff640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 0x7f399c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3993fff640 1 -- 172.21.15.27:0/3389593621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c1977a0 con 0x7f399c107900 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3993fff640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f398400d6f0 tx=0x7f398400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3984017070 con 0x7f399c107900 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f398400de00 con 0x7f399c107900 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c197a90 con 0x7f399c107900 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3984004bb0 con 0x7f399c107900 2024-09-20T19:17:44.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.972+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c198020 con 0x7f399c107900 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.973+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c103040 con 0x7f399c107900 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.974+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3984009a30 con 0x7f399c107900 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.974+0000 7f3999ffb640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 0x7f398807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.974+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f398409dc70 con 0x7f399c107900 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.974+0000 7f399bfff640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 0x7f398807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.975+0000 7f399bfff640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 0x7f398807d440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f398c0096c0 tx=0x7f398c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:44.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:44.979+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3984069140 con 0x7f399c107900 2024-09-20T19:17:45.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.202+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f399c109e70 con 0x7f399c107900 2024-09-20T19:17:45.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.202+0000 7f3999ffb640 1 -- 172.21.15.27:0/3389593621 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2040 (secure 0 0 0) 0x7f398406dff0 con 0x7f399c107900 2024-09-20T19:17:45.204 INFO:teuthology.orchestra.run.smithi027.stdout:e37 2024-09-20T19:17:45.204 INFO:teuthology.orchestra.run.smithi027.stdout:btime 2024-09-20T19:15:56:020110+0000 2024-09-20T19:17:45.204 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:17:45.204 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 37 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-20T19:03:06.273690+0000 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-20T19:15:55.063875+0000 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 60 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-20T19:17:45.205 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 93 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 1 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:in 0 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=34350} 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data enabled 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-20T19:17:45.206 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 1 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:qdb_cluster leader: 34350 members: 34350 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.paximv{0:34350} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.27:6826/68219843,v1:172.21.15.27:6827/68219843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi027.esfeuy{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.27:6828/4292901641,v1:172.21.15.27:6829/4292901641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.fdtjxi{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/3298509789,v1:172.21.15.98:6825/3298509789] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:17:45.207 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.cephfs.smithi098.hnflps{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/1308977984,v1:172.21.15.98:6827/1308977984] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 37 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.204+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 msgr2=0x7f398807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.204+0000 7f39a242e640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 0x7f398807d440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f398c0096c0 tx=0x7f398c031400 comp rx=0 tx=0).stop 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.204+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 msgr2=0x7f399c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.204+0000 7f39a242e640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f398400d6f0 tx=0x7f398400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 shutdown_connections 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f398807af80 0x7f398807d440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f399c107900 0x7f399c19db60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 --2- 172.21.15.27:0/3389593621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f399c101900 0x7f399c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 >> 172.21.15.27:0/3389593621 conn(0x7f399c0fd600 msgr2=0x7f399c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 shutdown_connections 2024-09-20T19:17:45.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:45.205+0000 7f39a242e640 1 -- 172.21.15.27:0/3389593621 wait complete. 2024-09-20T19:17:45.501 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:45 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3389593621' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:17:45.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:45 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3389593621' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:17:45.838 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-20T19:17:45.848 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-20T19:17:46.119 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:46.545 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:46 smithi027 ceph-mon[110082]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:46.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 -- 172.21.15.27:0/4033496884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 msgr2=0x7fb840100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 --2- 172.21.15.27:0/4033496884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb840100c70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb830009880 tx=0x7fb83002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 -- 172.21.15.27:0/4033496884 shutdown_connections 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 --2- 172.21.15.27:0/4033496884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb840100c70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 --2- 172.21.15.27:0/4033496884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb840106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 -- 172.21.15.27:0/4033496884 >> 172.21.15.27:0/4033496884 conn(0x7fb8400fc510 msgr2=0x7fb8400fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 -- 172.21.15.27:0/4033496884 shutdown_connections 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.626+0000 7fb844c11640 1 -- 172.21.15.27:0/4033496884 wait complete. 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 Processor -- start 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 -- start start 2024-09-20T19:17:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb84010bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010ede0 con 0x7fb840100810 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb844c11640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010ec60 con 0x7fb840106810 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb83e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb83e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53092/0 (socket says 172.21.15.27:53092) 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb83e59c640 1 -- 172.21.15.27:0/2782760903 learned_addr learned my addr 172.21.15.27:0/2782760903 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.627+0000 7fb83dd9b640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb84010bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb83e59c640 1 -- 172.21.15.27:0/2782760903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 msgr2=0x7fb84010bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb83e59c640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb84010bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb83e59c640 1 -- 172.21.15.27:0/2782760903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84010c220 con 0x7fb840100810 2024-09-20T19:17:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb83dd9b640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb84010bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb83e59c640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c8a0 tx=0x7fb82800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8280079b0 con 0x7fb840100810 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb828007b50 con 0x7fb840100810 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84010c510 con 0x7fb840100810 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb828018700 con 0x7fb840100810 2024-09-20T19:17:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.628+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8401a3df0 con 0x7fb840100810 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.629+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb840101f50 con 0x7fb840100810 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.630+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb828007d00 con 0x7fb840100810 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.630+0000 7fb8377fe640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.631+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fb82809e3d0 con 0x7fb840100810 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.631+0000 7fb83dd9b640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:46.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.631+0000 7fb83dd9b640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb84010d230 tx=0x7fb830031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:46.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.635+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb828014030 con 0x7fb840100810 2024-09-20T19:17:46.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:46 smithi098 ceph-mon[80954]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:46.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.862+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb840100c70 con 0x7fb840100810 2024-09-20T19:17:46.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.863+0000 7fb8377fe640 1 -- 172.21.15.27:0/2782760903 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5319 (secure 0 0 0) 0x7fb8280698a0 con 0x7fb840100810 2024-09-20T19:17:46.864 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:46.864 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":37,"btime":"2024-09-20T19:15:56:020110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/1308977984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1308977984},{"type":"v1","addr":"172.21.15.98:6827","nonce":1308977984}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:55.063875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34350,"qdb_cluster":[34350]},"id":1}]} 2024-09-20T19:17:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 37 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 msgr2=0x7fb82c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb84010d230 tx=0x7fb830031420 comp rx=0 tx=0).stop 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 msgr2=0x7fb84010b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c8a0 tx=0x7fb82800cd60 comp rx=0 tx=0).stop 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 shutdown_connections 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb82c07af90 0x7fb82c07d450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb840106810 0x7fb84010bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 --2- 172.21.15.27:0/2782760903 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb840100810 0x7fb84010b7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 >> 172.21.15.27:0/2782760903 conn(0x7fb8400fc510 msgr2=0x7fb8400fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 shutdown_connections 2024-09-20T19:17:46.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:46.865+0000 7fb844c11640 1 -- 172.21.15.27:0/2782760903 wait complete. 2024-09-20T19:17:47.524 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:47 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2782760903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-20T19:17:47.555 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-20T19:17:47.555 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 17 2024-09-20T19:17:47.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:47 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2782760903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-20T19:17:47.818 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- 172.21.15.27:0/4059212235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 msgr2=0x7f8c50106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 --2- 172.21.15.27:0/4059212235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c50106bd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009880 tx=0x7f8c4802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- 172.21.15.27:0/4059212235 shutdown_connections 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 --2- 172.21.15.27:0/4059212235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 0x7f8c50100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 --2- 172.21.15.27:0/4059212235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c50106bd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- 172.21.15.27:0/4059212235 >> 172.21.15.27:0/4059212235 conn(0x7f8c500fc550 msgr2=0x7f8c500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- 172.21.15.27:0/4059212235 shutdown_connections 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- 172.21.15.27:0/4059212235 wait complete. 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 Processor -- start 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.319+0000 7f8c57e13640 1 -- start start 2024-09-20T19:17:48.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c57e13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 0x7f8c5019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c57e13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c57e13640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5010dca0 con 0x7f8c501067f0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c57e13640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5010db20 con 0x7f8c501007f0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53104/0 (socket says 172.21.15.27:53104) 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 -- 172.21.15.27:0/3522632007 learned_addr learned my addr 172.21.15.27:0/3522632007 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c55baf640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 0x7f8c5019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 -- 172.21.15.27:0/3522632007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 msgr2=0x7f8c5019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 0x7f8c5019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 -- 172.21.15.27:0/3522632007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c50197750 con 0x7f8c501067f0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c553ae640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c8a0 tx=0x7f8c4400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c440079b0 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c44007b50 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c50197a40 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.320+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c44018700 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.321+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c50197fd0 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.321+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c50101f30 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.322+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8c44007d00 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.323+0000 7f8c4effd640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 0x7f8c3807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.323+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f8c4409e330 con 0x7f8c501067f0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.323+0000 7f8c55baf640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 0x7f8c3807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.323+0000 7f8c55baf640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 0x7f8c3807d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c48000c00 tx=0x7f8c48031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:48.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.327+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c44014030 con 0x7f8c501067f0 2024-09-20T19:17:48.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.551+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f8c50198c80 con 0x7f8c501067f0 2024-09-20T19:17:48.553 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:48 smithi027 ceph-mon[110082]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:48.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.552+0000 7f8c4effd640 1 -- 172.21.15.27:0/3522632007 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) ==== 107+0+4470 (secure 0 0 0) 0x7f8c44069800 con 0x7f8c501067f0 2024-09-20T19:17:48.554 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:48.554 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"btime":"2024-09-20T19:14:13:950325+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14594,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/3242536468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":3242536468},{"type":"v1","addr":"172.21.15.27:6827","nonce":3242536468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:48.554 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 17 2024-09-20T19:17:48.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 msgr2=0x7f8c3807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 0x7f8c3807d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c48000c00 tx=0x7f8c48031400 comp rx=0 tx=0).stop 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 msgr2=0x7f8c5019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c8a0 tx=0x7f8c4400cd60 comp rx=0 tx=0).stop 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 shutdown_connections 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f8c3807af80 0x7f8c3807d440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c501067f0 0x7f8c5019dbc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 --2- 172.21.15.27:0/3522632007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c501007f0 0x7f8c5019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 >> 172.21.15.27:0/3522632007 conn(0x7f8c500fc550 msgr2=0x7f8c50069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 shutdown_connections 2024-09-20T19:17:48.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:48.554+0000 7f8c57e13640 1 -- 172.21.15.27:0/3522632007 wait complete. 2024-09-20T19:17:48.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:48 smithi098 ceph-mon[80954]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:49.185 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-20T19:17:49.186 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 18 2024-09-20T19:17:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:49.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:49 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3522632007' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-20T19:17:49.721 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:49 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3522632007' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-20T19:17:49.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 -- 172.21.15.27:0/497465971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 msgr2=0x7f599c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 --2- 172.21.15.27:0/497465971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c101d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f598c009880 tx=0x7f598c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 -- 172.21.15.27:0/497465971 shutdown_connections 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 --2- 172.21.15.27:0/497465971 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c101d60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 --2- 172.21.15.27:0/497465971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 0x7f599c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.951+0000 7f59a41e0640 1 -- 172.21.15.27:0/497465971 >> 172.21.15.27:0/497465971 conn(0x7f599c0fd600 msgr2=0x7f599c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 -- 172.21.15.27:0/497465971 shutdown_connections 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 -- 172.21.15.27:0/497465971 wait complete. 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 Processor -- start 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 -- start start 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 0x7f599c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f599c10edd0 con 0x7f599c101900 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a41e0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f599c10ec50 con 0x7f599c107900 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.952+0000 7f59a1f7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53118/0 (socket says 172.21.15.27:53118) 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 -- 172.21.15.27:0/1069601812 learned_addr learned my addr 172.21.15.27:0/1069601812 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a177b640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 0x7f599c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 -- 172.21.15.27:0/1069601812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 msgr2=0x7f599c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 0x7f599c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 -- 172.21.15.27:0/1069601812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c1999d0 con 0x7f599c101900 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a1f7c640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f599800d6f0 tx=0x7f599800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5998017070 con 0x7f599c101900 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c199cc0 con 0x7f599c101900 2024-09-20T19:17:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f599800de00 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5998004bb0 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.953+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c19a220 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.954+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c103040 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.955+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5998004e60 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.955+0000 7f5992ffd640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 0x7f598807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.955+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f599809de00 con 0x7f599c101900 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.955+0000 7f59a177b640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 0x7f598807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.956+0000 7f59a177b640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 0x7f598807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599c19b1c0 tx=0x7f598c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:49.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:49.960+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5998069250 con 0x7f599c101900 2024-09-20T19:17:50.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.187+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7f599c19a4d0 con 0x7f599c101900 2024-09-20T19:17:50.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.188+0000 7f5992ffd640 1 -- 172.21.15.27:0/1069601812 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) ==== 107+0+5314 (secure 0 0 0) 0x7f599806e100 con 0x7f599c101900 2024-09-20T19:17:50.189 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:50.189 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":18,"btime":"2024-09-20T19:14:14:965237+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14594,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/3242536468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":3242536468},{"type":"v1","addr":"172.21.15.27:6827","nonce":3242536468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/448016576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":448016576},{"type":"v1","addr":"172.21.15.27:6829","nonce":448016576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:50.190 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 18 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 msgr2=0x7f598807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 0x7f598807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599c19b1c0 tx=0x7f598c031400 comp rx=0 tx=0).stop 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 msgr2=0x7f599c19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f599800d6f0 tx=0x7f599800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 shutdown_connections 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f598807af30 0x7f598807d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c107900 0x7f599c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 --2- 172.21.15.27:0/1069601812 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f599c101900 0x7f599c19f810 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 >> 172.21.15.27:0/1069601812 conn(0x7f599c0fd600 msgr2=0x7f599c074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 shutdown_connections 2024-09-20T19:17:50.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:50.190+0000 7f59a41e0640 1 -- 172.21.15.27:0/1069601812 wait complete. 2024-09-20T19:17:50.557 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:50 smithi027 ceph-mon[110082]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:50.557 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:50 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1069601812' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-20T19:17:50.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:50 smithi098 ceph-mon[80954]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:50.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:50 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1069601812' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-20T19:17:50.946 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-20T19:17:50.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 19 2024-09-20T19:17:51.208 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 -- 172.21.15.27:0/476685342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054103480 msgr2=0x7f005410b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 --2- 172.21.15.27:0/476685342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054103480 0x7f005410b970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0044009880 tx=0x7f004402a530 comp rx=0 tx=0).stop 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 -- 172.21.15.27:0/476685342 shutdown_connections 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 --2- 172.21.15.27:0/476685342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054103480 0x7f005410b970 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 --2- 172.21.15.27:0/476685342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054102b60 0x7f0054102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 -- 172.21.15.27:0/476685342 >> 172.21.15.27:0/476685342 conn(0x7f00540fc520 msgr2=0x7f00540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 -- 172.21.15.27:0/476685342 shutdown_connections 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.676+0000 7f005b207640 1 -- 172.21.15.27:0/476685342 wait complete. 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 Processor -- start 2024-09-20T19:17:51.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 -- start start 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054103480 0x7f005419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f005410ee50 con 0x7f0054102b60 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f005b207640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f005410ecd0 con 0x7f0054103480 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53142/0 (socket says 172.21.15.27:53142) 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 -- 172.21.15.27:0/2520959763 learned_addr learned my addr 172.21.15.27:0/2520959763 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0053fff640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054103480 0x7f005419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 -- 172.21.15.27:0/2520959763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054103480 msgr2=0x7f005419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054103480 0x7f005419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 -- 172.21.15.27:0/2520959763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00541978e0 con 0x7f0054102b60 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.677+0000 7f0058fa3640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f003c00b420 tx=0x7f003c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:51.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.678+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f003c011630 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.678+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f003c016070 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.678+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0054197bd0 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.678+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f003c010d40 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.678+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0054198130 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.679+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005406a9f0 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.679+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f003c01b460 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.680+0000 7f0051ffb640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 0x7f004007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.680+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f003c09d8a0 con 0x7f0054102b60 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.680+0000 7f0053fff640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 0x7f004007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.680+0000 7f0053fff640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 0x7f004007d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00541990d0 tx=0x7f0044004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:51.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.684+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f003c021250 con 0x7f0054102b60 2024-09-20T19:17:51.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.909+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f0054198e10 con 0x7f0054102b60 2024-09-20T19:17:51.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.910+0000 7f0051ffb640 1 -- 172.21.15.27:0/2520959763 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) ==== 107+0+4467 (secure 0 0 0) 0x7f003c068d70 con 0x7f0054102b60 2024-09-20T19:17:51.911 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:51.911 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"btime":"2024-09-20T19:14:17:593916+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/448016576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":448016576},{"type":"v1","addr":"172.21.15.27:6829","nonce":448016576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:51.912 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 19 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 msgr2=0x7f004007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 0x7f004007d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00541990d0 tx=0x7f0044004f30 comp rx=0 tx=0).stop 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 msgr2=0x7f005419d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f003c00b420 tx=0x7f003c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 shutdown_connections 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f004007af80 0x7f004007d440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0054103480 0x7f005419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 --2- 172.21.15.27:0/2520959763 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0054102b60 0x7f005419d720 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 >> 172.21.15.27:0/2520959763 conn(0x7f00540fc520 msgr2=0x7f0054103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 shutdown_connections 2024-09-20T19:17:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:51.912+0000 7f005b207640 1 -- 172.21.15.27:0/2520959763 wait complete. 2024-09-20T19:17:52.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:52 smithi098 ceph-mon[80954]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:52.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:52 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2520959763' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-20T19:17:52.523 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:52 smithi027 ceph-mon[110082]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:52.523 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:52 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2520959763' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-20T19:17:52.553 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-20T19:17:52.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 20 2024-09-20T19:17:52.823 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:53.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 -- 172.21.15.27:0/75638042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 msgr2=0x7f1330107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 --2- 172.21.15.27:0/75638042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330107ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1324009880 tx=0x7f132402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 -- 172.21.15.27:0/75638042 shutdown_connections 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 --2- 172.21.15.27:0/75638042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 0x7f1330101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 --2- 172.21.15.27:0/75638042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330107ce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 -- 172.21.15.27:0/75638042 >> 172.21.15.27:0/75638042 conn(0x7f13300fd600 msgr2=0x7f13300ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 -- 172.21.15.27:0/75638042 shutdown_connections 2024-09-20T19:17:53.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 -- 172.21.15.27:0/75638042 wait complete. 2024-09-20T19:17:53.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.250+0000 7f133707c640 1 Processor -- start 2024-09-20T19:17:53.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f133707c640 1 -- start start 2024-09-20T19:17:53.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f133707c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 0x7f13300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f133707c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f133707c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f133010ee30 con 0x7f1330107900 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f133707c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f133010ecb0 con 0x7f1330101900 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53160/0 (socket says 172.21.15.27:53160) 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 -- 172.21.15.27:0/1158692497 learned_addr learned my addr 172.21.15.27:0/1158692497 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f1334e18640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 0x7f13300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 -- 172.21.15.27:0/1158692497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 msgr2=0x7f13300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 0x7f13300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 -- 172.21.15.27:0/1158692497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1330074f70 con 0x7f1330107900 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.251+0000 7f132ffff640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b420 tx=0x7f131c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.252+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f131c011630 con 0x7f1330107900 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.252+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f131c016070 con 0x7f1330107900 2024-09-20T19:17:53.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.252+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1330075260 con 0x7f1330107900 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.252+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f131c010d40 con 0x7f1330107900 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.252+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13301a3e90 con 0x7f1330107900 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.253+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1330103040 con 0x7f1330107900 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.253+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f131c01b460 con 0x7f1330107900 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.254+0000 7f132dffb640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 0x7f132007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:53.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.254+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f131c09d8a0 con 0x7f1330107900 2024-09-20T19:17:53.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.254+0000 7f1334e18640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 0x7f132007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:53.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.255+0000 7f1334e18640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 0x7f132007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13240096c0 tx=0x7f1324031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:53.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.259+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f131c068cf0 con 0x7f1330107900 2024-09-20T19:17:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.485+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f1330109e70 con 0x7f1330107900 2024-09-20T19:17:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.486+0000 7f132dffb640 1 -- 172.21.15.27:0/1158692497 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) ==== 107+0+5308 (secure 0 0 0) 0x7f131c06dba0 con 0x7f1330107900 2024-09-20T19:17:53.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:53.488 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"btime":"2024-09-20T19:14:22:662781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/448016576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":448016576},{"type":"v1","addr":"172.21.15.27:6829","nonce":448016576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 20 2024-09-20T19:17:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 msgr2=0x7f132007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 0x7f132007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13240096c0 tx=0x7f1324031400 comp rx=0 tx=0).stop 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 msgr2=0x7f1330074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b420 tx=0x7f131c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 shutdown_connections 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f132007af30 0x7f132007d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1330107900 0x7f1330074a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 --2- 172.21.15.27:0/1158692497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1330101900 0x7f13300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 >> 172.21.15.27:0/1158692497 conn(0x7f13300fd600 msgr2=0x7f13300fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 shutdown_connections 2024-09-20T19:17:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:53.488+0000 7f133707c640 1 -- 172.21.15.27:0/1158692497 wait complete. 2024-09-20T19:17:54.091 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-20T19:17:54.091 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 21 2024-09-20T19:17:54.347 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:54.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:54 smithi098 ceph-mon[80954]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:54.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:54 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1158692497' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-20T19:17:54.758 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:54 smithi027 ceph-mon[110082]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:54.758 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:54 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1158692497' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-20T19:17:54.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 -- 172.21.15.27:0/3658910554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1067f0 msgr2=0x7f76ec106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 --2- 172.21.15.27:0/3658910554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1067f0 0x7f76ec106bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009880 tx=0x7f76e402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 -- 172.21.15.27:0/3658910554 shutdown_connections 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 --2- 172.21.15.27:0/3658910554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1007f0 0x7f76ec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 --2- 172.21.15.27:0/3658910554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1067f0 0x7f76ec106bd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 -- 172.21.15.27:0/3658910554 >> 172.21.15.27:0/3658910554 conn(0x7f76ec0fc550 msgr2=0x7f76ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 -- 172.21.15.27:0/3658910554 shutdown_connections 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 -- 172.21.15.27:0/3658910554 wait complete. 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.840+0000 7f76f3df2640 1 Processor -- start 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f3df2640 1 -- start start 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f3df2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f3df2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1067f0 0x7f76ec19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f3df2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10dca0 con 0x7f76ec1007f0 2024-09-20T19:17:54.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f3df2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10db20 con 0x7f76ec1067f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53174/0 (socket says 172.21.15.27:53174) 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 -- 172.21.15.27:0/4183925999 learned_addr learned my addr 172.21.15.27:0/4183925999 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f138d640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1067f0 0x7f76ec19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 -- 172.21.15.27:0/4183925999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1067f0 msgr2=0x7f76ec19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1067f0 0x7f76ec19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 -- 172.21.15.27:0/4183925999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec196790 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.841+0000 7f76f1b8e640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f76e4031460 tx=0x7f76e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.842+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76e403f070 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.842+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76e40035f0 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.842+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec196a20 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.842+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76e4035030 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.842+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec196f50 con 0x7f76ec1007f0 2024-09-20T19:17:54.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.843+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec101f30 con 0x7f76ec1007f0 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.843+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76e4042070 con 0x7f76ec1007f0 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.844+0000 7f76eaffd640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.844+0000 7f76f138d640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.844+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f76e40beac0 con 0x7f76ec1007f0 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.844+0000 7f76f138d640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 0x7f76d407d440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0ffca0 tx=0x7f76e000b590 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:54.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:54.848+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76e4089f90 con 0x7f76ec1007f0 2024-09-20T19:17:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.079+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f76ec197cc0 con 0x7f76ec1007f0 2024-09-20T19:17:55.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.080+0000 7f76eaffd640 1 -- 172.21.15.27:0/4183925999 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) ==== 107+0+4464 (secure 0 0 0) 0x7f76e408ee40 con 0x7f76ec1007f0 2024-09-20T19:17:55.082 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:55.082 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":21,"btime":"2024-09-20T19:14:35:702572+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:55.082 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 21 2024-09-20T19:17:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 msgr2=0x7f76d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:55.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 0x7f76d407d440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0ffca0 tx=0x7f76e000b590 comp rx=0 tx=0).stop 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 msgr2=0x7f76ec19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f76e4031460 tx=0x7f76e40045e0 comp rx=0 tx=0).stop 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 shutdown_connections 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1067f0 0x7f76ec19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 --2- 172.21.15.27:0/4183925999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f76ec1007f0 0x7f76ec19c610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 >> 172.21.15.27:0/4183925999 conn(0x7f76ec0fc550 msgr2=0x7f76ec0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 shutdown_connections 2024-09-20T19:17:55.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:55.083+0000 7f76f3df2640 1 -- 172.21.15.27:0/4183925999 wait complete. 2024-09-20T19:17:55.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:55 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/4183925999' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-20T19:17:55.710 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-20T19:17:55.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 22 2024-09-20T19:17:55.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:55 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/4183925999' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-20T19:17:55.971 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:56.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 -- 172.21.15.27:0/2253474651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc1033d0 msgr2=0x7fd0cc10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:56.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 --2- 172.21.15.27:0/2253474651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc10b8c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009880 tx=0x7fd0bc02a530 comp rx=0 tx=0).stop 2024-09-20T19:17:56.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 -- 172.21.15.27:0/2253474651 shutdown_connections 2024-09-20T19:17:56.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 --2- 172.21.15.27:0/2253474651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc10b8c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 --2- 172.21.15.27:0/2253474651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 -- 172.21.15.27:0/2253474651 >> 172.21.15.27:0/2253474651 conn(0x7fd0cc0fc550 msgr2=0x7fd0cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 -- 172.21.15.27:0/2253474651 shutdown_connections 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.440+0000 7fd0d356b640 1 -- 172.21.15.27:0/2253474651 wait complete. 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 Processor -- start 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 -- start start 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc10ede0 con 0x7fd0cc102ab0 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d356b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc10ec60 con 0x7fd0cc1033d0 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d1307640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d1307640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38646/0 (socket says 172.21.15.27:38646) 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.441+0000 7fd0d1307640 1 -- 172.21.15.27:0/3087990876 learned_addr learned my addr 172.21.15.27:0/3087990876 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d0b06640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:56.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d1307640 1 -- 172.21.15.27:0/3087990876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc1033d0 msgr2=0x7fd0cc19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d1307640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d1307640 1 -- 172.21.15.27:0/3087990876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc197810 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d1307640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d6f0 tx=0x7fd0c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0c8017070 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0c800de00 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc197b00 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0c8004bb0 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.442+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc198090 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.443+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0cc06a580 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.444+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd0c8009a30 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.444+0000 7fd0c27fc640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 0x7fd0b807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.444+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fd0c809dd20 con 0x7fd0cc102ab0 2024-09-20T19:17:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.444+0000 7fd0d0b06640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 0x7fd0b807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:56.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.445+0000 7fd0d0b06640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 0x7fd0b807d450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc031460 tx=0x7fd0bc000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:56.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.449+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0c80691f0 con 0x7fd0cc102ab0 2024-09-20T19:17:56.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.679+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7fd0cc105f50 con 0x7fd0cc102ab0 2024-09-20T19:17:56.681 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:56 smithi027 ceph-mon[110082]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:56.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.679+0000 7fd0c27fc640 1 -- 172.21.15.27:0/3087990876 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) ==== 107+0+5311 (secure 0 0 0) 0x7fd0c806e0a0 con 0x7fd0cc102ab0 2024-09-20T19:17:56.681 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:56.681 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"btime":"2024-09-20T19:14:39:759274+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:12.952208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi098.fdtjxi","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.98:6825/3223633733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3223633733},{"type":"v1","addr":"172.21.15.98:6825","nonce":3223633733}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-20T19:17:56.682 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 22 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 msgr2=0x7fd0b807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 0x7fd0b807d450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc031460 tx=0x7fd0bc000bc0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 msgr2=0x7fd0cc19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d6f0 tx=0x7fd0c800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 shutdown_connections 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd0b807af90 0x7fd0b807d450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc1033d0 0x7fd0cc19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 --2- 172.21.15.27:0/3087990876 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0cc102ab0 0x7fd0cc19d690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 >> 172.21.15.27:0/3087990876 conn(0x7fd0cc0fc550 msgr2=0x7fd0cc108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 shutdown_connections 2024-09-20T19:17:56.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:56.682+0000 7fd0d356b640 1 -- 172.21.15.27:0/3087990876 wait complete. 2024-09-20T19:17:56.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:56 smithi098 ceph-mon[80954]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:17:57.355 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-20T19:17:57.355 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 23 2024-09-20T19:17:57.638 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:57.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:57 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3087990876' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-20T19:17:57.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:17:57.759 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:57 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3087990876' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-20T19:17:57.760 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- 172.21.15.27:0/1200221051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41007f0 msgr2=0x7f99e4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1200221051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41007f0 0x7f99e4100c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009880 tx=0x7f99d402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- 172.21.15.27:0/1200221051 shutdown_connections 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1200221051 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41007f0 0x7f99e4100c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1200221051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41067f0 0x7f99e4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- 172.21.15.27:0/1200221051 >> 172.21.15.27:0/1200221051 conn(0x7f99e40fc550 msgr2=0x7f99e40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- 172.21.15.27:0/1200221051 shutdown_connections 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- 172.21.15.27:0/1200221051 wait complete. 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 Processor -- start 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.102+0000 7f99eb64c640 1 -- start start 2024-09-20T19:17:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99eb64c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41007f0 0x7f99e419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99eb64c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99eb64c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f99e410dca0 con 0x7f99e41067f0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99eb64c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99e410db20 con 0x7f99e41007f0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38658/0 (socket says 172.21.15.27:38658) 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 -- 172.21.15.27:0/1314338549 learned_addr learned my addr 172.21.15.27:0/1314338549 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e93e8640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41007f0 0x7f99e419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 -- 172.21.15.27:0/1314338549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41007f0 msgr2=0x7f99e419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41007f0 0x7f99e419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 -- 172.21.15.27:0/1314338549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e4197780 con 0x7f99e41067f0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99e8be7640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99d4031460 tx=0x7f99d4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.103+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99d403f070 con 0x7f99e41067f0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.104+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99d4004a90 con 0x7f99e41067f0 2024-09-20T19:17:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.104+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e4197a10 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.104+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99d4035030 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.104+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e4197f40 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.105+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e4101f30 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.105+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f99d4042070 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.106+0000 7f99da7fc640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 0x7f99d007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.106+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f99d40beb70 con 0x7f99e41067f0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.106+0000 7f99e93e8640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 0x7f99d007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:58.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.106+0000 7f99e93e8640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 0x7f99d007d450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009bd0 tx=0x7f99e0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.110+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99d408a040 con 0x7f99e41067f0 2024-09-20T19:17:58.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.335+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f99e4109d90 con 0x7f99e41067f0 2024-09-20T19:17:58.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.336+0000 7f99da7fc640 1 -- 172.21.15.27:0/1314338549 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) ==== 107+0+4445 (secure 0 0 0) 0x7f99d408eef0 con 0x7f99e41067f0 2024-09-20T19:17:58.338 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:17:58.338 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"btime":"2024-09-20T19:14:52:421599+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:52.421593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:17:58.338 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 23 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 msgr2=0x7f99d007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 0x7f99d007d450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009bd0 tx=0x7f99e0005f90 comp rx=0 tx=0).stop 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 msgr2=0x7f99e419db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99d4031460 tx=0x7f99d4004530 comp rx=0 tx=0).stop 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 shutdown_connections 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f99d007af90 0x7f99d007d450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e41067f0 0x7f99e419db40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 --2- 172.21.15.27:0/1314338549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99e41007f0 0x7f99e419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:58.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.338+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 >> 172.21.15.27:0/1314338549 conn(0x7f99e40fc550 msgr2=0x7f99e4069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:58.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.339+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 shutdown_connections 2024-09-20T19:17:58.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:58.339+0000 7f99eb64c640 1 -- 172.21.15.27:0/1314338549 wait complete. 2024-09-20T19:17:58.670 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:58.670 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.670 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.671 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:58.671 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:17:58.671 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:17:58.671 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.671 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:17:58 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1314338549' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:17:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:17:58 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1314338549' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-20T19:17:59.051 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-20T19:17:59.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 24 2024-09-20T19:17:59.313 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 -- 172.21.15.27:0/2700074146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c106800 msgr2=0x7f5f4c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/2700074146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c106800 0x7f5f4c106be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009880 tx=0x7f5f4802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 -- 172.21.15.27:0/2700074146 shutdown_connections 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/2700074146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c100800 0x7f5f4c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/2700074146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c106800 0x7f5f4c106be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:59.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 -- 172.21.15.27:0/2700074146 >> 172.21.15.27:0/2700074146 conn(0x7f5f4c0fc520 msgr2=0x7f5f4c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 -- 172.21.15.27:0/2700074146 shutdown_connections 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.764+0000 7f5f53bd5640 1 -- 172.21.15.27:0/2700074146 wait complete. 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 Processor -- start 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 -- start start 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c106800 0x7f5f4c0fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c10dcd0 con 0x7f5f4c100800 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f53bd5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c10db50 con 0x7f5f4c106800 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f51971640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f51971640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38676/0 (socket says 172.21.15.27:38676) 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.765+0000 7f5f51971640 1 -- 172.21.15.27:0/1561544128 learned_addr learned my addr 172.21.15.27:0/1561544128 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:17:59.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f51170640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c106800 0x7f5f4c0fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f51971640 1 -- 172.21.15.27:0/1561544128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c106800 msgr2=0x7f5f4c0fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f51971640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c106800 0x7f5f4c0fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f51971640 1 -- 172.21.15.27:0/1561544128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c0fd680 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f51971640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f48031460 tx=0x7f5f480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f4803f070 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f480035f0 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c0fd910 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f48035030 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.766+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c1a3da0 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.767+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c101f40 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.768+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5f48042070 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.768+0000 7f5f42ffd640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 0x7f5f3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.768+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f5f480bebd0 con 0x7f5f4c100800 2024-09-20T19:17:59.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.768+0000 7f5f51170640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 0x7f5f3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:59.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.769+0000 7f5f51170640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 0x7f5f3807d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c005fd0 tx=0x7f5f3c005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:59.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.773+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f4808a020 con 0x7f5f4c100800 2024-09-20T19:17:59.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.999+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f5f4c109d80 con 0x7f5f4c100800 2024-09-20T19:18:00.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:17:59.999+0000 7f5f42ffd640 1 -- 172.21.15.27:0/1561544128 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) ==== 107+0+4456 (secure 0 0 0) 0x7f5f4808c020 con 0x7f5f4c100800 2024-09-20T19:18:00.000 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:00.000 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":24,"btime":"2024-09-20T19:14:52:427320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:14:52.427304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24353":{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:00.000 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 24 2024-09-20T19:18:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.001+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 msgr2=0x7f5f3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 0x7f5f3807d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c005fd0 tx=0x7f5f3c005850 comp rx=0 tx=0).stop 2024-09-20T19:18:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 msgr2=0x7f5f4c0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f48031460 tx=0x7f5f480045e0 comp rx=0 tx=0).stop 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 shutdown_connections 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f5f3807af30 0x7f5f3807d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f4c106800 0x7f5f4c0fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 --2- 172.21.15.27:0/1561544128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f4c100800 0x7f5f4c0fcc00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 >> 172.21.15.27:0/1561544128 conn(0x7f5f4c0fc520 msgr2=0x7f5f4c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 shutdown_connections 2024-09-20T19:18:00.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:00.002+0000 7f5f53bd5640 1 -- 172.21.15.27:0/1561544128 wait complete. 2024-09-20T19:18:00.659 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-20T19:18:00.659 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 25 2024-09-20T19:18:00.773 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:00 smithi098 ceph-mon[80954]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:00.773 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:00 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1561544128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-20T19:18:00.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:00 smithi027 ceph-mon[110082]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:00.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:00 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1561544128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-20T19:18:00.920 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 -- 172.21.15.27:0/2713062223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 msgr2=0x7f2764107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 --2- 172.21.15.27:0/2713062223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f2764107ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2758009880 tx=0x7f275802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 -- 172.21.15.27:0/2713062223 shutdown_connections 2024-09-20T19:18:01.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 --2- 172.21.15.27:0/2713062223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 0x7f2764101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 --2- 172.21.15.27:0/2713062223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f2764107ce0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 -- 172.21.15.27:0/2713062223 >> 172.21.15.27:0/2713062223 conn(0x7f27640fd600 msgr2=0x7f27640ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 -- 172.21.15.27:0/2713062223 shutdown_connections 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 -- 172.21.15.27:0/2713062223 wait complete. 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.365+0000 7f276b040640 1 Processor -- start 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f276b040640 1 -- start start 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f276b040640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 0x7f276419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f276b040640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f276b040640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f276410ee30 con 0x7f2764107900 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f276b040640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f276410ecb0 con 0x7f2764101900 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38688/0 (socket says 172.21.15.27:38688) 2024-09-20T19:18:01.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 -- 172.21.15.27:0/3284715396 learned_addr learned my addr 172.21.15.27:0/3284715396 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2768ddc640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 0x7f276419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 -- 172.21.15.27:0/3284715396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 msgr2=0x7f276419f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 0x7f276419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 -- 172.21.15.27:0/3284715396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2764199a30 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2763fff640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f275000b420 tx=0x7f275000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.366+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2750011630 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.367+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2764199d20 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.367+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2750016070 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.367+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2750010d40 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.367+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276419a2b0 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.368+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764103040 con 0x7f2764107900 2024-09-20T19:18:01.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.368+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f275001b460 con 0x7f2764107900 2024-09-20T19:18:01.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.369+0000 7f2761ffb640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 0x7f275407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:01.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.369+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f275009d8b0 con 0x7f2764107900 2024-09-20T19:18:01.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.369+0000 7f2768ddc640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 0x7f275407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:01.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.370+0000 7f2768ddc640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 0x7f275407d440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2758031460 tx=0x7f2758009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:01.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.373+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2750068d20 con 0x7f2764107900 2024-09-20T19:18:01.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.604+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f276419b030 con 0x7f2764107900 2024-09-20T19:18:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.604+0000 7f2761ffb640 1 -- 172.21.15.27:0/3284715396 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) ==== 107+0+4461 (secure 0 0 0) 0x7f275006dbd0 con 0x7f2764107900 2024-09-20T19:18:01.605 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:01.605 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":25,"btime":"2024-09-20T19:15:01:542814+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:01.144907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24353":{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":177,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:01.605 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 25 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 msgr2=0x7f275407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 0x7f275407d440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2758031460 tx=0x7f2758009560 comp rx=0 tx=0).stop 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 msgr2=0x7f276419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f275000b420 tx=0x7f275000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 shutdown_connections 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f275407af80 0x7f275407d440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2764107900 0x7f276419fdb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 --2- 172.21.15.27:0/3284715396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2764101900 0x7f276419f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 >> 172.21.15.27:0/3284715396 conn(0x7f27640fd600 msgr2=0x7f2764074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 shutdown_connections 2024-09-20T19:18:01.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:01.607+0000 7f276b040640 1 -- 172.21.15.27:0/3284715396 wait complete. 2024-09-20T19:18:02.333 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-20T19:18:02.333 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 26 2024-09-20T19:18:02.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:02 smithi027 ceph-mon[110082]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:02.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:02 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3284715396' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-20T19:18:02.597 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:02.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:02 smithi098 ceph-mon[80954]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:02.721 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:02 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3284715396' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 -- 172.21.15.27:0/4163385340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8100800 msgr2=0x7f69e8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 --2- 172.21.15.27:0/4163385340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8100800 0x7f69e8100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009880 tx=0x7f69e402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 -- 172.21.15.27:0/4163385340 shutdown_connections 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 --2- 172.21.15.27:0/4163385340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8100800 0x7f69e8100c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 --2- 172.21.15.27:0/4163385340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8106800 0x7f69e8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 -- 172.21.15.27:0/4163385340 >> 172.21.15.27:0/4163385340 conn(0x7f69e80fc520 msgr2=0x7f69e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:03.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 -- 172.21.15.27:0/4163385340 shutdown_connections 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.029+0000 7f69ef540640 1 -- 172.21.15.27:0/4163385340 wait complete. 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 Processor -- start 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 -- start start 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8100800 0x7f69e819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f69e810dcd0 con 0x7f69e8106800 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ef540640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f69e810db50 con 0x7f69e8100800 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ecadb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ecadb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38708/0 (socket says 172.21.15.27:38708) 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ecadb640 1 -- 172.21.15.27:0/2739809384 learned_addr learned my addr 172.21.15.27:0/2739809384 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.030+0000 7f69ed2dc640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8100800 0x7f69e819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ecadb640 1 -- 172.21.15.27:0/2739809384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8100800 msgr2=0x7f69e819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ecadb640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8100800 0x7f69e819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ecadb640 1 -- 172.21.15.27:0/2739809384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e81966a0 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ecadb640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69e4031460 tx=0x7f69e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e403f070 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69e4004cf0 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e4035030 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e8196930 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.031+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e8196e30 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.032+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e8101f40 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.033+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f69e4042070 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.033+0000 7f69de7fc640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 0x7f69d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.033+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f69e40bec20 con 0x7f69e8106800 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.033+0000 7f69ed2dc640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 0x7f69d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.034+0000 7f69ed2dc640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 0x7f69d007d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69d80058c0 tx=0x7f69d800a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:03.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.038+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69e408a010 con 0x7f69e8106800 2024-09-20T19:18:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.263+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f69e8197bd0 con 0x7f69e8106800 2024-09-20T19:18:03.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.264+0000 7f69de7fc640 1 -- 172.21.15.27:0/2739809384 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) ==== 107+0+4458 (secure 0 0 0) 0x7f69e408eec0 con 0x7f69e8106800 2024-09-20T19:18:03.264 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:03.265 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"btime":"2024-09-20T19:15:02:550320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:01.552633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24353":{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":178,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:03.265 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-20T19:18:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 msgr2=0x7f69d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 0x7f69d007d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69d80058c0 tx=0x7f69d800a250 comp rx=0 tx=0).stop 2024-09-20T19:18:03.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 msgr2=0x7f69e819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69e4031460 tx=0x7f69e40048f0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 shutdown_connections 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f69d007af30 0x7f69d007d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69e8106800 0x7f69e819cb10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 --2- 172.21.15.27:0/2739809384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69e8100800 0x7f69e819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 >> 172.21.15.27:0/2739809384 conn(0x7f69e80fc520 msgr2=0x7f69e80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 shutdown_connections 2024-09-20T19:18:03.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:03.266+0000 7f69ef540640 1 -- 172.21.15.27:0/2739809384 wait complete. 2024-09-20T19:18:03.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:03 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2739809384' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-20T19:18:03.897 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-20T19:18:03.897 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 27 2024-09-20T19:18:03.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:03 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2739809384' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-20T19:18:04.164 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:04.546 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:04 smithi027 ceph-mon[110082]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 -- 172.21.15.27:0/1042144005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30102ac0 msgr2=0x7fce30102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 --2- 172.21.15.27:0/1042144005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30102ac0 0x7fce30102ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009880 tx=0x7fce2c02a530 comp rx=0 tx=0).stop 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 -- 172.21.15.27:0/1042144005 shutdown_connections 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 --2- 172.21.15.27:0/1042144005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce301033e0 0x7fce3010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 --2- 172.21.15.27:0/1042144005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce30102ac0 0x7fce30102ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.629+0000 7fce3730b640 1 -- 172.21.15.27:0/1042144005 >> 172.21.15.27:0/1042144005 conn(0x7fce300fc520 msgr2=0x7fce300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:04.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 -- 172.21.15.27:0/1042144005 shutdown_connections 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 -- 172.21.15.27:0/1042144005 wait complete. 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 Processor -- start 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 -- start start 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 0x7fce3019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fce3010edd0 con 0x7fce301033e0 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.630+0000 7fce3730b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce3010ec50 con 0x7fce30102ac0 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38728/0 (socket says 172.21.15.27:38728) 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 -- 172.21.15.27:0/3970220813 learned_addr learned my addr 172.21.15.27:0/3970220813 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce350a7640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 0x7fce3019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:04.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 -- 172.21.15.27:0/3970220813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 msgr2=0x7fce3019d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 0x7fce3019d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 -- 172.21.15.27:0/3970220813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce301978e0 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce350a7640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 0x7fce3019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce348a6640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce2000d6c0 tx=0x7fce2000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce20017070 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce30197bd0 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce20009ce0 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce2000f3c0 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.631+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce30198160 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.632+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3006aa90 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.633+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fce20010460 con 0x7fce301033e0 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.633+0000 7fce267fc640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 0x7fce1c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:04.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.634+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fce2009df90 con 0x7fce301033e0 2024-09-20T19:18:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.634+0000 7fce350a7640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 0x7fce1c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.634+0000 7fce350a7640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 0x7fce1c07d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce2c006010 tx=0x7fce2c005d50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:04.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.638+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce200693e0 con 0x7fce301033e0 2024-09-20T19:18:04.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.864+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7fce30105f90 con 0x7fce301033e0 2024-09-20T19:18:04.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.864+0000 7fce267fc640 1 -- 172.21.15.27:0/3970220813 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) ==== 107+0+4467 (secure 0 0 0) 0x7fce2006e290 con 0x7fce301033e0 2024-09-20T19:18:04.865 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:04.865 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":27,"btime":"2024-09-20T19:15:03:557988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:03.557980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24353":{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":0,"incarnation":24,"state":"up:active","state_seq":179,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24353,"qdb_cluster":[24353]},"id":1}]} 2024-09-20T19:18:04.866 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 27 2024-09-20T19:18:04.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 msgr2=0x7fce1c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:04.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 0x7fce1c07d400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce2c006010 tx=0x7fce2c005d50 comp rx=0 tx=0).stop 2024-09-20T19:18:04.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 msgr2=0x7fce3019dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:04.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce2000d6c0 tx=0x7fce2000db80 comp rx=0 tx=0).stop 2024-09-20T19:18:04.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 shutdown_connections 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fce1c07af40 0x7fce1c07d400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fce301033e0 0x7fce3019dc60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 --2- 172.21.15.27:0/3970220813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce30102ac0 0x7fce3019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.866+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 >> 172.21.15.27:0/3970220813 conn(0x7fce300fc520 msgr2=0x7fce30108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.867+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 shutdown_connections 2024-09-20T19:18:04.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:04.867+0000 7fce3730b640 1 -- 172.21.15.27:0/3970220813 wait complete. 2024-09-20T19:18:04.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:04 smithi098 ceph-mon[80954]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:05.486 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-20T19:18:05.486 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 28 2024-09-20T19:18:05.744 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:05.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:05 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3970220813' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-20T19:18:05.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:05 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3970220813' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-20T19:18:06.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 -- 172.21.15.27:0/3878895993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 msgr2=0x7fd618102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 --2- 172.21.15.27:0/3878895993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618102fc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd608009880 tx=0x7fd60802a530 comp rx=0 tx=0).stop 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 -- 172.21.15.27:0/3878895993 shutdown_connections 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 --2- 172.21.15.27:0/3878895993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd61810b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 --2- 172.21.15.27:0/3878895993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618102fc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 -- 172.21.15.27:0/3878895993 >> 172.21.15.27:0/3878895993 conn(0x7fd6180fc580 msgr2=0x7fd6180fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 -- 172.21.15.27:0/3878895993 shutdown_connections 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.236+0000 7fd61e501640 1 -- 172.21.15.27:0/3878895993 wait complete. 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 Processor -- start 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 -- start start 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd618100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd61810ee30 con 0x7fd618102be0 2024-09-20T19:18:06.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd61e501640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd61810ecb0 con 0x7fd618103500 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd617fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd617fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59096/0 (socket says 172.21.15.27:59096) 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.237+0000 7fd617fff640 1 -- 172.21.15.27:0/3284290755 learned_addr learned my addr 172.21.15.27:0/3284290755 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd60ffff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd618100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd617fff640 1 -- 172.21.15.27:0/3284290755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 msgr2=0x7fd618100d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd617fff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd618100d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd617fff640 1 -- 172.21.15.27:0/3284290755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181012c0 con 0x7fd618102be0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd60ffff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd618100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd617fff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd608004f90 tx=0x7fd6080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd60803f070 con 0x7fd618102be0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd618101550 con 0x7fd618102be0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd608004c70 con 0x7fd618102be0 2024-09-20T19:18:06.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd608035030 con 0x7fd618102be0 2024-09-20T19:18:06.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.238+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6181a3de0 con 0x7fd618102be0 2024-09-20T19:18:06.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.239+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61806ace0 con 0x7fd618102be0 2024-09-20T19:18:06.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.240+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd608042070 con 0x7fd618102be0 2024-09-20T19:18:06.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.240+0000 7fd615ffb640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 0x7fd60407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:06.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.241+0000 7fd60ffff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 0x7fd60407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:06.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.241+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fd6080bebe0 con 0x7fd618102be0 2024-09-20T19:18:06.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.241+0000 7fd60ffff640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 0x7fd60407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6181022d0 tx=0x7fd600005e50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:06.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.245+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd60808a030 con 0x7fd618102be0 2024-09-20T19:18:06.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.469+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fd618101d70 con 0x7fd618102be0 2024-09-20T19:18:06.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.470+0000 7fd615ffb640 1 -- 172.21.15.27:0/3284290755 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) ==== 107+0+5314 (secure 0 0 0) 0x7fd60808eee0 con 0x7fd618102be0 2024-09-20T19:18:06.471 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:06.471 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":28,"btime":"2024-09-20T19:15:04:565494+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:03.557980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24353":{"gid":24353,"name":"cephfs.smithi098.hnflps","rank":0,"incarnation":24,"state":"up:active","state_seq":179,"addr":"172.21.15.98:6827/1988280792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1988280792},{"type":"v1","addr":"172.21.15.98:6827","nonce":1988280792}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24353,"qdb_cluster":[24353]},"id":1}]} 2024-09-20T19:18:06.471 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 28 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.472+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 msgr2=0x7fd60407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 0x7fd60407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6181022d0 tx=0x7fd600005e50 comp rx=0 tx=0).stop 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 msgr2=0x7fd618100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd608004f90 tx=0x7fd6080048f0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 shutdown_connections 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd60407af30 0x7fd60407d3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd618103500 0x7fd618100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 --2- 172.21.15.27:0/3284290755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618102be0 0x7fd618100840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 >> 172.21.15.27:0/3284290755 conn(0x7fd6180fc580 msgr2=0x7fd618107f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 shutdown_connections 2024-09-20T19:18:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:06.473+0000 7fd61e501640 1 -- 172.21.15.27:0/3284290755 wait complete. 2024-09-20T19:18:06.773 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:06 smithi027 ceph-mon[110082]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:06.774 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:06 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3284290755' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-20T19:18:06.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:06 smithi098 ceph-mon[80954]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:06.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:06 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3284290755' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-20T19:18:07.147 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-20T19:18:07.147 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 29 2024-09-20T19:18:07.410 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 -- 172.21.15.27:0/2186425863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc102ac0 msgr2=0x7f97dc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 --2- 172.21.15.27:0/2186425863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc102ac0 0x7f97dc102ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009880 tx=0x7f97d802a530 comp rx=0 tx=0).stop 2024-09-20T19:18:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 -- 172.21.15.27:0/2186425863 shutdown_connections 2024-09-20T19:18:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 --2- 172.21.15.27:0/2186425863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc1033e0 0x7f97dc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 --2- 172.21.15.27:0/2186425863 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc102ac0 0x7f97dc102ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 -- 172.21.15.27:0/2186425863 >> 172.21.15.27:0/2186425863 conn(0x7f97dc0fc520 msgr2=0x7f97dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 -- 172.21.15.27:0/2186425863 shutdown_connections 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.927+0000 7f97e42cb640 1 -- 172.21.15.27:0/2186425863 wait complete. 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 Processor -- start 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 -- start start 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 0x7f97dc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc10edf0 con 0x7f97dc1033e0 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e42cb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc10ec70 con 0x7f97dc102ac0 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e1866640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e1866640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59124/0 (socket says 172.21.15.27:59124) 2024-09-20T19:18:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e1866640 1 -- 172.21.15.27:0/335990855 learned_addr learned my addr 172.21.15.27:0/335990855 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e2067640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 0x7f97dc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.928+0000 7f97e1866640 1 -- 172.21.15.27:0/335990855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 msgr2=0x7f97dc100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e1866640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 0x7f97dc100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e1866640 1 -- 172.21.15.27:0/335990855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc1011a0 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e2067640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 0x7f97dc100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e1866640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00c8f0 tx=0x7f97cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97cc00ae50 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97cc005020 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97cc004d70 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc101490 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.929+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc1a3e40 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.930+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc06aa90 con 0x7f97dc1033e0 2024-09-20T19:18:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.930+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f97cc0051d0 con 0x7f97dc1033e0 2024-09-20T19:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.931+0000 7f97d37fe640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 0x7f97c807d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.931+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f97cc09df40 con 0x7f97dc1033e0 2024-09-20T19:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.931+0000 7f97e2067640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 0x7f97c807d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.932+0000 7f97e2067640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 0x7f97c807d5f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f97d8031460 tx=0x7f97d8009580 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:07.936+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97cc014030 con 0x7f97dc1033e0 2024-09-20T19:18:08.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.176+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f97dc1a4160 con 0x7f97dc1033e0 2024-09-20T19:18:08.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.177+0000 7f97d37fe640 1 -- 172.21.15.27:0/335990855 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) ==== 107+0+4445 (secure 0 0 0) 0x7f97cc069410 con 0x7f97dc1033e0 2024-09-20T19:18:08.178 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:08.178 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":29,"btime":"2024-09-20T19:15:13:766873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi027.paximv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:13.766868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:08.178 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 29 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.179+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 msgr2=0x7f97c807d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.179+0000 7f97e42cb640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 0x7f97c807d5f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f97d8031460 tx=0x7f97d8009580 comp rx=0 tx=0).stop 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.179+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 msgr2=0x7f97dc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.179+0000 7f97e42cb640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00c8f0 tx=0x7f97cc00cdb0 comp rx=0 tx=0).stop 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 shutdown_connections 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f97c807b130 0x7f97c807d5f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:08.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f97dc1033e0 0x7f97dc100c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:08.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 --2- 172.21.15.27:0/335990855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97dc102ac0 0x7f97dc100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:08.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 >> 172.21.15.27:0/335990855 conn(0x7f97dc0fc520 msgr2=0x7f97dc10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:08.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 shutdown_connections 2024-09-20T19:18:08.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:08.180+0000 7f97e42cb640 1 -- 172.21.15.27:0/335990855 wait complete. 2024-09-20T19:18:08.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:08 smithi027 ceph-mon[110082]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:08.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:08 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/335990855' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-20T19:18:08.843 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-20T19:18:08.843 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 30 2024-09-20T19:18:08.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:08 smithi098 ceph-mon[80954]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:08.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:08 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/335990855' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-20T19:18:09.107 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:09.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- 172.21.15.27:0/4293495864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7394102ac0 msgr2=0x7f7394102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 --2- 172.21.15.27:0/4293495864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7394102ac0 0x7f7394102ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7390009880 tx=0x7f739002a530 comp rx=0 tx=0).stop 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- 172.21.15.27:0/4293495864 shutdown_connections 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 --2- 172.21.15.27:0/4293495864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73941033e0 0x7f739410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 --2- 172.21.15.27:0/4293495864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7394102ac0 0x7f7394102ea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- 172.21.15.27:0/4293495864 >> 172.21.15.27:0/4293495864 conn(0x7f73940fc520 msgr2=0x7f73940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- 172.21.15.27:0/4293495864 shutdown_connections 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- 172.21.15.27:0/4293495864 wait complete. 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 Processor -- start 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.570+0000 7f739baf9640 1 -- start start 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f739baf9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7394102ac0 0x7f739419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f739baf9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:09.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f739baf9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f739410edf0 con 0x7f73941033e0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f739baf9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f739410ec70 con 0x7f7394102ac0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59140/0 (socket says 172.21.15.27:59140) 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 -- 172.21.15.27:0/2993477534 learned_addr learned my addr 172.21.15.27:0/2993477534 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399895640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7394102ac0 0x7f739419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 -- 172.21.15.27:0/2993477534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7394102ac0 msgr2=0x7f739419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7394102ac0 0x7f739419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 -- 172.21.15.27:0/2993477534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73941977c0 con 0x7f73941033e0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f7399094640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f738400c8f0 tx=0x7f738400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f738400ae50 con 0x7f73941033e0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7384005020 con 0x7f73941033e0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7394197ab0 con 0x7f73941033e0 2024-09-20T19:18:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.571+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7384004d70 con 0x7f73941033e0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.572+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7394198040 con 0x7f73941033e0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.573+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739406aa90 con 0x7f73941033e0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.573+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f73840051d0 con 0x7f73941033e0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.574+0000 7f738affd640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 0x7f738007d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.574+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f738409dfe0 con 0x7f73941033e0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.574+0000 7f7399895640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 0x7f738007d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.574+0000 7f7399895640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 0x7f738007d5f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7390031460 tx=0x7f7390005bd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:09.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.578+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7384014030 con 0x7f73941033e0 2024-09-20T19:18:09.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.807+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f7394198350 con 0x7f73941033e0 2024-09-20T19:18:09.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.807+0000 7f738affd640 1 -- 172.21.15.27:0/2993477534 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) ==== 107+0+4456 (secure 0 0 0) 0x7f7384069410 con 0x7f73941033e0 2024-09-20T19:18:09.808 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:09.808 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"btime":"2024-09-20T19:15:13:772740+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:13.772724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 30 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 msgr2=0x7f738007d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 0x7f738007d5f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7390031460 tx=0x7f7390005bd0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 msgr2=0x7f739419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f738400c8f0 tx=0x7f738400cdb0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 shutdown_connections 2024-09-20T19:18:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f738007b130 0x7f738007d5f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73941033e0 0x7f739419db80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 --2- 172.21.15.27:0/2993477534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7394102ac0 0x7f739419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 >> 172.21.15.27:0/2993477534 conn(0x7f73940fc520 msgr2=0x7f739410af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 shutdown_connections 2024-09-20T19:18:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:09.810+0000 7f739baf9640 1 -- 172.21.15.27:0/2993477534 wait complete. 2024-09-20T19:18:10.451 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-20T19:18:10.451 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 31 2024-09-20T19:18:10.713 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:10.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:10 smithi027 ceph-mon[110082]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:10.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:10 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2993477534' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-20T19:18:10.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:10 smithi098 ceph-mon[80954]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:10.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:10 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2993477534' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- 172.21.15.27:0/3480306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc106800 msgr2=0x7fd4fc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 --2- 172.21.15.27:0/3480306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc106800 0x7fd4fc106be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- 172.21.15.27:0/3480306133 shutdown_connections 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 --2- 172.21.15.27:0/3480306133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc100800 0x7fd4fc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 --2- 172.21.15.27:0/3480306133 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc106800 0x7fd4fc106be0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- 172.21.15.27:0/3480306133 >> 172.21.15.27:0/3480306133 conn(0x7fd4fc0fc520 msgr2=0x7fd4fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- 172.21.15.27:0/3480306133 shutdown_connections 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- 172.21.15.27:0/3480306133 wait complete. 2024-09-20T19:18:11.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 Processor -- start 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.177+0000 7fd503cb5640 1 -- start start 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd503cb5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd503cb5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc106800 0x7fd4fc0fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd503cb5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc10dd30 con 0x7fd4fc100800 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd503cb5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc10dbb0 con 0x7fd4fc106800 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59160/0 (socket says 172.21.15.27:59160) 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 -- 172.21.15.27:0/921663981 learned_addr learned my addr 172.21.15.27:0/921663981 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501250640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc106800 0x7fd4fc0fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 -- 172.21.15.27:0/921663981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc106800 msgr2=0x7fd4fc0fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc106800 0x7fd4fc0fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 -- 172.21.15.27:0/921663981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc0fd6d0 con 0x7fd4fc100800 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.178+0000 7fd501a51640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8031460 tx=0x7fd4f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.179+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f803f070 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.179+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc0fd960 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.179+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4f8004cf0 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.179+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8035030 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.179+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4fc1a3de0 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.180+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4fc101f40 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.180+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd4f8042070 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.181+0000 7fd4f2ffd640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 0x7fd4e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.181+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fd4f80becb0 con 0x7fd4fc100800 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.181+0000 7fd501250640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 0x7fd4e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:11.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.182+0000 7fd501250640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 0x7fd4e807d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0fe6e0 tx=0x7fd4ec008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:11.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.186+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4f808a100 con 0x7fd4fc100800 2024-09-20T19:18:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.410+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7fd4fc109d80 con 0x7fd4fc100800 2024-09-20T19:18:11.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.411+0000 7fd4f2ffd640 1 -- 172.21.15.27:0/921663981 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) ==== 107+0+4460 (secure 0 0 0) 0x7fd4f808efb0 con 0x7fd4fc100800 2024-09-20T19:18:11.411 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:11.412 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"btime":"2024-09-20T19:15:22:644430+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:22.086095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:11.412 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 31 2024-09-20T19:18:11.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 msgr2=0x7fd4e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 0x7fd4e807d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0fe6e0 tx=0x7fd4ec008040 comp rx=0 tx=0).stop 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 msgr2=0x7fd4fc0fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8031460 tx=0x7fd4f80048f0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 shutdown_connections 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fd4e807af30 0x7fd4e807d3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4fc106800 0x7fd4fc0fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 --2- 172.21.15.27:0/921663981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4fc100800 0x7fd4fc0fcc50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 >> 172.21.15.27:0/921663981 conn(0x7fd4fc0fc520 msgr2=0x7fd4fc06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 shutdown_connections 2024-09-20T19:18:11.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:11.413+0000 7fd503cb5640 1 -- 172.21.15.27:0/921663981 wait complete. 2024-09-20T19:18:11.705 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:11 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/921663981' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-20T19:18:11.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:11 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/921663981' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-20T19:18:12.029 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-20T19:18:12.029 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 32 2024-09-20T19:18:12.290 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:12.665 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:12 smithi027 ceph-mon[110082]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 -- 172.21.15.27:0/1847410508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 msgr2=0x7fc71c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 --2- 172.21.15.27:0/1847410508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c100a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009c20 tx=0x7fc70c02a960 comp rx=0 tx=0).stop 2024-09-20T19:18:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 -- 172.21.15.27:0/1847410508 shutdown_connections 2024-09-20T19:18:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 --2- 172.21.15.27:0/1847410508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc71c101000 0x7fc71c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 --2- 172.21.15.27:0/1847410508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c100a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 -- 172.21.15.27:0/1847410508 >> 172.21.15.27:0/1847410508 conn(0x7fc71c0fc520 msgr2=0x7fc71c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 -- 172.21.15.27:0/1847410508 shutdown_connections 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.858+0000 7fc724115640 1 -- 172.21.15.27:0/1847410508 wait complete. 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 Processor -- start 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 -- start start 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc71c101000 0x7fc71c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c110f90 con 0x7fc71c100650 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc724115640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c110e10 con 0x7fc71c101000 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59182/0 (socket says 172.21.15.27:59182) 2024-09-20T19:18:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 -- 172.21.15.27:0/3891608599 learned_addr learned my addr 172.21.15.27:0/3891608599 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 -- 172.21.15.27:0/3891608599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc71c101000 msgr2=0x7fc71c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc71c101000 0x7fc71c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.859+0000 7fc721eb1640 1 -- 172.21.15.27:0/3891608599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c199980 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc721eb1640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc70c006010 tx=0x7fc70c02f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc70c034030 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c199c10 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc70c02fd60 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc70c004650 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.860+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c19a1a0 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.861+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c06aa90 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.861+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc70c037020 con 0x7fc71c100650 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.862+0000 7fc71affd640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 0x7fc70407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.862+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fc70c0bf220 con 0x7fc71c100650 2024-09-20T19:18:12.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.862+0000 7fc7216b0640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 0x7fc70407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:12.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.862+0000 7fc7216b0640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 0x7fc70407d400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc710005fd0 tx=0x7fc710005c70 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:12.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:12.867+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc70c08a670 con 0x7fc71c100650 2024-09-20T19:18:12.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:12 smithi098 ceph-mon[80954]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:13.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.096+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7fc71c19aeb0 con 0x7fc71c100650 2024-09-20T19:18:13.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.096+0000 7fc71affd640 1 -- 172.21.15.27:0/3891608599 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) ==== 107+0+4457 (secure 0 0 0) 0x7fc70c08f520 con 0x7fc71c100650 2024-09-20T19:18:13.097 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:13.097 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":32,"btime":"2024-09-20T19:15:23:653738+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:22.655848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:18:13.097 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 32 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.098+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 msgr2=0x7fc70407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.098+0000 7fc724115640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 0x7fc70407d400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc710005fd0 tx=0x7fc710005c70 comp rx=0 tx=0).stop 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 msgr2=0x7fc71c19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc70c006010 tx=0x7fc70c02f960 comp rx=0 tx=0).stop 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 shutdown_connections 2024-09-20T19:18:13.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fc70407af40 0x7fc70407d400 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:13.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc71c101000 0x7fc71c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:13.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 --2- 172.21.15.27:0/3891608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc71c100650 0x7fc71c19f7c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:13.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 >> 172.21.15.27:0/3891608599 conn(0x7fc71c0fc520 msgr2=0x7fc71c0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:13.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 shutdown_connections 2024-09-20T19:18:13.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:13.099+0000 7fc724115640 1 -- 172.21.15.27:0/3891608599 wait complete. 2024-09-20T19:18:13.738 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:13.738 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:13 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3891608599' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-20T19:18:13.767 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-20T19:18:13.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 33 2024-09-20T19:18:13.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:13.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:13 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3891608599' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-20T19:18:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 -- 172.21.15.27:0/653111157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 msgr2=0x7f2c08102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 --2- 172.21.15.27:0/653111157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c08102f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009880 tx=0x7f2bf802a530 comp rx=0 tx=0).stop 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 -- 172.21.15.27:0/653111157 shutdown_connections 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 --2- 172.21.15.27:0/653111157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 --2- 172.21.15.27:0/653111157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c08102f50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 -- 172.21.15.27:0/653111157 >> 172.21.15.27:0/653111157 conn(0x7f2c080fc550 msgr2=0x7f2c080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 -- 172.21.15.27:0/653111157 shutdown_connections 2024-09-20T19:18:14.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.492+0000 7f2c0c980640 1 -- 172.21.15.27:0/653111157 wait complete. 2024-09-20T19:18:14.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 Processor -- start 2024-09-20T19:18:14.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 -- start start 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0810ee40 con 0x7f2c08102b70 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0c980640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0810ecc0 con 0x7f2c08103490 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.493+0000 7f2c0659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59190/0 (socket says 172.21.15.27:59190) 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 -- 172.21.15.27:0/2987765530 learned_addr learned my addr 172.21.15.27:0/2987765530 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2bfffff640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 -- 172.21.15.27:0/2987765530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 msgr2=0x7f2c0819dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0819dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 -- 172.21.15.27:0/2987765530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c081978d0 con 0x7f2c08102b70 2024-09-20T19:18:14.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2bfffff640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0819dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0659c640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80099a0 tx=0x7f2bf80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bf803f070 con 0x7f2c08102b70 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c08197b60 con 0x7f2c08102b70 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bf8004cb0 con 0x7f2c08102b70 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bf8035030 con 0x7f2c08102b70 2024-09-20T19:18:14.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.494+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c08198090 con 0x7f2c08102b70 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.496+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0806a4c0 con 0x7f2c08102b70 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.496+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2bf8042070 con 0x7f2c08102b70 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.496+0000 7f2bff7fe640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 0x7f2bf407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.497+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f2bf80beda0 con 0x7f2c08102b70 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.497+0000 7f2bfffff640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 0x7f2bf407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:14.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.497+0000 7f2bfffff640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 0x7f2bf407d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c081089d0 tx=0x7f2bf0008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:14.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.501+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bf808a1f0 con 0x7f2c08102b70 2024-09-20T19:18:14.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.727+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f2c08198e00 con 0x7f2c08102b70 2024-09-20T19:18:14.728 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:14 smithi027 ceph-mon[110082]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:14.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.728+0000 7f2bff7fe640 1 -- 172.21.15.27:0/2987765530 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) ==== 107+0+4466 (secure 0 0 0) 0x7f2bf808f0a0 con 0x7f2c08102b70 2024-09-20T19:18:14.729 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:14.729 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":33,"btime":"2024-09-20T19:15:24:658948+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:24.658941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34350,"qdb_cluster":[34350]},"id":1}]} 2024-09-20T19:18:14.729 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 33 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 msgr2=0x7f2bf407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 0x7f2bf407d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c081089d0 tx=0x7f2bf0008040 comp rx=0 tx=0).stop 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 msgr2=0x7f2c0819d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80099a0 tx=0x7f2bf80048f0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 shutdown_connections 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f2bf407af90 0x7f2bf407d450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c08103490 0x7f2c0819dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 --2- 172.21.15.27:0/2987765530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2c08102b70 0x7f2c0819d710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:14.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 >> 172.21.15.27:0/2987765530 conn(0x7f2c080fc550 msgr2=0x7f2c08107e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:14.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 shutdown_connections 2024-09-20T19:18:14.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:14.730+0000 7f2c0c980640 1 -- 172.21.15.27:0/2987765530 wait complete. 2024-09-20T19:18:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:14 smithi098 ceph-mon[80954]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:15.427 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-20T19:18:15.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 34 2024-09-20T19:18:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:15.813 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:15 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2987765530' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-20T19:18:15.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:15 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2987765530' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 -- 172.21.15.27:0/3939293093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 msgr2=0x7fb46c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 --2- 172.21.15.27:0/3939293093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c100c60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb460009880 tx=0x7fb46002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 -- 172.21.15.27:0/3939293093 shutdown_connections 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 --2- 172.21.15.27:0/3939293093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c100c60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 --2- 172.21.15.27:0/3939293093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 0x7fb46c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 -- 172.21.15.27:0/3939293093 >> 172.21.15.27:0/3939293093 conn(0x7fb46c0fc520 msgr2=0x7fb46c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 -- 172.21.15.27:0/3939293093 shutdown_connections 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.198+0000 7fb4726ce640 1 -- 172.21.15.27:0/3939293093 wait complete. 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.199+0000 7fb4726ce640 1 Processor -- start 2024-09-20T19:18:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.199+0000 7fb4726ce640 1 -- start start 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4726ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4726ce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 0x7fb46c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4726ce640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c10dcd0 con 0x7fb46c100800 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4726ce640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c10db50 con 0x7fb46c106800 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46938/0 (socket says 172.21.15.27:46938) 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 -- 172.21.15.27:0/2126381637 learned_addr learned my addr 172.21.15.27:0/2126381637 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46b7fe640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 0x7fb46c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 -- 172.21.15.27:0/2126381637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 msgr2=0x7fb46c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 0x7fb46c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 -- 172.21.15.27:0/2126381637 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c199350 con 0x7fb46c100800 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb46bfff640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d6f0 tx=0x7fb45c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45c017070 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.200+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c1a1830 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.201+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb45c00de00 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.201+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45c004bb0 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.201+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c1a1c30 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.202+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c101f40 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.202+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb45c004e60 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.203+0000 7fb4697fa640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 0x7fb45407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.203+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7fb45c09ddf0 con 0x7fb46c100800 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.203+0000 7fb46b7fe640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 0x7fb45407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.203+0000 7fb46b7fe640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 0x7fb45407d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb46c06ad40 tx=0x7fb460031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.207+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb45c0691a0 con 0x7fb46c100800 2024-09-20T19:18:16.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.435+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7fb46c02d7c0 con 0x7fb46c100800 2024-09-20T19:18:16.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.436+0000 7fb4697fa640 1 -- 172.21.15.27:0/2126381637 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) ==== 107+0+5313 (secure 0 0 0) 0x7fb45c06e050 con 0x7fb46c100800 2024-09-20T19:18:16.437 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:16.437 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":34,"btime":"2024-09-20T19:15:25:666306+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/1308977984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1308977984},{"type":"v1","addr":"172.21.15.98:6827","nonce":1308977984}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:24.658941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34350,"qdb_cluster":[34350]},"id":1}]} 2024-09-20T19:18:16.437 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 34 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.438+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 msgr2=0x7fb45407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.438+0000 7fb4726ce640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 0x7fb45407d3f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb46c06ad40 tx=0x7fb460031400 comp rx=0 tx=0).stop 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.438+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 msgr2=0x7fb46c1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.438+0000 7fb4726ce640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d6f0 tx=0x7fb45c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 shutdown_connections 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7fb45407af30 0x7fb45407d3f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c106800 0x7fb46c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 --2- 172.21.15.27:0/2126381637 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb46c100800 0x7fb46c1987c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:16.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 >> 172.21.15.27:0/2126381637 conn(0x7fb46c0fc520 msgr2=0x7fb46c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:16.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 shutdown_connections 2024-09-20T19:18:16.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:16.439+0000 7fb4726ce640 1 -- 172.21.15.27:0/2126381637 wait complete. 2024-09-20T19:18:16.795 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:16 smithi027 ceph-mon[110082]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:16.795 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:16 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2126381637' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-20T19:18:16.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:16 smithi098 ceph-mon[80954]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:16.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:16 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2126381637' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-20T19:18:17.134 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-20T19:18:17.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 35 2024-09-20T19:18:17.396 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- 172.21.15.27:0/1518176960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c103490 msgr2=0x7f0c3c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 --2- 172.21.15.27:0/1518176960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c103490 0x7f0c3c10b980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009880 tx=0x7f0c3002a530 comp rx=0 tx=0).stop 2024-09-20T19:18:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- 172.21.15.27:0/1518176960 shutdown_connections 2024-09-20T19:18:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 --2- 172.21.15.27:0/1518176960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c103490 0x7f0c3c10b980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 --2- 172.21.15.27:0/1518176960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c102b70 0x7f0c3c102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- 172.21.15.27:0/1518176960 >> 172.21.15.27:0/1518176960 conn(0x7f0c3c0fc550 msgr2=0x7f0c3c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- 172.21.15.27:0/1518176960 shutdown_connections 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- 172.21.15.27:0/1518176960 wait complete. 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 Processor -- start 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.997+0000 7f0c4344e640 1 -- start start 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c4344e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c4344e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 0x7f0c3c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c4344e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c10ede0 con 0x7f0c3c102b70 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c4344e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c10ec60 con 0x7f0c3c103490 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46952/0 (socket says 172.21.15.27:46952) 2024-09-20T19:18:18.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 -- 172.21.15.27:0/2549077882 learned_addr learned my addr 172.21.15.27:0/2549077882 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c409e9640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 0x7f0c3c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 -- 172.21.15.27:0/2549077882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 msgr2=0x7f0c3c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 0x7f0c3c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 -- 172.21.15.27:0/2549077882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c1977d0 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c409e9640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 0x7f0c3c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c411ea640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d6f0 tx=0x7f0c3400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.998+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c34017070 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.999+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c3400de00 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.999+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c197ac0 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.999+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c34004bb0 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:17.999+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c198020 con 0x7f0c3c102b70 2024-09-20T19:18:18.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.000+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c06a4c0 con 0x7f0c3c102b70 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.000+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0c34009a30 con 0x7f0c3c102b70 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.001+0000 7f0c3a7fc640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 0x7f0c2407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.001+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f0c3409dd20 con 0x7f0c3c102b70 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.001+0000 7f0c409e9640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 0x7f0c2407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.001+0000 7f0c409e9640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 0x7f0c2407d450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c198b20 tx=0x7f0c30004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:18.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.005+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c340691f0 con 0x7f0c3c102b70 2024-09-20T19:18:18.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.230+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7f0c3c106000 con 0x7f0c3c102b70 2024-09-20T19:18:18.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.231+0000 7f0c3a7fc640 1 -- 172.21.15.27:0/2549077882 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) ==== 107+0+5313 (secure 0 0 0) 0x7f0c3406e0a0 con 0x7f0c3c102b70 2024-09-20T19:18:18.232 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:18.232 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":35,"btime":"2024-09-20T19:15:33:259247+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/1308977984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1308977984},{"type":"v1","addr":"172.21.15.98:6827","nonce":1308977984}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:32.262213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34350,"qdb_cluster":[34350]},"id":1}]} 2024-09-20T19:18:18.233 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 35 2024-09-20T19:18:18.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 msgr2=0x7f0c2407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 0x7f0c2407d450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c198b20 tx=0x7f0c30004f30 comp rx=0 tx=0).stop 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 msgr2=0x7f0c3c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400d6f0 tx=0x7f0c3400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 shutdown_connections 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f0c2407af90 0x7f0c2407d450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c3c103490 0x7f0c3c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 --2- 172.21.15.27:0/2549077882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c3c102b70 0x7f0c3c19d650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 >> 172.21.15.27:0/2549077882 conn(0x7f0c3c0fc550 msgr2=0x7f0c3c103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 shutdown_connections 2024-09-20T19:18:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:18.233+0000 7f0c4344e640 1 -- 172.21.15.27:0/2549077882 wait complete. 2024-09-20T19:18:18.798 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:18 smithi027 ceph-mon[110082]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:18.798 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:18 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/2549077882' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-20T19:18:18.900 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-20T19:18:18.900 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 36 2024-09-20T19:18:18.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:18 smithi098 ceph-mon[80954]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:18.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:18 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/2549077882' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-20T19:18:19.167 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 -- 172.21.15.27:0/2618728729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 msgr2=0x7f0518100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 --2- 172.21.15.27:0/2618728729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f0518100a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0514009880 tx=0x7f051402a490 comp rx=0 tx=0).stop 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 -- 172.21.15.27:0/2618728729 shutdown_connections 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 --2- 172.21.15.27:0/2618728729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 0x7f051810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 --2- 172.21.15.27:0/2618728729 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f0518100a30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 -- 172.21.15.27:0/2618728729 >> 172.21.15.27:0/2618728729 conn(0x7f05180fc520 msgr2=0x7f05180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 -- 172.21.15.27:0/2618728729 shutdown_connections 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.630+0000 7f051f788640 1 -- 172.21.15.27:0/2618728729 wait complete. 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 Processor -- start 2024-09-20T19:18:19.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 -- start start 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 0x7f051819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110fb0 con 0x7f0518100650 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051f788640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110e30 con 0x7f0518101000 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051d524640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051d524640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46970/0 (socket says 172.21.15.27:46970) 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.631+0000 7f051d524640 1 -- 172.21.15.27:0/3138293170 learned_addr learned my addr 172.21.15.27:0/3138293170 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051cd23640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 0x7f051819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051d524640 1 -- 172.21.15.27:0/3138293170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 msgr2=0x7f051819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051d524640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 0x7f051819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051d524640 1 -- 172.21.15.27:0/3138293170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05181999a0 con 0x7f0518100650 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051d524640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0514031460 tx=0x7f05140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:19.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f051403f070 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05140035f0 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0518199c30 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0514035030 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.632+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051819a1c0 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.633+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051806aa90 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.634+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0514042070 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.634+0000 7f050e7fc640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 0x7f050407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.634+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f05140bea10 con 0x7f0518100650 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.634+0000 7f051cd23640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 0x7f050407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.635+0000 7f051cd23640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 0x7f050407d440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0518102520 tx=0x7f050800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.639+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0514089ee0 con 0x7f0518100650 2024-09-20T19:18:19.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.863+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7f051819aed0 con 0x7f0518100650 2024-09-20T19:18:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.864+0000 7f050e7fc640 1 -- 172.21.15.27:0/3138293170 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) ==== 107+0+5319 (secure 0 0 0) 0x7f051408ed90 con 0x7f0518100650 2024-09-20T19:18:19.865 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-20T19:18:19.865 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":36,"btime":"2024-09-20T19:15:34:123615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi098.fdtjxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3298509789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3298509789},{"type":"v1","addr":"172.21.15.98:6825","nonce":3298509789}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44343,"name":"cephfs.smithi098.hnflps","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/1308977984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1308977984},{"type":"v1","addr":"172.21.15.98:6827","nonce":1308977984}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T19:03:06.273690+0000","modified":"2024-09-20T19:15:34.123595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34350":{"gid":34350,"name":"cephfs.smithi027.paximv","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.27:6827/68219843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":68219843},{"type":"v1","addr":"172.21.15.27:6827","nonce":68219843}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi027.esfeuy","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6829/4292901641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":4292901641},{"type":"v1","addr":"172.21.15.27:6829","nonce":4292901641}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34350,"qdb_cluster":[34350]},"id":1}]} 2024-09-20T19:18:19.866 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 36 2024-09-20T19:18:19.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 msgr2=0x7f050407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:19.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 0x7f050407d440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0518102520 tx=0x7f050800b390 comp rx=0 tx=0).stop 2024-09-20T19:18:19.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 msgr2=0x7f051819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:19.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0514031460 tx=0x7f05140045e0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 shutdown_connections 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f050407af80 0x7f050407d440 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0518101000 0x7f051819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 --2- 172.21.15.27:0/3138293170 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0518100650 0x7f051819f7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 >> 172.21.15.27:0/3138293170 conn(0x7f05180fc520 msgr2=0x7f05180fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 shutdown_connections 2024-09-20T19:18:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:19.866+0000 7f051f788640 1 -- 172.21.15.27:0/3138293170 wait complete. 2024-09-20T19:18:20.473 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-20T19:18:20.484 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-20T19:18:20.485 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T19:18:20.485 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:18:20.503 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T19:18:20.503 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:18:20.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-20T19:18:20.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:20 smithi027 ceph-mon[110082]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:20.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:20 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3138293170' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-20T19:18:20.861 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:20.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:20 smithi098 ceph-mon[80954]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:20.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:20 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3138293170' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 -- 172.21.15.27:0/214707380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c106800 msgr2=0x7f7d1c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/214707380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c106800 0x7f7d1c106be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009880 tx=0x7f7d0c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 -- 172.21.15.27:0/214707380 shutdown_connections 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/214707380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c100800 0x7f7d1c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/214707380 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c106800 0x7f7d1c106be0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 -- 172.21.15.27:0/214707380 >> 172.21.15.27:0/214707380 conn(0x7f7d1c0fc520 msgr2=0x7f7d1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 -- 172.21.15.27:0/214707380 shutdown_connections 2024-09-20T19:18:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.295+0000 7f7d20e9d640 1 -- 172.21.15.27:0/214707380 wait complete. 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 Processor -- start 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 -- start start 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c106800 0x7f7d1c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c10dd30 con 0x7f7d1c100800 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.296+0000 7f7d20e9d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c10dbb0 con 0x7f7d1c106800 2024-09-20T19:18:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46984/0 (socket says 172.21.15.27:46984) 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 -- 172.21.15.27:0/3144081251 learned_addr learned my addr 172.21.15.27:0/3144081251 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d13fff640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c106800 0x7f7d1c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 -- 172.21.15.27:0/3144081251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c106800 msgr2=0x7f7d1c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c106800 0x7f7d1c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 -- 172.21.15.27:0/3144081251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c197820 con 0x7f7d1c100800 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d1a59c640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c031460 tx=0x7f7d0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d0c03f070 con 0x7f7d1c100800 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c197ab0 con 0x7f7d1c100800 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d0c004cf0 con 0x7f7d1c100800 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d0c035030 con 0x7f7d1c100800 2024-09-20T19:18:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.297+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c197fe0 con 0x7f7d1c100800 2024-09-20T19:18:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.298+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1c101f40 con 0x7f7d1c100800 2024-09-20T19:18:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.299+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7d0c042070 con 0x7f7d1c100800 2024-09-20T19:18:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.300+0000 7f7d137fe640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 0x7f7d0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.300+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f7d0c0becb0 con 0x7f7d1c100800 2024-09-20T19:18:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.300+0000 7f7d13fff640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 0x7f7d0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.300+0000 7f7d13fff640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 0x7f7d0807d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c104f40 tx=0x7f7d04008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.304+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d0c08a100 con 0x7f7d1c100800 2024-09-20T19:18:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.507+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d1c198d50 con 0x7f7d1c100800 2024-09-20T19:18:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.508+0000 7f7d137fe640 1 -- 172.21.15.27:0/3144081251 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v93) ==== 81+0+2069 (secure 0 0 0) 0x7f7d0c08efb0 con 0x7f7d1c100800 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6825/3223633733 2024-09-21T19:14:52.421239+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6824/3223633733 2024-09-21T19:14:52.421239+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2635646182 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/3031006288 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/4025423151 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/1422110592 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/3031006288 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/931142735 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/519217990 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/2350483020 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/570952743 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/900682160 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:21.510 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/900682160 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/1494965994 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2799355393 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6827/1988280792 2024-09-21T19:15:13.766539+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6826/1988280792 2024-09-21T19:15:13.766539+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6829/3289268106 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6828/3289268106 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6827/444076941 2024-09-21T19:03:20.501740+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/306400522 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/245967963 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3522474440 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2663124002 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:21.511 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2981493086 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/1422110592 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2997066595 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3064380782 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6826/444076941 2024-09-21T19:03:20.501740+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3748322701 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/2350483020 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/1425439777 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2690377655 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1562300194 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:21.512 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2723471561 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:listed 35 entries 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 msgr2=0x7f7d0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 0x7f7d0807d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c104f40 tx=0x7f7d04008040 comp rx=0 tx=0).stop 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 msgr2=0x7f7d1c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c031460 tx=0x7f7d0c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 shutdown_connections 2024-09-20T19:18:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f7d0807af30 0x7f7d0807d3f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d1c106800 0x7f7d1c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 --2- 172.21.15.27:0/3144081251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d1c100800 0x7f7d1c19d6a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 >> 172.21.15.27:0/3144081251 conn(0x7f7d1c0fc520 msgr2=0x7f7d1c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 shutdown_connections 2024-09-20T19:18:21.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:21.510+0000 7f7d20e9d640 1 -- 172.21.15.27:0/3144081251 wait complete. 2024-09-20T19:18:21.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:21 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/3144081251' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:18:21.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:21 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/3144081251' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:18:22.172 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-20T19:18:22.172 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:18:22.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid e7838b9c-7781-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-20T19:18:22.490 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/mon.smithi027/config 2024-09-20T19:18:22.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:22 smithi027 ceph-mon[110082]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:22.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:22 smithi098 ceph-mon[80954]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 -- 172.21.15.27:0/4264414330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 msgr2=0x7f95a010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 --2- 172.21.15.27:0/4264414330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a010b8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9590009c20 tx=0x7f959002aa00 comp rx=0 tx=0).stop 2024-09-20T19:18:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 -- 172.21.15.27:0/4264414330 shutdown_connections 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 --2- 172.21.15.27:0/4264414330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a010b8d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 --2- 172.21.15.27:0/4264414330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 -- 172.21.15.27:0/4264414330 >> 172.21.15.27:0/4264414330 conn(0x7f95a00fc520 msgr2=0x7f95a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 -- 172.21.15.27:0/4264414330 shutdown_connections 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.112+0000 7f95a768e640 1 -- 172.21.15.27:0/4264414330 wait complete. 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 Processor -- start 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 -- start start 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010edf0 con 0x7f95a01033e0 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a768e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010ec70 con 0x7f95a0102ac0 2024-09-20T19:18:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47006/0 (socket says 172.21.15.27:47006) 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 -- 172.21.15.27:0/1654304287 learned_addr learned my addr 172.21.15.27:0/1654304287 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a542a640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 -- 172.21.15.27:0/1654304287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 msgr2=0x7f95a0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a4c29640 1 -- 172.21.15.27:0/1654304287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a01011a0 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.113+0000 7f95a542a640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95a4c29640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f959002af20 tx=0x7f959002ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9590047070 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f959002eeb0 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a0101430 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9590033050 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.114+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a3de0 con 0x7f95a01033e0 2024-09-20T19:18:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.115+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a006aa90 con 0x7f95a01033e0 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.115+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f959004a070 con 0x7f95a01033e0 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.116+0000 7f95967fc640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 0x7f958807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.116+0000 7f95a542a640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 0x7f958807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.116+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6589+0+0 (secure 0 0 0) 0x7f959003e030 con 0x7f95a01033e0 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.117+0000 7f95a542a640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 0x7f958807d450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:18:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.121+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f959008a730 con 0x7f95a01033e0 2024-09-20T19:18:23.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.321+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95a0105f60 con 0x7f95a01033e0 2024-09-20T19:18:23.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.321+0000 7f95967fc640 1 -- 172.21.15.27:0/1654304287 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v93) ==== 81+0+2069 (secure 0 0 0) 0x7f959008f5e0 con 0x7f95a01033e0 2024-09-20T19:18:23.323 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6825/3223633733 2024-09-21T19:14:52.421239+0000 2024-09-20T19:18:23.323 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6824/3223633733 2024-09-21T19:14:52.421239+0000 2024-09-20T19:18:23.323 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2635646182 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.323 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/3031006288 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/4025423151 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/1422110592 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/3031006288 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/931142735 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/519217990 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/2350483020 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/570952743 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/900682160 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/900682160 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/1494965994 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2799355393 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6827/1988280792 2024-09-21T19:15:13.766539+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6826/1988280792 2024-09-21T19:15:13.766539+0000 2024-09-20T19:18:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6829/3289268106 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:6828/3289268106 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6827/444076941 2024-09-21T19:03:20.501740+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/306400522 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/245967963 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3522474440 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2663124002 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2981493086 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/1422110592 2024-09-21T18:56:39.148571+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2997066595 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3064380782 2024-09-21T18:57:18.346866+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6826/444076941 2024-09-21T19:03:20.501740+0000 2024-09-20T19:18:23.325 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3748322701 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/2350483020 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/1425439777 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2690377655 2024-09-21T18:58:19.133219+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1562300194 2024-09-21T19:05:49.012506+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.98:0/2723471561 2024-09-21T19:06:56.859205+0000 2024-09-20T19:18:23.326 INFO:teuthology.orchestra.run.smithi027.stderr:listed 35 entries 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 msgr2=0x7f958807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 0x7f958807d450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f959c0058c0 tx=0x7f959c005850 comp rx=0 tx=0).stop 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 msgr2=0x7f95a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f959002af20 tx=0x7f959002ed40 comp rx=0 tx=0).stop 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 shutdown_connections 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:6800/2136930053,v1:172.21.15.27:6801/2136930053] conn(0x7f958807af90 0x7f958807d450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95a01033e0 0x7f95a0100c60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 --2- 172.21.15.27:0/1654304287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95a0102ac0 0x7f95a0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.324+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 >> 172.21.15.27:0/1654304287 conn(0x7f95a00fc520 msgr2=0x7f95a0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.325+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 shutdown_connections 2024-09-20T19:18:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-20T19:18:23.325+0000 7f95a768e640 1 -- 172.21.15.27:0/1654304287 wait complete. 2024-09-20T19:18:23.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:23 smithi027 ceph-mon[110082]: from='client.? 172.21.15.27:0/1654304287' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:18:23.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:23 smithi098 ceph-mon[80954]: from='client.? 172.21.15.27:0/1654304287' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:18:24.021 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2024-09-20T19:18:24.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:18:24.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-20T19:18:24.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T19:18:24.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:24 smithi027 ceph-mon[110082]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:24.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:24 smithi098 ceph-mon[80954]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:26.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:26 smithi027 ceph-mon[110082]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:26.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:26 smithi098 ceph-mon[80954]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:27.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:27.977 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:28.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:28 smithi027 ceph-mon[110082]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:28.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:28 smithi098 ceph-mon[80954]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:30.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:30 smithi098 ceph-mon[80954]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:30.975 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:30 smithi027 ceph-mon[110082]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:32.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:32 smithi027 ceph-mon[110082]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:32.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:32 smithi098 ceph-mon[80954]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:34 smithi098 ceph-mon[80954]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:35.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:34 smithi027 ceph-mon[110082]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:36.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:36 smithi098 ceph-mon[80954]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:36.987 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:36 smithi027 ceph-mon[110082]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:38.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:38 smithi098 ceph-mon[80954]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:39.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:38 smithi027 ceph-mon[110082]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:40.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:40 smithi098 ceph-mon[80954]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:41.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:40 smithi027 ceph-mon[110082]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:42.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:42 smithi027 ceph-mon[110082]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:42.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:42.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:42 smithi098 ceph-mon[80954]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:42.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:44.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:44 smithi098 ceph-mon[80954]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:45.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:44 smithi027 ceph-mon[110082]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:46.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:46 smithi098 ceph-mon[80954]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:47.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:46 smithi027 ceph-mon[110082]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:48.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:48 smithi098 ceph-mon[80954]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:48.980 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:48 smithi027 ceph-mon[110082]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:50.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:50 smithi098 ceph-mon[80954]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:51.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:50 smithi027 ceph-mon[110082]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:52.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:52 smithi027 ceph-mon[110082]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:52.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:52 smithi098 ceph-mon[80954]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:54.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:54 smithi098 ceph-mon[80954]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:54.978 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:54 smithi027 ceph-mon[110082]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:56.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:56 smithi098 ceph-mon[80954]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:57.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:56 smithi027 ceph-mon[110082]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:18:57.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:57.979 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:58.955 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:58 smithi027 ceph-mon[110082]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:58.956 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:18:58.956 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:18:58.956 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:18:58.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:58 smithi098 ceph-mon[80954]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:18:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:18:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:18:58.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:18:59.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:18:59.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:18:59.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:18:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:19:00.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:19:00.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:19:00.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:18:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:19:01.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:00 smithi027 ceph-mon[110082]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:01.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:00 smithi098 ceph-mon[80954]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:03.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:02 smithi027 ceph-mon[110082]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:03.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:02 smithi098 ceph-mon[80954]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:05.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:04 smithi027 ceph-mon[110082]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:05.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:04 smithi098 ceph-mon[80954]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:07.057 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:06 smithi027 ceph-mon[110082]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:07.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:06 smithi098 ceph-mon[80954]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:09.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:08 smithi027 ceph-mon[110082]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:09.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:08 smithi098 ceph-mon[80954]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:11.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:10 smithi027 ceph-mon[110082]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:11.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:10 smithi098 ceph-mon[80954]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:13.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:12 smithi027 ceph-mon[110082]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:13.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:13.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:12 smithi098 ceph-mon[80954]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:13.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:15.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:14 smithi027 ceph-mon[110082]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:15.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:14 smithi098 ceph-mon[80954]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:17.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:16 smithi027 ceph-mon[110082]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:17.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:16 smithi098 ceph-mon[80954]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:19.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:18 smithi027 ceph-mon[110082]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:19.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:18 smithi098 ceph-mon[80954]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:21.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:20 smithi027 ceph-mon[110082]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:21.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:20 smithi098 ceph-mon[80954]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:23.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:22 smithi027 ceph-mon[110082]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:23.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:22 smithi098 ceph-mon[80954]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:25.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:24 smithi027 ceph-mon[110082]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:25.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:24 smithi098 ceph-mon[80954]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:27.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:26 smithi027 ceph-mon[110082]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:27.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:26 smithi098 ceph-mon[80954]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:28.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:28.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:28.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:28 smithi098 ceph-mon[80954]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:29.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:28 smithi027 ceph-mon[110082]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:31.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:30 smithi027 ceph-mon[110082]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:31.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:30 smithi098 ceph-mon[80954]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:33.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:32 smithi098 ceph-mon[80954]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:33.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:32 smithi027 ceph-mon[110082]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:35.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:34 smithi027 ceph-mon[110082]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:35.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:34 smithi098 ceph-mon[80954]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:37.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:36 smithi098 ceph-mon[80954]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:37.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:36 smithi027 ceph-mon[110082]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:39.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:38 smithi098 ceph-mon[80954]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:39.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:38 smithi027 ceph-mon[110082]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:41.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:40 smithi098 ceph-mon[80954]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:41.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:40 smithi027 ceph-mon[110082]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:43.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:42 smithi098 ceph-mon[80954]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:43.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:42 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:43.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:42 smithi027 ceph-mon[110082]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:43.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:42 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:45.066 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:44 smithi027 ceph-mon[110082]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:45.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:44 smithi098 ceph-mon[80954]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:47.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:46 smithi098 ceph-mon[80954]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:47.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:46 smithi027 ceph-mon[110082]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:49.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:48 smithi098 ceph-mon[80954]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:49.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:48 smithi027 ceph-mon[110082]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:51.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:50 smithi098 ceph-mon[80954]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:51.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:50 smithi027 ceph-mon[110082]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:53.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:52 smithi098 ceph-mon[80954]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:53.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:52 smithi027 ceph-mon[110082]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:55.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:54 smithi098 ceph-mon[80954]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:55.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:54 smithi027 ceph-mon[110082]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:57.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:56 smithi098 ceph-mon[80954]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:57.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:56 smithi027 ceph-mon[110082]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:19:58.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:57 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:58.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:57 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:59.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:58 smithi098 ceph-mon[80954]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:59.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:19:59.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:58 smithi027 ceph-mon[110082]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:19:59.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:20:00.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:20:00.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:20:00.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:19:59 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:20:00.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:20:00.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:20:00.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:19:59 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:20:01.122 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:00 smithi098 ceph-mon[80954]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:01.122 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:00 smithi098 ceph-mon[80954]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:01.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:00 smithi027 ceph-mon[110082]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:01.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:00 smithi027 ceph-mon[110082]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:03.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:02 smithi098 ceph-mon[80954]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:03.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:02 smithi027 ceph-mon[110082]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:05.166 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:04 smithi027 ceph-mon[110082]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:05.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:04 smithi098 ceph-mon[80954]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:07.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:06 smithi098 ceph-mon[80954]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:07.241 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:06 smithi027 ceph-mon[110082]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:09.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:08 smithi098 ceph-mon[80954]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:09.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:08 smithi027 ceph-mon[110082]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:11.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:10 smithi098 ceph-mon[80954]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:11.318 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:10 smithi027 ceph-mon[110082]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:13.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:12 smithi098 ceph-mon[80954]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:13.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:13.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:12 smithi027 ceph-mon[110082]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:13.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:15.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:14 smithi098 ceph-mon[80954]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:15.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:14 smithi027 ceph-mon[110082]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:17.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:16 smithi098 ceph-mon[80954]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:17.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:16 smithi027 ceph-mon[110082]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:19.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:18 smithi098 ceph-mon[80954]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:19.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:18 smithi027 ceph-mon[110082]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:21.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:20 smithi098 ceph-mon[80954]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:21.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:20 smithi027 ceph-mon[110082]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:23.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:22 smithi098 ceph-mon[80954]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:23.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:22 smithi027 ceph-mon[110082]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:25.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:24 smithi098 ceph-mon[80954]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:25.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:24 smithi027 ceph-mon[110082]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:27.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:26 smithi098 ceph-mon[80954]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:27.317 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:26 smithi027 ceph-mon[110082]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:28.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:27 smithi098 ceph-mon[80954]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:28.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:27 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:28.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:27 smithi027 ceph-mon[110082]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:28.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:27 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:30.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:30 smithi098 ceph-mon[80954]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:30.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:30 smithi027 ceph-mon[110082]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:32.431 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:32 smithi027 ceph-mon[110082]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:32.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:32 smithi098 ceph-mon[80954]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:34.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:34 smithi027 ceph-mon[110082]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:34.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:34 smithi098 ceph-mon[80954]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:36.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:36 smithi098 ceph-mon[80954]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:36.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:36 smithi027 ceph-mon[110082]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:38.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:38 smithi098 ceph-mon[80954]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:38.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:38 smithi027 ceph-mon[110082]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:40.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:40 smithi027 ceph-mon[110082]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:40.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:40 smithi098 ceph-mon[80954]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:42.431 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:42 smithi027 ceph-mon[110082]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:42.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:42 smithi098 ceph-mon[80954]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:43.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:43.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:44.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:44 smithi098 ceph-mon[80954]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:44.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:44 smithi027 ceph-mon[110082]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:46.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:46 smithi027 ceph-mon[110082]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:46.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:46 smithi098 ceph-mon[80954]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:48.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:48 smithi098 ceph-mon[80954]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:48.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:48 smithi027 ceph-mon[110082]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:50.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:50 smithi098 ceph-mon[80954]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:50.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:50 smithi027 ceph-mon[110082]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:52.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:52 smithi027 ceph-mon[110082]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:52.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:52 smithi098 ceph-mon[80954]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:54.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:54 smithi098 ceph-mon[80954]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:54.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:54 smithi027 ceph-mon[110082]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:56.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:56 smithi098 ceph-mon[80954]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:56.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:56 smithi027 ceph-mon[110082]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:20:58.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:58 smithi027 ceph-mon[110082]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:58.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:20:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:58.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:58 smithi098 ceph-mon[80954]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:20:58.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:20:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:00.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:00 smithi098 ceph-mon[80954]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:00.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:21:00.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:21:00.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:21:00.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:21:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:00 smithi027 ceph-mon[110082]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:21:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:21:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:21:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:21:02.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:02 smithi098 ceph-mon[80954]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:02.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:02 smithi027 ceph-mon[110082]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:04.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:04 smithi027 ceph-mon[110082]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:04.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:04 smithi098 ceph-mon[80954]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:06.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:06 smithi098 ceph-mon[80954]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:06.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:06 smithi027 ceph-mon[110082]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:08.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:08 smithi098 ceph-mon[80954]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:08.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:08 smithi027 ceph-mon[110082]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:10.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:10 smithi027 ceph-mon[110082]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:10.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:10 smithi098 ceph-mon[80954]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:12.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:12 smithi098 ceph-mon[80954]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:12.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:12 smithi027 ceph-mon[110082]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:13.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:13.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:14.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:14 smithi098 ceph-mon[80954]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:14.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:14 smithi027 ceph-mon[110082]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:16.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:16 smithi027 ceph-mon[110082]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:16.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:16 smithi098 ceph-mon[80954]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:18.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:18 smithi098 ceph-mon[80954]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:18.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:18 smithi027 ceph-mon[110082]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:20.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:20 smithi098 ceph-mon[80954]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:20.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:20 smithi027 ceph-mon[110082]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:22.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:22 smithi027 ceph-mon[110082]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:22.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:22 smithi098 ceph-mon[80954]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:24.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:24 smithi027 ceph-mon[110082]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:24.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:24 smithi098 ceph-mon[80954]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:26.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:26 smithi027 ceph-mon[110082]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:26.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:26 smithi098 ceph-mon[80954]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:28.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:28 smithi027 ceph-mon[110082]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:28.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:28.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:28 smithi098 ceph-mon[80954]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:28.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:30.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:30 smithi027 ceph-mon[110082]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:30.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:30 smithi098 ceph-mon[80954]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:32.522 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:32 smithi098 ceph-mon[80954]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:32.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:32 smithi027 ceph-mon[110082]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:34.316 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:34 smithi027 ceph-mon[110082]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:34.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:34 smithi098 ceph-mon[80954]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:36.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:36 smithi027 ceph-mon[110082]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:36.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:36 smithi098 ceph-mon[80954]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:38.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:38 smithi027 ceph-mon[110082]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:38.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:38 smithi098 ceph-mon[80954]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:40.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:40 smithi027 ceph-mon[110082]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:40.628 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:40 smithi098 ceph-mon[80954]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:42.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:42 smithi027 ceph-mon[110082]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:42.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:42 smithi098 ceph-mon[80954]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:43.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:43.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:44.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:44 smithi027 ceph-mon[110082]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:44.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:44 smithi098 ceph-mon[80954]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:46.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:46 smithi027 ceph-mon[110082]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:46.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:46 smithi098 ceph-mon[80954]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:48.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:48 smithi027 ceph-mon[110082]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:48.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:48 smithi098 ceph-mon[80954]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:50.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:50 smithi027 ceph-mon[110082]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:50.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:50 smithi098 ceph-mon[80954]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:52.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:52 smithi027 ceph-mon[110082]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:52.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:52 smithi098 ceph-mon[80954]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:54.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:54 smithi027 ceph-mon[110082]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:54.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:54 smithi098 ceph-mon[80954]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:56.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:56 smithi027 ceph-mon[110082]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:56.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:56 smithi098 ceph-mon[80954]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:21:58.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:58 smithi027 ceph-mon[110082]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:58.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:21:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:58.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:58 smithi098 ceph-mon[80954]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:21:58.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:21:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:00.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:00 smithi027 ceph-mon[110082]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:22:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:22:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:22:00.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:22:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:00 smithi098 ceph-mon[80954]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:22:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:22:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:22:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:22:02.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:02 smithi027 ceph-mon[110082]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:02.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:02 smithi098 ceph-mon[80954]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:04.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:04 smithi027 ceph-mon[110082]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:04.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:04 smithi098 ceph-mon[80954]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:06.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:06 smithi027 ceph-mon[110082]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:06.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:06 smithi098 ceph-mon[80954]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:08.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:08 smithi027 ceph-mon[110082]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:08.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:08 smithi098 ceph-mon[80954]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:10.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:10 smithi027 ceph-mon[110082]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:10.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:10 smithi098 ceph-mon[80954]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:12.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:12 smithi027 ceph-mon[110082]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:12.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:12 smithi098 ceph-mon[80954]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:13.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:13 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:13.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:13 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:14.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:14 smithi027 ceph-mon[110082]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:14.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:14 smithi098 ceph-mon[80954]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:16.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:16 smithi098 ceph-mon[80954]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:16.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:16 smithi027 ceph-mon[110082]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:18.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:18 smithi098 ceph-mon[80954]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:18.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:18 smithi027 ceph-mon[110082]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:20.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:20 smithi098 ceph-mon[80954]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:20.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:20 smithi027 ceph-mon[110082]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:22.692 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:22 smithi027 ceph-mon[110082]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:22.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:22 smithi098 ceph-mon[80954]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:24.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:24 smithi098 ceph-mon[80954]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:24.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:24 smithi027 ceph-mon[110082]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:26.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:26 smithi098 ceph-mon[80954]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:26.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:26 smithi027 ceph-mon[110082]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:28.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:28 smithi098 ceph-mon[80954]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:28.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:28 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:28.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:28 smithi027 ceph-mon[110082]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:28.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:28 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:30.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:30 smithi098 ceph-mon[80954]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:30.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:30 smithi027 ceph-mon[110082]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:32.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:32 smithi098 ceph-mon[80954]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:32.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:32 smithi027 ceph-mon[110082]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:34.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:34 smithi098 ceph-mon[80954]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:34.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:34 smithi027 ceph-mon[110082]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:36.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:36 smithi098 ceph-mon[80954]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:36.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:36 smithi027 ceph-mon[110082]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:38.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:38 smithi098 ceph-mon[80954]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:38.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:38 smithi027 ceph-mon[110082]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:40.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:40 smithi098 ceph-mon[80954]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:40.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:40 smithi027 ceph-mon[110082]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:42.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:42 smithi098 ceph-mon[80954]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:42.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:42 smithi027 ceph-mon[110082]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:43.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:43 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:43.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:43 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:44.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:44 smithi098 ceph-mon[80954]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:44.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:44 smithi027 ceph-mon[110082]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:46.624 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:46 smithi098 ceph-mon[80954]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:46.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:46 smithi027 ceph-mon[110082]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:48.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:48 smithi027 ceph-mon[110082]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:48.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:48 smithi098 ceph-mon[80954]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:50.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:50 smithi098 ceph-mon[80954]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:50.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:50 smithi027 ceph-mon[110082]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:52.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:52 smithi098 ceph-mon[80954]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:52.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:52 smithi027 ceph-mon[110082]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:54.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:54 smithi098 ceph-mon[80954]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:54.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:54 smithi027 ceph-mon[110082]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:56.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:56 smithi098 ceph-mon[80954]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:56.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:56 smithi027 ceph-mon[110082]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:22:58.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:58 smithi098 ceph-mon[80954]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:58.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:22:58 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:58.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:58 smithi027 ceph-mon[110082]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:22:58.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:22:58 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:23:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:00 smithi098 ceph-mon[80954]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:00.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:00 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:23:00.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:00 smithi027 ceph-mon[110082]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:00.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:00 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:23:01.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:01 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:23:01.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:01 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:23:01.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:01 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:23:01.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:01 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:23:01.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:01 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:23:01.816 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:01 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' 2024-09-20T19:23:02.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:02 smithi027 ceph-mon[110082]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:02.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:02 smithi098 ceph-mon[80954]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:04.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:04 smithi098 ceph-mon[80954]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:05.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:04 smithi027 ceph-mon[110082]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:06.931 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:06 smithi098 ceph-mon[80954]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:06.981 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:06 smithi027 ceph-mon[110082]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:08.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:08 smithi027 ceph-mon[110082]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:08.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:08 smithi098 ceph-mon[80954]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:10.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:10 smithi098 ceph-mon[80954]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:11.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:10 smithi027 ceph-mon[110082]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:12.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:12 smithi098 ceph-mon[80954]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:12.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:12 smithi098 ceph-mon[80954]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:23:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:12 smithi027 ceph-mon[110082]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:12.983 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:12 smithi027 ceph-mon[110082]: from='mgr.14764 172.21.15.27:0/3826417378' entity='mgr.smithi027.tlgpqo' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:23:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:14 smithi098 ceph-mon[80954]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:15.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:14 smithi027 ceph-mon[110082]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:16.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:16 smithi098 ceph-mon[80954]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:17.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:16 smithi027 ceph-mon[110082]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:18.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:18 smithi098 ceph-mon[80954]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:18.975 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:18 smithi027 ceph-mon[110082]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:20.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:20 smithi098 ceph-mon[80954]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:21.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:20 smithi027 ceph-mon[110082]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T19:23:22.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:22 smithi098 ceph-mon[80954]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:23.065 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:22 smithi027 ceph-mon[110082]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-20T19:23:23.121 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-20T19:23:23.121 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:23:23.123 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-20T19:23:23.136 INFO:tasks.cephadm:Teardown begin 2024-09-20T19:23:23.136 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:23:23.138 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:23:23.172 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:23:23.206 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-20T19:23:23.206 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T19:23:23.230 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T19:23:23.263 INFO:tasks.cephadm:Stopping all daemons... 2024-09-20T19:23:23.263 INFO:tasks.cephadm.mon.smithi027:Stopping mon.smithi027... 2024-09-20T19:23:23.264 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027 2024-09-20T19:23:23.564 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:23 smithi027 systemd[1]: Stopping Ceph mon.smithi027 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:23.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:23 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[110078]: 2024-09-20T19:23:23.564+0000 7f8c12e2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi027 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:23.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:23 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027[110078]: 2024-09-20T19:23:23.564+0000 7f8c12e2e640 -1 mon.smithi027@0(leader) e2 *** Got Signal Terminated *** 2024-09-20T19:23:23.815 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:23 smithi027 podman[152071]: 2024-09-20 19:23:23.778887706 +0000 UTC m=+0.306247941 container died 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-20T19:23:24.565 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:24 smithi027 podman[152071]: 2024-09-20 19:23:24.273537697 +0000 UTC m=+0.800897973 container cleanup 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T19:23:24.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:24 smithi027 bash[152071]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027 2024-09-20T19:23:24.566 INFO:journalctl@ceph.mon.smithi027.smithi027.stdout:Sep 20 19:23:24 smithi027 podman[152083]: 2024-09-20 19:23:24.499974631 +0000 UTC m=+0.717434246 container remove 8feb78653ee3729a36601eab83bf3efd194220f9f90fa9d400eed128ddf21b70 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi027, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-20T19:23:24.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi027.service' 2024-09-20T19:23:24.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:24.701 INFO:tasks.cephadm.mon.smithi027:Stopped mon.smithi027 2024-09-20T19:23:24.701 INFO:tasks.cephadm.mon.smithi098:Stopping mon.smithi098... 2024-09-20T19:23:24.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi098 2024-09-20T19:23:25.004 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:24 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:25.445 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:25 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098[80949]: 2024-09-20T19:23:25.004+0000 7fecde700640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:25.446 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:25 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098[80949]: 2024-09-20T19:23:25.004+0000 7fecde700640 -1 mon.smithi098@1(peon) e2 *** Got Signal Terminated *** 2024-09-20T19:23:25.446 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:25 smithi098 podman[115050]: 2024-09-20 19:23:25.157956396 +0000 UTC m=+0.257049621 container died 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T19:23:25.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:25 smithi098 podman[115050]: 2024-09-20 19:23:25.6298816 +0000 UTC m=+0.728974819 container cleanup 3959011c74584b406ec9866ea68a38727cf909069c6f74b927d154cf8ba130a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-20T19:23:25.720 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 20 19:23:25 smithi098 bash[115050]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-mon-smithi098 2024-09-20T19:23:26.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@mon.smithi098.service' 2024-09-20T19:23:26.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:26.112 INFO:tasks.cephadm.mon.smithi098:Stopped mon.smithi098 2024-09-20T19:23:26.112 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-20T19:23:26.112 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.0 2024-09-20T19:23:26.411 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:26 smithi027 systemd[1]: Stopping Ceph osd.0 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:26.815 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:26 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:23:26.410+0000 7feecf6e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:26.815 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:26 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:23:26.410+0000 7feecf6e0640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-20T19:23:26.815 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:26 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0[118315]: 2024-09-20T19:23:26.410+0000 7feecf6e0640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:23:32.237 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:31 smithi027 podman[152204]: 2024-09-20 19:23:31.952916629 +0000 UTC m=+5.634114466 container died 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:23:32.565 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:32 smithi027 podman[152204]: 2024-09-20 19:23:32.311661547 +0000 UTC m=+5.992859383 container cleanup 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:32.565 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:32 smithi027 bash[152204]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0 2024-09-20T19:23:32.947 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:32 smithi027 podman[152221]: 2024-09-20 19:23:32.593260685 +0000 UTC m=+0.631862119 container remove 608855b7e07e9b816f246ff87d9e4999fa43f46a4c486771fb34d403bbaa2d48 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731) 2024-09-20T19:23:33.241 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:32 smithi027 podman[152308]: 2024-09-20 19:23:32.850823094 +0000 UTC m=+0.016744014 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:23:33.241 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:32 smithi027 podman[152308]: 2024-09-20 19:23:32.964365699 +0000 UTC m=+0.130286609 container create a0b212218eb139b1d74d2b5442a6025e79c39aae79de5fdbe52a0a5ac8b6be3e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-20T19:23:33.241 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:33 smithi027 podman[152308]: 2024-09-20 19:23:33.16695353 +0000 UTC m=+0.332874450 container init a0b212218eb139b1d74d2b5442a6025e79c39aae79de5fdbe52a0a5ac8b6be3e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T19:23:33.241 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:33 smithi027 podman[152308]: 2024-09-20 19:23:33.170890899 +0000 UTC m=+0.336811810 container start a0b212218eb139b1d74d2b5442a6025e79c39aae79de5fdbe52a0a5ac8b6be3e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-20T19:23:33.241 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:33 smithi027 podman[152308]: 2024-09-20 19:23:33.24197899 +0000 UTC m=+0.407899900 container attach a0b212218eb139b1d74d2b5442a6025e79c39aae79de5fdbe52a0a5ac8b6be3e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T19:23:33.565 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 20 19:23:33 smithi027 podman[152308]: 2024-09-20 19:23:33.364453103 +0000 UTC m=+0.530374024 container died a0b212218eb139b1d74d2b5442a6025e79c39aae79de5fdbe52a0a5ac8b6be3e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:23:34.045 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.0.service' 2024-09-20T19:23:34.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:34.090 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-20T19:23:34.090 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-20T19:23:34.090 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.1 2024-09-20T19:23:34.315 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:34 smithi027 systemd[1]: Stopping Ceph osd.1 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:34.815 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:34 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:23:34.433+0000 7faabea65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:34.815 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:34 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:23:34.433+0000 7faabea65640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-20T19:23:34.815 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:34 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1[124137]: 2024-09-20T19:23:34.433+0000 7faabea65640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:23:40.200 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:39 smithi027 podman[152415]: 2024-09-20 19:23:39.862708042 +0000 UTC m=+5.525290227 container died 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:23:40.565 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:40 smithi027 podman[152415]: 2024-09-20 19:23:40.282776139 +0000 UTC m=+5.945358320 container cleanup 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-20T19:23:40.565 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:40 smithi027 bash[152415]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1 2024-09-20T19:23:41.065 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:40 smithi027 podman[152441]: 2024-09-20 19:23:40.567451887 +0000 UTC m=+0.697268871 container remove 1cdccf8bb4b5d5297be4070c9054b7e3daf933580828511ac45b6d4bfd620bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-20T19:23:41.345 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:40.973765295 +0000 UTC m=+0.016584420 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:23:41.346 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:41.10218146 +0000 UTC m=+0.145000575 container create bb710fadd1b4b3948eb129410a5d960c2f4ac9e22ceaf202346b4f012e171503 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-20T19:23:41.346 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:41.346499202 +0000 UTC m=+0.389318328 container init bb710fadd1b4b3948eb129410a5d960c2f4ac9e22ceaf202346b4f012e171503 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:41.815 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:41.349991394 +0000 UTC m=+0.392810516 container start bb710fadd1b4b3948eb129410a5d960c2f4ac9e22ceaf202346b4f012e171503 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:23:41.816 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:41.429822247 +0000 UTC m=+0.472641375 container attach bb710fadd1b4b3948eb129410a5d960c2f4ac9e22ceaf202346b4f012e171503 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:41.816 INFO:journalctl@ceph.osd.1.smithi027.stdout:Sep 20 19:23:41 smithi027 podman[152531]: 2024-09-20 19:23:41.554185774 +0000 UTC m=+0.597004886 container died bb710fadd1b4b3948eb129410a5d960c2f4ac9e22ceaf202346b4f012e171503 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T19:23:42.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.1.service' 2024-09-20T19:23:42.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:42.301 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-20T19:23:42.302 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-20T19:23:42.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.2 2024-09-20T19:23:42.661 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:42 smithi027 systemd[1]: Stopping Ceph osd.2 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:42.985 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:42 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:23:42.662+0000 7fb2712cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:42.985 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:42 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:23:42.662+0000 7fb2712cc640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-20T19:23:42.985 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:42 smithi027 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2[129808]: 2024-09-20T19:23:42.662+0000 7fb2712cc640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:23:48.263 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:47 smithi027 podman[152637]: 2024-09-20 19:23:47.971548713 +0000 UTC m=+5.432029691 container died c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:23:48.565 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:48 smithi027 podman[152637]: 2024-09-20 19:23:48.354125407 +0000 UTC m=+5.814606377 container cleanup c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2) 2024-09-20T19:23:48.565 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:48 smithi027 bash[152637]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2 2024-09-20T19:23:48.967 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:48 smithi027 podman[152658]: 2024-09-20 19:23:48.630628401 +0000 UTC m=+0.648745697 container remove c369c6546689c29afa5ba3575d5efb5c7664227a2df66e4f460eac3253047973 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:23:49.220 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:48 smithi027 podman[152747]: 2024-09-20 19:23:48.87105251 +0000 UTC m=+0.016818152 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:23:49.220 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:48 smithi027 podman[152747]: 2024-09-20 19:23:48.972978791 +0000 UTC m=+0.118744419 container create 240c187f7c717b1efd3deff9390cb2fc10d2de2cdce23644748515bc92d22152 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-20T19:23:49.220 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:49 smithi027 podman[152747]: 2024-09-20 19:23:49.217517645 +0000 UTC m=+0.363283287 container init 240c187f7c717b1efd3deff9390cb2fc10d2de2cdce23644748515bc92d22152 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2) 2024-09-20T19:23:49.220 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:49 smithi027 podman[152747]: 2024-09-20 19:23:49.221036255 +0000 UTC m=+0.366801887 container start 240c187f7c717b1efd3deff9390cb2fc10d2de2cdce23644748515bc92d22152 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T19:23:49.566 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:49 smithi027 podman[152747]: 2024-09-20 19:23:49.325726599 +0000 UTC m=+0.471492239 container attach 240c187f7c717b1efd3deff9390cb2fc10d2de2cdce23644748515bc92d22152 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-20T19:23:49.566 INFO:journalctl@ceph.osd.2.smithi027.stdout:Sep 20 19:23:49 smithi027 podman[152747]: 2024-09-20 19:23:49.423388549 +0000 UTC m=+0.569154196 container died 240c187f7c717b1efd3deff9390cb2fc10d2de2cdce23644748515bc92d22152 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T19:23:50.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.2.service' 2024-09-20T19:23:50.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:50.080 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-20T19:23:50.080 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-20T19:23:50.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.3 2024-09-20T19:23:50.384 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:50 smithi098 systemd[1]: Stopping Ceph osd.3 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:50.722 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:50 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:23:50.383+0000 7f70af518640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:50.722 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:50 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:23:50.383+0000 7f70af518640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-20T19:23:50.722 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:50 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:23:50.383+0000 7f70af518640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:23:53.970 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:53 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:53.567+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:53.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:53 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:53.778+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:54.593 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:23:54.226+0000 7f70a7b25640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:25.646224+0000 front 2024-09-20T19:23:25.646337+0000 (oldest deadline 2024-09-20T19:23:53.846613+0000) 2024-09-20T19:23:54.970 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:54.593+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:54.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:54 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:54.763+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:55.544 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3[88444]: 2024-09-20T19:23:55.234+0000 7f70a7b25640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:25.646224+0000 front 2024-09-20T19:23:25.646337+0000 (oldest deadline 2024-09-20T19:23:53.846613+0000) 2024-09-20T19:23:55.853 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:55.544+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:55.853 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:55 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:55.716+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:56.144 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:55 smithi098 podman[115183]: 2024-09-20 19:23:55.85416242 +0000 UTC m=+5.569365991 container died 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:23:56.470 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:56 smithi098 podman[115183]: 2024-09-20 19:23:56.243114307 +0000 UTC m=+5.958317866 container cleanup 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-20T19:23:56.470 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:56 smithi098 bash[115183]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3 2024-09-20T19:23:56.820 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:56 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:56.693+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:56.821 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:56 smithi098 podman[115198]: 2024-09-20 19:23:56.49444406 +0000 UTC m=+0.630942653 container remove 6a772126b9d9ecb042bf990b953aa4c0350d90e757bb986ed36592dc38b5d88d (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-20T19:23:56.821 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:56 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:56.500+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:57.081 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:56 smithi098 podman[115287]: 2024-09-20 19:23:56.72409673 +0000 UTC m=+0.015686128 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:23:57.081 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:56 smithi098 podman[115287]: 2024-09-20 19:23:56.828708876 +0000 UTC m=+0.120298305 container create a116d70437e08ff61cac346a574ff05ebc546a0ea81157004b9c7c8c865197b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-20T19:23:57.081 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:57 smithi098 podman[115287]: 2024-09-20 19:23:57.081944333 +0000 UTC m=+0.373533727 container init a116d70437e08ff61cac346a574ff05ebc546a0ea81157004b9c7c8c865197b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:57.470 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:57 smithi098 podman[115287]: 2024-09-20 19:23:57.08546306 +0000 UTC m=+0.377052453 container start a116d70437e08ff61cac346a574ff05ebc546a0ea81157004b9c7c8c865197b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:57.470 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:57 smithi098 podman[115287]: 2024-09-20 19:23:57.173540903 +0000 UTC m=+0.465130323 container attach a116d70437e08ff61cac346a574ff05ebc546a0ea81157004b9c7c8c865197b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T19:23:57.471 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 20 19:23:57 smithi098 podman[115287]: 2024-09-20 19:23:57.270516534 +0000 UTC m=+0.562105928 container died a116d70437e08ff61cac346a574ff05ebc546a0ea81157004b9c7c8c865197b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-20T19:23:57.910 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:57 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:57.502+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:57.910 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:57 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:57.739+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:57.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.3.service' 2024-09-20T19:23:57.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:57.968 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-20T19:23:57.968 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-20T19:23:57.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.4 2024-09-20T19:23:58.220 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:58 smithi098 systemd[1]: Stopping Ceph osd.4 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:23:58.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:58.314+0000 7fc2cde76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:23:58.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:58.314+0000 7fc2cde76640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-20T19:23:58.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:58.314+0000 7fc2cde76640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:23:58.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:58.490+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:23:59.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:58 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:58.780+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:23:59.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:23:59 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:23:59.466+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:24:00.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:23:59 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:23:59.792+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:00.720 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:00 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:24:00.419+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:24:01.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:00 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:00.780+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:01.719 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:01 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:24:01.442+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:24:02.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:01 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:01.747+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:02.692 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:02 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4[93629]: 2024-09-20T19:24:02.428+0000 7fc2c6483640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:28.110932+0000 front 2024-09-20T19:23:28.110898+0000 (oldest deadline 2024-09-20T19:23:53.410748+0000) 2024-09-20T19:24:02.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:02 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:02.790+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:04.097 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:03 smithi098 podman[115390]: 2024-09-20 19:24:03.827839641 +0000 UTC m=+5.639824577 container died 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:24:04.098 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:03 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:03.768+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:04.465 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:04 smithi098 podman[115390]: 2024-09-20 19:24:04.206263442 +0000 UTC m=+6.018248377 container cleanup 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-20T19:24:04.465 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:04 smithi098 bash[115390]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4 2024-09-20T19:24:04.719 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:04 smithi098 podman[115416]: 2024-09-20 19:24:04.465923623 +0000 UTC m=+0.633058331 container remove 129e99f5af51dd611b1dec266748f3e24c1097aae65a976955c17c7f62d73e76 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T19:24:05.102 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:04.779+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:05.102 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:04 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:04.779+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:05.102 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:04 smithi098 podman[115506]: 2024-09-20 19:24:04.725431203 +0000 UTC m=+0.015670482 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:24:05.102 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:04 smithi098 podman[115506]: 2024-09-20 19:24:04.824938945 +0000 UTC m=+0.115178211 container create 3b0e5660ca0dcf2657bdad1038185fd5c664afb992607a502dd4b3f3e4d7247b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0) 2024-09-20T19:24:05.102 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:05 smithi098 podman[115506]: 2024-09-20 19:24:05.102889047 +0000 UTC m=+0.393128314 container init 3b0e5660ca0dcf2657bdad1038185fd5c664afb992607a502dd4b3f3e4d7247b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:24:05.470 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:05 smithi098 podman[115506]: 2024-09-20 19:24:05.106826027 +0000 UTC m=+0.397065302 container start 3b0e5660ca0dcf2657bdad1038185fd5c664afb992607a502dd4b3f3e4d7247b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.vendor=CentOS) 2024-09-20T19:24:05.470 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:05 smithi098 podman[115506]: 2024-09-20 19:24:05.186022455 +0000 UTC m=+0.476261738 container attach 3b0e5660ca0dcf2657bdad1038185fd5c664afb992607a502dd4b3f3e4d7247b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux ) 2024-09-20T19:24:05.470 INFO:journalctl@ceph.osd.4.smithi098.stdout:Sep 20 19:24:05 smithi098 podman[115506]: 2024-09-20 19:24:05.291196588 +0000 UTC m=+0.581435863 container died 3b0e5660ca0dcf2657bdad1038185fd5c664afb992607a502dd4b3f3e4d7247b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-20T19:24:05.888 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:05.760+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:05.889 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:05 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:05.760+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:05.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.4.service' 2024-09-20T19:24:05.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:24:05.949 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-20T19:24:05.949 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-20T19:24:05.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.5 2024-09-20T19:24:06.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 systemd[1]: Stopping Ceph osd.5 for e7838b9c-7781-11ef-baf5-efdc52797490... 2024-09-20T19:24:06.720 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:06.309+0000 7f26d9700640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:24:06.720 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:06.309+0000 7f26d9700640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-20T19:24:06.720 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:06.309+0000 7f26d9700640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:24:07.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:06.792+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:07.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:06 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:06.792+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:08.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:07 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:07.768+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:08.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:07 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:07.768+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:09.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:08 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:08.780+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:09.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:08 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:08.780+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:09.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:08 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:08.780+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6822 osd.2 since back 2024-09-20T19:23:44.491767+0000 front 2024-09-20T19:23:44.491728+0000 (oldest deadline 2024-09-20T19:24:08.591633+0000) 2024-09-20T19:24:10.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:09 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:09.782+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:10.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:09 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:09.782+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:10.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:09 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:09.782+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6822 osd.2 since back 2024-09-20T19:23:44.491767+0000 front 2024-09-20T19:23:44.491728+0000 (oldest deadline 2024-09-20T19:24:08.591633+0000) 2024-09-20T19:24:11.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:10 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:10.797+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-20T19:23:31.190013+0000 front 2024-09-20T19:23:31.190133+0000 (oldest deadline 2024-09-20T19:23:53.489815+0000) 2024-09-20T19:24:11.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:10 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:10.797+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6814 osd.1 since back 2024-09-20T19:23:38.591147+0000 front 2024-09-20T19:23:38.591237+0000 (oldest deadline 2024-09-20T19:24:04.491241+0000) 2024-09-20T19:24:11.220 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:10 smithi098 ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5[98502]: 2024-09-20T19:24:10.797+0000 7f26d5d15640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.27:6822 osd.2 since back 2024-09-20T19:23:44.491767+0000 front 2024-09-20T19:23:44.491728+0000 (oldest deadline 2024-09-20T19:24:08.591633+0000) 2024-09-20T19:24:12.018 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:11 smithi098 podman[115610]: 2024-09-20 19:24:11.747392682 +0000 UTC m=+5.570681642 container died 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T19:24:12.368 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115610]: 2024-09-20 19:24:12.117863051 +0000 UTC m=+5.941152003 container cleanup 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:24:12.368 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 bash[115610]: ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5 2024-09-20T19:24:12.687 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115627]: 2024-09-20 19:24:12.369066724 +0000 UTC m=+0.614459436 container remove 8369594e8285a16c0965e9fc373b09e5e99fd934389e2eacf2ad8d71c95fad52 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-20T19:24:12.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115715]: 2024-09-20 19:24:12.591044862 +0000 UTC m=+0.015905112 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:24:12.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115715]: 2024-09-20 19:24:12.694737083 +0000 UTC m=+0.119597320 container create 4f2258bbad14c57ee3fc9734b717c799bc344d57aa58cbbf80cc60bb09a1243f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-20T19:24:12.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115715]: 2024-09-20 19:24:12.922494288 +0000 UTC m=+0.347354529 container init 4f2258bbad14c57ee3fc9734b717c799bc344d57aa58cbbf80cc60bb09a1243f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T19:24:12.970 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:12 smithi098 podman[115715]: 2024-09-20 19:24:12.925927949 +0000 UTC m=+0.350788186 container start 4f2258bbad14c57ee3fc9734b717c799bc344d57aa58cbbf80cc60bb09a1243f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-20T19:24:13.263 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:13 smithi098 podman[115715]: 2024-09-20 19:24:13.014308778 +0000 UTC m=+0.439169034 container attach 4f2258bbad14c57ee3fc9734b717c799bc344d57aa58cbbf80cc60bb09a1243f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:24:13.263 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 20 19:24:13 smithi098 podman[115715]: 2024-09-20 19:24:13.123890617 +0000 UTC m=+0.548750857 container died 4f2258bbad14c57ee3fc9734b717c799bc344d57aa58cbbf80cc60bb09a1243f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-e7838b9c-7781-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-20T19:24:13.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e7838b9c-7781-11ef-baf5-efdc52797490@osd.5.service' 2024-09-20T19:24:13.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:24:13.884 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-20T19:24:13.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e7838b9c-7781-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T19:24:14.098 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:24:18.613 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[76300]: fuse finished with error 0 and tester_r 0 2024-09-20T19:24:36.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e7838b9c-7781-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T19:24:37.157 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:24:53.988 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:24:54.023 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:24:54.050 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-20T19:24:54.052 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi027/crash 2024-09-20T19:24:54.053 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash -- . 2024-09-20T19:24:54.092 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T19:24:54.092 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now 2024-09-20T19:24:54.094 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi098/crash 2024-09-20T19:24:54.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash -- . 2024-09-20T19:24:54.118 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T19:24:54.118 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-20T19:24:54.119 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-20T19:24:54.119 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-20T19:24:54.171 INFO:tasks.cephadm:Compressing logs... 2024-09-20T19:24:54.172 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T19:24:54.214 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T19:24:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-20T19:24:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:: No such file or directory 2024-09-20T19:24:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi027.log 2024-09-20T19:24:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi027.tlgpqo.log 2024-09-20T19:24:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi027.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi027.tlgpqo.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.paximv.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.1.log: /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.paximv.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr: 94.0% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi027.log.gz 2024-09-20T19:24:54.243 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log: 86.5% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T19:24:54.244 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi098.wrcvbg.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi098.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi098.wrcvbg.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi098.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.fdtjxi.log 2024-09-20T19:24:54.245 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.fdtjxi.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.hnflps.log 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi098.stderr: 85.1% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.hnflps.log: 91.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.esfeuy.log 2024-09-20T19:24:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log: 91.6% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T19:24:54.247 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi027.log 2024-09-20T19:24:54.250 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.esfeuy.log: 88.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T19:24:54.251 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-20T19:24:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log 2024-09-20T19:24:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi098.log 2024-09-20T19:24:54.261 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi027.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T19:24:54.263 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log: 88.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T19:24:54.264 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-20T19:24:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi098.log: 91.3% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T19:24:54.267 INFO:teuthology.orchestra.run.smithi098.stderr: 94.0% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi098.log.gz 2024-09-20T19:24:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-20T19:24:54.267 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T19:24:54.270 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.0.log: 91.3% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T19:24:54.289 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 89.1% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi098.wrcvbg.log.gz 2024-09-20T19:24:54.290 INFO:teuthology.orchestra.run.smithi098.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T19:24:54.314 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T19:24:54.668 INFO:teuthology.orchestra.run.smithi027.stderr: 89.5% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mgr.smithi027.tlgpqo.log.gz 2024-09-20T19:24:54.695 INFO:teuthology.orchestra.run.smithi098.stderr: 92.6% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi098.log.gz 2024-09-20T19:24:55.586 INFO:teuthology.orchestra.run.smithi027.stderr: 90.4% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mon.smithi027.log.gz 2024-09-20T19:24:58.003 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-20T19:24:58.727 INFO:teuthology.orchestra.run.smithi027.stderr: 93.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-20T19:25:00.327 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-20T19:25:00.390 INFO:teuthology.orchestra.run.smithi098.stderr: 94.9% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.hnflps.log.gz 2024-09-20T19:25:01.043 INFO:teuthology.orchestra.run.smithi027.stderr: 93.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-20T19:25:01.077 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-20T19:25:01.561 INFO:teuthology.orchestra.run.smithi027.stderr: 93.8% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-20T19:25:02.280 INFO:teuthology.orchestra.run.smithi027.stderr: 94.9% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.paximv.log.gz 2024-09-20T19:25:08.292 INFO:teuthology.orchestra.run.smithi027.stderr: 94.9% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi027.esfeuy.log.gz 2024-09-20T19:25:10.536 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-20T19:25:10.536 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-20T19:25:10.632 INFO:teuthology.orchestra.run.smithi027.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-20T19:25:10.634 INFO:teuthology.orchestra.run.smithi027.stderr: 2024-09-20T19:25:10.634 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m16.406s 2024-09-20T19:25:10.634 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m56.982s 2024-09-20T19:25:10.634 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m1.793s 2024-09-20T19:26:31.506 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/e7838b9c-7781-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi098.fdtjxi.log.gz 2024-09-20T19:26:31.508 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-20T19:26:31.508 INFO:teuthology.orchestra.run.smithi098.stderr:real 1m37.279s 2024-09-20T19:26:31.508 INFO:teuthology.orchestra.run.smithi098.stderr:user 2m12.670s 2024-09-20T19:26:31.508 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m3.957s 2024-09-20T19:26:31.508 INFO:tasks.cephadm:Archiving logs... 2024-09-20T19:26:31.508 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi027/log 2024-09-20T19:26:31.509 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T19:26:38.177 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi098/log 2024-09-20T19:26:38.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T19:26:57.392 INFO:tasks.cephadm:Removing cluster... 2024-09-20T19:26:57.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e7838b9c-7781-11ef-baf5-efdc52797490 --force 2024-09-20T19:26:57.604 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:26:57.910 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e7838b9c-7781-11ef-baf5-efdc52797490 --force 2024-09-20T19:26:58.105 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: e7838b9c-7781-11ef-baf5-efdc52797490 2024-09-20T19:26:58.498 INFO:tasks.cephadm:Removing cephadm ... 2024-09-20T19:26:58.498 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T19:26:58.515 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T19:26:58.532 INFO:tasks.cephadm:Teardown complete 2024-09-20T19:26:58.532 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-20T19:26:58.543 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:26:58.544 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-20T19:26:58.544 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T19:26:58.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T19:26:58.647 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-20T19:26:58.657 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-20T19:26:58.657 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T19:26:58.660 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T19:26:58.673 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-20T19:26:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +274us[ +281us] +/- 46ms 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 +669us[ +669us] +/- 42ms 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -1934us[-1934us] +/- 85ms 2024-09-20T19:26:58.677 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +270us[ +264us] +/- 46ms 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +673us[ +667us] +/- 42ms 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1950us[-1956us] +/- 85ms 2024-09-20T19:26:58.679 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T19:26:58.679 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-20T19:26:58.690 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-20T19:26:58.690 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-20T19:26:58.699 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T19:26:58.802 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T19:26:58.874 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T19:26:58.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:26:58.904 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T19:26:58.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:26:58.933 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-20T19:26:58.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-20T19:26:58.959 INFO:teuthology.task.internal:Duration was 2246.675508 seconds 2024-09-20T19:26:58.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-20T19:26:58.968 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-20T19:26:58.968 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T19:26:58.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T19:26:59.008 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T19:26:59.011 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T19:26:59.359 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-20T19:26:59.359 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-09-20T19:26:59.359 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T19:26:59.424 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-20T19:26:59.424 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T19:26:59.448 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-20T19:26:59.449 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T19:26:59.466 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T19:26:59.515 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-20T19:26:59.516 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T19:26:59.534 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T19:27:00.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-20T19:27:00.208 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-20T19:27:00.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T19:27:00.234 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T19:27:00.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-20T19:27:00.273 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:27:00.277 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:27:00.299 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-09-20T19:27:00.325 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-20T19:27:00.350 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:27:00.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:27:00.375 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:27:00.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:27:00.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-20T19:27:00.417 INFO:teuthology.task.internal:Transferring archived files... 2024-09-20T19:27:00.418 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi027 2024-09-20T19:27:00.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T19:27:00.464 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912735/remote/smithi098 2024-09-20T19:27:00.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T19:27:00.503 INFO:teuthology.task.internal:Removing archive directory... 2024-09-20T19:27:00.503 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T19:27:00.505 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T19:27:00.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-20T19:27:00.563 INFO:teuthology.task.internal:Not uploading archives. 2024-09-20T19:27:00.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-20T19:27:00.574 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-20T19:27:00.574 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T19:27:00.577 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T19:27:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 20 19:27 /home/ubuntu/cephtest 2024-09-20T19:27:00.590 INFO:teuthology.orchestra.run.smithi027.stdout: 530200 4 d--------- 2 ubuntu ubuntu 4096 Sep 20 19:03 /home/ubuntu/cephtest/mnt.0 2024-09-20T19:27:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-20T19:27:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-20T19:27:00.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:27:00.594 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-20T19:27:00.595 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-20T19:27:00.606 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-20T19:27:00.618 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:27:00.621 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2246.6755084991455 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-20T19:27:00.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T19:27:00.714 INFO:teuthology.run:FAIL